Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Towards Quality of Experience for Industrial Internet of Things
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Computer Science.ORCID iD: 0000-0003-1139-6998
2020 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [sv]

Today’s research on Quality of Experience (QoE) mainly addresses multimedia services, where the end-users' subjective perception is the prime factor of determining the QoE. With the introduction of the Internet of Things (IoT), there is a need for new ways of evaluating the QoE. Emerging IoT services, such as remotely-controlled operations, autonomous vehicles (AVs), and energy management, are more complex, creating additional quality requirements emerging from the machine-to-machine (M2M) communication and autonomous processes. One challenge, as an extension of the legacy QoE concept, is understanding the perception of end-users QoE in the context of IoT services. For instance, within the current state of the art in QoE it is not clear how intelligent machines can impact end-users' QoE, but also how end-users can alter or affect an intelligent machine. Another challenge is the quality evaluation of the M2M and systems that enable the machines to run by themselves. Consider a self-driving vehicle, where multiple autonomous decisions are simultaneously made as a result of predictive models that reason on the vehicle's generated data. An evaluation of the predictive models is inevitable due to abundance of the potential sources of failures. A quality degradation of the IoT hardware, the software enabling autonomous decision, and the M2M communication can raise life-threatening concerns, directly impacting the end-users' QoE. In this thesis, we argue for a paradigm shift in the QoE area that understands the relationships between humans and intelligent machines, as well as within the machines. Our contributions are as follows: first, we introduce the term Quality of IoT-experience (QoIoT) to extend the conventional QoE approaches in covering IoT services. Within QoIoT, we consider a quality evaluation from the perspective of the end-users, as well as from intelligent machines. The end-user's perception is captured by following the conventional QoE approaches, while regarding intelligent machine we propose the usage of objective metrics to describe their experiences and performance. As our second contribution, we propose a novel QoIoT architecture that consists of a layered methodology in order to determine the overall QoIoT. The QoIoT architecture, firstly, models the data-sources of an IoT service, classified within four layers: physical, network, application, and virtual. Secondly, the architecture proposes three layers for measuring the QoIoT by considering Quality of Data (QoD), Quality of Network (QoN), and Quality of Context (QoC), with QoC being the prime layer in measuring the objective performance metrics. Finally, the third contribution considers a case-study of cellular IoT, involving autonomous mining vehicles, which we utilize to achieve a preliminary results that validate the proposed QoIoT architecture.

Place, publisher, year, edition, pages
Sweden: Luleå University of Technology, 2020.
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
Keywords [en]
QoE, IoT, AI, ML
National Category
Computer Systems
Research subject
Pervasive Mobile Computing
Identifiers
URN: urn:nbn:se:ltu:diva-78084ISBN: 978-91-7790-558-5 (print)ISBN: 978-91-7790-559-2 (electronic)OAI: oai:DiVA.org:ltu-78084DiVA, id: diva2:1415073
Presentation
2020-04-21, Room A, Forskargatan 1, Skellefteå, 10:00 (English)
Opponent
Supervisors
Available from: 2020-03-17 Created: 2020-03-17 Last updated: 2020-03-31Bibliographically approved
List of papers
1. Modeling Quality of IoT Experience in Autonomous Vehicles
Open this publication in new window or tab >>Modeling Quality of IoT Experience in Autonomous Vehicles
2020 (English)In: IEEE Internet of Things Journal, ISSN 2327-4662, Vol. 7, no 5, p. 3833-3849Article in journal (Refereed) Published
Abstract [en]

Today's research on Quality of Experience (QoE) mainly addresses multimedia services. With the introduction of the Internet of Things (IoT), there is a need for new ways of evaluating the QoE. Emerging IoT services, such as autonomous vehicles (AVs), are more complex and involve additional quality requirements, such as those related to machine-to-machine communication that enables self-driving. In fully autonomous cases, it is the intelligent machines operating the vehicles. Thus, it is not clear how intelligent machines will impact end-user QoE, but also how end users can alter and affect a self-driving vehicle. This article argues for a paradigm shift in the QoE area to cover the relationship between humans and intelligent machines. We introduce the term Quality of IoT-experience (QoIoT) within the context of AV, where the quality evaluation, besides end users, considers quantifying the perspectives of intelligent machines with objective metrics. Hence, we propose a novel architecture that considers Quality of Data (QoD), Quality of Network (QoN), and Quality of Context (QoC) to determine the overall QoIoT in the context of AVs. Finally, we present a case study to illustrate the use of QoIoT.

Place, publisher, year, edition, pages
Canada: IEEE Computer Society Digital Library, 2020
Keywords
IoT, QoE, QoS, AI, V2X
National Category
Computer Systems Computer and Information Sciences
Research subject
Pervasive Mobile Computing
Identifiers
urn:nbn:se:ltu:diva-78081 (URN)10.1109/JIOT.2020.2975418 (DOI)000536066300014 ()2-s2.0-85084920472 (Scopus ID)
Note

Validerad;2020;Nivå 2;2020-06-03 (johcin)

Available from: 2020-03-17 Created: 2020-03-17 Last updated: 2025-02-18Bibliographically approved
2. Analysis and Estimation of Video QoE in Wireless Cellular Networks using Machine Learning
Open this publication in new window or tab >>Analysis and Estimation of Video QoE in Wireless Cellular Networks using Machine Learning
2019 (English)In: 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), IEEE, 2019Conference paper, Published paper (Refereed)
Abstract [en]

The use of video streaming services are increasing in the cellular networks, inferring a need to monitor video quality to meet users' Quality of Experience (QoE). The so-called no-reference (NR) models for estimating video quality metrics mainly rely on packet-header and bitstream information. However, there are situations where the availability of such information is limited due to tighten security and encryption, which necessitates exploration of alternative parameters for conducting video QoE assessment. In this study we collect real-live in-smartphone measurements describing the radio link of the LTE connection while streaming reference videos in uplink. The radio measurements include metrics such as RSSI, RSRP, RSRQ, and CINR. We then use these radio metrics to train a Random Forrest machine learning model against calculated video quality metrics from the reference videos. The aim is to estimate the Mean Opinion Score (MOS), PSNR, Frame delay, Frame skips, and Blurriness. Our result show 94% classification accuracy, and 85% model accuracy (R 2 value) when predicting the MOS using regression. Correspondingly, we achieve 89%, 84%, 85%, and 82% classification accuracy when predicting PSNR, Frame delay, Frame Skips, and Blurriness respectively. Further, we achieve 81%, 77%, 79%, and 75% model accuracy (R 2 value) regarding the same parameters using regression.

Place, publisher, year, edition, pages
IEEE, 2019
Keywords
QoE, QoS, Video, MOS, PSNR, LTE
National Category
Computer and Information Sciences
Research subject
Pervasive Mobile Computing
Identifiers
urn:nbn:se:ltu:diva-76619 (URN)10.1109/QoMEX.2019.8743281 (DOI)000482562000047 ()2-s2.0-85068699424 (Scopus ID)978-1-5386-8212-8 (ISBN)
Conference
2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), 5-7 June 2019,Berlin, Germany
Available from: 2019-11-05 Created: 2019-11-05 Last updated: 2025-02-18Bibliographically approved
3. Defining Quality of Experience for the Internet of Things
Open this publication in new window or tab >>Defining Quality of Experience for the Internet of Things
2020 (English)In: IT Professional Magazine, ISSN 1520-9202, E-ISSN 1941-045X, Vol. 22, no 5, p. 62-70Article in journal (Refereed) Published
Abstract [en]

The Internet of Things (IoT) brings a set of unique and complex challenges to the field of Quality of Experience (QoE) evaluation. The state-of-the-art research in QoE mainly targets multimedia services, such as voice, video, and the Web, to determine quality perceived by end-users. Therein, main evaluation metrics involve subjective and objective human factors and network quality factors. Emerging IoT may also include intelligent machines within services, such as health-care, logistics, and manufacturing. The integration of new technologies such as machine-to-machine communications and artificial intelligence within IoT services may lead to service quality degradation caused by machines. In this article, we argue that evaluating QoE in the IoT services should also involve novel metrics for measuring the performance of the machines alongside metrics for end-users' QoE. This article extends the legacy QoE definition in the area of IoT and defines conceptual metrics for evaluating QoE using an industrial IoT case study.

Place, publisher, year, edition, pages
USA: IEEE, 2020
National Category
Computer and Information Sciences
Research subject
Pervasive Mobile Computing
Identifiers
urn:nbn:se:ltu:diva-78082 (URN)10.1109/MITP.2020.2968259 (DOI)000569565100009 ()2-s2.0-85091267137 (Scopus ID)
Note

Validerad;2020;Nivå 2;2020-09-18 (alebob)

Available from: 2020-03-17 Created: 2020-03-17 Last updated: 2025-02-18Bibliographically approved
4. Real-time Performance Evaluation of LTE for IIoT
Open this publication in new window or tab >>Real-time Performance Evaluation of LTE for IIoT
2018 (English)In: Proceedings of the 43rd IEEE Conference on Local Computer Networks (LCN) / [ed] Soumaya Cherkaoui, Karl Andersson, Fadi Al-Turjman, IEEE, 2018, p. 623-631Conference paper, Published paper (Refereed)
Abstract [en]

Industrial Internet of Things (IIoT) is claimed to be a global booster technology for economic development. IIoT brings bulky use-cases with a simple goal of enabling automation, autonomation or just plain digitalization of industrial processes. The abundance of interconnected IoT and CPS generate additional burden on the telecommunication networks, imposing number of challenges to satisfy the key performance requirements. In particular, the QoS metrics related to real-time data exchange for critical machine-to-machine type communication. This paper analyzes a real-world example of IIoT from a QoS perspective, such as remotely operated underground mining vehicle. As part of the performance evaluation, a software tool is developed for estimating the absolute, one-way delay in end-toend transmissions. The measured metric is passed to a machine learning model for one-way delay prediction based on LTE RAN measurements using a commercially available cutting-edge software tool. The achieved results prove the possibility to predict the delay figures using machine learning model with a coefficient of determination up to 90%.

Place, publisher, year, edition, pages
IEEE, 2018
Series
Conference on Local Computer Networks (LCN), ISSN 0742-1303
Keywords
IIoT, LTE, QoS, delay, jitter, real-time, critical IoT
National Category
Computer and Information Sciences
Research subject
Pervasive Mobile Computing
Identifiers
urn:nbn:se:ltu:diva-70316 (URN)10.1109/LCN.2018.8638081 (DOI)2-s2.0-85062855153 (Scopus ID)
Conference
43nd IEEE Conference on Local Computer Networks Workshops (LCN Workshops), 1-4 October, 2018, Chicago, USA
Note

ISBN för värdpublikation: 978-1-5386-4413-3, 978-1-5386-4414-0

Available from: 2018-08-09 Created: 2018-08-09 Last updated: 2025-02-18Bibliographically approved

Open Access in DiVA

fulltext(8885 kB)1468 downloads
File information
File name FULLTEXT01.pdfFile size 8885 kBChecksum SHA-512
21ef3878358636aa13f6d4fad076a092b00234a7d90c92649d68b51a35efd5da6dc882b521c51fa3202011be029b4e35f0a3c89fffd1735e0c6fde9133285c5b
Type fulltextMimetype application/pdf

Authority records

Minovski, Dimitar

Search in DiVA

By author/editor
Minovski, Dimitar
By organisation
Computer Science
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 1469 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 976 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf