CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Multimodal Interaction with Internet of Things and Augmented Reality: Foundations, Systems and Challenges
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Computer Science.
2020 (English)Report (Other academic)
Abstract [en]

The development of technology has enabled diverse modalities that can be used by humans or machines to interact with computer systems. In particular, the Internet of Things (IoT) and Augmented Reality (AR) are explored in this report due to the new modalities offered by these two innovations which could be used to build multimodal interaction systems. Researchers have utilized multiple modalities in interaction systems for providing better usability. However, the employment of multiple modalities introduces some challenges that need to be considered in the development of multimodal interaction systems to achieve high usability. In order to identify a number of remaining challenges in the research area of multimodal interaction systems with IoT and AR, we analyzed a body of literature on multimodal interaction systems from the perspectives of system architecture, input and output modalities, data processing methodology and use cases. The identified challenges are regarding of (i) multidisciplinary knowledge, (ii) reusability, scalability and security of multimodal interaction system architecture, (iii) usability of multimodal interaction interface, (iv) adaptivity of multimodal interface design, (v) limitation of current technology, and (vi) advent of new modalities. We are expecting that the findings of this report and future research can be used to nurture the multimodal interaction system research area, which is still in its infancy.

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2020. , p. 33
Series
Technical report / Luleå University of Technology, ISSN 1402-1536
National Category
Media and Communication Technology
Research subject
Pervasive Mobile Computing
Identifiers
URN: urn:nbn:se:ltu:diva-78116ISBN: 978-91-7790-562-2 (electronic)OAI: oai:DiVA.org:ltu-78116DiVA, id: diva2:1415900
Available from: 2020-03-20 Created: 2020-03-20 Last updated: 2020-03-20Bibliographically approved

Open Access in DiVA

fulltext(1563 kB)140 downloads
File information
File name FULLTEXT01.pdfFile size 1563 kBChecksum SHA-512
0cf762fd8a523c95256af863aac6d7865962033c02382ea7359185c9e3ea9a7476ff6e4bcecfdfe64d3e47a05fc3c0eb8b0bec0f0a49e3f5e84407f32291382e
Type fulltextMimetype application/pdf

Authority records BETA

Kim, Joo Chan

Search in DiVA

By author/editor
Kim, Joo Chan
By organisation
Computer Science
Media and Communication Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 140 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 103 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf