Change search
Link to record
Permanent link

Direct link
BETA
Publications (2 of 2) Show all publications
Kim, J. C. (2020). Multimodal Interaction with Internet of Things and Augmented Reality: Foundations, Systems and Challenges. Luleå: Luleå University of Technology
Open this publication in new window or tab >>Multimodal Interaction with Internet of Things and Augmented Reality: Foundations, Systems and Challenges
2020 (English)Report (Other academic)
Abstract [en]

The development of technology has enabled diverse modalities that can be used by humans or machines to interact with computer systems. In particular, the Internet of Things (IoT) and Augmented Reality (AR) are explored in this report due to the new modalities offered by these two innovations which could be used to build multimodal interaction systems. Researchers have utilized multiple modalities in interaction systems for providing better usability. However, the employment of multiple modalities introduces some challenges that need to be considered in the development of multimodal interaction systems to achieve high usability. In order to identify a number of remaining challenges in the research area of multimodal interaction systems with IoT and AR, we analyzed a body of literature on multimodal interaction systems from the perspectives of system architecture, input and output modalities, data processing methodology and use cases. The identified challenges are regarding of (i) multidisciplinary knowledge, (ii) reusability, scalability and security of multimodal interaction system architecture, (iii) usability of multimodal interaction interface, (iv) adaptivity of multimodal interface design, (v) limitation of current technology, and (vi) advent of new modalities. We are expecting that the findings of this report and future research can be used to nurture the multimodal interaction system research area, which is still in its infancy.

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2020. p. 33
Series
Technical report / Luleå University of Technology, ISSN 1402-1536
National Category
Media and Communication Technology
Research subject
Pervasive Mobile Computing
Identifiers
urn:nbn:se:ltu:diva-78116 (URN)978-91-7790-562-2 (ISBN)
Available from: 2020-03-20 Created: 2020-03-20 Last updated: 2020-03-20Bibliographically approved
Kim, J. C., Lindberg, R. S. N., Laine, T. H., Faarinen, E.-C., De Troyer, O. & Nygren, E. (2019). Multidisciplinary Development Process of a Story-based Mobile Augmented Reality Game for Learning Math. In: František Jakab (Ed.), Proceedings on the 17th International Conference on Emerging eLearning Technologies and Applications: PROCEEDINGS. Paper presented at 17th International Conference on Emerging eLearning Technologies and Applications, November 21-22, 2019, Starý Smokovec, Slovakia (pp. 372-377). IEEE
Open this publication in new window or tab >>Multidisciplinary Development Process of a Story-based Mobile Augmented Reality Game for Learning Math
Show others...
2019 (English)In: Proceedings on the 17th International Conference on Emerging eLearning Technologies and Applications: PROCEEDINGS / [ed] František Jakab, IEEE, 2019, p. 372-377Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

Despite the high number of educational games released, only a few games have a strong story that is more than an excuse for players’ actions. Furthermore, even fewer story-based games utilise the affordances of augmented reality (AR) to concretise abstract concepts while engaging players.Based on our literature review, we were inspired to merge AR into a story-based educational mobile game for teaching fractions to elementary school students. The game Tales & Fractions was created through a two-phase multidisciplinary development process. In order to successfully integrate AR into a story-based educational game, we employed an adapted version of the Scrum agile software development method implemented by a multidisciplinary team of experts from computer science, pedagogy, design and arts. During the development process, we faced many issues that other story-based AR game developers could meet. We summarised the encountered issues with our solutions which could be useful for developers to avoid common pitfalls and to enrich the user engagement.

Place, publisher, year, edition, pages
IEEE, 2019
Series
International Conference on Emerging eLearning Technologies and Applications (ICETA)
Keywords
Multidisciplinary, Storytelling, Educational game, Augmented Reality, Game-based learning, Mathematics
National Category
Media and Communication Technology Didactics
Research subject
Pervasive Mobile Computing; Mathematics Education
Identifiers
urn:nbn:se:ltu:diva-78156 (URN)10.1109/ICETA48886.2019.9039962 (DOI)2-s2.0-85082988012 (Scopus ID)
Conference
17th International Conference on Emerging eLearning Technologies and Applications, November 21-22, 2019, Starý Smokovec, Slovakia
Note

ISBN för värdpublikation: 978-1-7281-4967-7, 978-1-7281-4968-4

Available from: 2020-03-24 Created: 2020-03-24 Last updated: 2020-04-27Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-1536-5753

Search in DiVA

Show all publications