Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Human-centric Maintenance Process Through Integration of AI, Speech, and AR
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Operation, Maintenance and Acoustics.ORCID iD: 0009-0002-6155-8449
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Operation, Maintenance and Acoustics.ORCID iD: 0000-0003-0734-0959
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Operation, Maintenance and Acoustics.ORCID iD: 0000-0002-0055-2740
2025 (English)Conference paper, Published paper (Refereed)
Abstract [en]

The adoption of Augmented Reality (AR) is increasing to enhance Human-System Interaction (HSI) by creating immersive experiences that improve efficiency and safety in various industries. In industrial maintenance, traditional practices involve physical documentation and device interactions, which might disrupt the task, affect efficiency, and increase the cognitive load for the maintenance personnel. AR has the potential to support and enhance industrial maintenance processes in these aspects. Therefore, the purpose of this research is to study and explore how advanced technologies like Artificial Intelligence (AI), AR and speech processing can be integrated to support hands-free, real-time task logging and interaction in maintenance environments. This is done by developing a demonstrator for Microsoft HoloLens 2 using Unity, C#, Azure Cognitive Services, and Azure Functions, which enables speech-to-text transcription for hands-free maintenance support. Using Azure’s speech recognition, the demonstrator can achieve high transcription accuracy in an AR environment, facilitating natural interactions between users and the augmented environment. The study aims to explore the potential of AR to reduce cognitive load, streamline workflows, and improve safety by enhancing HSI for maintenance personnel in high-stakes environments. 

Place, publisher, year, edition, pages
2025.
National Category
Human Computer Interaction
Identifiers
URN: urn:nbn:se:ltu:diva-115416OAI: oai:DiVA.org:ltu-115416DiVA, id: diva2:2014367
Conference
IAI 2025
Available from: 2025-11-17 Created: 2025-11-17 Last updated: 2026-01-14
In thesis
1. A Proposed Framework for Human-Centric Maintenance
Open this publication in new window or tab >>A Proposed Framework for Human-Centric Maintenance
2026 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Industrial systems are moving towards Industry 5.0, where digital technologies are expected to enhance rather than replace human capabilities. This puts human well-being, resilience, and sustainability at the centre of industrial processes. In sectors such as railways, construction, and mining, as well as other similar industrial sectors that rely on complex technical systems, achieving this vision in maintenance requires a strong Human-System Interaction (HSI) foundation. Despite the increasing integration of immersive and intelligent technologies in maintenance, many solutions remain system-centred and treat humans as peripheral users rather than as an integral part of the system. As a result, digital maintenance support is often insufficiently aligned with real maintenance workflows, operational constraints, and decision-making conditions. Existing research and industrial solutions frequently address HSI as a secondary usability concern, rather than as a primary design driver grounded in how maintenance activities are actually performed and supported in practice.The purpose of this research is to contribute to the development of a human-centric maintenance in the context of Industry 5.0. This research is framed through the concept of supportability, focusing on how maintenance support is implemented and delivered during operation. The emphasis is on maintenance as performed in practice, where task execution, interaction quality in terms of usability and cognitive support, and HSI are critical.The research is based on a combination of a structured literature review, applied design studies, and empirical investigations. A systematic analysis of immersive technologies in maintenance results in a taxonomy of HSI challenges, highlighting the interconnected nature of usability, cognitive workload, trust, and contextual alignment. Building on these findings, human-centric maintenance support solutions are designed and studied in industrial contexts, including railway inspection, to examine how task-aligned and contextualised maintenance information and interaction influence usability-related interaction aspects and cognitive workload. In addition, empirical investigations of decision-support powered by intelligent technologies examine how interpretability and trust influence user experience (UX) and mental effort.The results provide: (i) a structured understanding of HSI challenges associated with immersive and intelligent technologies in maintenance; (ii) a human-centric maintenance support framework integrating maintenance information, decision-support, and interaction during maintenance activities; and (iii) design-oriented insights into the implications of human-centric maintenance for usability, cognitive workload, and maintenance task execution. Together, these contributions support the alignment of immersive and intelligent maintenance technologies with human work, contributing to the realisation of human-centric maintenance systems in line with Industry 5.0.

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2026
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
Keywords
Maintenance, Industry 5.0, Human-System Interaction, Decision Support, Immersive Technologies, AR
National Category
Other Civil Engineering Production Engineering, Human Work Science and Ergonomics
Research subject
Operation and Maintenance Engineering
Identifiers
urn:nbn:se:ltu:diva-115967 (URN)978-91-8048-977-5 (ISBN)978-91-8048-978-2 (ISBN)
Presentation
2026-03-13, A117, Luleå University of Technology, Luleå, 09:30 (English)
Opponent
Supervisors
Available from: 2026-01-14 Created: 2026-01-14 Last updated: 2026-04-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Authority records

Khanna, ParulKour, RavdeepKarim, Ramin

Search in DiVA

By author/editor
Khanna, ParulKour, RavdeepKarim, Ramin
By organisation
Operation, Maintenance and Acoustics
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 83 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf