System disruptions
We are currently experiencing disruptions on the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
23456785 of 16
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Cloud-based IoT and Collaborative Learning for Cyber-Physical System of Systems
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0002-2123-8187
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The growth in cyber-physical systems (CPS), the industrial internet of things (IIoT) and integrations of machine learning (ML) models have enabled Industry 4.0 automation and intelligence in industrial System of Systems (SoS). However, scalable automation frameworks, dynamic interoperability for smooth communication among heterogeneous systems, and the integration of ML models particularly for online collaborative intelligence in distributed architectures, are open challenges that must be addressed. This thesis structures its research as a progressive investigation, with each identified challenge leading to the next. First, local cloud-based automation is explored using the Eclipse Arrowhead framework to propose digitalization frameworks for industrial use cases, such as predictive maintenance in wind energy systems and smart manufacturing. The primary objective is to bridge the digital divide in SoSs environments, ensuring seamless intercommunication between IoT-connected devices. Significant engineering effort is dedicated to developing dynamically scalable automation solutions that integrate heterogeneous CPS, providing real-time adaptability and efficiency. This leads to the second research challenge addressed in this thesis. To investigate the challenge of semantic interoperability among heterogeneous IIoT devices, this research explores ontology alignment techniques through Natural Language Processing (NLP) and deep learning models. Extension of an existing language model (BERT_Intereaction) is proposed for ontology graphs to facilitate seamless communication between heterogeneous IIoT devices. It is designed using a language encoder to develop knowledge of the text to understand the labels or entities and a structural encoder to understand the context or semantics behind the text. This proposed model consistently outperforms cross-lingual tasks over the state-of-theart techniques with an error reduction of 2.1% on benchmark datasets DBP15KZH−EN, DBP15KJA−EN, and DBP15KFR−EN.

 

The third challenge involves scaling collaborative intelligence across distributed IioT systems. To address this, a local cloud-based collaborative learning (CCL) model is designed for the service-oriented architecture (SOA) and a decentralized ML model to digitalize IIoTs while enabling ML-based optimizations for IIoT tasks across cloud and edge nodes. The CCL model integrates machine learning-as-a-service (MLaaS) into the distributed cloud architectures. CCL offers scalable, privacy-driven, self-contained local

clouds for every CPS in the system of systems model. The local clouds enable distributed ML deployment across the IIoT SoS, where devices collaborate to share their knowledge representations. The model uses unsupervised dictionary learning, allowing IIoT nodes to share compressed, optimized learning representations. Furthermore, this thesis also highlights a culminating issue for designing decentralized ML-enabled IIoT solutions that is the information overload and redundancy at the edge and cloud. To mitigate this challenge, the CCL+ model is proposed, integrating coherence-based dictionary refinement

with Bayesian optimization. The model is tested on the condition monitoring task using data from an automated farm of six wind turbines using the CCL model. Implementing redundancy-aware strategies in the CCL+ optimized bandwidth usage and reduced communication overhead, especially for the resource-constrained IIoT devices. In the simulation experiments, over one year, the propagated learned dictionary size at a single wind turbine exceeded 1 petabyte. In contrast, in comparison, using the CCL+ model, for the same duration, the learned dictionary remained at 18 MB, significantly enhancing communication and computational efficiency without losing essential information.

 

Various potential future research directions accompany the findings presented in this thesis. For instance, to strengthen the ablation study on the semantic interoperability among heterogeneous SoS challenge, a generalized IIoT ontology that is designed for any IoT device (beyond sensors), such as the smart applications reference ontology (SAREF) can be tested for ontology alignment. This work provides a step towards enabling translation between heterogeneous IoT sensor devices. The proposed BERT Intereaction model can be further extended to a translation module using the generalized ontology graphs. Then investigations can be conducted to test if the model can interpret the messages transmitted across ontologically different devices in two scenarios: a) where the ontology graphs of both devices are a subset of the generalized ontology graph, and b) they are overlapping graphs and may contain different nodes and relations but they are semantically the same. Furthermore, exploring the utility of CCL+ model for extended

large-scale SoS with multiple parallel tasks to test the collaborative learning concept across the heterogeneous cyber-physical system of systems (CPSoS).

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2025. , p. 200
Series
Doctoral thesis / Luleå University of Technology 1 jan 1997 → …, ISSN 1402-1544
Keywords [en]
cloud-based architectures, dynamic interoperability, ontology alignment, machine learning-as-a-service (MLaaS), digitalized predictive maintenance, cyber-physical system of systems (CPSoS), collaborative learning
National Category
Computer Vision and Learning Systems
Research subject
Machine Learning
Identifiers
URN: urn:nbn:se:ltu:diva-111754ISBN: 978-91-8048-769-6 (print)ISBN: 978-91-8048-770-2 (electronic)OAI: oai:DiVA.org:ltu-111754DiVA, id: diva2:1940215
Public defence
2025-04-11, C305, Luleå University of Technology, Luleå, 09:00 (English)
Opponent
Supervisors
Available from: 2025-02-26 Created: 2025-02-25 Last updated: 2025-03-21Bibliographically approved
List of papers
1. AI Concepts for System of Systems Dynamic Interoperability
Open this publication in new window or tab >>AI Concepts for System of Systems Dynamic Interoperability
Show others...
2024 (English)In: Sensors, E-ISSN 1424-8220, Vol. 24, no 9, article id 2921Article in journal (Refereed) Published
Abstract [en]

Interoperability is a central problem in digitization and sos engineering, which concerns the capacity of systems to exchange information and cooperate. The task to dynamically establish interoperability between heterogeneous cps at run-time is a challenging problem. Different aspects of the interoperability problem have been studied in fields such as sos, neural translation, and agent-based systems, but there are no unifying solutions beyond domain-specific standardization efforts. The problem is complicated by the uncertain and variable relations between physical processes and human-centric symbols, which result from, e.g., latent physical degrees of freedom, maintenance, re-configurations, and software updates. Therefore, we surveyed the literature for concepts and methods needed to automatically establish sos with purposeful cps communication, focusing on machine learning and connecting approaches that are not integrated in the present literature. Here, we summarize recent developments relevant to the dynamic interoperability problem, such as representation learning for ontology alignment and inference on heterogeneous linked data; neural networks for transcoding of text and code; concept learning-based reasoning; and emergent communication. We find that there has been a recent interest in deep learning approaches to establishing communication under different assumptions about the environment, language, and nature of the communicating entities. Furthermore, we present examples of architectures and discuss open problems associated with ai-enabled solutions in relation to sos interoperability requirements. Although these developments open new avenues for research, there are still no examples that bridge the concepts necessary to establish dynamic interoperability in complex sos, and realistic testbeds are needed.

Place, publisher, year, edition, pages
MDPI, 2024
Keywords
system of systems, dynamic interoperability, AI for cyber-physical systems, representation learning
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems; Machine Learning
Identifiers
urn:nbn:se:ltu:diva-87246 (URN)10.3390/s24092921 (DOI)001219942200001 ()38733028 (PubMedID)2-s2.0-85192703355 (Scopus ID)
Note

Validerad;2024;Nivå 2;2024-05-03 (joosat);

Funder: European Commission and Arrowhead Tools project (ECSEL JU grant agreement No. 826452);

Full text: CC BY License

Available from: 2021-09-28 Created: 2021-09-28 Last updated: 2025-02-25Bibliographically approved
2. Deep Ontology Alignment Using a Natural Language Processing Approach for Automatic M2M Translation in IIoT
Open this publication in new window or tab >>Deep Ontology Alignment Using a Natural Language Processing Approach for Automatic M2M Translation in IIoT
Show others...
2023 (English)In: Sensors, E-ISSN 1424-8220, Vol. 23, no 20, article id 8427Article in journal (Refereed) Published
Abstract [en]

The technical capabilities of modern Industry 4.0 and Industry 5.0 are vast and growing exponentially daily. The present-day Industrial Internet of Things (IIoT) combines manifold underlying technologies that require real-time interconnection and communication among heterogeneous devices. Smart cities are established with sophisticated designs and control of seamless machine-to-machine (M2M) communication, to optimize resources, costs, performance, and energy distributions. All the sensory devices within a building interact to maintain a sustainable climate for residents and intuitively optimize the energy distribution to optimize energy production. However, this encompasses quite a few challenges for devices that lack a compatible and interoperable design. The conventional solutions are restricted to limited domains or rely on engineers designing and deploying translators for each pair of ontologies. This is a costly process in terms of engineering effort and computational resources. An issue persists that a new device with a different ontology must be integrated into an existing IoT network. We propose a self-learning model that can determine the taxonomy of devices given their ontological meta-data and structural information. The model finds matches between two distinct ontologies using a natural language processing (NLP) approach to learn linguistic contexts. Then, by visualizing the ontological network as a knowledge graph, it is possible to learn the structure of the meta-data and understand the device's message formulation. Finally, the model can align entities of ontological graphs that are similar in context and structure.Furthermore, the model performs dynamic M2M translation without requiring extra engineering or hardware resources.

Place, publisher, year, edition, pages
MDPI, 2023
Keywords
deep learning, industrial internet of things, Industry 4.0, Industry 5.0 IIoT, knowledge graph, M2M translation, ontology alignment, self-attention, smart city
National Category
Computer Sciences Communication Systems
Research subject
Machine Learning; Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-102316 (URN)10.3390/s23208427 (DOI)001095200100001 ()37896522 (PubMedID)2-s2.0-85175279210 (Scopus ID)
Note

Validerad;2023;Nivå 2;2023-11-14 (marisr);

License fulltext: CC BY

Available from: 2023-11-06 Created: 2023-11-06 Last updated: 2025-02-25Bibliographically approved
3. Cloud-based Collaborative Learning (CCL) for the Automated Condition Monitoring of Wind Farms
Open this publication in new window or tab >>Cloud-based Collaborative Learning (CCL) for the Automated Condition Monitoring of Wind Farms
Show others...
2022 (English)In: Proceedings 2022 IEEE 5th International Conference on Industrial Cyber-Physical Systems (ICPS), Institute of Electrical and Electronics Engineers (IEEE), 2022Conference paper, Published paper (Refereed)
Abstract [en]

Modeling Industrial Internet of Things (IIoT) architectures for the automation of wind turbines and farms(WT/F), as well as their condition monitoring (CM) is a growing concept among researchers. Several end-to-end automated cloud-based solutions that digitize CM operations intelligently to reduce manual efforts and costs are being developed. However, establishing robust and secure communication across WT/F is still difficult for the wind energy industry. We propose a fully automated cloud-based collaborative learning (CCL) architecture using the Eclipse Arrowhead Framework and an unsupervised dictionary learning (USDL) CM approach. The scalability of the framework enabled digitization and collaboration across the WT/Fs. Collaborative learning is a novel approach that allows all WT/Fs to learn from each other in real-time. Each turbine has CCL based CM using USDL as micro-services that autonomously perform feature selection and failure prediction to optimize cost, computation, and resources. The fundamental essence of the USDA approach is to enhance the WT/F’s learning and accuracy. We use dictionary distances as a metric for analyzing the CM of WT in our proposed USDL approach. A dictionary indicates an anomaly if its distances increased from the dictionary computed at a healthy state of that WT. Using CCL, a WT/F learns all types of failures that could occur in a similar WT/F, predicts any machinery failure, and sends alerts to the technicians to ensure guaranteed proactive maintenance. The results of our research support the notion that when testing a turbine with dictionaries of all the other turbines, every dictionary converges to similar behavior and captures the fault that occurs in that turbine.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022
Keywords
ndustry 4.0, Cloud-based Architectures, Eclipse Arrowhead Framework, Machine Learning, Unsupervised Learning, Wind Turbine, Wind Farms, Condition Monitoring
National Category
Computer Sciences
Research subject
Machine Learning; Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-90195 (URN)10.1109/ICPS51978.2022.9816960 (DOI)2-s2.0-85135621043 (Scopus ID)
Conference
5th IEEE International Conference on Industrial Cyber-Physical Systems (ICPS 2022), Coventry, United Kingdom, May 24-26, 2022
Projects
Arrowhead Tools
Note

Funder: ECSEL JU (82645);

ISBN för värdpublikation: 978-1-6654-9770-1

Available from: 2022-04-13 Created: 2022-04-13 Last updated: 2025-02-25Bibliographically approved
4. A Smart Manufacturing Ecosystem for Industry 5.0 using Cloud-based Collaborative Learning at the Edge
Open this publication in new window or tab >>A Smart Manufacturing Ecosystem for Industry 5.0 using Cloud-based Collaborative Learning at the Edge
Show others...
2023 (English)In: NOMS 2023-2023 IEEE/IFIP Network Operations and Management Symposium / [ed] Kemal Akkaya, Olivier Festor, Carol Fung, Mohammad Ashiqur Rahman, Lisandro Zambenedetti Granville, Carlos Raniery Paula dos Santos, IEEE, 2023Conference paper, Published paper (Refereed)
Abstract [en]

In the modern manufacturing industry, collaborative architectures are growing in popularity. We propose an Industry 5.0 value-driven manufacturing process automation ecosystem in which each edge automation system is based on a local cloud and has a service-oriented architecture. Additionally, we integrate cloud-based collaborative learning (CCL) across building energy management, logistic robot management, production line management, and human worker Aide local clouds to facilitate shared learning and collaborate in generating manufacturing workflows. Consequently, the workflow management system generates the most effective and Industry 5.0-driven workflow recipes. In addition to managing energy for a sustainable climate and executing a cost-effective, optimized, and resilient manufacturing process, this work ensures the well-being of human workers. This work has significant implications for future work, as the ecosystem can be deployed and tested for any industrial use case.

Place, publisher, year, edition, pages
IEEE, 2023
Series
IEEE/IFIP Network Operations and Management Symposium, ISSN 1542-1201, E-ISSN 2374-9709
Keywords
Industry 5.0, Smart Manufacturing Ecosystem, Eclipse Arrowhead Framework, Value-driven Automation, Local Cloud-based Architecture, AI at the Edge, Collaborative Learning
National Category
Other Mechanical Engineering
Research subject
Cyber-Physical Systems; Machine Learning
Identifiers
urn:nbn:se:ltu:diva-96939 (URN)10.1109/NOMS56928.2023.10154323 (DOI)2-s2.0-85164738175 (Scopus ID)978-1-6654-7717-8 (ISBN)978-1-6654-7716-1 (ISBN)
Conference
IEEE/IFIP Network Operations and Management Symposium, May 8–12, 2023, Miami, USA
Note

European Commission, Arrowhead Tools project (ECSEL JU, No.826452)

Available from: 2023-04-25 Created: 2023-04-25 Last updated: 2025-02-25Bibliographically approved
5. Local Cloud-based Collaborative Learning vs Other IIoT Decentralized AI Solutions: A Systematic Literature Review
Open this publication in new window or tab >>Local Cloud-based Collaborative Learning vs Other IIoT Decentralized AI Solutions: A Systematic Literature Review
Show others...
(English)Manuscript (preprint) (Other academic)
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Machine Learning; Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-111751 (URN)
Available from: 2025-02-25 Created: 2025-02-25 Last updated: 2025-03-06
6. CCL+: Enhancing the local Cloud-basedCollaborative Learning (CCL) Model for OnlineData Reduction
Open this publication in new window or tab >>CCL+: Enhancing the local Cloud-basedCollaborative Learning (CCL) Model for OnlineData Reduction
Show others...
(English)Manuscript (preprint) (Other academic)
National Category
Computer Systems
Research subject
Machine Learning
Identifiers
urn:nbn:se:ltu:diva-111753 (URN)
Available from: 2025-02-25 Created: 2025-02-25 Last updated: 2025-03-06

Open Access in DiVA

fulltext(13268 kB)15 downloads
File information
File name FULLTEXT01.pdfFile size 13268 kBChecksum SHA-512
14f0ca14bebf891a52758dc080af661c769d03fbe1a35b473a4237c0eb10cf0a4e077a61d1ffcb47257a28e8f5c3a8a0a7603701d3412d78e69143f5621959f2
Type fulltextMimetype application/pdf
The full text will be freely available from 2026-09-21 09:00
Available from 2026-09-21 09:00

Authority records

(Javed) Haseeb, Saleha

Search in DiVA

By author/editor
(Javed) Haseeb, Saleha
By organisation
Embedded Internet Systems Lab
Computer Vision and Learning Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 15 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 468 hits
23456785 of 16
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf