Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Irregular Change Detection in Sparse Bi-Temporal Point Clouds Using Learned Place Recognition Descriptors and Point-to-Voxel Comparison
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0002-0108-6286
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0001-8235-2728
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0003-0126-1897
2023 (English)In: 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Institute of Electrical and Electronics Engineers (IEEE), 2023, p. 8077-8083Conference paper, Published paper (Refereed)
Abstract [en]

Change detection and irregular object extraction in 3D point clouds is a challenging task that is of high importance not only for autonomous navigation but also for updating existing digital twin models of various industrial environments. This article proposes an innovative approach for change detection in 3D point clouds using deep learned place recognition descriptors and irregular object extraction based on voxel-to-point comparison. The proposed method first aligns the bi-temporal point clouds using a map-merging algorithm in order to establish a common coordinate frame. Then, it utilizes deep learning techniques to extract robust and discriminative features from the 3D point cloud scans, which are used to detect changes between consecutive point cloud frames and therefore find the changed areas. Finally, the altered areas are sampled and compared between the two time instances to extract any obstructions that caused the area to change. The proposed method was successfully evaluated in real-world field experiments, where it was able to detect different types of changes in 3D point clouds, such as object or muck-pile addition and displacement, showcasing the effectiveness of the approach. The results of this study demonstrate important implications for various applications, including safety and security monitoring in construction sites, mapping and exploration and suggests potential future research directions in this field.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2023. p. 8077-8083
National Category
Robotics and automation
Research subject
Robotics and Artificial Intelligence
Identifiers
URN: urn:nbn:se:ltu:diva-103440DOI: 10.1109/IROS55552.2023.10342248ISI: 001136907802050Scopus ID: 2-s2.0-85182524039OAI: oai:DiVA.org:ltu-103440DiVA, id: diva2:1823422
Conference
International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA, October 1-5, 2023
Funder
EU, Horizon 2020, 101003591 NEX-GEN SIMS
Note

ISBN for host publication: 978-1-6654-9190-7 (electronic), 978-1-6654-9191-4 (print)

Available from: 2024-01-02 Created: 2024-01-02 Last updated: 2025-02-09Bibliographically approved
In thesis
1. On Autonomous Map-merging for Multi-Robot Systems
Open this publication in new window or tab >>On Autonomous Map-merging for Multi-Robot Systems
2024 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Three-dimensional (3D) point cloud map merging is a pivotal technology in robotics and automation, enabling the integration of multiple 3D point cloud maps into a single, comprehensive representation of the environment. This technique is particularly advantageous in multi-robot coordination, where multiple robots collaborate to explore and map extensive areas. Each robot generates a local map within its local frame, which serves as crucial data for localization, collision avoidance, navigation, and path planning, and can later be shared and fused into a global map. In addition, human operators in the industry can find this advantageous, as it allows for faster and more efficient inspections without the need for manual map alignment. This thesis introduces a modular framework for autonomous 3D point cloud map merging in multi-robot systems, addressing the challenge of aligning local maps by identifying acceptable spatial coordinate transformations. This framework facilitates real-time map merging during multi-robot exploration, enhancing mapping efficiency by preventing redundant exploration of already mapped areas. The first contribution stems from formulating and addressing the map merging problem through a modular pipeline and evaluating each component. Then two methods are presented that improve place recognition performance, a fundamental aspect of the process. The first method extends the place recognition pipeline with a topological classification module, enhancing performance in challenging environments and autonomously triggering the map merging pipeline for higher success rates. The second method integrates additional data modalities, such as an inexpensive Wi-Fi module, to enhance place recognition performance. Furthermore, the thesis addresses communication challenges in multi-robot systems. A solution for centralized systems is proposed, where a control mechanism regulates map data transmission to ensure critical information is preserved and the map merging process is not compromised. Additionally, a combined solution for place recognition descriptors is presented, which compresses LiDAR data to improve transmission efficiency. Finally, the map merging framework serves as the backbone of a change detection algorithm. Both the map merging framework and the change detection algorithm are evaluated through a series of use-case deployments, including autonomous Unmanned Aerial Vehicles (UAVs) operations in mining areas and a safety inspection mission following a real blast. 

Place, publisher, year, edition, pages
Luleå University of Technology, 2024. p. 234
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
Keywords
Robotics, Multi-Robot Systems, Map merging
National Category
Robotics and automation
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-110608 (URN)978-91-8048-696-5 (ISBN)978-91-8048-697-2 (ISBN)
Presentation
2024-12-06, A3024, Luleå University of Technology, Luleå, 09:00 (English)
Opponent
Supervisors
Available from: 2024-10-31 Created: 2024-10-31 Last updated: 2025-02-09Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Stathoulopoulos, NikolaosKoval, AntonNikolakopoulos, George

Search in DiVA

By author/editor
Stathoulopoulos, NikolaosKoval, AntonNikolakopoulos, George
By organisation
Signals and Systems
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 50 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf