Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
First-look enabled Autonomous Aerial Visual Inspection of Geometrically Fractured Objects in Constrained Environments
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0002-4383-7316
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0003-1437-1809
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0003-3922-1735
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0003-0126-1897
2022 (English)In: 2022 IEEE 31st International Symposium on Industrial Electronics (ISIE), IEEE, 2022, p. 295-300Conference paper, Published paper (Refereed)
Abstract [en]

In this article we propose a novel offline, model-based aerial visual inspection scheme for geometrically fractured large objects, based on fully autonomous Unmanned Aerial Ve-hicles (UAV s), while specifically targeting the case of constrained environments. The proposed framework enables a safe and collision free inspection mission, while guaranteeing a complete visual inspection of the object of interest. The proposed framework employs a novel First - Look approach to generate viewpoints satisfying specific photogrammetric requirements, as well as spatial constraints that are inherently applied by the UAV's state constraints. As it will be presented, i) the First - Look approach allows the UAV to first orient it's view vector towards the nearest available point detected by kd - tree based Nearest Neighbour search on the object, from it's current position, and ii) in the sequel, based on the orientation of the left vector of the camera and the overlap distance, the next viewpoint is projected. This approach is repeated throughout the whole inspection procedure, while the established framework has also the merit to ensure that the inspection path adapts to the shape of the object, which is highly advantageous for the cases of geometrically fractured objects. Multiple realistic and physics based simulation results are presented that prove the efficacy of the proposed scheme.

Place, publisher, year, edition, pages
IEEE, 2022. p. 295-300
Series
Proceedings of the IEEE International Symposium on Industrial Electronics, ISSN 2163-5137, E-ISSN 2163-5145
Keywords [en]
Visual inspection, first-look, Con-strained environment, geometrically fractured objects, Kd-tree search
National Category
Robotics
Research subject
Robotics and Artificial Intelligence
Identifiers
URN: urn:nbn:se:ltu:diva-92626DOI: 10.1109/ISIE51582.2022.9831615Scopus ID: 2-s2.0-85135818135OAI: oai:DiVA.org:ltu-92626DiVA, id: diva2:1689258
Conference
31st International Symposium on Industrial Electronics (ISIE), Anchorage [Hybrid], Alaska, USA, June 1-3, 2022
Note

ISBN för värdpublikation: 978-1-6654-8240-0 (electronic), 978-1-6654-8241-7 (print)

Available from: 2022-08-22 Created: 2022-08-22 Last updated: 2023-09-11Bibliographically approved
In thesis
1. One Image, Many Insights: A Synergistic Approach Towards Enabling Autonomous Visual Inspection
Open this publication in new window or tab >>One Image, Many Insights: A Synergistic Approach Towards Enabling Autonomous Visual Inspection
2023 (English)Licentiate thesis, comprehensive summary (Other academic)
Alternative title[sv]
En bild, många insikter: ett synergistiskt tillvägagångssätt för att möjliggöra autonom visuell inspektion
Abstract [en]

Visual inspection in autonomous robotics is a task in which autonomous agents are required to gather visual information of objects of interest, in a manner that ensures safety, efficiency and comprehensive coverage. It is, therefore, crucial for identifying key landmarks, detecting cracks or defects, or reconstructing the observed object for detailed analysis. This thesis delves into the  challenges encountered by autonomous agents in executing such tasks and presents frameworks for scenarios ranging from operations by multiple spacecrafts in close proximity to celestial bodies in Deep Space to terrestrial deployments of Unmanned Aerial Vehicles (UAVs) for inspection of large-scale infrastructures. The research thus pursues two main directions: Firstly, a novel formation control strategy is developed to enable autonomous agents to perform proximity operations safely, efficiently, and accurately in order to map the surface of Small Celestial Bodies (SCBs). This investigation encompasses control and coordination strategies, leveraging a realistic astrodynamic model of the orbital environment to navigate safely around SCBs. Along this direction, the contributions focus on enabling a distributed autonomy framework in the form of a cooperative stereo configuration between two spacecraft, allowing acquisition of 3D topological information of the candidate SCB. The framework employs a Leader-Follower approach, treating the maintenance of the desired stereo-formation as a 6 Degree-of-Freedom (DoF) nonlinear model predictive control (NMPC) problem.

The second research direction focuses on addressing the problem of enabling robotic inspection for terrestrial applications. With the growing demand for efficient and reliable inspection techniques to improve in-situ situational awareness, the research concentrates on addressing the problem of obtaining detailed visual scan of available structures without any a priori knowledge of either the environment nor the structures. Thus, the key contributions of the presented work reside in the implementation of a unified autonomy, with the unification drawing it's root from the merging of two distinct research perspectives: Inspection and Exploration planning. The contribution establishes a novel solution by introducing a map-independent approach with a synergistic formulation of a reactive profile-adaptive view-planner coupled with a hierarchical exploration strategy and an environment-invariant scene recognition module. By integrating exploration and inspection methodologies, this research seeks to enhance the capabilities of UAVs in navigating and inspecting unknown structures in unfamiliar environments. 

Through theoretical developments, extensive simulations and experimental validations, this thesis contributes to the advancement of the state-of-the-art in visual inspection with autonomous robots. Moreover, the findings extend current capabilities of autonomous agents in the field of space exploration as well as in disaster response and complex infrastructure inspection.

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2023
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
Keywords
Unified autonomy, aerial robotics, space robotics
National Category
Robotics
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-101301 (URN)978-91-8048-367-4 (ISBN)978-91-8048-368-1 (ISBN)
Presentation
2023-11-09, A1545, Luleå University of Technology, Luleå, 09:00 (English)
Opponent
Supervisors
Available from: 2023-09-11 Created: 2023-09-11 Last updated: 2023-10-19Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Kottayam Viswanathan, VigneshSatpute, SumeetLindqvist, BjörnNikolakopoulos, George

Search in DiVA

By author/editor
Kottayam Viswanathan, VigneshSatpute, SumeetLindqvist, BjörnNikolakopoulos, George
By organisation
Signals and Systems
Robotics

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 39 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf