Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Evaluation of Visual Localization Systems in Underground Mining
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0001-8870-6718
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0003-0126-1897
2016 (English)In: 24th Mediterranean Conference on Control and Automation (MED): June 21-24, Athens, Greece, 2016, Piscataway, NJ: IEEE Communications Society, 2016, p. 539-544, article id 7535853Conference paper, Published paper (Refereed)
Abstract [en]

In this article an evaluation of the current technology on visual localization systems for underground mining is presented. The proposed study is considered to be the first step among others towards enabling the vision of underground localization for Unmanned Micro Aerial Vehicles. Furthermore, the aim of this article, is to verify applicable and reliable low cost existing methods and technologies for the problem of UAV localization in underground, harsh mining environments and more specifically in one of the biggest mines in Europe, the iron ore mine of LKAB in Kiruna, Sweden. In the experimental trials, the sensors employed were a RGB-D camera, a Kinect 2 and a Playstation 3 Eye web camera used in two configurations, as a stereo rig and as a monocular visual sensor. The processing of the stored data from the experiments will provide an insight for the applicability of these sensors, while it will identify what further technological and research developments are required in order to develop affordable autonomous UAV solutions for improving the underground mining production processes.

Place, publisher, year, edition, pages
Piscataway, NJ: IEEE Communications Society, 2016. p. 539-544, article id 7535853
Series
Mediterranean Conference on Control and Automation, E-ISSN 2325-369X
National Category
Control Engineering
Research subject
Control Engineering
Identifiers
URN: urn:nbn:se:ltu:diva-35033DOI: 10.1109/MED.2016.7535853ISI: 000391154900090Scopus ID: 2-s2.0-84986238187Local ID: 966e0ac9-f78a-4222-bd15-8271662d2c2fISBN: 978-1-4673-8345-5 (electronic)OAI: oai:DiVA.org:ltu-35033DiVA, id: diva2:1008285
Conference
Mediterranean Conference on Control and Automation : 21/06/2016 - 24/06/2016
Projects
Collaborative Aerial Robotic Workers, AEROWORKS
Funder
EU, Horizon 2020, 644128
Note

Godkänd; 2016; 20160419 (geonik)

Available from: 2016-09-30 Created: 2016-09-30 Last updated: 2022-09-23Bibliographically approved
In thesis
1. On Visual Perception for an Aerial Robotic Worker
Open this publication in new window or tab >>On Visual Perception for an Aerial Robotic Worker
2017 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Micro Aerial Vehicles and especially multi rotors are gaining more and more attention for accomplishing complex tasks, considering their simple mechanical design and their versatile movement. MAVs are ideal candidates to perform tasks autonomously, to work safely in close proximity and in collaboration with humans, and to operate safely and effectively in natural human environments, like infrastructure inspection-maintenance, underground mine operations and surveillance missions. Adopting this vision, this thesis contributes in the aerial platform ecosystem that can be summarized by the term Aerial Robotic Worker (ARW). An ARW is characterized, among others, by its advanced capabilities on environmental perception and 3D reconstruction and active aerial manipulation.Using cameras for localization, mapping of an ARW as well as guidance on aerial manipulation is appealing mainly because of the small size and cost of such sensors. Nevertheless, visualinformation provided from the cameras is enormous, posing significant challenges in real-time data processing, while meeting the constraints of these platforms. Additionally, another challenge on visual perception considers the usage of multiple agents that collaboratively perceive their surroundings forming an aerial sensor. This thesis also investigates the applicability of visual SLAM algorithms in uncontrolled and cluttered environments. Furthermore, work will be presented on visual guidance for an aerial manipulator, which is challenging regarding the object detection, tracking and the platform approaching strategies. The first contribution will be the establishment of a flexible virtual stereo rig consisted of MPC controlled MAVs. The advantage of this approach is the varying baseline sensor that is composed from independently moving cameras, adjusting the depth perception accordingly. This method is able to provide the 3D reconstruction of the environment in a sparse pointcloud. The second contribution of this this thesis will examine the single agents in two different scenarios. Initially, experimental trials of commonly used visual sensors in hard and challenging environments will be presented in real scale underground ore mine to evaluate the localization and mapping performance of such technology for potential usage in UAVs. Secondly, theoretical work will be performed regarding attitude regulation of a hexacopter for stable hovering based on visual localization. In this work the time delays induced from the processing should be compensated with a switching control scheme which is able to maintain the stability of the platform. Finally, a third contribution of this thesis will be vision for aerial manipulation. The developed system includes a stereo camera that is attached on the end-effector of the aerial manipulator and is used to provide robust target detection and tracking. The visual feedback is processed to co-localize the aerial agent with the target and generate a waypoint that allows to approach the target.

Place, publisher, year, edition, pages
Luleå tekniska universitet, 2017
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
National Category
Control Engineering
Research subject
Control Engineering
Identifiers
urn:nbn:se:ltu:diva-65535 (URN)978-91-7583-955-4 (ISBN)978-91-7583-956-1 (ISBN)
Presentation
2017-10-10, D2223, Luleå, 09:00 (English)
Funder
EU, Horizon 2020
Available from: 2017-09-11 Created: 2017-09-08 Last updated: 2021-10-15Bibliographically approved

Open Access in DiVA

fulltext(4040 kB)927 downloads
File information
File name FULLTEXT01.pdfFile size 4040 kBChecksum SHA-512
d8781efff995200508a4074221edf36b080b06c9a7c445a62c680e723ae47f9753f88ffe3817934c243175cc46ef2801feba371ff6268a6413fa6b74c371338b
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Kanellakis, ChristoforosNikolakopoulos, George

Search in DiVA

By author/editor
Kanellakis, ChristoforosNikolakopoulos, George
By organisation
Signals and Systems
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 929 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 393 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf