Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Dynamic visual sensing based on MPC controlled UAVs
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0001-8870-6718
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0001-7631-002X
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0003-0126-1897
2017 (English)In: 2017 25th Mediterranean Conference on Control and Automation, MED 2017, Piscataway, NJ: Institute of Electrical and Electronics Engineers (IEEE), 2017, p. 1201-1206, article id 7984281Conference paper, Published paper (Refereed)
Abstract [en]

This article considers the establishment of a dynamic visual sensor from monocular cameras to enable a reconfigurable environmental perception. The cameras are mounted on Micro Aerial Vehicles (MAV) which are coordinated by a Model Predictive Control (MPC) scheme to retain overlapping field of views and form a global sensor with varying baseline. The specific merits of the proposed scheme are: a) the ability to form a configurable stereo rig, according to the application needs, and b) the simple design, the reduction of the payload and the corresponding cost. Moreover, the proposed configurable sensor provides a glpobal 3D reconstruction of the surrounding area, based on a modified Structure from Motion approach. The efficiency of the suggested flexible visual sensor is demonstrated in simulation results that highlight the novel concept of cooperative flying cameras and their 3D reconstruction capabilities

Place, publisher, year, edition, pages
Piscataway, NJ: Institute of Electrical and Electronics Engineers (IEEE), 2017. p. 1201-1206, article id 7984281
Series
Mediterranean Conference on Control and Automation, ISSN 2325-369X
National Category
Control Engineering
Research subject
Control Engineering
Identifiers
URN: urn:nbn:se:ltu:diva-65606DOI: 10.1109/MED.2017.7984281ISI: 000426926300196Scopus ID: 2-s2.0-85028515340ISBN: 9781509045334 (electronic)OAI: oai:DiVA.org:ltu-65606DiVA, id: diva2:1140535
Conference
25th Mediterranean Conference on Control and Automation, MED 2017, University of Malta, Valletta, Malta, 3-6 July 2017
Projects
Collaborative Aerial Robotic Workers, AEROWORKS
Funder
EU, Horizon 2020, 644128Available from: 2017-09-12 Created: 2017-09-12 Last updated: 2021-10-15Bibliographically approved
In thesis
1. On Visual Perception for an Aerial Robotic Worker
Open this publication in new window or tab >>On Visual Perception for an Aerial Robotic Worker
2017 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Micro Aerial Vehicles and especially multi rotors are gaining more and more attention for accomplishing complex tasks, considering their simple mechanical design and their versatile movement. MAVs are ideal candidates to perform tasks autonomously, to work safely in close proximity and in collaboration with humans, and to operate safely and effectively in natural human environments, like infrastructure inspection-maintenance, underground mine operations and surveillance missions. Adopting this vision, this thesis contributes in the aerial platform ecosystem that can be summarized by the term Aerial Robotic Worker (ARW). An ARW is characterized, among others, by its advanced capabilities on environmental perception and 3D reconstruction and active aerial manipulation.Using cameras for localization, mapping of an ARW as well as guidance on aerial manipulation is appealing mainly because of the small size and cost of such sensors. Nevertheless, visualinformation provided from the cameras is enormous, posing significant challenges in real-time data processing, while meeting the constraints of these platforms. Additionally, another challenge on visual perception considers the usage of multiple agents that collaboratively perceive their surroundings forming an aerial sensor. This thesis also investigates the applicability of visual SLAM algorithms in uncontrolled and cluttered environments. Furthermore, work will be presented on visual guidance for an aerial manipulator, which is challenging regarding the object detection, tracking and the platform approaching strategies. The first contribution will be the establishment of a flexible virtual stereo rig consisted of MPC controlled MAVs. The advantage of this approach is the varying baseline sensor that is composed from independently moving cameras, adjusting the depth perception accordingly. This method is able to provide the 3D reconstruction of the environment in a sparse pointcloud. The second contribution of this this thesis will examine the single agents in two different scenarios. Initially, experimental trials of commonly used visual sensors in hard and challenging environments will be presented in real scale underground ore mine to evaluate the localization and mapping performance of such technology for potential usage in UAVs. Secondly, theoretical work will be performed regarding attitude regulation of a hexacopter for stable hovering based on visual localization. In this work the time delays induced from the processing should be compensated with a switching control scheme which is able to maintain the stability of the platform. Finally, a third contribution of this thesis will be vision for aerial manipulation. The developed system includes a stereo camera that is attached on the end-effector of the aerial manipulator and is used to provide robust target detection and tracking. The visual feedback is processed to co-localize the aerial agent with the target and generate a waypoint that allows to approach the target.

Place, publisher, year, edition, pages
Luleå tekniska universitet, 2017
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
National Category
Control Engineering
Research subject
Control Engineering
Identifiers
urn:nbn:se:ltu:diva-65535 (URN)978-91-7583-955-4 (ISBN)978-91-7583-956-1 (ISBN)
Presentation
2017-10-10, D2223, Luleå, 09:00 (English)
Funder
EU, Horizon 2020
Available from: 2017-09-11 Created: 2017-09-08 Last updated: 2021-10-15Bibliographically approved
2. On Visual Area Coverage Using Micro Aerial Vehicles
Open this publication in new window or tab >>On Visual Area Coverage Using Micro Aerial Vehicles
2018 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

The aim of this Licentiate is to advance the field of cooperative visual coverage path planners for multiple Micro Aerial Vehicles (MAVs), while aiming for their real life adoption towards the tasks of aerial infrastructure inspection. The fields that will be addressed are focusing in: a) the collaborative perception of the environment, b) the collaborative visual inspection, and c) the optimization of the aerial missions based on the remaining flying battery, camera constraints, coverage constraints and other real life mission induced constraints.

Towards this envisioned aim, this Licentiate will present the following main theoretical contributions: a) centralized and distributed Model Predictive Control (MPC) schemes for the cooperative motion control of MAVs focusing in the establishing of a formation control architecture to enable a dynamic visual sensor from monocular cameras towards a reconfigurable environmental perception, b) revisiting the Cooperative Coverage Path Planning (C-CPP) problem for the inspection of complex infrastructures, c) developing a holistic approach to the problems of 2-D area coverage with MAVs for polygon areas, while considering the camera footprint, and d) designing of a scheme to estimate the Remaining Useful Life (RUL) of the battery during a flight mission, a fact that directly effects the flying capabilities of the MAVs. The theoretical contributions of this thesis have been extensively evaluated in simulation and real life large scale field trials, a direction that adds another contribution of the suggested framework towards the massive insertion of the aerial platforms as aerial tools in the close future.

In the first part of this Licentiate, the vision, motivation, open challenges, contributions, and future works are discussed, while in the second part the full articles connected to the presented contributions in this Licentiate are presented in the annex.

Place, publisher, year, edition, pages
Luleå: Luleå tekniska universitet, 2018
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
National Category
Control Engineering
Research subject
Control Engineering
Identifiers
urn:nbn:se:ltu:diva-68666 (URN)978-91-7790-140-2 (ISBN)978-91-7790-141-9 (ISBN)
Presentation
2018-06-15, A1547, Luleå tekniska universitet, Luleå, 13:00 (English)
Opponent
Supervisors
Available from: 2018-05-07 Created: 2018-05-07 Last updated: 2018-06-08Bibliographically approved

Open Access in DiVA

fulltext(430 kB)209 downloads
File information
File name FULLTEXT01.pdfFile size 430 kBChecksum SHA-512
a4971fefa24e24ab9a7d287dc8dc2bc1aba9e68085f8c72f0f5d84bfa6e84672294ead8a78a82c05f14f7c15ebdf5010fe81a6e944fef018b1b7846e95606d1c
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Kanellakis, ChristoforosMansouri, Sina SharifNikolakopoulos, George

Search in DiVA

By author/editor
Kanellakis, ChristoforosMansouri, Sina SharifNikolakopoulos, George
By organisation
Signals and Systems
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 209 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 138 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf