Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Dynamic visual sensing based on MPC controlled UAVs
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Signals and Systems.ORCID iD: 0000-0003-0126-1897
2017 (English)In: 2017 25th Mediterranean Conference on Control and Automation, MED 2017, Piscataway, NJ: Institute of Electrical and Electronics Engineers (IEEE), 2017, 1201-1206 p., 7984281Conference paper, Published paper (Refereed)
Abstract [en]

This article considers the establishment of a dynamic visual sensor from monocular cameras to enable a reconfigurable environmental perception. The cameras are mounted on Micro Aerial Vehicles (MAV) which are coordinated by a Model Predictive Control (MPC) scheme to retain overlapping field of views and form a global sensor with varying baseline. The specific merits of the proposed scheme are: a) the ability to form a configurable stereo rig, according to the application needs, and b) the simple design, the reduction of the payload and the corresponding cost. Moreover, the proposed configurable sensor provides a glpobal 3D reconstruction of the surrounding area, based on a modified Structure from Motion approach. The efficiency of the suggested flexible visual sensor is demonstrated in simulation results that highlight the novel concept of cooperative flying cameras and their 3D reconstruction capabilities

Place, publisher, year, edition, pages
Piscataway, NJ: Institute of Electrical and Electronics Engineers (IEEE), 2017. 1201-1206 p., 7984281
National Category
Control Engineering
Research subject
Control Engineering
Identifiers
URN: urn:nbn:se:ltu:diva-65606DOI: 10.1109/MED.2017.7984281Scopus ID: 2-s2.0-85028515340ISBN: 9781509045334 (electronic)OAI: oai:DiVA.org:ltu-65606DiVA: diva2:1140535
Conference
25th Mediterranean Conference on Control and Automation, MED 2017, University of Malta, Valletta, Malta, 3-6 July 2017
Available from: 2017-09-12 Created: 2017-09-12 Last updated: 2017-11-24Bibliographically approved
In thesis
1. On Visual Perception for an Aerial Robotic Worker
Open this publication in new window or tab >>On Visual Perception for an Aerial Robotic Worker
2017 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Micro Aerial Vehicles and especially multi rotors are gaining more and more attention for accomplishing complex tasks, considering their simple mechanical design and their versatile movement. MAVs are ideal candidates to perform tasks autonomously, to work safely in close proximity and in collaboration with humans, and to operate safely and effectively in natural human environments, like infrastructure inspection-maintenance, underground mine operations and surveillance missions. Adopting this vision, this thesis contributes in the aerial platform ecosystem that can be summarized by the term Aerial Robotic Worker (ARW). An ARW is characterized, among others, by its advanced capabilities on environmental perception and 3D reconstruction and active aerial manipulation.Using cameras for localization, mapping of an ARW as well as guidance on aerial manipulation is appealing mainly because of the small size and cost of such sensors. Nevertheless, visualinformation provided from the cameras is enormous, posing significant challenges in real-time data processing, while meeting the constraints of these platforms. Additionally, another challenge on visual perception considers the usage of multiple agents that collaboratively perceive their surroundings forming an aerial sensor. This thesis also investigates the applicability of visual SLAM algorithms in uncontrolled and cluttered environments. Furthermore, work will be presented on visual guidance for an aerial manipulator, which is challenging regarding the object detection, tracking and the platform approaching strategies. The first contribution will be the establishment of a flexible virtual stereo rig consisted of MPC controlled MAVs. The advantage of this approach is the varying baseline sensor that is composed from independently moving cameras, adjusting the depth perception accordingly. This method is able to provide the 3D reconstruction of the environment in a sparse pointcloud. The second contribution of this this thesis will examine the single agents in two different scenarios. Initially, experimental trials of commonly used visual sensors in hard and challenging environments will be presented in real scale underground ore mine to evaluate the localization and mapping performance of such technology for potential usage in UAVs. Secondly, theoretical work will be performed regarding attitude regulation of a hexacopter for stable hovering based on visual localization. In this work the time delays induced from the processing should be compensated with a switching control scheme which is able to maintain the stability of the platform. Finally, a third contribution of this thesis will be vision for aerial manipulation. The developed system includes a stereo camera that is attached on the end-effector of the aerial manipulator and is used to provide robust target detection and tracking. The visual feedback is processed to co-localize the aerial agent with the target and generate a waypoint that allows to approach the target.

Place, publisher, year, edition, pages
Luleå tekniska universitet, 2017
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
National Category
Control Engineering
Research subject
Control Engineering
Identifiers
urn:nbn:se:ltu:diva-65535 (URN)978-91-7583-955-4 (ISBN)978-91-7583-956-1 (ISBN)
Presentation
2017-10-10, D2223, Luleå, 09:00 (English)
Funder
EU, Horizon 2020
Available from: 2017-09-11 Created: 2017-09-08 Last updated: 2017-11-24Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Kanellakis, ChristoforosMansouri, Sina SharifNikolakopoulos, George
By organisation
Signals and Systems
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 52 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf