Change search
Link to record
Permanent link

Direct link
Mansouri, Sina SharifORCID iD iconorcid.org/0000-0001-7631-002x
Publications (10 of 53) Show all publications
Kottayam Viswanathan, V., Mansouri, S. S. & Kanellakis, C. (2023). Aerial infrastructures inspection. In: George Nikolakopoulos, Sina Sharif Mansouri, Christoforos Kanellakis (Ed.), Aerial Robotic Workers: Design, Modeling, Control, Vision, and Their Applications: (pp. 175-211). Elsevier
Open this publication in new window or tab >>Aerial infrastructures inspection
2023 (English)In: Aerial Robotic Workers: Design, Modeling, Control, Vision, and Their Applications / [ed] George Nikolakopoulos, Sina Sharif Mansouri, Christoforos Kanellakis, Elsevier, 2023, p. 175-211Chapter in book (Other academic)
Abstract [en]

This chapter presents the application of autonomous Aerial Robotic Workers towards performing a visual inspection of 3D infrastructures by utilizing single and multiple Aerial Robotic Workers (ARWs). To address this problem, the developed framework combines the fundamental tasks of path planning, localization, and mapping, which are the essential components for autonomous robotic navigation systems. In the presented approach, the Unmanned Aerial Workers (ARWs) deployed for inspecting the structure rely only on their onboard computer and sensory system. Initially, the problem of path planner is discussed and mathematically formulated, leading to the development of a geometry-based approach for coverage of complex structures. The navigation of the platform is performed through the localization component, which provides accurate pose estimation for the vehicle using a visual-inertial estimation scheme. During the coverage mission, the agents collect image data for post-processing and mapping using Visual SLAM and Structure from Motion techniques. The performance of the proposed framework has been experimentally evaluated in multiple indoor and realistic outdoor infrastructure inspection experiments, depicting the merits of the autonomous navigation system (path planning and localization) and 3D model building of the inspected object and infrastructure.

Place, publisher, year, edition, pages
Elsevier, 2023
Keywords
Infrastructure inspections, ARWs, Autonomy, Visual inspection, 3D point cloud
National Category
Control Engineering Robotics
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-97393 (URN)10.1016/B978-0-12-814909-6.00017-2 (DOI)2-s2.0-85150100105 (Scopus ID)978-0-12-814909-6 (ISBN)
Available from: 2023-05-24 Created: 2023-05-24 Last updated: 2023-05-24Bibliographically approved
Nikolakopoulos, G., Mansouri, S. S. & Kanellakis, C. (Eds.). (2023). Aerial Robotic Workers: Design, Modeling, Control, Vision, and Their Applications. Elsevier
Open this publication in new window or tab >>Aerial Robotic Workers: Design, Modeling, Control, Vision, and Their Applications
2023 (English)Collection (editor) (Other academic)
Place, publisher, year, edition, pages
Elsevier, 2023. p. 265
National Category
Robotics
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-96926 (URN)10.1016/C2017-0-02260-7 (DOI)2-s2.0-85150084021 (Scopus ID)978-0-12-814909-6 (ISBN)
Available from: 2023-04-24 Created: 2023-04-24 Last updated: 2023-04-24Bibliographically approved
Lindqvist, B., Mansouri, S. S., Kanellakis, C. & Kottayam Viswanathan, V. (2023). ARW deployment for subterranean environments. In: George Nikolakopoulos, Sina Sharif Mansouri, Christoforos Kanellakis (Ed.), Aerial Robotic Workers: Design, Modeling, Control, Vision, and Their Applications: (pp. 213-243). Elsevier
Open this publication in new window or tab >>ARW deployment for subterranean environments
2023 (English)In: Aerial Robotic Workers: Design, Modeling, Control, Vision, and Their Applications / [ed] George Nikolakopoulos, Sina Sharif Mansouri, Christoforos Kanellakis, Elsevier, 2023, p. 213-243Chapter in book (Other academic)
Abstract [en]

This chapter will present the application of deployment of full autonomous Aerial Robotic Workers for inspection and exploration tasks in Subterranean environments. The framework shown will focus on the navigation, control, and perception capabilities of resource-constrained aerial platforms, contributing to the development of consumable scouting robotic platforms for real-life applications in extreme environments. In the approach, the aerial platform will be treated as a floating object, commanded by a velocity controller on the x-y axes, a height controller, as well as a heading correction module aligning the platform with the mining tunnel open space. Multiple experimentally verified methods regarding the heading correction module, for dark environments with limited texture, using either a visual camera or a 2D LiDAR presented in real mining environments are presented.

Place, publisher, year, edition, pages
Elsevier, 2023
Keywords
Subterranean, Autonomous, Reactive navigation, Collision avoidance
National Category
Robotics
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-97388 (URN)10.1016/B978-0-12-814909-6.00018-4 (DOI)2-s2.0-85150120419 (Scopus ID)978-0-12-814909-6 (ISBN)
Available from: 2023-05-24 Created: 2023-05-24 Last updated: 2023-05-24Bibliographically approved
Koval, A., Mansouri, S. S. & Kanellakis, C. (2023). Machine learning for ARWs. In: George Nikolakopoulos, Sina Sharif Mansouri, Christoforos Kanellakis (Ed.), Aerial Robotic Workers: Design, Modeling, Control, Vision, and Their Applications: (pp. 159-174). Elsevier
Open this publication in new window or tab >>Machine learning for ARWs
2023 (English)In: Aerial Robotic Workers: Design, Modeling, Control, Vision, and Their Applications / [ed] George Nikolakopoulos, Sina Sharif Mansouri, Christoforos Kanellakis, Elsevier, 2023, p. 159-174Chapter in book (Other academic)
Abstract [en]

Navigation in underground mine environments is a challenging area for the aerial robotic workers. Mines usually have complex geometries, including multiple crossings with different tunnels. Moreover, improving the safety of mines requires drones to be able to detect human workers. Thus, in this Chapter, we introduce frameworks for junction and human detection in the underground mine environments.

Place, publisher, year, edition, pages
Elsevier, 2023
Keywords
CNN, Human detection, Junction recognition, Transfer learning
National Category
Other Civil Engineering
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-97392 (URN)10.1016/B978-0-12-814909-6.00016-0 (DOI)2-s2.0-85150104596 (Scopus ID)978-0-12-814909-6 (ISBN)
Available from: 2023-05-24 Created: 2023-05-24 Last updated: 2023-09-15Bibliographically approved
Lindqvist, B., Kanellakis, C., Mansouri, S. S., Agha-mohammadi, A.-a. & Nikolakopoulos, G. (2022). COMPRA: A COMPact Reactive Autonomy Framework for Subterranean MAV Based Search-And-Rescue Operations. Journal of Intelligent and Robotic Systems, 105(3), Article ID 49.
Open this publication in new window or tab >>COMPRA: A COMPact Reactive Autonomy Framework for Subterranean MAV Based Search-And-Rescue Operations
Show others...
2022 (English)In: Journal of Intelligent and Robotic Systems, ISSN 0921-0296, E-ISSN 1573-0409, Vol. 105, no 3, article id 49Article in journal (Refereed) Published
Abstract [en]

This work establishes COMPRA, a compact and reactive autonomy framework for fast deployment of Micro Aerial Vehicles (MAVs) in subterranean Search-and- Rescue (SAR) missions. A COMPRA-enabled MAV is able to autonomously explore previously unknown areas while specific mission criteria are considered e.g. an object of interest is identified and localized, the remaining useful battery life, the overall desired exploration mission duration. The proposed architecture follows a low-complexity algorithmic design to facilitate fully on-board computations, including nonlinear control, state-estimation, navigation, exploration behavior and object localization capabilities. The framework is mainly structured around a reactive local avoidance planner, based on enhanced Potential Field concepts and using instantaneous 3D pointclouds, as well as a computationally efficient heading regulation technique, based on depth images from an instantaneous camera stream. Those techniques decouple the collision-free path generation from the dependency of a global map and are capable of handling imprecise localization occasions. Field experimental verification of the overall architecture is performed in relevant unknown Global Positioning System (GPS)-denied environments.

Place, publisher, year, edition, pages
Springer, 2022
Keywords
MAV SubT exploration framework, Search-and-rescue Robotics, NMPC, Obstacle Avoidance, MAV autonomy, Object localization
National Category
Robotics
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-92079 (URN)10.1007/s10846-022-01665-6 (DOI)000815065100002 ()2-s2.0-85132582633 (Scopus ID)
Funder
Luleå University of TechnologyEU, Horizon 2020, 869379 illuMINEation, 101003591 NEXGEN-SIMSInterreg Nord, ROBOSOL NYPS 20202891
Note

Validerad;2022;Nivå 2;2022-07-06 (sofila)

Available from: 2022-07-06 Created: 2022-07-06 Last updated: 2022-07-11Bibliographically approved
Koval, A., Karlsson, S., Mansouri, S. S., Kanellakis, C., Tevetzidis, I., Haluska, J., . . . Nikolakopoulos, G. (2022). Dataset collection from a SubT environment. Robotics and Autonomous Systems, 155, Article ID 104168.
Open this publication in new window or tab >>Dataset collection from a SubT environment
Show others...
2022 (English)In: Robotics and Autonomous Systems, ISSN 0921-8890, E-ISSN 1872-793X, Vol. 155, article id 104168Article in journal (Refereed) Published
Abstract [en]

This article presents a dataset collected from the subterranean (SubT) environment with a current state-of-the-art sensors required for autonomous navigation. The dataset includes sensor measurements collected with RGB, RGB-D, event-based and thermal cameras, 2D and 3D lidars, inertial measurement unit (IMU), and ultra wideband (UWB) positioning systems which are mounted on the mobile robot. The overall sensor setup will be referred further in the article as a data collection platform. The dataset contains synchronized raw data measurements from all the sensors in the robot operating system (ROS) message format and video feeds collected with action and 360 cameras. A detailed description of the sensors embedded into the data collection platform and a data collection process are introduced. The collected dataset is aimed for evaluating navigation, localization and mapping algorithms in SubT environments. This article is accompanied with the public release of all collected datasets from the SubT environment. Link: Dataset (C) 2022 The Author(s). Published by Elsevier B.V.

Place, publisher, year, edition, pages
Elsevier, 2022
Keywords
Dataset, SubT, RGB, RGB-D, Event-based and thermal cameras, 2D and 3D lidars
National Category
Computer Vision and Robotics (Autonomous Systems)
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-92577 (URN)10.1016/j.robot.2022.104168 (DOI)000833416900009 ()2-s2.0-85132735325 (Scopus ID)
Funder
EU, Horizon Europe, 869379 illuMINEation
Note

Validerad;2022;Nivå 2;2022-08-19 (hanlid)

Available from: 2022-08-19 Created: 2022-08-19 Last updated: 2022-08-19Bibliographically approved
Lindqvist, B., Mansouri, S. S., Haluška, J. & Nikolakopoulos, G. (2022). Reactive Navigation of an Unmanned Aerial Vehicle With Perception-Based Obstacle Avoidance Constraints. IEEE Transactions on Control Systems Technology, 30(5), 1847-1862
Open this publication in new window or tab >>Reactive Navigation of an Unmanned Aerial Vehicle With Perception-Based Obstacle Avoidance Constraints
2022 (English)In: IEEE Transactions on Control Systems Technology, ISSN 1063-6536, E-ISSN 1558-0865, Vol. 30, no 5, p. 1847-1862Article in journal (Refereed) Published
Abstract [en]

In this article, we propose a reactive constrained navigation scheme, with embedded obstacles avoidance for an unmanned aerial vehicle (UAV), for enabling navigation in obstacle-dense environments. The proposed navigation architecture is based on a nonlinear model predictive controller (NMPC) and utilizes an onboard 2-D LiDAR to detect obstacles and translate online the key geometric information of the environment into parametric constraints for the NMPC that constrain the available position space for the UAV. This article focuses also on the real-world implementation and experimental validation of the proposed reactive navigation scheme, and it is applied in multiple challenging laboratory experiments, where we also conduct comparisons with relevant methods of reactive obstacle avoidance. The solver utilized in the proposed approach is the optimization engine (OpEn) and the proximal averaged Newton for optimal control (PANOC) algorithm, where a penalty method is applied to properly consider obstacles and input constraints during the navigation task. The proposed novel scheme allows for fast solutions while using limited onboard computational power, which is a required feature for the overall closed-loop performance of a UAV and is applied in multiple real-time scenarios. The combination of built-in obstacle avoidance and real-time applicability makes the proposed reactive constrained navigation scheme an elegant framework for UAVs that is able to perform fast nonlinear control, local path planning, and obstacle avoidance, all embedded in the control layer.

Place, publisher, year, edition, pages
IEEE, 2022
Keywords
Model predictive control (MPC), obstacle avoidance, path planning, reactive navigation, unmanned aerial vehicles (UAVs)
National Category
Robotics
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-88019 (URN)10.1109/tcst.2021.3124820 (DOI)000730036500001 ()2-s2.0-85137811221 (Scopus ID)
Funder
EU, Horizon 2020, 869379
Note

Validerad;2022;Nivå 2;2022-09-26 (hanlid)

Available from: 2021-11-25 Created: 2021-11-25 Last updated: 2022-09-26Bibliographically approved
Mukherjee, M., Banerjee, A., Papadimitriou, A., Mansouri, S. S. & Nikolakopoulos, G. (2021). A decentralized sensor fusion scheme for multi sensorial fault resilient pose estimation. Sensors, 21(24), Article ID 8259.
Open this publication in new window or tab >>A decentralized sensor fusion scheme for multi sensorial fault resilient pose estimation
Show others...
2021 (English)In: Sensors, E-ISSN 1424-8220, Vol. 21, no 24, article id 8259Article in journal (Refereed) Published
Abstract [en]

This article proposes a novel decentralized two-layered and multi-sensorial based fusion architecture for establishing a novel resilient pose estimation scheme. As it will be presented, the first layer of the fusion architecture considers a set of distributed nodes. All the possible combinations of pose information, appearing from different sensors, are integrated to acquire various possibilities of estimated pose obtained by involving multiple extended Kalman filters. Based on the estimated poses, obtained from the first layer, a Fault Resilient Optimal Information Fusion (FR-OIF) paradigm is introduced in the second layer to provide a trusted pose estimation. The second layer incorporates the output of each node (constructed in the first layer) in a weighted linear combination form, while explicitly accounting for the maximum likelihood fusion criterion. Moreover, in the case of inaccurate measurements, the proposed FR-OIF formulation enables a self resiliency by embedding a built-in fault isolation mechanism. Additionally, the FR-OIF scheme is also able to address accurate localization in the presence of sensor failures or erroneous measurements. To demonstrate the effectiveness of the proposed fusion architecture, extensive experimental studies have been conducted with a micro aerial vehicle, equipped with various onboard pose sensors, such as a 3D lidar, a real-sense camera, an ultra wide band node, and an IMU. The efficiency of the proposed novel framework is extensively evaluated through multiple experimental results, while its superiority is also demonstrated through a comparison with the classical multi-sensorial centralized fusion approach. © 2021 by the authors. Licensee MDPI, Basel, Switzerland.

Place, publisher, year, edition, pages
MDPI, 2021
Keywords
Information fusion, Kalman filters, Maximum likelihood estimation, Micro air vehicle (MAV), Decentralised, Decentralized fusion, Fault resilient optimal information fusion, Fusion architecture, Linear minimum variance, Maximum likelihood function, Multi-sensor fusion, Optimal information filter, Optimal information fusion, Pose-estimation, Antennas
National Category
Computer Vision and Robotics (Autonomous Systems)
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-88527 (URN)10.3390/s21248259 (DOI)000737322300001 ()34960352 (PubMedID)2-s2.0-85120770377 (Scopus ID)
Funder
EU, Horizon 2020, 101003591 NEXGEN SIMS
Note

Validerad;2022;Nivå 2;2022-01-01 (johcin)

Available from: 2021-12-20 Created: 2021-12-20 Last updated: 2024-02-22Bibliographically approved
Koval, A., Mansouri, S. S., Kanellakis, C. & Nikolakopoulos, G. (2021). Aerial Thermal Image based Convolutional Neural Networks for Human Detection in SubT Environments. In: 2021 The International Conference on Unmanned Aircraft Systems (ICUAS’21): . Paper presented at International Conference on Unmanned Aircraft Systems (ICUAS ’21), Athens, Greece, June 15-18, 2021 (pp. 536-541). IEEE
Open this publication in new window or tab >>Aerial Thermal Image based Convolutional Neural Networks for Human Detection in SubT Environments
2021 (English)In: 2021 The International Conference on Unmanned Aircraft Systems (ICUAS’21), IEEE, 2021, p. 536-541Conference paper, Published paper (Refereed)
Abstract [en]

This article proposes a novel strategy for detecting humans in harsh Sub-terranean (SubT) environments, with a thermal camera mounted on an aerial platform, based on the AlexNet Convolutional Neural Network (CNN). A transfer learning framework will be utilized for detecting the humans, where the aerial thermal images are fed to the trained network, which binary classifies them image content into two categories: a) human, and b) no human. Moreover, the AlexNet based framework is compared with two related popular CNN approaches as the GoogleNet and the Inception3Net. The efficacy of the proposed scheme has been experimentally evaluated through multiple data-sets, collected from a FLIR thermal camera during flights on an underground mining environment, fully demonstrating the performance and merits of the proposed module.

Place, publisher, year, edition, pages
IEEE, 2021
Series
International Conference on Unmanned Aircraft Systems (ICUAS), E-ISSN 2575-7296
National Category
Computer Vision and Robotics (Autonomous Systems)
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-86524 (URN)10.1109/ICUAS51884.2021.9476853 (DOI)2-s2.0-85111457713 (Scopus ID)
Conference
International Conference on Unmanned Aircraft Systems (ICUAS ’21), Athens, Greece, June 15-18, 2021
Funder
EU, Horizon 2020, 869379
Note

ISBN för värdpublikation: 978-1-6654-1535-4

Available from: 2021-08-05 Created: 2021-08-05 Last updated: 2021-08-19Bibliographically approved
Papadimitriou, A., Mansouri, S. S., Kanellakis, C. & Nikolakopoulos, G. (2021). Geometry Aware NMPC Scheme for Morphing Quadrotor Navigation in Restricted Entrances. In: 2021 European Control Conference (ECC): . Paper presented at 2021 European Control Conference, ECC 2021, Virtual Event / Delft, The Netherlands, June 29 - July 2, 2021 (pp. 1597-1603). IEEE
Open this publication in new window or tab >>Geometry Aware NMPC Scheme for Morphing Quadrotor Navigation in Restricted Entrances
2021 (English)In: 2021 European Control Conference (ECC), IEEE, 2021, p. 1597-1603Conference paper, Published paper (Refereed)
Abstract [en]

Geometry-morphing Micro Aerial Vehicles (MAVs) are gaining more attention lately, since, their ability to modify their geometric morphology in-flight increases their versatility while expanding their application range. In this novel research field, most of the works focus on the platform design and on the low-level control for maintaining stability after changing its shape. Nevertheless, another aspect of geometry morphing MAVs is the association of its morphology with respect to the shape and structure of the environment. In this article, we propose a novel Nonlinear Model Predictive Control (NMPC) structure that modifies the morphology of a quadrotor based on the environment entrances' geometrical shape. The proposed method considers restricted entrances as a constraint in the NMPC and modifies the arm configuration of the MAV to provide a collision-free path from the initial position to the desired goal while passing through the entrance. Multiple simulation results present the performance and efficiency of the proposed scheme in scenarios where the quadrotor is commanded to pass through narrow entrances.

Place, publisher, year, edition, pages
IEEE, 2021
National Category
Control Engineering
Research subject
Robotics and Artificial Intelligence
Identifiers
urn:nbn:se:ltu:diva-89571 (URN)10.23919/ECC54610.2021.9655205 (DOI)000768455200233 ()2-s2.0-85124909216 (Scopus ID)
Conference
2021 European Control Conference, ECC 2021, Virtual Event / Delft, The Netherlands, June 29 - July 2, 2021
Note

ISBN för värdpublikation: 978-9-4638-4236-5; 978-1-6654-7945-5

Available from: 2022-03-31 Created: 2022-03-31 Last updated: 2022-04-21Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-7631-002x

Search in DiVA

Show all publications