Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Utilization of Computer Vision Technique for Automated Crack Detection Based on UAV-Taken Images
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Structural and Fire Engineering.ORCID iD: 0000-0002-1375-3322
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Structural and Fire Engineering. SINTEF Narvik AS, Narvik, Norway.ORCID iD: 0000-0001-9423-7436
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Structural and Fire Engineering.ORCID iD: 0000-0002-5154-7044
Show others and affiliations
2021 (English)In: International Conference of the European Association on Quality Control of Bridges and Structures: EUROSTRUCT 2021: Proceedings of the 1st Conference of the European Association on Quality Control of Bridges and Structures / [ed] Carlo Pellegrino; Flora Faleschini; Mariano Angelo Zanini; José C. Matos; Joan R. Casas; Alfred Strauss, Springer, 2021, p. 713-720Conference paper, Published paper (Refereed)
Abstract [en]

Conventional bridge inspection is usually performed by experienced engineers, trying to detect and document damage patterns manually. By increased number of built Bridges, there is a growing interest in automated damage detection methods. Therefore, the field of autonomous bridge inspection with the application of machine learning techniques on UAV-taken images is gaining popularity. Due to recent technological advancement, a large number of datasets can be collected, with a high rate of productivity and accuracy, to train convolutional neural networks (CNNs) leading us to automated Structural health monitoring (SHM). In this paper, a case study is chosen to scan two times with almost one year as a time interval. In the first scanning, dataset was gathered to train four different CNNs. Then, the performance of CNNs was compared for the purpose of autonomous crack detection in the second round of scanning. Models evaluated on a number of performance metrics, namely- (i) accuracy, (ii) loss, (iii) computation time, (iv) model size, and (v) architectural depth. Finally, the performance of studied CNNs is discussed, which can lead researchers in the Transfer-Learning approach to generate a model for damage detection with a limited number of datasets prepared in the first turn of bridge inspection. 

Place, publisher, year, edition, pages
Springer, 2021. p. 713-720
Series
Lecture Notes in Civil Engineering (LNCE), ISSN 2366-2557, E-ISSN 2366-2565 ; 200
Keywords [en]
Structural health monitoring, Crack detection, Inception v3, GoogleNet, ResNet-50, VGG-19
National Category
Infrastructure Engineering
Research subject
Structural Engineering
Identifiers
URN: urn:nbn:se:ltu:diva-88655DOI: 10.1007/978-3-030-91877-4_81Scopus ID: 2-s2.0-85121924067OAI: oai:DiVA.org:ltu-88655DiVA, id: diva2:1624598
Conference
1st Conference of the European Association on Quality Control of Bridges and Structures (EUROSTRUCT2021) August 29 - September 1 2021, Padova, Italy
Note

ISBN för värdpublikation: 978-3-030-91876-7, 978-3-030-91877-4

Available from: 2022-01-04 Created: 2022-01-04 Last updated: 2023-10-20Bibliographically approved
In thesis
1. An Algorithmic Framework for Intelligent Concrete Structural Defects Detection and Classification
Open this publication in new window or tab >>An Algorithmic Framework for Intelligent Concrete Structural Defects Detection and Classification
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The primary objective of inspecting concrete civil structures is to gather information concerning the deterioration of concrete elements, including issues like concrete cover cracking, delamination, or corrosion. Typically, this data is documented through field inspection notes, hand-drawn sketches, and photographs. Unfortunately, this information is often stored in diverse formats, relying on close-range images and paper-based records. Moreover, the process heavily depends on the inspector's experience, structural knowledge, and familiarity with the material properties of the system under investigation. Traditional inspection methods have inherent limitations, as they generally focus on easily accessible areas due to time constraints, safety concerns, or the challenging terrains often encountered in the field. This is particularly relevant when inspecting large structures like bridges, where examining the entire area would be time-consuming and potentially unsafe. The transfer of knowledge from one inspection period to the next becomes problematic when different inspectors are involved. Hence, there is a compelling need to explore modern inspection and monitoring techniques for structures, with a focus on reducing disruption and enhancing the efficiency and reliability of data acquisition.

In this context, the previously published licentiate thesis was aimed to contribute by developing optical alternatives that complement existing techniques. These alternatives should be cost-effective, suitable for on-site application, and easily deployable. To align with the objectives of this research project, the following research questions were addressed before in the licentiate seminar:

1.    How accurate is Close-Range Photogrammetry (CRP) for monitoring geometric deviations and detecting defects?

2.    In pursuit of maximum accuracy and minimal computation time in crack detection, which convolutional neural network (CNN) architecture performs best in classification and semantic segmentation tasks?

3.    Is there a correlation between surface deformations in reinforced concrete, measured through Digital Image Correlation (DIC), and strains in the embedded reinforcement?

However, there are still challenges to be addressed. Concrete civil structure inspection involves more than just defect detection and measurement. In this final thesis, the objective is to discuss an algorithm for creating an intelligent machine capable of classifying concrete defects. This requires the computer, acting as the inspector, to possess substantial knowledge about the concrete structure, including protocols, standards, guidelines, and an understanding of the overall structure's status. Consequently, two additional research questions are introduced:

1.    Building on our previous discussion in the licentiate seminar regarding the correlation between surface deformations and strains in embedded rebars, we aim to enhance the accuracy of the strain estimation. To achieve this, we intend to train intelligent regression models using available experimental data and newly generated synthetic data. Research Question 1: How can we estimate strains on embedded rebars with the application of machine learning regression, employing a hybrid-learning approach? This question is explored in the paper "Prediction of strain in embedded rebars for RC member: application of a hybrid learning approach."

2.    While computer vision techniques are effective in defect detection, structural health assessment encompasses more than just identifying defects. The objective is to provide a comprehensive solution that bridges the gap between defect detection, classification, and assessment, ultimately contributing to a more accurate understanding of detected defects. Research Question 2: How can we bridge the gap between defect detection and classification to achieve effective defect classification? This question is the subject of the forthcoming manuscript, "Defect Classification and Structural Assessment of Concrete Bridges: A Data-Driven Decision-Making Approach".

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2023
Series
Doctoral thesis / Luleå University of Technology 1 jan 1997 → …, ISSN 1402-1544
Keywords
Civil Engineering Structures, defect detection, Structural Health Assessment, Bridge Inspection, Computer Vision, Point-Cloud Generation, Severity Assessment, Machine Learning Regression, Bridge 3D Modeling, Unmanned Inspections
National Category
Infrastructure Engineering Building Technologies
Research subject
Structural Engineering
Identifiers
urn:nbn:se:ltu:diva-101744 (URN)978-91-8048-416-9 (ISBN)978-91-8048-417-6 (ISBN)
Public defence
2023-12-14, F 341, Luleå tekniska universitet, Luleå, 10:00 (English)
Opponent
Supervisors
Funder
Swedish Research Council Formas, 2019-01515
Available from: 2023-10-20 Created: 2023-10-20 Last updated: 2023-11-23Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Mirzazade, AliNodeh, Maryam PahlavanPopescu, CosminBlanksvärd, ThomasTäljsten, Björn

Search in DiVA

By author/editor
Mirzazade, AliNodeh, Maryam PahlavanPopescu, CosminBlanksvärd, ThomasTäljsten, Björn
By organisation
Structural and Fire EngineeringEmbedded Internet Systems Lab
Infrastructure Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 219 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf