Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Semi-autonomous inspection for concrete structures using digital models and a hybrid approach based on deep learning and photogrammetry
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Structural and Fire Engineering.ORCID iD: 0000-0002-1375-3322
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Structural and Fire Engineering. SINTEF Narvik AS, 8517 Narvik, Norway.ORCID iD: 0000-0001-9423-7436
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Structural and Fire Engineering.ORCID iD: 0000-0003-3548-6082
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Structural and Fire Engineering.ORCID iD: 0000-0002-5154-7044
Show others and affiliations
2023 (English)In: Journal of Civil Structural Health Monitoring, ISSN 2190-5452, Vol. 13, no 8, p. 1633-1652Article in journal (Refereed) Published
Abstract [en]

Bridge inspections are relied heavily on visual inspection, and usually conducted within limited time windows, typically at night, to minimize their impact on traffic. This makes it difficult to inspect every meter of the structure, especially for large-scale bridges with hard-to-access areas, which creates a risk of missing serious defects or even safety hazards. This paper presents a new technique for the semi-automated damage detection in tunnel linings and bridges using a hybrid approach based on photogrammetry and deep learning. The first approach involves using photogrammetry to reconstruct a 3D model. It is shown that a model with sub-centimeter accuracy can be obtained after noise removal. However, noise removal also reduces the point cloud density, making the 3D point cloud unsuitable for quantification of small-scale damages such as fine cracks. Therefore, the captured images are also analyzed using deep convolutional neural network (CNN) models to enable crack detection and segmentation. For this aim, in the second approach, the 3D model is generated by the output of CNN models to enable crack localization and quantification on 3D digital model. These two approaches were evaluated in separate case studies, showing that the proposed technique could be a valuable tool to assist human inspectors in detecting, localizing, and quantifying defects on concrete structures.

Place, publisher, year, edition, pages
Springer Nature, 2023. Vol. 13, no 8, p. 1633-1652
Keywords [en]
Bridge inspection, Computer vision, Photogrammetry, Damage detection, Damage segmentation, UAV
National Category
Infrastructure Engineering
Research subject
Structural Engineering
Identifiers
URN: urn:nbn:se:ltu:diva-95443DOI: 10.1007/s13349-023-00680-xISI: 000921813700002Scopus ID: 2-s2.0-85146975670OAI: oai:DiVA.org:ltu-95443DiVA, id: diva2:1732417
Funder
Swedish Research Council Formas, 2019-01515EU, Horizon 2020, 101012456 IN2TRACK3
Note

Validerad;2024;Nivå 2;2024-04-02 (hanlid);

Full text license: CC BY 4.0

Available from: 2023-01-31 Created: 2023-01-31 Last updated: 2025-10-21Bibliographically approved
In thesis
1. An Algorithmic Framework for Intelligent Concrete Structural Defects Detection and Classification
Open this publication in new window or tab >>An Algorithmic Framework for Intelligent Concrete Structural Defects Detection and Classification
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The primary objective of inspecting concrete civil structures is to gather information concerning the deterioration of concrete elements, including issues like concrete cover cracking, delamination, or corrosion. Typically, this data is documented through field inspection notes, hand-drawn sketches, and photographs. Unfortunately, this information is often stored in diverse formats, relying on close-range images and paper-based records. Moreover, the process heavily depends on the inspector's experience, structural knowledge, and familiarity with the material properties of the system under investigation. Traditional inspection methods have inherent limitations, as they generally focus on easily accessible areas due to time constraints, safety concerns, or the challenging terrains often encountered in the field. This is particularly relevant when inspecting large structures like bridges, where examining the entire area would be time-consuming and potentially unsafe. The transfer of knowledge from one inspection period to the next becomes problematic when different inspectors are involved. Hence, there is a compelling need to explore modern inspection and monitoring techniques for structures, with a focus on reducing disruption and enhancing the efficiency and reliability of data acquisition.

In this context, the previously published licentiate thesis was aimed to contribute by developing optical alternatives that complement existing techniques. These alternatives should be cost-effective, suitable for on-site application, and easily deployable. To align with the objectives of this research project, the following research questions were addressed before in the licentiate seminar:

1.    How accurate is Close-Range Photogrammetry (CRP) for monitoring geometric deviations and detecting defects?

2.    In pursuit of maximum accuracy and minimal computation time in crack detection, which convolutional neural network (CNN) architecture performs best in classification and semantic segmentation tasks?

3.    Is there a correlation between surface deformations in reinforced concrete, measured through Digital Image Correlation (DIC), and strains in the embedded reinforcement?

However, there are still challenges to be addressed. Concrete civil structure inspection involves more than just defect detection and measurement. In this final thesis, the objective is to discuss an algorithm for creating an intelligent machine capable of classifying concrete defects. This requires the computer, acting as the inspector, to possess substantial knowledge about the concrete structure, including protocols, standards, guidelines, and an understanding of the overall structure's status. Consequently, two additional research questions are introduced:

1.    Building on our previous discussion in the licentiate seminar regarding the correlation between surface deformations and strains in embedded rebars, we aim to enhance the accuracy of the strain estimation. To achieve this, we intend to train intelligent regression models using available experimental data and newly generated synthetic data. Research Question 1: How can we estimate strains on embedded rebars with the application of machine learning regression, employing a hybrid-learning approach? This question is explored in the paper "Prediction of strain in embedded rebars for RC member: application of a hybrid learning approach."

2.    While computer vision techniques are effective in defect detection, structural health assessment encompasses more than just identifying defects. The objective is to provide a comprehensive solution that bridges the gap between defect detection, classification, and assessment, ultimately contributing to a more accurate understanding of detected defects. Research Question 2: How can we bridge the gap between defect detection and classification to achieve effective defect classification? This question is the subject of the forthcoming manuscript, "Defect Classification and Structural Assessment of Concrete Bridges: A Data-Driven Decision-Making Approach".

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2023
Series
Doctoral thesis / Luleå University of Technology, ISSN 1402-1544
Keywords
Civil Engineering Structures, defect detection, Structural Health Assessment, Bridge Inspection, Computer Vision, Point-Cloud Generation, Severity Assessment, Machine Learning Regression, Bridge 3D Modeling, Unmanned Inspections
National Category
Infrastructure Engineering Building Technologies
Research subject
Structural Engineering
Identifiers
urn:nbn:se:ltu:diva-101744 (URN)978-91-8048-416-9 (ISBN)978-91-8048-417-6 (ISBN)
Public defence
2023-12-14, F 341, Luleå tekniska universitet, Luleå, 10:00 (English)
Opponent
Supervisors
Funder
Swedish Research Council Formas, 2019-01515
Available from: 2023-10-20 Created: 2023-10-20 Last updated: 2025-10-21Bibliographically approved

Open Access in DiVA

fulltext(15986 kB)198 downloads
File information
File name FULLTEXT02.pdfFile size 15986 kBChecksum SHA-512
3b58cba644a3d9e3a05c894a92967acfc0da4b7e96de0254396d78c5d4781ffb93e8cbe5445e3255e23294568adca604f59e9fc86a37b073026275cd010ce513
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Mirzazade, AliPopescu, CosminGonzalez-Libreros, JaimeBlanksvärd, ThomasTäljsten, BjörnSas, Gabriel

Search in DiVA

By author/editor
Mirzazade, AliPopescu, CosminGonzalez-Libreros, JaimeBlanksvärd, ThomasTäljsten, BjörnSas, Gabriel
By organisation
Structural and Fire Engineering
Infrastructure Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 453 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 570 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf