Three-Dimensional Reconstruction from a Single RGB Image Using Deep Learning: A ReviewShow others and affiliations
2022 (English)In: Journal of Imaging, E-ISSN 2313-433X, Vol. 8, no 9, article id 225Article, review/survey (Refereed) Published
Abstract [en]
Performing 3D reconstruction from a single 2D input is a challenging problem that is trending in literature. Until recently, it was an ill-posed optimization problem, but with the advent of learning-based methods, the performance of 3D reconstruction has also significantly improved. Infinitely many different 3D objects can be projected onto the same 2D plane, which makes the reconstruction task very difficult. It is even more difficult for objects with complex deformations or no textures. This paper serves as a review of recent literature on 3D reconstruction from a single view, with a focus on deep learning methods from 2018 to 2021. Due to the lack of standard datasets or 3D shape representation methods, it is hard to compare all reviewed methods directly. However, this paper reviews different approaches for reconstructing 3D shapes as depth maps, surface normals, point clouds, and meshes; along with various loss functions and metrics used to train and evaluate these methods.
Place, publisher, year, edition, pages
MDPI, 2022. Vol. 8, no 9, article id 225
Keywords [en]
deep learning, 3D reconstruction, convolutional neural networks, textureless surfaces
National Category
Computer graphics and computer vision Computational Mathematics
Research subject
Machine Learning
Identifiers
URN: urn:nbn:se:ltu:diva-92727DOI: 10.3390/jimaging8090225ISI: 000856378500001PubMedID: 36135391Scopus ID: 2-s2.0-85139006500OAI: oai:DiVA.org:ltu-92727DiVA, id: diva2:1691928
Funder
EU, Horizon 2020, 883293 INFINITY
Note
Validerad;2022;Nivå 2;2022-09-02 (hanlid);
Part of special issue: Geometry Reconstruction from Images
2022-08-312022-08-312025-02-01Bibliographically approved