Domain Adaptable Self-supervised Representation Learning on Remote Sensing Satellite Imagery Show others and affiliations
2023 (English) In: IJCNN 2023 - International Joint Conference on Neural Networks, Conference Proceedings, Institute of Electrical and Electronics Engineers Inc. , 2023Conference paper, Published paper (Refereed)
Abstract [en]
This work presents a novel domain adaption paradigm for studying contrastive self-supervised representation learning and knowledge transfer using remote sensing satellite data. Major state-of-the-art remote sensing visual domain ef-forts primarily focus on fully supervised learning approaches that rely entirely on human annotations. On the other hand, human annotations in remote sensing satellite imagery are always subject to limited quantity due to high costs and domain expertise, making transfer learning a viable alternative. The proposed approach investigates the knowledge transfer of self-supervised representations across the distinct source and target data distributions in depth in the remote sensing data domain. In this arrangement, self-supervised contrastive learning- based pretraining is performed on the source dataset, and downstream tasks are performed on the target datasets in a round-robin fashion. Experiments are conducted on three publicly avail-able datasets, UC Merced Landuse (UCMD), SIRI-WHU, and MLRSNet, for different downstream classification tasks versus label efficiency. In self-supervised knowledge transfer, the pro-posed approach achieves state-of-the-art performance with label efficiency labels and outperforms a fully supervised setting. A more in-depth qualitative examination reveals consistent evidence for explainable representation learning. The source code and trained models are published on GitHub1.
Place, publisher, year, edition, pages Institute of Electrical and Electronics Engineers Inc. , 2023.
Series
Proceedings of the International Joint Conference on Neural Networks, ISSN 2161-4393, E-ISSN 2161-4407
Keywords [en]
contrastive learning, domain adaptation, remote sensing, representation learning, satellite image, self-supervised learning
National Category
Computer Sciences Signal Processing
Research subject Machine Learning
Identifiers URN: urn:nbn:se:ltu:diva-101307 DOI: 10.1109/IJCNN54540.2023.10191249 ISI: 001046198701085 Scopus ID: 2-s2.0-85169612572 ISBN: 978-1-6654-8868-6 (print) ISBN: 978-1-6654-8867-9 (electronic) OAI: oai:DiVA.org:ltu-101307 DiVA, id: diva2:1796213
Conference 2023 International Joint Conference on Neural Networks, IJCNN 2023, Gold Coast, Australia, June 18-23, 2023
2023-09-122023-09-122024-03-07 Bibliographically approved