Log detection for autonomous forwarding using auto-annotated data from a real-time virtual environment
2026 (English)In: Journal of terramechanics, ISSN 0022-4898, E-ISSN 1879-1204, Vol. 121, article id 101096Article in journal (Refereed) Published
Abstract [en]
Object detectors for autonomous forestry operations have previously been developed mainly by training on physical manually annotated data, which is both time-consuming and costly. Since the ground truth in the virtual model is known, the training data can be auto-annotated, enabling the creation of larger training datasets, while also improving time and cost efficiency. In this work, a virtual environment in Unity is used in co-simulation with a real-time digital twin of a physical forestry vehicle, to generate realistic auto-annotated training data, as captured by an onboard stereo camera. First, it is shown that a log detector trained on physical data can detect logs in the virtual environment. Second, new detectors are trained, using different shares of virtual and physical data. It is shown that a detector trained using only virtual data, can learn to detect logs in the physical world. Moreover, virtual pre-training is shown to improve the performance of physically trained and tested detectors, both at low availability of physical training data, and in terms of domain generalization. A detailed detector performance analysis also highlights further potential and opportunities for future improvements. Furthermore, the real-time capable virtual models enable future machine learning tasks utilizing different levels of Hardware-in-the-Loop.
Place, publisher, year, edition, pages
International Society for Terrain-Vehicle Systems (ISTVS) , 2026. Vol. 121, article id 101096
Keywords [en]
Transfer learning, Domain generalization, Virtual training, Auto-annotation, Real-time, Logging, Tree harvesting, Forwarder, Cut-to-length, CTL
National Category
Computer graphics and computer vision
Research subject
Machine Design
Identifiers
URN: urn:nbn:se:ltu:diva-114870DOI: 10.1016/j.jterra.2025.101096ISI: 001577666600001Scopus ID: 2-s2.0-105016454462OAI: oai:DiVA.org:ltu-114870DiVA, id: diva2:2000319
Projects
Sustainable Autonomous Material Handling (SAMHand)AutoPlant 3
Funder
Norrbotten County Council, NYPS 20357986Interreg Aurora, NYPS 20357984Vinnova, 2023-02747The Kempe Foundations, JCSMKJF23-0004Luleå University of Technology, Jubilee Fund
Note
Validerad;2025;Nivå 2;2025-09-23 (u8);
Funder: Skogstekniska Klustret (The Cluster of Forest Technology);
Full text license: CC BY
2025-09-232025-09-232025-11-28Bibliographically approved