UAV-based automated earthwork progress monitoring using deep learning with image inpainting

ERSÖZ A. B., PEKCAN O.

Automation in Construction, cilt.175, 2025 (SCI-Expanded, Scopus) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 175
  • Basım Tarihi: 2025
  • Doi Numarası: 10.1016/j.autcon.2025.106211
  • Dergi Adı: Automation in Construction
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Aerospace Database, Communication Abstracts, Compendex, ICONDA Bibliographic, INSPEC, Metadex, Civil Engineering Abstracts
  • Anahtar Kelimeler: Deep learning, Earthwork volume calculation, Image inpainting, Image segmentation, UAV photogrammetry
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

Accurate monitoring of earthwork progress is crucial in construction due to its significant costs and potential delays. Traditional methods are labor-intensive and pose safety risks. Unmanned Aerial Vehicle (UAV) photogrammetry offers a promising alternative. However, the presence of moving machinery can distort earthwork progress in generated point clouds. This paper addresses this challenge by integrating deep learning-based segmentation and image inpainting techniques to remove machinery from aerial images. The AIDCON dataset was used to train the Pointrend algorithm for machinery segmentation, achieving an average precision exceeding 90% across common machinery categories. The identified machinery was removed using the LaMa inpainting algorithm. Field experiments validated that the UAV-based net volume calculations closely matched the laser scanning results with less than 6% deviation, and both methods aligned with truck count estimates. Furthermore, the required time was reduced from several days to hours, lowering labor costs and enhancing safety.