Comparison of state-of-The-Art multi-view stereo solutions for close range heritage documentation

  • A. Murtiyoso
  • , J. Markiewicz
  • , A. K. Karwel
  • , P. Grussenmeyer
  • , P. Kot

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

In recent years novel 3D reconstruction methods have been developed to improve the conventional image-based point cloud generation techniques. These novel methods generally attempt to address various challenges encountered in conventional methods, namely, the reconstruction of reflective surfaces and the amount of processing time required, both of which are major bottlenecks in heritage documentation and especially those related to large and complex objects. In this paper, we identified three types of 3D image-based reconstruction techniques and tested their usage on heritage datasets, namely (1) conventional multi-view stereo (MVS), (2) learningbased MVS, and (3) neural radiance fields (NeRF). The aim of this study is to determine the capabilities of these methods in reconstruction of three different heritage-related datasets with different challenges. Our results show that conventional MVS is nowadays a reliable solution for 3D reconstruction, in many instances recording good results relative to the reference terrestrial laser scans (TLS) when properly deployed. When applied to a challenging highly reflective scene, conventional MVS fared well using the PatchMatch algorithm (reaching an object completeness rate of 99.05%), while NeRF s best performance was 99.98%. However, NeRF suffered from noisy data, some of which may stem from its radiance field-To-point cloud conversion method. The results show that there is great potential in using specific methods for specific cases, and research in combining them may yield interesting results in the future.

Original languageEnglish
Title of host publicationThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Pages317-323
Number of pages7
Volume48
Edition2
DOIs
Publication statusPublished - 14 Feb 2024
Externally publishedYes
Event10th International Workshop 3D-ARCH "3D Virtual Reconstruction and Visualization of Complex Architectures" - Siena, Italy
Duration: 21 Feb 202423 Feb 2024

Publication series

NameInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
PublisherInternational Society for Photogrammetry and Remote Sensing
ISSN (Print)1682-1750

Conference

Conference10th International Workshop 3D-ARCH "3D Virtual Reconstruction and Visualization of Complex Architectures"
Country/TerritoryItaly
CitySiena
Period21/02/2423/02/24

Keywords

  • Close-range
  • Documentation
  • Heritage
  • Learning-based
  • MVS
  • NeRF
  • Photogrammetry

Fingerprint

Dive into the research topics of 'Comparison of state-of-The-Art multi-view stereo solutions for close range heritage documentation'. Together they form a unique fingerprint.

Cite this