Improving the pair selection and the model fusion steps of satellite multi-view stereo pipelines

Gómez, Alvaro - Randall, Gregory - Facciolo, Gabriele - Grompone von Gioi, Rafael

Resumen:

Multi-view stereo reconstruction of scenes from satellite images is traditionally performed with a pair-wise stereovision approach: (1) multiple views are grouped into pairs, (2) each pair is processed by two-view stereo methods producing an elevation model or point cloud, lastly (3) the pairwise reconstructions are integrated and filtered to obtain a final result. These steps are organized in a pipeline and the end-to-end performance of reconstructions depends on the behavior of these steps. This work introduces two changes that increase the performance of the reconstructions: a new pair selection approach and a new integration method are presented. The new pair selection replaces commonly used heuristics with a principled criterion that predicts the completeness of a pair based on offline simulations. The presented integration method is based on an iterated bilateral filter. Experiments show that these changes yield a systematic improvement on the performance of the pipeline.


Detalles Bibliográficos
2023
Point cloud compression
Computer vision
Satellites
Systematics
Computational modeling
Pipelines
Predictive models
Applications
Remote Sensing
Inglés
Universidad de la República
COLIBRI
https://ieeexplore.ieee.org/document/10030230
https://openaccess.thecvf.com/content/WACV2023/html/Gomez_Improving_the_Pair_Selection_and_the_Model_Fusion_Steps_of_WACV_2023_paper.html
https://hdl.handle.net/20.500.12008/35934
Acceso abierto
Licencia Creative Commons Atribución - No Comercial - Sin Derivadas (CC - By-NC-ND 4.0)
Resumen:
Sumario:Multi-view stereo reconstruction of scenes from satellite images is traditionally performed with a pair-wise stereovision approach: (1) multiple views are grouped into pairs, (2) each pair is processed by two-view stereo methods producing an elevation model or point cloud, lastly (3) the pairwise reconstructions are integrated and filtered to obtain a final result. These steps are organized in a pipeline and the end-to-end performance of reconstructions depends on the behavior of these steps. This work introduces two changes that increase the performance of the reconstructions: a new pair selection approach and a new integration method are presented. The new pair selection replaces commonly used heuristics with a principled criterion that predicts the completeness of a pair based on offline simulations. The presented integration method is based on an iterated bilateral filter. Experiments show that these changes yield a systematic improvement on the performance of the pipeline.