Academic Journal
Stereo Matching in Satellite Imagery: A Depth Estimation Foundation Model-Assisted Iterative Approach.
| Τίτλος: | Stereo Matching in Satellite Imagery: A Depth Estimation Foundation Model-Assisted Iterative Approach. |
|---|---|
| Συγγραφείς: | Hu, Kunpeng, Zhao, Wei |
| Πηγή: | Remote Sensing; Jul2026, Vol. 18 Issue 13, p2245, 33p |
| Θεματικοί όροι: | Remote sensing, Binocular vision, Remote-sensing images, Machine learning, Iterative methods (Mathematics), Three-dimensional imaging, Depth maps (Digital image processing) |
| Περίληψη: | Highlights: What are the main findings? We propose IFMA-Stereo, a novel iterative-based foundation model-assisted stereo matching method for remote sensing. This method incorporates scene structure priors from a depth estimation foundation model into the iterative disparity optimization process at both the feature and pixel levels. It achieves mutual guidance and collaborative optimization between depth information and disparity estimation, thereby overcoming the limitations of existing remote sensing disparity estimation approaches. The model achieves superior accuracy in texture-less, repetitive-pattern and occluded regions, and effectively mitigates errors caused by spatio-temporal heterogeneity. What are the implications of the main findings? By leveraging geometric priors from a foundation model (feature-level) and iterative refinement (pixel-level), the approach provides a new pathway to overcome dataset scarcity and generalizes robustly across unseen urban areas. The successful coupling of monocular depth and stereo matching offers a framework to address binocular matching failures (e.g., from occlusions or scene changes), enhancing the reliability of large-scale 3D reconstruction from satellite imagery. In optical remote sensing 3D reconstruction, high-resolution satellite stereo matching is a critical task, yet it is challenged by extreme imaging geometries, texture-less and repetitive patterns, occlusions, and scene variations caused by spatio-temporal heterogeneity. To address these issues, we propose IFMA-Stereo, an innovative binocular disparity estimation method that leverages a monocular depth foundation model. Our approach constructs a multi-scale spatial information pyramid to jointly integrate the foundation model with a disparity extraction network. At the feature level, an attention interaction mechanism captures multi-dimensional contextual dependencies and transforms general scene understanding priors into long-range associative features suitable for stereo cost volume construction. At the pixel level, a cyclic iterative refinement module embeds depth information from the foundation model throughout the iteration process and performs joint optimization, enhancing the model's adaptability in geometrically complex regions. Experiments on the US3D and GaoFen-7 datasets demonstrate that IFMA-Stereo achieves superior performance in challenging areas (texture-less regions, disparity discontinuities, repetitive patterns) and effectively mitigates prediction errors caused by spatio-temporal heterogeneity, albeit at the cost of increased inference time compared to baseline methods. Quantitatively, the method achieves an end-point error (EPE) of 1.347 and a D1 error of 7.26% on the US3D dataset, and an EPE of 1.585 and a D1 error of 13.41% on the GaoFen-7 dataset. Notably, the method also yields precise predictions for unseen urban areas, indicating strong generalization. These results confirm that IFMA-Stereo achieves state-of-the-art accuracy in remote sensing disparity estimation. [ABSTRACT FROM AUTHOR] |
| Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Βάση Δεδομένων: | Complementary Index |
καταχωρήστε σχόλιο πρώτοι!