Academic Journal
Stereo Matching in Satellite Imagery: A Depth Estimation Foundation Model-Assisted Iterative Approach.
| Title: | Stereo Matching in Satellite Imagery: A Depth Estimation Foundation Model-Assisted Iterative Approach. |
|---|---|
| Authors: | Hu, Kunpeng, Zhao, Wei |
| Source: | Remote Sensing; Jul2026, Vol. 18 Issue 13, p2245, 33p |
| Subject Terms: | Remote sensing, Binocular vision, Remote-sensing images, Machine learning, Iterative methods (Mathematics), Three-dimensional imaging, Depth maps (Digital image processing) |
| Abstract: | Highlights: What are the main findings? We propose IFMA-Stereo, a novel iterative-based foundation model-assisted stereo matching method for remote sensing. This method incorporates scene structure priors from a depth estimation foundation model into the iterative disparity optimization process at both the feature and pixel levels. It achieves mutual guidance and collaborative optimization between depth information and disparity estimation, thereby overcoming the limitations of existing remote sensing disparity estimation approaches. The model achieves superior accuracy in texture-less, repetitive-pattern and occluded regions, and effectively mitigates errors caused by spatio-temporal heterogeneity. What are the implications of the main findings? By leveraging geometric priors from a foundation model (feature-level) and iterative refinement (pixel-level), the approach provides a new pathway to overcome dataset scarcity and generalizes robustly across unseen urban areas. The successful coupling of monocular depth and stereo matching offers a framework to address binocular matching failures (e.g., from occlusions or scene changes), enhancing the reliability of large-scale 3D reconstruction from satellite imagery. In optical remote sensing 3D reconstruction, high-resolution satellite stereo matching is a critical task, yet it is challenged by extreme imaging geometries, texture-less and repetitive patterns, occlusions, and scene variations caused by spatio-temporal heterogeneity. To address these issues, we propose IFMA-Stereo, an innovative binocular disparity estimation method that leverages a monocular depth foundation model. Our approach constructs a multi-scale spatial information pyramid to jointly integrate the foundation model with a disparity extraction network. At the feature level, an attention interaction mechanism captures multi-dimensional contextual dependencies and transforms general scene understanding priors into long-range associative features suitable for stereo cost volume construction. At the pixel level, a cyclic iterative refinement module embeds depth information from the foundation model throughout the iteration process and performs joint optimization, enhancing the model's adaptability in geometrically complex regions. Experiments on the US3D and GaoFen-7 datasets demonstrate that IFMA-Stereo achieves superior performance in challenging areas (texture-less regions, disparity discontinuities, repetitive patterns) and effectively mitigates prediction errors caused by spatio-temporal heterogeneity, albeit at the cost of increased inference time compared to baseline methods. Quantitatively, the method achieves an end-point error (EPE) of 1.347 and a D1 error of 7.26% on the US3D dataset, and an EPE of 1.585 and a D1 error of 13.41% on the GaoFen-7 dataset. Notably, the method also yields precise predictions for unseen urban areas, indicating strong generalization. These results confirm that IFMA-Stereo achieves state-of-the-art accuracy in remote sensing disparity estimation. [ABSTRACT FROM AUTHOR] |
| Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Complementary Index |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://resolver.ebsco.com/c/fiv2js/result?sid=EBSCO:edb&genre=article&issn=20724292&ISBN=&volume=18&issue=13&date=20260701&spage=2245&pages=2245-2277&title=Remote Sensing&atitle=Stereo%20Matching%20in%20Satellite%20Imagery%3A%20A%20Depth%20Estimation%20Foundation%20Model-Assisted%20Iterative%20Approach.&aulast=Hu%2C%20Kunpeng&id=DOI:10.3390/rs18132245 Name: Full Text Finder (for New FTF UI) (ns324271) Category: fullText Text: Full Text Finder MouseOverText: Full Text Finder |
|---|---|
| Header | DbId: edb DbLabel: Complementary Index An: 195440589 RelevancyScore: 1082 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 1082.42175292969 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Stereo Matching in Satellite Imagery: A Depth Estimation Foundation Model-Assisted Iterative Approach. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Hu%2C+Kunpeng%22">Hu, Kunpeng</searchLink><br /><searchLink fieldCode="AR" term="%22Zhao%2C+Wei%22">Zhao, Wei</searchLink> – Name: TitleSource Label: Source Group: Src Data: Remote Sensing; Jul2026, Vol. 18 Issue 13, p2245, 33p – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Remote+sensing%22">Remote sensing</searchLink><br /><searchLink fieldCode="DE" term="%22Binocular+vision%22">Binocular vision</searchLink><br /><searchLink fieldCode="DE" term="%22Remote-sensing+images%22">Remote-sensing images</searchLink><br /><searchLink fieldCode="DE" term="%22Machine+learning%22">Machine learning</searchLink><br /><searchLink fieldCode="DE" term="%22Iterative+methods+%28Mathematics%29%22">Iterative methods (Mathematics)</searchLink><br /><searchLink fieldCode="DE" term="%22Three-dimensional+imaging%22">Three-dimensional imaging</searchLink><br /><searchLink fieldCode="DE" term="%22Depth+maps+%28Digital+image+processing%29%22">Depth maps (Digital image processing)</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Highlights: What are the main findings? We propose IFMA-Stereo, a novel iterative-based foundation model-assisted stereo matching method for remote sensing. This method incorporates scene structure priors from a depth estimation foundation model into the iterative disparity optimization process at both the feature and pixel levels. It achieves mutual guidance and collaborative optimization between depth information and disparity estimation, thereby overcoming the limitations of existing remote sensing disparity estimation approaches. The model achieves superior accuracy in texture-less, repetitive-pattern and occluded regions, and effectively mitigates errors caused by spatio-temporal heterogeneity. What are the implications of the main findings? By leveraging geometric priors from a foundation model (feature-level) and iterative refinement (pixel-level), the approach provides a new pathway to overcome dataset scarcity and generalizes robustly across unseen urban areas. The successful coupling of monocular depth and stereo matching offers a framework to address binocular matching failures (e.g., from occlusions or scene changes), enhancing the reliability of large-scale 3D reconstruction from satellite imagery. In optical remote sensing 3D reconstruction, high-resolution satellite stereo matching is a critical task, yet it is challenged by extreme imaging geometries, texture-less and repetitive patterns, occlusions, and scene variations caused by spatio-temporal heterogeneity. To address these issues, we propose IFMA-Stereo, an innovative binocular disparity estimation method that leverages a monocular depth foundation model. Our approach constructs a multi-scale spatial information pyramid to jointly integrate the foundation model with a disparity extraction network. At the feature level, an attention interaction mechanism captures multi-dimensional contextual dependencies and transforms general scene understanding priors into long-range associative features suitable for stereo cost volume construction. At the pixel level, a cyclic iterative refinement module embeds depth information from the foundation model throughout the iteration process and performs joint optimization, enhancing the model's adaptability in geometrically complex regions. Experiments on the US3D and GaoFen-7 datasets demonstrate that IFMA-Stereo achieves superior performance in challenging areas (texture-less regions, disparity discontinuities, repetitive patterns) and effectively mitigates prediction errors caused by spatio-temporal heterogeneity, albeit at the cost of increased inference time compared to baseline methods. Quantitatively, the method achieves an end-point error (EPE) of 1.347 and a D1 error of 7.26% on the US3D dataset, and an EPE of 1.585 and a D1 error of 13.41% on the GaoFen-7 dataset. Notably, the method also yields precise predictions for unseen urban areas, indicating strong generalization. These results confirm that IFMA-Stereo achieves state-of-the-art accuracy in remote sensing disparity estimation. [ABSTRACT FROM AUTHOR] – Name: Abstract Label: Group: Ab Data: <i>Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edb&AN=195440589 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3390/rs18132245 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 33 StartPage: 2245 Subjects: – SubjectFull: Remote sensing Type: general – SubjectFull: Binocular vision Type: general – SubjectFull: Remote-sensing images Type: general – SubjectFull: Machine learning Type: general – SubjectFull: Iterative methods (Mathematics) Type: general – SubjectFull: Three-dimensional imaging Type: general – SubjectFull: Depth maps (Digital image processing) Type: general Titles: – TitleFull: Stereo Matching in Satellite Imagery: A Depth Estimation Foundation Model-Assisted Iterative Approach. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Hu, Kunpeng – PersonEntity: Name: NameFull: Zhao, Wei IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 07 Text: Jul2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 20724292 Numbering: – Type: volume Value: 18 – Type: issue Value: 13 Titles: – TitleFull: Remote Sensing Type: main |
| ResultId | 1 |