Motion Artifact Correction in Deep-Tissue Three-Photon Fluorescence Microscopy Using Adaptive Optical Flow Learning With Transformer.

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Motion Artifact Correction in Deep-Tissue Three-Photon Fluorescence Microscopy Using Adaptive Optical Flow Learning With Transformer.
Συγγραφείς: Li Y; State Key Laboratory of Extreme Photonics and Instrumentation, Centre for Optical and Electromagnetic Research, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou, China., Zhang R; The School of Electrical and Information Engineering, Tianjin University, Tianjin, China., Li K; Zhejiang University-University of Edinburgh Institute, Zhejiang University, School of Medicine, Haining, China., Wang Y; School of Information and Electronic Engineering, Zhejiang Gongshang University, Hangzhou, China., He M; State Key Laboratory of Extreme Photonics and Instrumentation, Centre for Optical and Electromagnetic Research, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou, China., Qian J; State Key Laboratory of Extreme Photonics and Instrumentation, Centre for Optical and Electromagnetic Research, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou, China.
Πηγή: Journal of biophotonics [J Biophotonics] 2025 Dec; Vol. 18 (12), pp. e202500407. Date of Electronic Publication: 2025 Aug 17.
Τύπος έκδοσης: Journal Article
Γλώσσα: English
Στοιχεία περιοδικού: Publisher: Wiley-VCH Country of Publication: Germany NLM ID: 101318567 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1864-0648 (Electronic) Linking ISSN: 1864063X NLM ISO Abbreviation: J Biophotonics Subsets: MEDLINE
Imprint Name(s): Original Publication: Weinheim : Wiley-VCH
Ιατρικοί όροι (MeSH): Microscopy, Fluorescence, Multiphoton*/methods , Image Processing, Computer-Assisted*/methods , Artifacts* , Deep Learning*, Brain/diagnostic imaging ; Brain/blood supply ; Intestines/diagnostic imaging ; Intestines/blood supply ; Imaging, Three-Dimensional ; Movement ; Animals
Περίληψη: Three-photon fluorescence microscopy (3PFM) enables high-resolution volumetric imaging in deep tissues but is often hindered by motion artifacts in dynamic physiological environments. Existing solutions, including surgical fixation and conventional image registration algorithms, frequently fail under intense and nonuniform motions, particularly in low-texture or highly deformed regions. To overcome these problems, we propose StabiFormer, a transformer-based optical flow learning network designed for robust motion correction. Central to StabiFormer is the stable-dynamic feature extractor, which captures interlayer dynamics to facilitate accurate image registration. Our validation across cerebrovascular and intestinal 3PFM datasets demonstrates that StabiFormer achieves near-zero displacement error relative to ground truth in brain vasculature. Furthermore, it enables artifact-free 3D visualization of intestinal macrophages and vasculature at 300 μm depth, a physiologically relevant depth for studying intestinal immune microvasculature. These results establish a noninvasive computational solution for motion-artifact-free volumetric imaging, paving the way for quantitative investigations in previously inaccessible dynamic organ systems.
(© 2025 Wiley‐VCH GmbH.)
References: L. Shi, L. A. Sordillo, A. Rodríguez‐Contreras, and R. Alfano, “Transmission in Near‐Infrared Optical Windows for Deep Brain Imaging,” Journal of Biophotonics 9 (2016): 38–43.
S. Haleh, G. Hirac, and P. Frederic, “Optical Properties of Mice Skull Bone in the 455‐ to 705‐nm Range,” Journal of Biomedical Optics 22 (2017): 10503.
Z. Zhao, Y. Zhou, B. Liu, et al., “Two‐Photon Synthetic Aperture Microscopy for Minimally Invasive Fast 3D Imaging of Native Subcellular Behaviors in Deep Tissue,” Cell 186 (2023): 2475–2491.e22.
W. Chen, X. Ge, Q. Zhang, et al., “High‐Throughput Volumetric Mapping of Synaptic Transmission,” Nature Methods 21 (2024): 1298–1305.
J. Wu, N. Ji, and K. K. Tsia, “Speed Scaling in Multiphoton Fluorescence Microscopy,” Nature Photonics 15 (2021): 800–812.
G. Meng, J. Zhong, Q. Zhang, et al., “Ultrafast Two‐Photon Fluorescence Imaging of Cerebral Blood Circulation in the Mouse Brain In Vivo,” Proceedings of the National Academy of Sciences of the United States of America 119 (2022): e2117346119.
T. Wang and C. Xu, “Three‐Photon Neuronal Imaging in Deep Mouse Brain,” Optica 7 (2020): 947–960.
N. G. Horton, K. Wang, D. Kobat, et al., “In Vivo Three‐Photon Microscopy of Subcortical Structures Within an Intact Mouse Brain,” Nature Photonics 7 (2013): 205–209.
D. G. Ouzounov, T. Wang, M. Wang, et al., “In Vivo Three‐Photon Imaging of Activity of GCaMP6‐Labeled Neurons Deep in Intact Mouse Brain,” Nature Methods 14 (2017): 388–390.
T. Wang, D. G. Ouzounov, C. Wu, et al., “Three‐Photon Imaging of Mouse Brain Structure and Function Through the Intact Skull,” Nature Methods 15 (2018): 789–792.
M. He, D. Li, Z. Zheng, et al., “Aggregation‐Induced Emission Nanoprobe Assisted Ultra‐Deep Through‐Skull Three‐Photon Mouse Brain Imaging,” Nano Today 45 (2022): 101536.
H. Zhang, P. Fu, Y. Liu, et al., “Large‐Depth Three‐Photon Fluorescence Microscopy Imaging of Cortical Microvasculature on Nonhuman Primates With Bright AIE Probe In Vivo,” Biomaterials 289 (2022): 121809.
K. Choe, Y. Hontani, T. Y. Wang, et al., “Intravital Three‐Photon Microscopy Allows Visualization Over the Entire Depth of Mouse Lymph Nodes,” Nature Immunology 23 (2022): 330–340.
M. He, H. Park, G. Niu, et al., “Lipid Droplets Imaging With Three‐Photon Microscopy,” Journal of Innovative Optical Health Sciences 16 (2022): 2250033.
S. Li, M. He, X. Jin, et al., “Extending the Stokes Shifts of Donor–Acceptor Fluorophores by Regulating the Donor Configuration for In Vivo Three‐Photon Fluorescence Imaging,” Chemistry of Materials 34 (2022): 5999–6008.
S. Wang, X. Li, S. Y. Chong, et al., “In Vivo Three‐Photon Imaging of Lipids Using Ultrabright Fluorogens With Aggregation‐Induced Emission,” Advanced Materials 33 (2021): 2007490.
J. S. Jones, D. M. Small, and N. Nishimura, “In Vivo Calcium Imaging of Cardiomyocytes in the Beating Mouse Heart With Multiphoton Microscopy,” Frontiers in Physiology 9 (2018): 969.
D. Entenberg, S. Voiculescu, P. Guo, et al., “A Permanent Window for the Murine Lung Enables High‐Resolution Imaging of Cancer Metastasis,” Nature Methods 15 (2018): 73–80.
L. Ritsma, E. J. Steller, S. I. Ellenbroek, O. Kranenburg, I. H. Borel Rinkes, and J. van Rheenen, “Surgical Implantation of an Abdominal Imaging Window for Intravital Microscopy,” Nature Protocols 8 (2013): 583–594.
N. Rakhilin, B. Barth, J. Choi, et al., “Simultaneous Optical and Electrical In Vivo Analysis of the Enteric Nervous System,” Nature Communications 7 (2016): 11800.
N. Rakhilin, A. Garrett, C.‐Y. Eom, et al., “An Intravital Window to Image the Colon in Real Time,” Nature Communications 10 (2019): 5647.
A. Vaswani, N. Shazeer, N. Parmar, et al., “Attention Is All You Need,” in Advances in Neural Information Processing Systems (Curran Associates Inc, 2017), 6000–6010.
A. Dosovitskiy, L. Beyer, A. Kolesnikov, et al., “An Image is Worth 16 × 16 Words: Transformers for Image Recognition at Scale,” preprint, arXiv October 22, 2020.
A. Katharopoulos, A. Vyas, N. Pappas, and F. Fleuret, “Transformers Are RNNs: Fast Autoregressive Transformers With Linear Attention,” in Proceedings of the 37th International Conference on Machine Learning (2020) 5156–5165.
G. Zhang, Y. Zhu, H. Wang, Y. Chen, G. Wu, and L. Wang, “Extracting Motion and Appearance via Inter‐Frame Attention for Efficient Video Frame Interpolation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2023), 5682–5692.
M. Wang, G. Y. Yang, J. K. Lin, et al., “Deep Online Video Stabilization With Multi‐Grid Warping Transformation Learning,” IEEE Transactions on Image Processing 28 (2019): 2283–2292.
Grant Information: U23A20487 the National Natural Science Foundation of China; 61975172 the National Natural Science Foundation of China; 2024YFF1206700 the National Key R&D Program of China; Dr. Li Dak Sum & Yip Yio Chin Development Fund for Regenerative Medicine, Zhejiang University
Contributed Indexing: Keywords: intravital imaging; motion artifact correction; optical flow learning; three‐photon fluorescence microscopy; transformer network
Entry Date(s): Date Created: 20250817 Date Completed: 20251214 Latest Revision: 20260708
Update Code: 20260708
DOI: 10.1002/jbio.202500407
PMID: 40819894
Βάση Δεδομένων: MEDLINE
Περιγραφή
ISSN:1864-0648
DOI:10.1002/jbio.202500407