Academic Journal
Προβολή σε EDS
Συνδεδεμένο Πλήρες Κείμενο

Physics-informed multi-encoder adaptive optics enables rapid aberration correction for intravital microscopy of deep complex tissue.

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Physics-informed multi-encoder adaptive optics enables rapid aberration correction for intravital microscopy of deep complex tissue.
Συγγραφείς: Cheng X; Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen, China.; Department of Immunology and Microbiology, School of Life Sciences, Southern University of Science and Technology, Shenzhen, China., Wang B; Department of Immunology and Microbiology, School of Life Sciences, Southern University of Science and Technology, Shenzhen, China., Luo L; Department of Immunology and Microbiology, School of Life Sciences, Southern University of Science and Technology, Shenzhen, China., Sun Z; Department of Immunology and Microbiology, School of Life Sciences, Southern University of Science and Technology, Shenzhen, China.; Division of Life Science, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China., He S; Department of Immunology and Microbiology, School of Life Sciences, Southern University of Science and Technology, Shenzhen, China. hesc@sustech.edu.cn.
Πηγή: Nature communications [Nat Commun] 2026 May 20; Vol. 17 (1). Date of Electronic Publication: 2026 May 20.
Τύπος έκδοσης: Journal Article
Γλώσσα: English
Στοιχεία περιοδικού: Publisher: Nature Pub. Group Country of Publication: England NLM ID: 101528555 Publication Model: Electronic Cited Medium: Internet ISSN: 2041-1723 (Electronic) Linking ISSN: 20411723 NLM ISO Abbreviation: Nat Commun Subsets: MEDLINE
Imprint Name(s): Original Publication: [London] : Nature Pub. Group
Ιατρικοί όροι (MeSH): Intravital Microscopy*/methods , Intravital Microscopy*/instrumentation , Optical Imaging*/methods , Optics and Photonics*/methods, Visual Cortex/diagnostic imaging ; Brain/diagnostic imaging ; Calcium/metabolism ; Neurons/metabolism ; Microglia/metabolism ; Image Processing, Computer-Assisted/methods ; Eye/diagnostic imaging ; Animals ; Zebrafish ; Mice ; Male
Περίληψη: Tissue-induced optical aberrations fundamentally constrain intravital microscopy in deep or complex biological specimens. While adaptive optics (AO) can compensate for these aberrations, conventional AO methods are limited by either guide-star dependency or slow correction speeds. Here, we develop MeNet-AO, a multi-encoder network-based AO method that enables rapid, guide-star-free aberration correction. By integrating a noise-resilient, structure-independent feature extraction model with a physics-informed multi-encoder architecture, MeNet-AO jointly decodes multiple large-amplitude aberration modes from wavefront-modulated image pairs, achieving an effective balance between prediction accuracy and temporal efficiency. Validated in living organisms, MeNet-AO improves fluorescence imaging in zebrafish brain and eye, enhances neuronal calcium transients and direction selectivity in mouse visual cortex, and enables subcellular-resolution microglial calcium imaging through thinned-skull windows - revealing spatiotemporally heterogeneous signaling patterns previously obscured by skull aberration. The speed and robustness of MeNet-AO in low-signal and scattering conditions establish it as a versatile platform for dynamic subcellular imaging deep within native tissue environments.
(© 2026. The Author(s).)
Competing Interests: Competing interests: All authors declare no competing interests.
References: Kitching, A. R. & Hickey, M. J. Immune cell behaviour and dynamics in the kidney — insights from in vivo imaging. Nat. Rev. Nephrol. 18, 22–37 (2021). (PMID: 3455683610.1038/s41581-021-00481-9)
Yang, W. & Yuste, R. In vivo imaging of neural activity. Nat. Methods 14, 349–359 (2017). (PMID: 28362436590357810.1038/nmeth.4230)
Denk, W., Strickler, J. H. & Webb, W. W. Two-Photon Laser Scanning Fluorescence Microscopy. Science 248, 73–76 (1990). (PMID: 232102710.1126/science.2321027)
Helmchen, F. & Denk, W. Deep tissue two-photon microscopy. Nat. Methods 2, 932–940 (2005). (PMID: 1629947810.1038/nmeth818)
Miller, D. R., Jarrett, J. W., Hassan, A. M. & Dunn, A. K. Deep tissue imaging with multiphoton fluorescence microscopy. Curr. Opin. Biomed. Eng. 4, 32–39 (2017). (PMID: 29335679576627510.1016/j.cobme.2017.09.004)
Marx, V. Microscopy: hello, adaptive optics. Nat. Methods 14, 1133–1136 (2017). (PMID: 2919027010.1038/nmeth.4508)
Booth, M. J. Adaptive optical microscopy: the ongoing quest for a perfect image. Light Sci. Appl 3, e165–e165 (2014). (PMID: 10.1038/lsa.2014.46)
Hampson, K. M. et al. Adaptive optics for high-resolution imaging. Nat. Rev. Methods Primers 1, 68 (2021).
Zhang, Q. et al. Adaptive optics for optical microscopy [Invited]. Biomed. Opt. Express 14, 1732 (2023). (PMID: 370780271011029810.1364/BOE.479886)
Yao, P., Liu, R., Broggini, T., Thunemann, M. & Kleinfeld, D. Construction and use of an adaptive optics two-photon microscope with direct wavefront sensing. Nat. Protoc. 18, 3732–3766 (2023). (PMID: 379147811103354810.1038/s41596-023-00893-w)
Débarre, D. et al. Image-based adaptive optics for two-photon microscopy. Opt. Lett. 34, 2495 (2009). (PMID: 19684827332004310.1364/OL.34.002495)
Ji, N., Milkie, D. E. & Betzig, E. Adaptive optics via pupil segmentation for high-resolution imaging in biological tissues. Nat. Methods 7, 141–147 (2009). (PMID: 2003759210.1038/nmeth.1411)
Wang, K. et al. Direct wavefront sensing for high-resolution in vivo imaging in scattering tissue. Nat. Commun. 6, 7276 (2015).
Azucena, O. et al. Wavefront aberration measurements and corrections through thick tissue using fluorescent microsphere reference beacons. Opt. Express 18, 17521 (2010). (PMID: 20721137340892110.1364/OE.18.017521)
Azucena, O. et al. Adaptive optics wide-field microscopy using direct wavefront sensing. Opt. Lett. 36, 825 (2011). (PMID: 2140369710.1364/OL.36.000825)
Wang, K. et al. Rapid adaptive optical recovery of optimal resolution over large volumes. Nat. Methods 11, 625–628 (2014). (PMID: 24727653406920810.1038/nmeth.2925)
Zheng, W. et al. Adaptive optics improves multiphoton super-resolution imaging. Nat. Methods 14, 869–872 (2017). (PMID: 28628128774971010.1038/nmeth.4337)
Liu, R., Li, Z., Marvin, J. S. & Kleinfeld, D. Direct wavefront sensing enables functional imaging of infragranular axons and spines. Nat. Methods 16, 615–618 (2019). (PMID: 31209383676339510.1038/s41592-019-0434-7)
Chen, C. et al. High-resolution two-photon transcranial imaging of brain using direct wavefront sensing. Photon. Res. 9, 1144 (2021). (PMID: 10.1364/PRJ.420220)
Qin, Z. et al. Adaptive optics two-photon endomicroscopy enables deep-brain imaging at synaptic resolution over large volumes. Sci. Adv. 6, eabc6521 (2020).
Qin, Z. et al. Adaptive optics two-photon microscopy enables near-diffraction-limited and functional retinal imaging in vivo. Light Sci. Appl. 9, 79 (2020).
Zhang, Q. et al. Retinal microvascular and neuronal pathologies probed in vivo by adaptive optical two-photon fluorescence microscopy. eLife 12, e84853 (2023).
Feng, J. et al. High-accuracy direct wavefront reconstruction with a 2 × 2 lens array. Chin. Opt. Lett. 23, 121202 (2025). (PMID: 10.3788/COL202523.121202)
Debarre, D., Booth, M. J. & Wilson, T. Image based adaptive optics through optimisation of low spatial frequencies. Opt. Express 15, 8176 (2007). (PMID: 1954714510.1364/OE.15.008176)
Facomprez, A., Beaurepaire, E. & Débarre, D. Accuracy of correction in modal sensorless adaptive optics. Opt. Express 20, 2598 (2012). (PMID: 2233049810.1364/OE.20.002598)
Tang, J., Germain, R. N. & Cui, M. Superpenetration optical microscopy by iterative multiphoton adaptive compensation technique. Proc. Natl. Acad. Sci. USA. 109, 8434–8439 (2012). (PMID: 22586078336522210.1073/pnas.1119590109)
Žurauskas, M. et al. IsoSense: frequency enhanced sensorless adaptive optics through structured illumination. Optica 6, 370 (2019). (PMID: 31417942668376510.1364/OPTICA.6.000370)
Streich, L. et al. High-resolution structural and functional deep brain imaging using adaptive optics three-photon microscopy. Nat. Methods 18, 1253–1258 (2021). (PMID: 34594033849015510.1038/s41592-021-01257-6)
Wang, K. et al. Iterative multi-photon adaptive compensation technique for deep tissue two-photon fluorescence lifetime imaging. Chin. Opt. Lett. 22, 041702 (2024). (PMID: 10.3788/COL202422.041702)
Rivenson, Y. et al. Deep learning microscopy. Optica 4, 1437 (2017). (PMID: 10.1364/OPTICA.4.001437)
Weigert, M. et al. Content-aware image restoration: pushing the limits of fluorescence microscopy. Nat. Methods 15, 1090–1097 (2018). (PMID: 3047832610.1038/s41592-018-0216-7)
Wang, H. et al. Deep learning enables cross-modality super-resolution in fluorescence microscopy. Nat. Methods 16, 103–110 (2018). (PMID: 30559434727609410.1038/s41592-018-0239-0)
Barbastathis, G., Ozcan, A. & Situ, G. On the use of deep learning for computational imaging. Optica 6, 921 (2019). (PMID: 10.1364/OPTICA.6.000921)
Chen, J. et al. Three-dimensional residual channel attention networks denoise and sharpen fluorescence microscopy image volumes. Nat. Methods 18, 678–687 (2021). (PMID: 3405982910.1038/s41592-021-01155-x)
Qiao, C. et al. Evaluation and development of deep neural networks for image super-resolution in optical microscopy. Nat. Methods 18, 194–202 (2021). (PMID: 3347952210.1038/s41592-020-01048-5)
Li, Y. et al. Incorporating the image formation process into deep learning improves network performance. Nat. Methods 19, 1427–1437 (2022). (PMID: 36316563963602310.1038/s41592-022-01652-7)
Qiao, C. et al. Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes. Nat. Biotechnol. 41, 367–377 (2022). (PMID: 3620301210.1038/s41587-022-01471-3)
Li, X. et al. Three-dimensional structured illumination microscopy with enhanced axial resolution. Nat. Biotechnol. 41, 1307–1319 (2023). (PMID: 367028971049740910.1038/s41587-022-01651-1)
Tahir, W., Wang, H. & Tian, L. Adaptive 3D descattering with a dynamic synthesis network. Light Sci. Appl. 11, 42 (2022).
Liu, H. et al. Learning-based real-time imaging through dynamic scattering media. Light Sci. Appl. 13, 194 (2024).
Wijethilake, N. et al. DEEP-squared: Deep learning powered de-scattering with excitation patterning. Light Sci. Appl. 12, 228 (2023).
Siemons, M. E., Hanemaaijer, N. A. K., Kole, M. H. P. & Kapitein, L. C. Robust adaptive optics for localization microscopy deep in complex tissue. Nat Commun. 12, 3407 (2021).
Zhang, P. et al. Deep learning-driven adaptive optics for single-molecule localization microscopy. Nat. Methods 20, 1748–1758 (2023). (PMID: 377707121063014410.1038/s41592-023-02029-0)
Qiao, C. et al. Deep learning-based optical aberration estimation enables offline digital adaptive optics and super-resolution imaging. Photon. Res. 12, 474 (2024). (PMID: 10.1364/PRJ.506778)
Wang, K. et al. On the use of deep learning for phase recovery. Light Sci. Appl. 13, 4 (2024).
Guo, M. et al. Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy. Nat. Commun. 16, 313 (2025).
Hou, X. et al. HD2Net: a deep learning framework for simultaneous denoising and deaberration in fluorescence microscopy. Opt. Expr. 33, 27317 (2025). (PMID: 10.1364/OE.554927)
Paine, S. W. & Fienup, J. R. Machine learning for improved image-based wavefront sensing. Opt. Lett. 43, 1235 (2018). (PMID: 2954326010.1364/OL.43.001235)
Möckl, L., Petrov, P. N. & Moerner, W. E. Accurate phase retrieval of complex 3D point spread functions with deep residual neural networks. Appl. Phys. Lett. 115, 251106 (2019).
Allan, G., Kang, I., Douglas, E. S., Barbastathis, G. & Cahoy, K. Deep residual learning for low-order wavefront sensing in high-contrast imaging systems. Opt. Express 28, 26267 (2020). (PMID: 3290690210.1364/OE.397790)
Hu, L., Hu, S., Gong, W. & Si, K. Learning-based Shack-Hartmann wavefront sensor for high-order aberration detection. Opt. Express 27, 33504 (2019). (PMID: 3187841810.1364/OE.27.033504)
Saha, D. et al. Practical sensorless aberration estimation for 3D microscopy with deep learning. Opt. Expr. 28, 29044 (2020). (PMID: 10.1364/OE.401933)
Rai, M. R., Li, C., Ghashghaei, H. T. & Greenbaum, A. Deep learning-based adaptive optics for light sheet fluorescence microscopy. Biomed. Opt. Express 14, 2905 (2023). (PMID: 373427011027861010.1364/BOE.488995)
Kang, I., Zhang, Q., Yu, S. X. & Ji, N. Coordinate-based neural representations for computational adaptive optics in widefield microscopy. Nat. Mach. Intell. 6, 714–725 (2024). (PMID: 10.1038/s42256-024-00853-3)
Kang, I. et al. Adaptive optical correction for in vivo two-photon fluorescence microscopy with neural fields. Nat. Methods 23, 1037–1046 (2026).
Culley, S. et al. Quantitative mapping and minimization of super-resolution optical imaging artifacts. Nat. Methods 15, 263–266 (2018). (PMID: 29457791588442910.1038/nmeth.4605)
Belthangady, C. & Royer, L. A. Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction. Nat. Methods 16, 1215–1225 (2019). (PMID: 3128562310.1038/s41592-019-0458-z)
Li, X., Zhang, Y., Wu, J. & Dai, Q. Challenges and opportunities in bioimage analysis. Nat. Methods 20, 958–961 (2023). (PMID: 3743399610.1038/s41592-023-01900-4)
Zhao, W. et al. Quantitatively mapping local quality of super-resolution microscopy by rolling Fourier ring correlation. Light Sci. Appl. 12, (2023).
Qiao, C. et al. A neural network for long-term super-resolution imaging of live cells with reliable confidence quantification. Nat. Biotechnol. https://doi.org/10.1038/s41587-025-02553-8 (2025).
Xin, Q., Ju, G., Zhang, C. & Xu, S. Object-independent image-based wavefront sensing approach using phase diversity images and deep learning. Opt. Express 27, 26102 (2019). (PMID: 3151047110.1364/OE.27.026102)
Ge, X. et al. Object-independent wavefront sensing method based on an unsupervised learning model for overcoming aberrations in optical systems. Opt. Lett. 48, 4476 (2023). (PMID: 3765653210.1364/OL.499340)
Hu, Q. et al. Universal adaptive optics for microscopy through embedded neural network control. Light Sci. Appl. 12, 270 (2023).
Johnson, C. et al. Phase-diversity-based wavefront sensing for fluorescence microscopy. Optica 11, 806 (2024). (PMID: 10.1364/OPTICA.518559)
Mahajan, V. N. Strehl ratio for primary aberrations: some analytical results for circular and annular pupils. J. Opt. Soc. Am. 72, 1258–1266 (1982). (PMID: 10.1364/JOSA.72.001258)
Bentley, J. & Olson, C. Field Guide to Lens Design (SPIE Press, 2012).
Göbel, W. & Helmchen, F. In vivo calcium imaging of neural network function. Physiology 22, 358–365 (2007). (PMID: 1807340810.1152/physiol.00032.2007)
Li, Y., Van Hooser, S. D., Mazurek, M., White, L. E. & Fitzpatrick, D. Experience with moving visual stimuli drives the early development of cortical direction selectivity. Nature 456, 952–956 (2008). (PMID: 18946471264457810.1038/nature07417)
Jeon, B. B., Swain, A. D., Good, J. T., Chase, S. M. & Kuhlman, S. J. Feature selectivity is stable in primary visual cortex across a range of spatial frequencies. Sci. Rep. 8, 15288 (2018).
Lee, S., Meyer, J. F., Park, J. & Smirnakis, S. M. Visually driven neuropil activity and information encoding in mouse primary visual cortex. Front. Neural Circuits 11, 50 (2017).
Xu, H.-T., Pan, F., Yang, G. & Gan, W.-B. Choice of cranial window type for in vivo imaging affects dendritic spine turnover in the cortex. Nat. Neurosci. 10, 549–551 (2007). (PMID: 1741763410.1038/nn1883)
Yang, G., Pan, F., Parkhurst, C. N., Grutzendler, J. & Gan, W.-B. Thinned-skull cranial window technique for long-term imaging of the cortex in live mice. Nat. Protoc. 5, 201–208 (2010). (PMID: 20134419469045710.1038/nprot.2009.222)
Umpierre, A. D. et al. Microglial calcium signaling is attuned to neuronal activity in awake mice. eLife 9, e56502 (2020).
Simonyan, K. & Zisserman, A. Two-stream convolutional networks for action recognition in videos. Adv. Neural Inf. Process Syst. 27, 568–576 (2014).
Karpathy, A. et al. Large-Scale Video Classification with Convolutional Neural Networks. 2014 IEEE Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/cvpr.2014.223 (2014).
Boulahia, S. Y., Amamra, A., Madi, M. R. & Daikh, S. Early, intermediate and late fusion strategies for robust deep learning-based multimodal action recognition. Machine Vision and Applications 32, (2021).
Zhang, P. et al. Analyzing complex single-molecule emission patterns with deep learning. Nat. Methods 15, 913–916 (2018). (PMID: 30377349662485310.1038/s41592-018-0153-5)
Speiser, A. et al. Deep learning enables fast and dense single-molecule localization with high accuracy. Nat. Methods 18, 1082–1090 (2021). (PMID: 34480155761166910.1038/s41592-021-01236-x)
Fu, S. et al. Field-dependent deep learning enables high-throughput whole-cell 3D super-resolution imaging. Nat. Methods 20, 459–468 (2023). (PMID: 3682333510.1038/s41592-023-01775-5)
Yoon, S. et al. Deep optical imaging within complex scattering media. Nat. Rev. Phys. 2, 141–158 (2020). (PMID: 10.1038/s42254-019-0143-2)
Gonsalves, R. A. Phase retrieval and diversity in adaptive optics. Opt. Eng. 21, (1982).
Paxman, R. G., Schulz, T. J. & Fienup, J. R. Joint estimation of object and aberrations by using phase diversity. J. Opt. Soc. Am. A 9, 1072 (1992). (PMID: 10.1364/JOSAA.9.001072)
Vogel, C. R., Chan, T. F. & Plemmons, R. J. Fast algorithms for phase-diversity-based blind deconvolution. SPIE Proc. 3353, 994 (1998). (PMID: 10.1117/12.321720)
Lee, D. J., Roggemann, M. C. & Welsh, B. M. Cramér-Rao analysis of phase-diverse wave-front sensing,. J. Opt. Soc. Am. A 16, 1005–1019 (1999). (PMID: 10.1364/JOSAA.16.001005)
Kner, P. Phase diversity for three-dimensional imaging. J. Opt. Soc. Am. A 30, 1980 (2013). (PMID: 10.1364/JOSAA.30.001980)
Krishnan, A. P. et al. Optical aberration correction via phase diversity and deep learning https://doi.org/10.1101/2020.04.05.026567 (2020).
Reiser, N., Guo, M., Shroff, H. & La Riviere, P. J. Phase diverse phase retrieval for microscopy: Comparison of gaussian and poisson approaches. Preprint at https://doi.org/10.48550/ARXIV.2308.00734 (2023).
Park, J.-H., Kong, L., Zhou, Y. & Cui, M. Large-field-of-view imaging by multi-pupil adaptive optics. Nat. Methods 14, 581–583 (2017). (PMID: 28481364548223310.1038/nmeth.4290)
Li, X. et al. Spatial redundancy transformer for self-supervised fluorescence image denoising. Nat. Comput Sci. 3, 1067–1080 (2023). (PMID: 381777221076653110.1038/s43588-023-00568-2)
Qiao, C. et al. Fast-adaptive super-resolution lattice light-sheet microscopy for rapid, long-term, near-isotropic subcellular imaging. Nat. Methods 22, 1059–1069 (2025). (PMID: 4030162310.1038/s41592-025-02678-3)
Hall, N., Titlow, J., Booth, M. J. & Dobbie, I. M. Microscope-AOtools: A generalised adaptive optics implementation. Opt. Expr. 28, 28987 (2020). (PMID: 10.1364/OE.401117)
Goodman, J. Introduction to Fourier Optics 2nd ed. (MaGraw-Hill 1996).
Born, M. & Wolf, E. Principles of Optics 7th ed. (Cambridge University 1999).
Noll, R. J. Zernike polynomials and atmospheric turbulence. J. Opt. Soc. Am. 66, 207 (1976). (PMID: 10.1364/JOSA.66.000207)
He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 770–778 (2016).
Westerfield, M. The Zebrafish Book. A Guild for the Laboratory use of Zebrafish (Insititute of Neuroscience, University of Oregon Press, ed. 4, 2000).
Holtmaat, A. et al. Long-term, high-resolution imaging in the mouse neocortex through a chronic cranial window. Nat. Protoc. 4, 1128–1144 (2009). (PMID: 19617885307283910.1038/nprot.2009.89)
Schindelin, J. et al. Fiji: an open-source platform for biological-image analysis. Nat. Methods 9, 676–682 (2012). (PMID: 22743772385584410.1038/nmeth.2019)
Pachitariu, M. et al. Suite2p: beyond 10,000 neurons with standard two-photon microscopy. https://doi.org/10.1101/061507 (2016).
Chen, W. et al. In vivo volumetric imaging of calcium and glutamate activity at synapses with high spatiotemporal resolution. Nat Commun 12 (2021).
Chen, W. et al. High-throughput volumetric mapping of synaptic transmission. Nat. Methods 21, 1298–1305 (2024). (PMID: 3889809410.1038/s41592-024-02309-3)
Grant Information: 32192400 National Natural Science Foundation of China (National Science Foundation of China); 2021ZT09Y104 Guangdong Innovative and Entrepreneurial Research Team Program
Substance Nomenclature: SY7Q814VUP (Calcium)
Entry Date(s): Date Created: 20260520 Date Completed: 20260719 Latest Revision: 20260726
Update Code: 20260726
PubMed Central ID: PMC13381939
DOI: 10.1038/s41467-026-73389-2
PMID: 42161926
Βάση Δεδομένων: MEDLINE
Περιγραφή
ISSN:2041-1723
DOI:10.1038/s41467-026-73389-2