Lensless fiber endomicroscopy in biomedicine

Jiawei Sun^{1, 2, 3},
Robert Kuschmierz^{1, 3, 4},
Ori Katz⁵,
Nektarios Koukourakis^{1, 3},
Juergen W. Czarske^{1, 3, 4, 6, 7}

1.
Competence Center for Biomedical Computational Laser Systems (BIOLAS), TU Dresden, Dresden, 01069, Germany
2.
Shanghai Artificial Intelligence Laboratory, Longwen Road 129, Xuhui District, Shanghai, 200232, China
3.
Laboratory of Measurement and Sensor System Technique (MST), TU Dresden, Helmholtzstrasse 18, Dresden, 01069, Germany
4.
Else Kröner Fresenius Center for digital Heath, TU Dresden, Dresden, 01062, Germany
5.
Institute of Applied Physics, The Hebrew University of Jerusalem, Jerusalem, Israel
6.
Cluster of Excellence Physics of Life, TU Dresden, Dresden, 01062, Germany
7.
Institute of Applied Physics, TU Dresden, Dresden, 01062, Germany

Funds: We would like to acknowledge the kind invitation and support from the PhotoniX editorial office.

摘要

- /
- /
- /
- /
- /
- /
- /
- /
- /
- /
- /
- /
- /
- /
Abstract:
Lensless fiber endomicroscopy, an emergent paradigm shift for minimally-invasive microscopic optical imaging and targeted light delivery, holds transformative potential, especially in biomedicine. Leveraging holographic detection and physical or computational wavefront correction, it enables three-dimensional imaging in an unprecedentedly small footprint, which is crucial for various applications such as brain surgery. This perspective reviews the recent breakthroughs, highlighting potential emerging applications, and pinpointing gaps between innovation and real-world applications. As the research in this realm accelerates, the novel breakthroughs and existing frontiers highlighted in this perspective can be used as guidelines for researchers joining this exciting domain.

HTML全文

下载: 全尺寸图片幻灯片

参考文献(26)

[1]	Sun J, Wu J, Wu S, Goswami R, Girardo S, Cao L, Guck J, Koukourakis N, Czarske JW. Quantitative phase imaging through an ultra-thin lensless fiber endoscope. Light Sci AppL. 2022;11(1 11):1–10.
[2]	Badt N, Katz O. Real-time holographic lensless micro-endoscopy through flexible fibers via fiber bundle distal holography. Nat Commun. 2022;13(1):6055.
[3]	Choi W, Kang M, Hong JH, Katz O, Lee B, Kim GH, Choi Y, Choi W. Flexible-type ultrathin holographic endoscope for microscopic imaging of unstained biological tissues. Nat Commun. 2022;13(1):4469.
[4]	Du Y, Turtaev S, Leite IT, Lorenz A, Kobelke J, Wondraczek K, Čižmár T. Hybrid multimode-multicore fibre based holographic endoscope for deep-tissue neurophotonics. Light Adv Manuf. 2022;3(3):408–16.
[5]	Kuschmierz R, Scharf E, Koukourakis N, Czarske JW. Self-calibration of lensless holographic endoscope using programmable guide stars. Opt Lett. 2018;43(12): 2997.
[6]	Wen Z, Dong Z, Deng Q, Pang C, Kaminski CF, Xu X, Yan H, Wang L, Liu S, Tang J, Chen W, Liu X, Yang Q. Single multimode fibre for in vivo light-field-encoded endoscopic imaging. Nat Photonics 2023. 2023;17(8):8.
[7]	Vasquez-Lopez SA, Turcotte R, Koren V, Plöschner M, Padamsey Z, Booth MJ, Čižmár T, Emptage NJ. Subcellular spatial resolution achieved for deep-brain imaging in vivo using a minimally invasive multimode fiber. Light Sci Appl 2018. 2018;7(1 7):1–6.
[8]	Papadopoulos IN, Farahi S, Moser C, Psaltis D, Flusberg B, Cocker E, Piyawattanametha W, Jung J, Cheung E, Schnitzer M, Mehta A, Aksay E, Stepnoski R. High-resolution, lensless endoscope based on digital scanning through a multimode optical fiber. Biomedical Opt Express. 2013;4(2):260–70.
[9]	Stibůrek M, Ondráčková P, Tučková T, Turtaev S, Šiler M, Pikálek T, Jákl P, Gomes A, Krejčí J, Kolbábková P, Uhlířová H, Čižmár T. 110 µm thin endo-microscope for deep-brain in vivo observations of neuronal connectivity, activity and blood flow dynamics. Nat Commun 2023. 2023;14(1 14):1–9.
[10]	Accanto N, Blot FGC, Lorca-Cámara A, Zampini V, Bui F, Tourain C, Badt N, Katz O, Emiliani V. A flexible two-photon fiberscope for fast activity imaging and precise optogenetic photostimulation of neurons in freely moving mice. Neuron. 2023;111(2):176-e1896.
[11]	Sun J, Yang B, Koukourakis N, Guck J, Czarske JW. AI-driven projection tomography with multicore fibre-optic cell rotation. Nat Commun. 2024;15(1):147.
[12]	Gissibl T, Thiele S, Herkommer A, Giessen H. Two-photon direct laser writing of ultracompact multi-lens objectives. Nat Photonics 2016. 2016;10(8):8.
[13]	Wang C, Dudman JT, Ji N, Jiang W, Aponte Y, Bocarsly ME. Minimally invasive microendoscopy system for in vivo functional imaging of deep nuclei in the mouse brain. Biomed Opt Express. 2015;6(11):4546–56.
[14]	Turtaev S, Leite IT, Altwegg-Boussac T, Pakan JMP, Rochefort NL, Čižmár T. High-fidelity multimode fibre-based endoscopy for deep brain in vivo imaging. Light Sci Appl. 2018;7(1):1–8.
[15]	Choi Y, Yoon C, Kim M, Yang TD, Fang-Yen C, Dasari RR, Lee KJ, Choi W. Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber. Phys Rev Lett. 2012;109(20): 203901.
[16]	Moser C, Psaltis D, Kakkava E, Borhani N. Learning to see through multimode fibers. Optica. 2018;5(8):960–6.
[17]	Wu J, Wang T, Uckermann O, Galli R, Schackert G, Cao L, Czarske J, Kuschmierz R. Learned end-to-end high-resolution lensless fiber imaging towards real-time cancer diagnosis. Sci Rep. 2022;12(1):18846.
[18]	Thompson AJ, Paterson C, Neil MAA, Dunsby C, French PMW. Adaptive phase compensation for ultracompact laser scanning endomicroscopy. Opt Lett. 2011;36(9):1707–9.
[19]	Weiss U, Katz O. Two-photon lensless micro-endoscopy with in-situ wavefront correction. Opt Express. 2018;26(22): 28808.
[20]	Trägårdh J, Pikálek T, Šerý M, Meyer T, Popp J, Čižmár T. Label-free CARS microscopy through a multimode fiber endoscope. Opt Express. 2019;27(21): 30055.
[21]	Xiang Y, Basirun C, Chou J, Warkiani M, Török P, Wang Y, Gao S, Kabakova I. Background-free fibre optic brillouin probe for remote mapping of micromechanics. Biomed Opt Express. 2020;11(11):6687–98.
[22]	Yeminy T, Katz O. Guidestar-free image-guided wavefront shaping. Sci Adv. 2021;7(21):5364–83.
[23]	Kakkava E, Romito M, Conkey DB, Loterie D, Stankovic KM, Moser C, Psaltis D. Selective femtosecond laser ablation via two-photon fluorescence imaging through a multimode fiber. Biomed Opt Express. 2019;10(2):423.
[24]	Kuschmierz R, Scharf E, Ortegón-González DF, Glosemeyer T, Czarske JW, Kuschmierz R, Scharf E, Ortegón-González DF, Glosemeyer T, Czarske JW. Ultra-thin 3D lensless fiber endoscopy using diffractive optical elements and deep neural networks. Light: Adv Manuf. 2021;2(4):1–10.
[25]	Fröch JE, Huang L, Tanguy QAA, Colburn S, Zhan A, Ravagli A, Seibel EJ, Böhringer KF, Majumdar A. Real time full-color imaging in a Meta-optical fiber endoscope. eLight. 2023;3(1):13.
[26]	Sun J, Zhao B, Wang D, Wang Z, Zhang J, Koukourakis N, Czarske J, Li X. Calibration-free quantitative phase imaging in multi-core fiber endoscopes using end-to-end deep learning. Opt Lett. 2024;49(2):342–5.