In Vivo Intelligent Fluorescence Endo-Microscopy by Varifocal Meta-Device and Deep Learning

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

View graph of relations

Author(s)

  • Yu-Hsin Chia
  • Wei-Hao Liao
  • Sunil Vyas
  • Cheng Hung Chu
  • Takeshi Yamaguchi
  • Takuo Tanaka
  • Yi-You Huang
  • Wen-Shiang Chen
  • Yuan Luo

Detail(s)

Original languageEnglish
Article number2307837
Journal / PublicationAdvanced Science
Publication statusOnline published - 15 Mar 2024

Abstract

Endo-microscopy is crucial for real-time 3D visualization of internal tissues and subcellular structures. Conventional methods rely on axial movement of optical components for precise focus adjustment, limiting miniaturization and complicating procedures. Meta-device, composed of artificial nanostructures, is an emerging optical flat device that can freely manipulate the phase and amplitude of light. Here, an intelligent fluorescence endo-microscope is developed based on varifocal meta-lens and deep learning (DL). The breakthrough enables in vivo 3D imaging of mouse brains, where varifocal meta-lens focal length adjusts through relative rotation angle. The system offers key advantages such as invariant magnification, a large field-of-view, and optical sectioning at a maximum focal length tuning range of ≈2 mm with 3 µm lateral resolution. Using a DL network, image acquisition time and system complexity are significantly reduced, and in vivo high-resolution brain images of detailed vessels and surrounding perivascular space are clearly observed within 0.1 s (≈50 times faster). The approach will benefit various surgical procedures, such as gastrointestinal biopsies, neural imaging, brain surgery, etc.

© 2024 The Authors. Advanced Science published by Wiley-VCH Gmb

Citation Format(s)

In Vivo Intelligent Fluorescence Endo-Microscopy by Varifocal Meta-Device and Deep Learning. / Chia, Yu-Hsin; Liao, Wei-Hao; Vyas, Sunil et al.
In: Advanced Science, 15.03.2024.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review