Skip to main navigation Skip to search Skip to main content

Learning continuous neural representations enables scalable and high-fidelity electron microscopy

Research output: Journal Publications and Reviews › RGC 21 - Publication in refereed journal › peer-review

Abstract

Electron microscopy (EM) is indispensable for investigating nanoscale structures and dynamics across physical and life sciences. Conventional frame-based representations, however, store detector measurements as discrete pixel arrays, generating redundant and noise-sensitive datasets that grow rapidly with detector resolution and acquisition rate. Here, we introduce electron microscopy data representation (ENCODE), which learns a continuous neural representation of EM data and stores it as neural-network parameters rather than as independent pixel values. Across multiple EM modalities, ENCODE achieves substantial compression while preserving fidelity for downstream analyses. Its continuous formulation also enables arbitrary-index querying, intermediate-frame interpolation, and self-supervised denoising. Applied to low-dose in situ scanning transmission electron microscopy (STEM) observations of vanadium-doped tungsten disulfide (V-doped WS2), ENCODE reconstructs transient atomic migration associated with vacancy filling and local lattice relaxation that are obscured in raw measurements. These results establish continuous neural representations as a scalable framework for EM data storage and analysis, supporting interpolation of smoothly evolving states and analysis of dynamics in noisy measurements. © 2026 The Author(s).
Original languageEnglish
Article number103540
Number of pages17
JournalCell Reports Physical Science
Volume7
Issue number9
Online published10 Sept 2026
DOIs
Publication statusPublished - 16 Sept 2026

Funding

This work was financially supported by the National Natural Science Foundation of China ( T2422017 , 52171014 , 22405225 , and 52303301 ); the Guangdong Basic and Applied Basic Research Foundation ( 2024A1515012303 ); the Sino-German Mobility Program by the Sino-German Center for Research Promotion ( M-0265 ); the Research Grants Council of the Hong Kong Special Administrative Region, China (project nos. E-CityU101/20 , C1013-23EF , C1018-22E , CityU 11309822 , CityU 11307926, 9043713 and 21204124 ); Innovation and Technology Fund (RAI/23/1/020A); the European Research Council (grant no. 856538 , project \u201C3D MAGiC\u201D); the City University of Hong Kong (project nos. 7020207, 7030048, 9380092, 9610484 , 9680291 , 9678288 , 9610607 , and 9229120 ); the City University of Hong Kong Shenzhen Research Institute , the Shun Hing Institute of Advanced Engineering, CUHK (no. RNE-p1-25 ); and a CUHK direct grant ( 4055248 ). This work used resources from the TRACE TEM center at City University of Hong Kong.

Research Keywords

  • atomic-resolution imaging
  • computational microscopy
  • denoising
  • electron microscopy
  • implicit neural representation
  • scientific data compression
  • temporal interpolation

Publisher's Copyright Statement

  • This full text is made available under CC-BY-NC-ND 4.0. https://creativecommons.org/licenses/by-nc-nd/4.0/

Fingerprint

Dive into the research topics of 'Learning continuous neural representations enables scalable and high-fidelity electron microscopy'. Together they form a unique fingerprint.

Cite this