Birdlike broadband neuromorphic visual sensor arrays for fusion imaging

Pengshan Xie, Yunchao Xu, Jingwen Wang, Dengji Li, Yuxuan Zhang, Zixin Zeng, Boxiang Gao, Quan Quan, Bowen Li, You Meng, Weijun Wang, Yezhan Li, Yan Yan, Yi Shen, Jia Sun*, Johnny C. Ho*

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

10 Citations (Scopus)
11 Downloads (CityUHK Scholars)

Abstract

Wearable visual bionic devices, fueled by advancements in artificial intelligence, are making remarkable progress. However, traditional silicon vision chips often grapple with high energy losses and challenges in emulating complex biological behaviors. In this study, we constructed a van der Waals P3HT/GaAs nanowires P-N junction by carefully directing the arrangement of organic molecules. Combined with a Schottky junction, this facilitated multi-faceted birdlike visual enhancement, including broadband non-volatile storage, low-light perception, and a near-zero power consumption operating mode in both individual devices and 5 × 5 arrays on arbitrary substrates. Specifically, we realized over 5 bits of in-memory sensing and computing with both negative and positive photoconductivity. When paired with two imaging modes (visible and UV), our reservoir computing system demonstrated up to 94% accuracy for color recognition. It achieved motion and UV grayscale information extraction (displayed with sunscreen), leading to fusion visual imaging. This work provides a promising co-design of material and device for a broadband and highly biomimetic optoelectronic neuromorphic system. © The Author(s) 2024.
Original languageEnglish
Article number8298
JournalNature Communications
Volume15
Online published27 Sept 2024
DOIs
Publication statusPublished - 2024

Funding

We acknowledge a fellowship award from the Research Grants Council of the Hong Kong Special Administrative Region, China (CityU RFS2021 − 1S04) and the Innovation and Technology Fund (MHP/126/21) from the Innovation and Technology Commission of the Government of the Hong Kong Special Administrative Region of the People’s Republic of China. J.C.H. and J.S. acknowledge the support from the National Key Research and Development Program of China (No. 2023YFE0208600).

Publisher's Copyright Statement

  • This full text is made available under CC-BY-NC-ND 4.0. https://creativecommons.org/licenses/by-nc-nd/4.0/

Fingerprint

Dive into the research topics of 'Birdlike broadband neuromorphic visual sensor arrays for fusion imaging'. Together they form a unique fingerprint.

Cite this