Binary Optical Machine Learning: Million-Scale Physical Neural Networks with Nano Neurons

Xueyuan Yang, Zhenlin An*, Qingrui Pan, Lei Yang*, Dangyuan Lei, Yulong Fan

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

1 Citation (Scopus)

Abstract

Deep learning excels in advanced inference tasks using electronic neural networks (ENN), but faces energy consumption and limited computation speed challenges. To mitigate this, optical neural networks (ONNs) were developed, utilizing light for computations. However, their high manufacturing costs limited accessibility. In this work, we first introduce the binary optical neural network (BONN) – a streamlined ONN variant with binarized weights, which significantly reduces fabrication complexities and costs. Specifically, we address (i) the development of a binarization weight function aligned with backward-error propagation, and (ii) a simulation-based training for extra-large neural networks housing millions of neurons. We prototype six BONNs, each comprising four 0.8 × 0.8mm2 layers with one million 800 nm diameter neurons. Costs are cut to 0.13 USD per layer, marking a substantial decrease of 769× from previous ONNs. Experimental results reveal BONNs consume 2, 405× less power than leading ENNs while maintaining an average recognition accuracy of 74% across six datasets. © 2024 Copyright held by the owner/author(s).
Original languageEnglish
Title of host publicationACM MobiCom ’24
Subtitle of host publicationProceedings of the Thirtieth International Conference On Mobile Computing And Networking
PublisherAssociation for Computing Machinery
Pages603-617
ISBN (Print)9798400704895
DOIs
Publication statusPublished - 2024
Event30th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2024) - Washington, United States
Duration: 18 Nov 202422 Nov 2024
https://dl.acm.org/doi/proceedings/10.1145/3636534

Publication series

NameACM MobiCom - Proceedings of the International Conference on Mobile Computing and Networking

Conference

Conference30th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2024)
Country/TerritoryUnited States
CityWashington
Period18/11/2422/11/24
Internet address

Funding

This study is supported by NSFCKeyProgram(No.61932017), UGC/GRF (No. 15204820, 15215421), and Innovation and Technology Fund(ITS/099/21). We sincerely thank all the anonymous reviewers for their valuable comments and helpful suggestions. Thanks to Yaorong Wang for the valuable discussions. Zhenlin An and Lei Yang are the co-corresponding authors.

Fingerprint

Dive into the research topics of 'Binary Optical Machine Learning: Million-Scale Physical Neural Networks with Nano Neurons'. Together they form a unique fingerprint.

Cite this