Homeomorphic Projection to Ensure Neural-Network Solution Feasibility for Constrained Optimization

Enming Liang, Minghua Chen*, Steven H. Low

*Corresponding author for this work

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

6 Downloads (CityUHK Scholars)

Abstract

There has been growing interest in employing neural networks (NNs) to directly solve constrained optimization problems with low run-time complexity. However, it is non-trivial to ensure NN solutions strictly satisfy problem constraints due to inherent NN prediction errors. Existing feasibility-ensuring methods are either computationally expensive or lack performance guarantee. In this paper, we propose Homeomorphic Projection as a low- complexity scheme to guarantee NN solution feasibility for optimization over a general set homeomorphic to a unit ball, covering all compact convex sets and certain classes of non- convex sets. The idea is to (i) learn a minimum distortion homeomorphic mapping between the constraint set and a unit ball using a bi-Lipschitz invertible NN (INN), and then (ii) perform a simple bisection operation concerning the unit ball such that the INN-mapped final solution is feasible with respect to the constraint set with minor distortion-induced optimality loss. We prove the feasibility guarantee and bounded optimality loss under mild conditions. Simulation results, including those for non-convex AC-OPF problems in power grid operation, show that homeomorphic projection outperforms existing methods in solution feasibility and run-time complexity while achieving similar optimality loss. © 2024 Enming Liang, Minghua Chen, and Steven H. Low.
Original languageEnglish
Article number329
JournalJournal of Machine Learning Research
Volume25
Publication statusPublished - Sept 2024

Funding

This work is supported in part by (i) a General Research Fund from Research Grants Council, Hong Kong (Project No. 11203122), (ii) an InnoHK initiative, The Government of the HKSAR, Laboratory for AI-Powered Financial Technologies, (iii) a Shenzhen-Hong Kong-Macau Science & Technology Project (Category C, Project No. SGDX20220530111203026), (iv) Caltech Resnick Sustainability Institute, and (v) Caltech S2I program. Part of this work has been presented at ICML 2023 (Liang et al., 2023). The authors would also like to thank the anonymous reviewers for their helpful comments.

Research Keywords

  • constrained optimization
  • feasibility
  • homeomorphism
  • distortion
  • projection

Publisher's Copyright Statement

  • This full text is made available under CC-BY 4.0. https://creativecommons.org/licenses/by/4.0/

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Homeomorphic Projection to Ensure Neural-Network Solution Feasibility for Constrained Optimization'. Together they form a unique fingerprint.

Cite this