Large Language Model for Multiobjective Evolutionary Optimization

Fei Liu*, Xi Lin, Shunyu Yao, Zhenkun Wang, Xialiang Tong, Mingxuan Yuan, Qingfu Zhang

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

1 Citation (Scopus)

Abstract

Multiobjective evolutionary algorithms (MOEAs) are major solutions for solving multiobjective optimization problems (MOPs). However, to design efficient and powerful operators in MOEAs, a tedious process of trial-and-error with domain experts is usually required. This paper investigates a novel approach that leverages large language models (LLM) to design MOEA operators. Firstly, with proper prompt engineering, we directly employ an LLM to serve as a black-box search operator for decomposition-based MOEA in a zero-shot manner. In this way, we can get rid of the time-consuming manual operator design process. In addition, we further design a white-box operator to interpret and approximate the behaviour of LLM and propose a new version of decomposition-based MOEA, termed MOEA/D-LMO. This white-box operator improves generalization and reduces runtime by eliminating costly LLM interaction. Experimental studies on different test benchmarks show that our proposed method can achieve competitive performance with widely used MOEAs. Furthermore, the operators only learned from LLMs on a few instances have good generalization performances on unseen problems with different patterns and settings. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.
Original languageEnglish
Title of host publicationEvolutionary Multi-Criterion Optimization
Subtitle of host publication13th International Conference, EMO 2025, Proceedings, Part I
EditorsHemant Singh, Tapabrata Ray, Joshua Knowles, Xiaodong Li, Juergen Branke, Bing Wang, Akira Oyama
PublisherSpringer Singapore
Pages178-191
Edition1
ISBN (Electronic)978-981-96-3506-1
ISBN (Print)978-981-96-3505-4
DOIs
Publication statusPublished - Mar 2025
Event13th International Conference on Evolutionary Multi-Criterion Optimization (EMO 2025) - Shine Dome, Canberra, Australia
Duration: 4 Mar 20257 Mar 2025
https://emo2025.org/

Publication series

NameLecture Notes in Computer Science
Volume15513 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference13th International Conference on Evolutionary Multi-Criterion Optimization (EMO 2025)
Country/TerritoryAustralia
CityCanberra
Period4/03/257/03/25
Internet address

Funding

The work described in this paper was supported by the Research Grants Council of the Hong Kong Special Administrative Region, China [GRF Project No. CityU11215723 ] and Natural Science Foundation of China (Project No: 62276223).

Research Keywords

  • Evolutionary algorithm
  • Large language model
  • Machine learning
  • Multiobjective optimization

Fingerprint

Dive into the research topics of 'Large Language Model for Multiobjective Evolutionary Optimization'. Together they form a unique fingerprint.

Cite this