Skip to main navigation Skip to search Skip to main content

Trade-Offs in Image Generation: How Do Different Dimensions Interact?

  • Sicheng Zhang (Co-first Author)
  • , Binzhu Xie (Co-first Author)
  • , Zhonghao Yan (Co-first Author)
  • , Yuli Zhang
  • , Donghao Zhou
  • , Xiaofei Chen
  • , Shi Qiu*
  • , Jiaqi Liu
  • , Guoyang Xie*
  • , Zhichao Lu
  • *Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Model performance in text-to-image (T2I) and image-toimage (I2I) generation often depends on multiple aspects, including quality, alignment, diversity, and robustness. However, models' complex trade-offs among these dimensions have been rarely explored due to (1) the lack of datasets that allow fine-grained quantification of these trade-offs, and (2) using a single metric for multiple dimensions. To address this gap, we introduce TRIG-Bench (Trade-offs in Image Generation), which spans 10 dimensions (Realism, Originality, Aesthetics, Content, Relation, Style, Knowledge, Ambiguity, Toxicity and Bias), contains 40,200 samples, and covers 132 Pairwise Dimensional Subsets. Furthermore, we develop TRIGScore, a VLM-as-judge metric that automatically adapts to various dimensions. Based on TRIG-Bench and TRIGScore, we evaluate 14 cuttingedge models across T2I and I2I tasks. In addition, we propose the Relation Recognition System and generate the Dimension Trade-off Map (DTM), which visualizes modelspecific capability trade-offs. Our experiments demonstrate that DTM consistently provides a comprehensive under-standing of the trade-offs between dimensions for each type of generation model. Notably, after fine-tuning on DTM, the model's dimension-specific impact is mitigated, and overall performance is enhanced. Code is available at: https://github.com/fesvhtr/TRIG. © 2025 IEEE.
Original languageEnglish
Title of host publication2025 IEEE/CVF International Conference on Computer Vision (ICCV)
PublisherIEEE
Pages17256-17267
Number of pages12
ISBN (Electronic)979-8-3315-8775-8
ISBN (Print)979-8-3315-8776-5
DOIs
Publication statusPublished - Oct 2025
Event2025 IEEE/CVF International Conference on Computer Vision (ICCV 2025) - Hawaii Convention Center, Honolulu, United States
Duration: 19 Oct 202523 Oct 2025
https://iccv.thecvf.com/

Publication series

NameProceedings of the IEEE International Conference on Computer Vision
ISSN (Print)1550-5499
ISSN (Electronic)2380-7504

Conference

Conference2025 IEEE/CVF International Conference on Computer Vision (ICCV 2025)
Abbreviated titleICCVW 2025
PlaceUnited States
CityHonolulu
Period19/10/2523/10/25
Internet address

Bibliographical note

Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

Funding

This work was supported by The Chinese University of Hong Kong (Project No.: 4055212); and in part by the Research Grants Council of the Hong Kong Special Administrative Region, China (Project No.: T45-401/22-N).

Research Keywords

  • evaluation metrics
  • generative models
  • image generation

Fingerprint

Dive into the research topics of 'Trade-Offs in Image Generation: How Do Different Dimensions Interact?'. Together they form a unique fingerprint.

Cite this