Abstract
Model performance in text-to-image (T2I) and image-toimage (I2I) generation often depends on multiple aspects, including quality, alignment, diversity, and robustness. However, models' complex trade-offs among these dimensions have been rarely explored due to (1) the lack of datasets that allow fine-grained quantification of these trade-offs, and (2) using a single metric for multiple dimensions. To address this gap, we introduce TRIG-Bench (Trade-offs in Image Generation), which spans 10 dimensions (Realism, Originality, Aesthetics, Content, Relation, Style, Knowledge, Ambiguity, Toxicity and Bias), contains 40,200 samples, and covers 132 Pairwise Dimensional Subsets. Furthermore, we develop TRIGScore, a VLM-as-judge metric that automatically adapts to various dimensions. Based on TRIG-Bench and TRIGScore, we evaluate 14 cuttingedge models across T2I and I2I tasks. In addition, we propose the Relation Recognition System and generate the Dimension Trade-off Map (DTM), which visualizes modelspecific capability trade-offs. Our experiments demonstrate that DTM consistently provides a comprehensive under-standing of the trade-offs between dimensions for each type of generation model. Notably, after fine-tuning on DTM, the model's dimension-specific impact is mitigated, and overall performance is enhanced. Code is available at: https://github.com/fesvhtr/TRIG. © 2025 IEEE.
| Original language | English |
|---|---|
| Title of host publication | 2025 IEEE/CVF International Conference on Computer Vision (ICCV) |
| Publisher | IEEE |
| Pages | 17256-17267 |
| Number of pages | 12 |
| ISBN (Electronic) | 979-8-3315-8775-8 |
| ISBN (Print) | 979-8-3315-8776-5 |
| DOIs | |
| Publication status | Published - Oct 2025 |
| Event | 2025 IEEE/CVF International Conference on Computer Vision (ICCV 2025) - Hawaii Convention Center, Honolulu, United States Duration: 19 Oct 2025 → 23 Oct 2025 https://iccv.thecvf.com/ |
Publication series
| Name | Proceedings of the IEEE International Conference on Computer Vision |
|---|---|
| ISSN (Print) | 1550-5499 |
| ISSN (Electronic) | 2380-7504 |
Conference
| Conference | 2025 IEEE/CVF International Conference on Computer Vision (ICCV 2025) |
|---|---|
| Abbreviated title | ICCVW 2025 |
| Place | United States |
| City | Honolulu |
| Period | 19/10/25 → 23/10/25 |
| Internet address |
Bibliographical note
Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).Funding
This work was supported by The Chinese University of Hong Kong (Project No.: 4055212); and in part by the Research Grants Council of the Hong Kong Special Administrative Region, China (Project No.: T45-401/22-N).
Research Keywords
- evaluation metrics
- generative models
- image generation
Fingerprint
Dive into the research topics of 'Trade-Offs in Image Generation: How Do Different Dimensions Interact?'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver