Skip to main navigation Skip to search Skip to main content

Duetsvg: Unified multimodal svg generation with internal visual guidance

  • Peiying Zhang
  • , Nanxuan Zhao
  • , Matthew Fisher
  • , Yiran Xu
  • , Jing Liao*
  • , Difan Liu*
  • *Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

Recent vision-language model (VLM)-based approaches have achieved impressive results on SVG generation. However, because they generate only text and lack visual signals during decoding, they often struggle with complex semantics and fail to produce visually appealing or geometrically coherent SVGs. We introduce DuetSVG, a unified multimodal model that jointly generates image tokens and corresponding SVG tokens in an end-to-end manner. DuetSVG is trained on both image and SVG datasets. At inference, we apply a novel test-time scaling strategy that leverages the model's native visual predictions as guidance to improve SVG decoding quality. Extensive experiments show that our method outperforms existing methods, producing visually faithful, semantically aligned, and syntactically clean SVGs across a wide range of applications.
Original languageEnglish
Title of host publicationProceedings - 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
PublisherIEEE
Pages10219-10229
Number of pages11
Publication statusPublished - 3 Jun 2026
Event2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
- Colorado Convention Center, Denver, United States
Duration: 3 Jun 20267 Jun 2026
https://cvpr.thecvf.com/

Conference

Conference2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
PlaceUnited States
CityDenver
Period3/06/267/06/26
Internet address

Funding

This work was partially supported by the Innovation and Technology Fund (ITF) of the Innovation and Technology Commission (ITC) of the Hong Kong Special Administrative Region (HKSAR) Government [Project No. ITS/269/24FP].

Fingerprint

Dive into the research topics of 'Duetsvg: Unified multimodal svg generation with internal visual guidance'. Together they form a unique fingerprint.

Cite this