TY - JOUR
T1 - DyArtbank
T2 - Diverse artistic style transfer via pre-trained stable diffusion and dynamic style prompt Artbank
AU - Zhang, Zhanjie
AU - Zhang, Quanwei
AU - Li, Guangyuan
AU - Luan, Junsheng
AU - Yang, Mengyuan
AU - Wang, Yun
AU - Zhao, Lei
PY - 2025/2/15
Y1 - 2025/2/15
N2 - Artistic style transfer aims to transfer the learned style onto an arbitrary content image. However, most existing style transfer methods can only render consistent artistic stylized images, making it difficult for users to get enough stylized images to enjoy. To solve this issue, we propose a novel artistic style transfer framework called DyArtbank, which can generate diverse and highly realistic artistic stylized images. Specifically, we introduce a Dynamic Style Prompt ArtBank (DSPA), a set of learnable parameters. It can learn and store the style information from the collection of artworks, dynamically guiding pre-trained stable diffusion to generate diverse and highly realistic artistic stylized images. DSPA can also generate random artistic image samples with the learned style information, providing a new idea for data augmentation. Besides, a Key Content Feature Prompt (KCFP) module is proposed to provide sufficient content prompts for pre-trained stable diffusion to preserve the detailed structure of the input content image. Extensive qualitative and quantitative experiments verify the effectiveness of our proposed method. © 2025 Elsevier B.V.
AB - Artistic style transfer aims to transfer the learned style onto an arbitrary content image. However, most existing style transfer methods can only render consistent artistic stylized images, making it difficult for users to get enough stylized images to enjoy. To solve this issue, we propose a novel artistic style transfer framework called DyArtbank, which can generate diverse and highly realistic artistic stylized images. Specifically, we introduce a Dynamic Style Prompt ArtBank (DSPA), a set of learnable parameters. It can learn and store the style information from the collection of artworks, dynamically guiding pre-trained stable diffusion to generate diverse and highly realistic artistic stylized images. DSPA can also generate random artistic image samples with the learned style information, providing a new idea for data augmentation. Besides, a Key Content Feature Prompt (KCFP) module is proposed to provide sufficient content prompts for pre-trained stable diffusion to preserve the detailed structure of the input content image. Extensive qualitative and quantitative experiments verify the effectiveness of our proposed method. © 2025 Elsevier B.V.
KW - Artistic style transfer
KW - Pre-trained large-scale model
UR - http://www.scopus.com/inward/record.url?scp=85214494874&partnerID=8YFLogxK
UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85214494874&origin=recordpage
U2 - 10.1016/j.knosys.2025.112959
DO - 10.1016/j.knosys.2025.112959
M3 - RGC 21 - Publication in refereed journal
SN - 0950-7051
VL - 310
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
M1 - 112959
ER -