Multimodal Conditioning of Fine-Tuned Stable Diffusion XL for Controllable and Culturally Faithful Ulos Motif Generation
Researchers developed a multimodal generative framework using Stable Diffusion XL and LLaMA to create controllable and culturally faithful Ulos motif designs. The framework incorporates four conditioning mechanisms: text, image, representation, and semantic map. An ablation study showed that combining all four mechanisms resulted in the weakest FID score, indicating conflicting optimization signals. The framework was evaluated by weavers and the public, with statistically significant positive acceptance.
Save an API key to vote.