Sel3DCraft: Interactive Visual Prompts for User-Friendly Text-to-3D Generation
By: Nan Xiang , Tianyi Liang , Haiwen Huang and more
Potential Business Impact:
Creates 3D objects from text with better control.
Text-to-3D (T23D) generation has transformed digital content creation, yet remains bottlenecked by blind trial-and-error prompting processes that yield unpredictable results. While visual prompt engineering has advanced in text-to-image domains, its application to 3D generation presents unique challenges requiring multi-view consistency evaluation and spatial understanding. We present Sel3DCraft, a visual prompt engineering system for T23D that transforms unstructured exploration into a guided visual process. Our approach introduces three key innovations: a dual-branch structure combining retrieval and generation for diverse candidate exploration; a multi-view hybrid scoring approach that leverages MLLMs with innovative high-level metrics to assess 3D models with human-expert consistency; and a prompt-driven visual analytics suite that enables intuitive defect identification and refinement. Extensive testing and user studies demonstrate that Sel3DCraft surpasses other T23D systems in supporting creativity for designers.
Similar Papers
Say It, See It: A Systematic Evaluation on Speech-Based 3D Content Generation Methods in Augmented Reality
Human-Computer Interaction
Creates 3D objects from words and pictures.
PromptMap: Supporting Exploratory Text-to-Image Generation
Human-Computer Interaction
Helps artists find good ideas faster.
Controllable 3D Object Generation with Single Image Prompt
CV and Pattern Recognition
Creates 3D objects from pictures, not just words.