ShapeGen: Towards High-Quality 3D Shape Synthesis
By: Yangguang Li , Xianglong He , Zi-Xin Zou and more
Potential Business Impact:
Creates detailed 3D objects from pictures.
Inspired by generative paradigms in image and video, 3D shape generation has made notable progress, enabling the rapid synthesis of high-fidelity 3D assets from a single image. However, current methods still face challenges, including the lack of intricate details, overly smoothed surfaces, and fragmented thin-shell structures. These limitations leave the generated 3D assets still one step short of meeting the standards favored by artists. In this paper, we present ShapeGen, which achieves high-quality image-to-3D shape generation through 3D representation and supervision improvements, resolution scaling up, and the advantages of linear transformers. These advancements allow the generated assets to be seamlessly integrated into 3D pipelines, facilitating their widespread adoption across various applications. Through extensive experiments, we validate the impact of these improvements on overall performance. Ultimately, thanks to the synergistic effects of these enhancements, ShapeGen achieves a significant leap in image-to-3D generation, establishing a new state-of-the-art performance.
Similar Papers
GeoSAM2: Unleashing the Power of SAM2 for 3D Part Segmentation
CV and Pattern Recognition
Adds tiny details to 3D shapes quickly.
ShapeGen4D: Towards High Quality 4D Shape Generation from Videos
CV and Pattern Recognition
Turns videos into moving 3D models.
GEN3D: Generating Domain-Free 3D Scenes from a Single Image
CV and Pattern Recognition
Creates realistic 3D worlds from one picture.