We present DreamCraft3D++, an enhanced iteration of DreamCraft3D, a multi-stage 3D generation framework that enables efficient,
high-quality production of complex 3D assets. DreamCraft3D++ significantly improves upon its predecessor in both generation speed and quality,
reducing creation time to 10 minutes — a 20-fold acceleration. While retaining the multi-stage generation process, DreamCraft3D++ introduces two key innovations:
(1) A feed-forward multi-plane based reconstruction model replaces the time-consuming geometry sculpting optimization, achieving a 1000x speedup in this stage.
(2) For texture refinement, we propose a novel training-free IP-Adapter module that dynamically selects embeddings based on camera position, enhancing texture and geometry consistency.
This approach provides a 4x faster alternative to DreamCraft3D's DreamBooth fine-tuning.
Compared to current LRM-based methods, DreamCraft3D++ achieves a substantial improvement in both texture and geometric quality.
Extensive experiments across diverse datasets demonstrate DreamCraft3D++'s superior capability in generating creative 3D assets with intricate geometry and realistic 360° textures,
outperforming state-of-the-art image-to-3D methods. To foster further advancements in 3D content creation, we will open-source the complete implementation of DreamCraft3D++.
Given a single input image, Dreamcraft3D++ processes it with multi-view diffusion models to generate orthogonal, consistent views and normal maps. A feed-forward sparse-view 3D reconstruction model then infers textured meshes from these multi-view images, using a convolutional U-Net to map the input to non-orthogonal planes, which are subsequently decoded into Flexicubes. Finally, a training-free object-aware diffusion prior enhances high-frequency geometry and texture details through score distillation.
@article{sun2024dreamcraft3d++,
title={DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model},
author={Sun, Jingxiang and Peng, Cheng and Shao, Ruizhi and Guo, Yuan-Chen and Zhao, Xiaochen and Li, Yangguang and Cao, Yanpei and Zhang, Bo and Liu, Yebin},
journal={arXiv preprint arXiv:2410.12928},
year={2024},
}
@article{sun2023dreamcraft3d,
title={Dreamcraft3d: Hierarchical 3d generation with bootstrapped diffusion prior},
author={Sun, Jingxiang and Zhang, Bo and Shao, Ruizhi and Wang, Lizhen and Liu, Wen and Xie, Zhenda and Liu, Yebin},
journal={arXiv preprint arXiv:2310.16818},
year={2023}
}