Unique3D: High-Quality 3D Meshes from a Single Image 238

Unique3D generates high-fidelity, diversely textured meshes from single-view wild images in 30 seconds, though runtime speed depends on your hardware resources.

Unique3D Main Features:

• High-Fidelity Generation: Unique3D achieves state-of-the-art generation fidelity, capable of producing detailed, intricate textures and complex geometries. This is achieved through a multi-view diffusion model that generates orthogonal multi-view images and corresponding normal maps.

• Efficiency: The framework is highly efficient, capable of generating high-fidelity 3D meshes in 30 seconds. This efficiency is attributed to the integration of a fast feed-forward model and an instant mesh reconstruction algorithm called ISOMER.

• Consistency: Unique3D ensures consistency in generated views by using a multi-level upscaling process to progressively increase the resolution of generated images. The ISOMER algorithm integrates color and geometric priors into the mesh results, addressing inconsistencies found in previous methods.

• Versatility: The framework exhibits strong versatility, performing well on diverse wild 2D images of various styles. This is demonstrated by extensive experiments showing that Unique3D outperforms existing methods in terms of fidelity, geometric detail, and resolution.

• Multi-Level Upscaling Strategy: Unique3D employs a multi-level upscaling strategy to progressively enhance the resolution of generated images. This involves fine-tuning multi-view-aware ControlNet and using super-resolution models to achieve high-resolution output.

• Normal Map Prediction: To capture rich surface details, Unique3D uses a normal diffusion model to predict normal maps corresponding to multi-view color images. This improves the accuracy of geometric details, especially at edges.

• ExplicitTarget Optimization: To address multi-view inconsistency issues and refine geometric details, Unique3D introduces ExplicitTarget optimization. This method assigns a unique optimization target to each vertex, guiding the optimization direction more robustly than traditional methods.

Unique3D Features:

• Generates high-fidelity textured meshes within 30 seconds.

• Trained in just 5 days using only 8 RTX4090 GPUs.

• Leverages multi-view diffusion model and normal diffusion model to generate multi-view images and normal maps.

• Adopts multi-level upscaling process to enhance resolution.

• Uses ISOMER for instant and consistent mesh reconstruction.

Unique3D was jointly developed by research teams from Tsinghua University and AVAR Inc.

Unique3D Official Website Entry:

Unique3D Online Use: https://huggingface.co/spaces/Wuvin/Unique3D

Unique3D Project Page: https://wukailu.github.io/Unique3D/

Unique3D Github: https://github.com/AiuniAI/Unique3D