Multimodal
OrbitForge: Text-to-3D Scene Generation via Reconstruction-Anchored Video Synthesis
OrbitForge is a novel adapter designed for text-to-3D scene generation, utilizing frozen video priors and Gaussian Splatting reconstruction optimization to convert text-generated videos into consistent 3D Gaussian Splatting scenes. It leverages Deformable Gaussian Splatting for initial reconstruction and completes missing views using the text-to-video model, achieving a median span of 359.0 degrees on the T3Bench-derived audit and significantly improving the ImageReward metric from 8.07 to 16.36. This approach streamlines the process without requiring task-specific fine-tuning, making it a valuable tool for practitioners aiming to enhance 3D consistency in generated scenes.
text-to-3dvideo-synthesis