Matrix-Zero: Kunlun Wanwei Launches China's First 3D World Model 196

Kunlun Tech launched the Matrix-Zero world model on February 14, 2025, becoming the first domestic company to simultaneously release 3D scene generation and interactive video generation models.

The world model consists of two sub-models: one is a 3D scene generation model, which can convert user-input images into realistic 3D scenes that can be freely explored, featuring global consistency, support for different style image inputs and style transfer, as well as the ability to generate dynamic physical effects. The other is an interactive video generation model, which supports real-time user input to generate interactive video effects and provides precise viewpoint control.

Matrix-Zero Features

3D Scene Generation Model:

• Input Conversion: Converts user-input images into realistic and reasonable 3D scenes that can be freely explored.

• Global Consistency: The generated 3D scenes remain consistent after 360-degree viewing, with no front-to-back inconsistencies.

• Free Exploration: Supports long-distance, large-scale exploration in any direction within the scene.

• Style Transfer: Supports input images of different styles and generates 3D scenes in various styles.

• Dynamic Scene Generation: Supports the generation of physical effects such as lighting effects, water splash dynamics, and cloud/fog dynamics.

Interactive Video Generation Model:

• User Input Driven: With user input as the core driver, generates interactive spatial intelligence videos.

• Precise Control: Features a more precisely controlled action model, supporting viewpoint and action control via keyboard and mouse.

• Smooth Experience: Optimizes control experience through a sliding window mechanism, reducing input latency and improving interactive smoothness.

• Multi-type Input Processing: Includes discrete motion control module, continuous viewpoint control module, and 3D scene position tracking module to handle different types of user input.

Matrix-Zero Application Scenarios

• 3D Game Development: Provides controllable and fast 3D scene modeling, improving game development efficiency.

• Film and Television Production: Supports scene and shot generation for movies/short dramas, offering more creative possibilities.

• Embodied Intelligence: Quickly builds simulated scenes, enhancing the training and application efficiency of embodied intelligence.

• Virtual Environments and Interactive Applications: Provides immersive experiences, expanding application scenarios in virtual environments and interactive applications.

• AI Multi-matrix Products: Empowers the company's AI game production, AI short drama production and editing businesses, boosting productivity.

Spatial intelligence is the next milestone of AI. What is spatial intelligence? In the view of AI godmother Fei-Fei Li, spatial intelligence is not only about enabling AI to see the world, but also about enabling AI to understand the three-dimensional world and have the ability to interact with it, ultimately achieving deep interaction with the real world.

Matrix-Zero is expected to launch in April 2025, and will first be applied to Kunlun Tech's AI game production and AI short drama production business lines.