ByteDance Video Generation Models PixelDance and Seaweed Now Live on Jimeng AI 202

On November 15, 2024, ByteDance's two video generation models, PixelDance and Seaweed, were officially launched on the Jimeng AI platform. Currently, both the web version and the mobile app support the use of these two models, which have been made available to the public for free. Users can experience this feature through the "Video Generation" section of Jimeng AI.

The PixelDance model supports text-to-video and image-to-video, capable of generating high-quality video clips up to 10 seconds long, with human actions approaching photorealistic quality, surpassing OpenAI's Sora model in handling complex actions. The Seaweed model, on the other hand, demonstrates excellent first-frame consistency in image-to-video scenarios, maintaining consistency with the user's input image, while also offering efficient generation capabilities—it can complete a 5-second high-quality video in just 60 seconds, far exceeding the industry standard of 3-5 minutes within China.

Model Features

• PixelDance Features: Capable of generating magical special effects, suitable for using techniques such as temporal prompts, long takes, and more.

• Seaweed Features: Demonstrates excellent first-frame consistency in image-to-video scenarios, maintaining consistency with the user's input image and accurately reproducing details such as color.

• Camera Switching: PixelDance performs best when switching cameras 3-5 times within a 10-second video, maintaining strong consistency in scenes and characters.

• Visual Effects: The Seaweed model delivers smooth, natural, and realistic visuals for large-amplitude motion scenes.

• Prompt Description: Through subtle and progressive prompt descriptions, PixelDance can generate magical special effects.

Application Scenarios

• Design Field: Both models can be applied in the design field, helping creators achieve more creative design works.

• Film and TV Production: In film and TV production, these models can be used to generate special effects and complex scenes.

• Animation Creation: The models support animation creation, capable of generating smooth and natural animation effects.

• Professional Creation: Refined through business scenarios such as Jianying and Jimeng AI, the models better serve professional creators and artists.

• Story Creation: The features provided by the Jimeng AI platform facilitate story creation and improve creative efficiency.

The release of these two models, especially PixelDance, reflects ByteDance's maturity in video generation technology, particularly achieving industry-leading levels in semantic understanding, human action processing, and consistency across multi-camera switches.