ToonCrafter: Auto-Generate Transition Frames for Cartoon Animation 223

ToonCrafter automatically generates transition frames for cartoon animations and auto-colors animation sketches based on reference images. Using a generative interpolation approach, ToonCrafter produces natural, coherent intermediate frames between cartoon animation frames. It can handle complex nonlinear motion and occlusion issues, making animation transitions smoother and more natural. It can also color sketches based on reference images.

You only need to provide one or two reference images, and the system will color the input sketches according to the colors and style of the reference images.

ToonCrafter is adaptable to different animation styles, handling both simple line animations and complex cartoon scenes with ease.

ToonCrafter is a tool jointly developed by the Chinese University of Hong Kong, City University of Hong Kong, and Tencent's Artificial Intelligence Lab, designed to help animators more efficiently generate and optimize transition effects in cartoon animations. By leveraging generative models and interpolation techniques, it addresses the issue of unnatural frame-to-frame transitions in cartoon animation, improving both the efficiency and quality of animation production.

ToonCrafter Features:

Generative Cartoon Interpolation: ToonCrafter employs a generative interpolation method to produce natural, coherent intermediate frames between cartoon animation frames. This approach can handle complex nonlinear motion and occlusion issues, resulting in smoother and more natural animation transitions. ToonCrafter adapts to both simple and complex animation styles.

An example illustrates how ToonCrafter generates intermediate frames between each step of a character's stride when producing a running animation, making the running motion appear fluid and realistic.

Sketch-Guided Interpolation: ToonCrafter also supports sketch-guided interpolation. Users can provide sparse sketch inputs, and the system will generate intermediate frames that align with the user's intent. This allows for fine-grained control over animation transitions, enhancing the accuracy and personalization of the interpolation results.

An example illustrates how, when producing a waving animation, the user only needs to draw the starting and ending poses, and ToonCrafter will generate the in-between waving motion.

ToonCrafter Project URL:https://huggingface.co/spaces/Doubiiu/tooncrafter

ToonCrafter Github:https://github.com/ToonCrafter/ToonCrafter