StreamV2V: Open-Source Tool for Real-Time Video Face Swap and Style Transfer 197

StreamV2V: An open-source video tool for real-time video-to-video conversion, capable of real-time video face swapping and style conversion. StreamV2V enables real-time video-to-video conversion on an RTX 4090 GPU, achieving a processing frame rate of 20 FPS.

Because it is stream-based, StreamV2V supports videos of unlimited length and allows real-time prompt-based control of the video. It works by maintaining a feature bank that stores information from past frames; when a new frame arrives, the model leverages the features in this bank to help generate the output, much like looking into the past.

StreamV2V is able to handle streaming input—the input video can be a real-time streamed video, such as a video stream transmitted from a webcam.

StreamV2V supports replacing a person's face in a video with someone else's face, and can also transform videos into different artistic styles, including:

Claymation style: Processes the video into an effect resembling clay animation.

Doodle art style: Converts the video into an artistic effect resembling hand-drawn doodles.

StreamV2V official website: https://jeff-liangf.github.io/projects/streamv2v/

GitHub: https://github.com/Jeff-LiangF/streamv2v