Live-Portrait.org

Overview

Live Portrait is an AI tool capable of turning static photos into dynamic, expressive animations. This tool provides the flexibility to animate photos across various styles and sizes utilizing stitching technology.

It allows users to generate highly realistic facial expressions, smooth head movements, and accurate lip synchronization from a single photo. Dynamic video-to-video face animation and editing capabilities are also offered.

Control over the animation of eye openness and lip positions are provided for nuanced expression control. The technology behind Live Portrait extends the potential of the implicit-keypoint-based framework to balance computational efficiency and controllability.

This is achieved through a mixed image-video training strategy, an upgraded network architecture, and improved motion transformation and optimization objectives.

Also included are stitching and retargeting modules for enhanced control. The main applications include self or cross re-enactment, portrait animation from still images, portrait video editing, eye and lip retargeting control, and animation across different styles.

Live Portrait also has the potential to be fine-tuned for animal animations. The tool was jointly developed by researchers from Kuaishou Technology, the University of Science and Technology of China, and Fudan University.

Live Portrait can be accessed and tried for free, potentially revolutionizing the way portrait animations are made.