Animate portraits with video-driven facial movements.

Open

August 2, 2024

Rank #5966

Live-Portrait

Avatar animation

814

1.0(1)

Use tool Copy 🔗

Inputs:

Outputs:

Animate portraits with video-driven facial movements.

Overview

Overview Releases Alternatives Pricing Pros & Cons Prompts Reviews Q&A

Featured alternatives

AI Animal Generator

477

Overview Discussion

Overview

The fofr/live-portrait is an AI model that enables portrait animation by leveraging a driving video source. The main functionality is to generate animated portraits given input images.

This happens on the platform Replicate and the API enables integration with other applications. With an open-source provision, users also have the option of running the model on their local systems with Docker.

The model, which operates on Nvidia A40 (Large) GPU hardware, varies prediction times based on the given inputs. As part of the functionality, LivePortrait uses InsightFace buffalo_l models, thus its usage in commercial applications is restricted.

Additionally, the LivePortrait code and weights are released under the MIT license. The model utilises the ComfyUI custom node that was created by Kijai and the safetensor weights they converted.

There is considerable support with documentation and available examples to assist users in understanding how to use the model. This can be especially helpful while exploring various applications of portrait animation, from digital art creation to virtual avatar design.

Releases

Live-PortraitInitial

Get notified when a new version of Live-Portrait is released

Notify me

Initial release

July 8, 2024

Initial release of Live-Portrait.

+ Submit new release

By unverified author Claim this AI

🇺🇸United States

Pricing

Pricing model

Paid

Paid options from

$0.00/unit

Billing frequency

Pay-as-you-go

Use tool

Save

🔗 Copy link

🗳️ Vote Best AI Tool

Featured

Avatar animation Live-Portrait

Avatar animation

814

1.0(1)

Overview Releases Alternatives Pricing Pros & Cons Prompts Reviews Q&A

Use tool

Save

Top alternatives

Krikey AI

Created animated characters for developers.

Avatar animation

Open

2,135 www.krikey.ai

Share

🇺🇸 United States

Released 2y ago
No pricing

22,020
78
3.1
Nero Face Animation

Animate photos with vivid facial emotions for free

Avatar animation

Open

Share

🇩🇪 Germany

Released 2y ago
No pricing

3,356
27
4.0

Promote AI Claim AI New release

Reviews

1.0

Average from 1 rating.

★ ★ ★ ★ ★ 0

★ ★ ★ ★ 0

★ ★ ★ 0

★ ★ 0

★ 1

Your rating

★ ★ ★ ★ ★

Post

How would you rate Live-Portrait?

Help other people by letting them know if this AI was useful.

Prompts & Results

Title:

Description:

Prompt type*:

Prompt*:

Output type*:

Output*:

Add your own prompts and outputs to help others understand how to use this AI.

Pros and Cons

Pros

Animates portraits with video input

Integration ability with API

Runs on Replicate platform

Option for local system execution

Compatible with Docker

Operates on Nvidia GPU

Open-source provision

MIT license

InsightFace buffalo_l model usage

Custom ComfyUI node

Assistance with documentation

Availability of application examples

Potential for digital art creation

Avatar design capabilities

Adaptable prediction times

Cost transparency

Option for public runs

Support for various input/output

Detailed README

Retargeting control in animation

Links to example driving videos

Links to GitHub and paper

Restriction for commercial applications

View 18 more pros

Cons

Commercial use restricted

Runs on Nvidia A40 GPU only

Variable prediction times

Requires Docker for local execution

Relies on InsightFace buffalo_l models

Requires ComfyUI custom node

Depends on safetensor weights

Limited to portrait animation

MIT License restrictions

Usage bound to Replicate platform

View 5 more cons

Q&A

What is the primary functionality of the LivePortrait AI model?

The primary functionality of the LivePortrait AI model is to generate animated portraits given input images.

How does LivePortrait use a driving video source to animate portraits?

LivePortrait leverages a driving video source to animate portraits. It uses the motions and expressions in the source video to animate the given portrait. Although the specific methodology isn't detailed, this generally involves feature extraction, mapping, and synthesis.

What platform does the LivePortrait operate on?

LivePortrait operates on the Replicate platform.

Is there an API for integrating LivePortrait with other applications?

Yes, there is an API provided for integrating LivePortrait with other applications.

Is it possible to run the LivePortrait model on my local system?

Yes, thanks to its open-source provision, you could run the LivePortrait model on your local system. Particularly, the Docker option they provide can assist in this.

What hardware does LivePortrait operate on?

LivePortrait operates on Nvidia A40 (Large) GPU hardware.

+ Show 14 more

How do input variations affect the prediction times of the LivePortrait?

The prediction times of LivePortrait vary based on the inputs. While specific details are not mentioned, factors such as image complexity or resolution could potentially impact prediction times.

Why is the usage of LivePortrait in commercial applications restricted?

The reason commercial use of LivePortrait is restricted is because the model uses InsightFace buffalo_l models, which have their own usage limitations.

Under what license are the LivePortrait code and weights released?

The LivePortrait code and weights are released under the MIT license.

What is the ComfyUI custom node and how does LivePortrait utilize it?

The ComfyUI custom node is a component used by the LivePortrait model, created by Kijai. However, precise details of how the model utilises this node are not mentioned.

Who converted the safetensor weights the model uses and why?

The safetensor weights that the model uses were converted by Kijai, though the specific reasons for this conversion are not indicated.

What is the role of the safetensor weights in the LivePortrait's performance?

While the exact role of safetensor weights in LivePortrait's performance isn't expressly stated, they are most likely integral to the operations of the model and its ability to generate animated portraits.

What kind of support is provided to help users understand how to use the LivePortrait model?

Considerable support is provided to help users understand how to use the LivePortrait model, in the form of documentation and available examples.

What are some popular applications of portrait animation with LivePortrait?

While a variety of applications for LivePortrait are possible, the key examples mentioned are digital art creation and virtual avatar design.

What are the requirements to run the fofr/live-portrait model with an API on Replicate?

The requirements to run the LivePortrait model with an API on Replicate are not specified. However, being open-source and having Docker integration, the model may be deployed on various systems as long as they meet basic hardware and software requirements.

What is the cost of running the LivePortrait model on Replicate?

Running the LivePortrait model on Replicate costs approximately $0.020 per run or 50 runs per $1. However, the actual cost may fluctuate depending on your inputs.

Can I use LivePortrait for avatar animation?

Yes, one of the applications of LivePortrait is for avatar animation, bringing static portrait images to life based on a driving video source.

Is this AI model related to any academic or scientific work?

LivePortrait is indeed related to academic work, being based on a paper titled 'Efficient Portrait Animation with Stitching and Retargeting Control'.

How can Docker be used to run this AI model on a personal computer?

The specifics of using Docker to run the LivePortrait model on a personal computer is unclear. However, as the model is open-source and runs with Docker, it should be possible to use Docker for running the model locally as long as the local system satisfies necessary requirements.

What restrictions are there on the commercial use of this AI model?

The commercial use of LivePortrait is restricted due to its use of InsightFace buffalo_l models. The complete restrictions or terms are not mentioned in the given content but usage restrictions are generally guided by the modeling and licensing terms of these specific models.

Ask a question

Submit

#5966

Search

Live-Portrait

Overview

Releases

Pricing

Top alternatives

Related topics

Reviews

How would you rate Live-Portrait?

Prompts & Results

Pros and Cons

Pros

View 18 more pros

Cons

View 5 more cons

Q&A

Search

Overview

Releases

Pricing

Top alternatives

Related topics

Reviews

How would you rate Live-Portrait?

Prompts & Results

Pros and Cons

Pros

View 18 more pros

Cons

View 5 more cons

Q&A

Help

People also viewed

Feedback and Incident Report

AI Options

Create AI Tools

Mini Tool

Vibe code an AI Tool