mbukerepo/live-portrait ✓🖼️ → 🖼️

▶️ 1.3K runs 📅 Jul 2024 ⚙️ Cog 0.9.12 🔗 GitHub 📄 Paper ⚖️ License

face-animation face-reenactment image-to-video

About

Efficient Portrait Animation with Stitching and Retargeting Control

Example Output

Output

Performance Metrics

6.68s Prediction Time

83.46s Total Time

All Input Parameters

{
  "flag_pasteback": true,
  "input_image_path": "https://replicate.delivery/pbxt/LENuJxQtTDy21AqLGeIPFR2aWRMUvUUIuzlMWqGAuDQS2T9Y/s9.jpg",
  "input_video_path": "https://replicate.delivery/pbxt/LENuJTpAkCkWI1pYnnV8hKJjC1jjUBzw8X6lHt111cliA4WV/d2.mp4",
  "flag_do_crop_input": true,
  "flag_relative_input": true
}

Input Parameters

flag_pasteback Type: booleanDefault: true: paste-back
input_image_path (required) Type: string: Portrait image
input_video_path (required) Type: string: Driving video
flag_do_crop_input Type: booleanDefault: true: We recommend checking the do crop option when facial areas occupy a relatively small portion of your image.
flag_relative_input Type: booleanDefault: true: relative motion

Output Schema

Output

Type: string • Format: uri

Example Execution Logs

[06:56:47] Load source image from                   live_portrait_pipeline.py:46
/tmp/tmpdv2p6edks9.jpg
/root/.pyenv/versions/3.10.14/lib/python3.10/site-packages/torch/nn/modules/conv.py:456: UserWarning: Plan failed with a cudnnException: CUDNN_BACKEND_EXECUTION_PLAN_DESCRIPTOR: cudnnFinalize Descriptor Failed cudnn_status: CUDNN_STATUS_NOT_SUPPORTED (Triggered internally at ../aten/src/ATen/native/cudnn/Conv_v8.cpp:919.)
return F.conv2d(input, weight, bias, self.stride,
[06:56:50] Load from video file (mp4 mov avi        live_portrait_pipeline.py:72
etc...): /tmp/tmptlq05lfad2.mp4
/root/.pyenv/versions/3.10.14/lib/python3.10/site-packages/torch/nn/modules/conv.py:605: UserWarning: Plan failed with a cudnnException: CUDNN_BACKEND_EXECUTION_PLAN_DESCRIPTOR: cudnnFinalize Descriptor Failed cudnn_status: CUDNN_STATUS_NOT_SUPPORTED (Triggered internally at ../aten/src/ATen/native/cudnn/Conv_v8.cpp:919.)
return F.conv3d(
Animating... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00
Concatenating result... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00
Dump to /tmp/tmpdv2p6edks9--tmptlq05lfad2_concat.mp4
Dump to /tmp/tmpdv2p6edks9--tmptlq05lfad2.mp4

Version Details

Version ID: 55392f840e8bfdc7af4d6139c67b6e713725e2b51dca63b53b499717902ea584
Version Created: July 8, 2024

Run on Replicate →