okaris/live-portrait 🔢✓🖼️ → 🖼️

▶️ 162.2K runs 📅 Jul 2024 ⚙️ Cog 0.10.0-alpha20

About

Example Output

Output

Performance Metrics

39.49s Prediction Time

133.71s Total Time

All Input Parameters

{
  "scale": 2.3,
  "vx_ratio": 0,
  "vy_ratio": -0.01,
  "flag_remap": true,
  "flag_do_crop": true,
  "source_image": "https://replicate.delivery/pbxt/LM1eHhq9VUnim4cZmYHDLBZp7eKRj3QXxTid79ifYn37NJoi/image-13.webp",
  "driving_video": "https://replicate.delivery/pbxt/LLyKx8PIeZAMBkTTpxCpoM1lWSx6YBBrRGXeMhBOxjFdpyFe/IMG_2228.mov",
  "flag_relative": true,
  "flag_crop_driving_video": false,
  "scale_crop_driving_video": 2.2,
  "vx_ratio_crop_driving_video": 0,
  "vy_ratio_crop_driving_video": -0.1,
  "flag_video_editing_head_rotation": false,
  "driving_smooth_observation_variance": 0.01
}

Input Parameters

scale Type: numberDefault: 2.3Range: 1.8 - 3.2: Source crop scale
vx_ratio Type: numberDefault: 0Range: -0.5 - 0.5: Source crop x
vy_ratio Type: numberDefault: -0.125Range: -0.5 - 0.5: Source crop y
flag_remap Type: booleanDefault: true: Use paste-back
flag_do_crop Type: booleanDefault: true: Crop source image/video
source_image (required) Type: string: Source image for animation
source_video Type: string: Source video for animation
driving_video (required) Type: string: Driving video for animation
flag_relative Type: booleanDefault: true: Use relative motion
flag_crop_driving_video Type: booleanDefault: false: Crop driving video
scale_crop_driving_video Type: numberDefault: 2.2Range: 1.8 - 3.2: Driving crop scale
vx_ratio_crop_driving_video Type: numberDefault: 0Range: -0.5 - 0.5: Driving crop x
vy_ratio_crop_driving_video Type: numberDefault: -0.1Range: -0.5 - 0.5: Driving crop y
flag_video_editing_head_rotation Type: booleanDefault: false: Use relative head rotation (v2v)
driving_smooth_observation_variance Type: numberDefault: 3e-7Range: 1e-11 - 0.01: Motion smooth strength (v2v)

Output Schema

Output

Type: array • Items Type: string • Items Format: uri

Example Execution Logs

args_user:  {'source': '/tmp/tmpnmdzy8ebimage-13.webp', 'driving': '/tmp/tmp9yp2f4vhIMG_2228.mov', 'flag_relative_motion': True, 'flag_do_crop': True, 'flag_pasteback': True, 'flag_crop_driving_video': False, 'flag_video_editing_head_rotation': False, 'scale': 2.3, 'vx_ratio': 0.0, 'vy_ratio': -0.01, 'scale_crop_driving_video': 2.2, 'vx_ratio_crop_driving_video': 0.0, 'vy_ratio_crop_driving_video': -0.1, 'driving_smooth_observation_variance': 0.01}
Load source image from                   live_portrait_pipeline.py:90
/tmp/tmpnmdzy8ebimage-13.webp
Load driving video from:                live_portrait_pipeline.py:128
/tmp/tmp9yp2f4vhIMG_2228.mov, FPS is 30
[06:37:20] Start making driving motion template... live_portrait_pipeline.py:134
Making motion templates... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:01
[06:37:26] Dump motion template to                 live_portrait_pipeline.py:159
/tmp/tmp9yp2f4vhIMG_2228.pkl
Prepared pasteback mask done.           live_portrait_pipeline.py:168
[06:37:27] The animated video consists of 154      live_portrait_pipeline.py:238
frames.
🚀Animating... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:14
Concatenating result... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00
[06:37:46] Audio is selected from                  live_portrait_pipeline.py:387
/tmp/tmp9yp2f4vhIMG_2228.mov, concat
mode
Video with audio generated successfully:                 video.py:203
animations/tmpnmdzy8ebimage-13--tmp9yp2f4vhIMG_2228_conc
at_with_audio.mp4
Replace                                 live_portrait_pipeline.py:390
animations/tmpnmdzy8ebimage-13--tmp9yp2
f4vhIMG_2228_concat.mp4 with
animations/tmpnmdzy8ebimage-13--tmp9yp2
f4vhIMG_2228_concat_with_audio.mp4
[06:37:49] Audio is selected from                  live_portrait_pipeline.py:404
/tmp/tmp9yp2f4vhIMG_2228.mov
Video with audio generated successfully:                 video.py:203
animations/tmpnmdzy8ebimage-13--tmp9yp2f4vhIMG_2228_with
_audio.mp4
Replace                                 live_portrait_pipeline.py:407
animations/tmpnmdzy8ebimage-13--tmp9yp2
f4vhIMG_2228.mp4 with
animations/tmpnmdzy8ebimage-13--tmp9yp2
f4vhIMG_2228_with_audio.mp4
Animated template:                      live_portrait_pipeline.py:411
/tmp/tmp9yp2f4vhIMG_2228.pkl, you can
specify `-d` argument with this
template path next time to avoid
cropping video, motion making and
protecting privacy.
Animated video:                         live_portrait_pipeline.py:412
animations/tmpnmdzy8ebimage-13--tmp9yp2
f4vhIMG_2228.mp4
Animated video with concat:             live_portrait_pipeline.py:413
animations/tmpnmdzy8ebimage-13--tmp9yp2
f4vhIMG_2228_concat.mp4

Version Details

Version ID: 8be2edeab144ba0865f9fa84168f621ee417a2003db947802f900519f7c43300
Version Created: August 1, 2024

Run on Replicate →