zsxkib/moore-animateanyone 🔢🖼️ → 🖼️

▶️ 894 runs 📅 Jan 2024 ⚙️ Cog 0.8.6 🔗 GitHub 📄 Paper ⚖️ License
image-to-video pose-guided-animation video-consistent-character-generation

About

Unofficial Re-Trained AnimateAnyone (Image + DWPose Video → Animated Video of Image)

Example Output

Output

Performance Metrics

449.09s Prediction Time
579.68s Total Time
All Input Parameters
{
  "width": 512,
  "height": 768,
  "length": 128,
  "guidance_scale": 3.5,
  "sampling_steps": 25,
  "motion_sequence": "https://replicate.delivery/pbxt/KFWQJTPDhFou0smS93XVLMlyVQIedFa2GiP4C1gfTaW5GnQF/anyone-video-5_kps.mp4",
  "reference_image": "https://replicate.delivery/pbxt/KFWQJsyppeXHrUBQnwo5PS4eaAFe0utu15cvH5TUSrKz3hOR/anyone-10.png"
}
Input Parameters
seed Type: integer
Random seed. Leave blank to randomize the seed
width Type: integerDefault: 512Range: 448 - 768
Desired width of the output video
height Type: integerDefault: 768Range: 512 - 1024
Desired height of the output video
length Type: integerDefault: 24Range: 24 - 128
Desired length of the output video in frames
guidance_scale Type: numberDefault: 3.5
Scale for guidance during animation generation
sampling_steps Type: integerDefault: 25
Number of sampling steps for the animation
motion_sequence (required) Type: string
Path to the motion sequence video
reference_image (required) Type: string
Path to the reference image
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
Using seed: 22384
Some weights of the model checkpoint were not used when initializing UNet2DConditionModel:
['conv_norm_out.weight, conv_norm_out.bias, conv_out.weight, conv_out.bias']
/root/.pyenv/versions/3.11.7/lib/python3.11/site-packages/torch/_utils.py:776: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
return self.fget.__get__(instance, owner)()
/src/src/pipelines/pipeline_pose2vid_long.py:406: FutureWarning: Accessing config attribute `in_channels` directly via 'UNet3DConditionModel' object attribute is deprecated. Please access 'in_channels' over 'UNet3DConditionModel's config object instead, e.g. 'unet.config.in_channels'.
num_channels_latents = self.denoising_unet.in_channels
  0%|          | 0/25 [00:00<?, ?it/s]
  4%|▍         | 1/25 [00:15<06:16, 15.70s/it]
  8%|▊         | 2/25 [00:31<06:00, 15.68s/it]
 12%|█▏        | 3/25 [00:47<05:45, 15.70s/it]
 16%|█▌        | 4/25 [01:02<05:30, 15.72s/it]
 20%|██        | 5/25 [01:18<05:14, 15.74s/it]
 24%|██▍       | 6/25 [01:34<04:59, 15.77s/it]
 28%|██▊       | 7/25 [01:50<04:44, 15.78s/it]
 32%|███▏      | 8/25 [02:06<04:28, 15.80s/it]
 36%|███▌      | 9/25 [02:21<04:13, 15.82s/it]
 40%|████      | 10/25 [02:37<03:57, 15.83s/it]
 44%|████▍     | 11/25 [02:53<03:41, 15.84s/it]
 48%|████▊     | 12/25 [03:09<03:26, 15.85s/it]
 52%|█████▏    | 13/25 [03:25<03:10, 15.86s/it]
 56%|█████▌    | 14/25 [03:41<02:54, 15.86s/it]
 60%|██████    | 15/25 [03:57<02:38, 15.86s/it]
 64%|██████▍   | 16/25 [04:12<02:22, 15.86s/it]
 68%|██████▊   | 17/25 [04:28<02:06, 15.87s/it]
 72%|███████▏  | 18/25 [04:44<01:51, 15.87s/it]
 76%|███████▌  | 19/25 [05:00<01:35, 15.87s/it]
 80%|████████  | 20/25 [05:16<01:19, 15.87s/it]
 84%|████████▍ | 21/25 [05:32<01:03, 15.87s/it]
 88%|████████▊ | 22/25 [05:48<00:47, 15.87s/it]
 92%|█████████▏| 23/25 [06:04<00:31, 15.87s/it]
 96%|█████████▌| 24/25 [06:19<00:15, 15.87s/it]
100%|██████████| 25/25 [06:35<00:00, 15.87s/it]
100%|██████████| 25/25 [06:35<00:00, 15.83s/it]
  0%|          | 0/128 [00:00<?, ?it/s]
  3%|▎         | 4/128 [00:00<00:03, 39.03it/s]
  6%|▋         | 8/128 [00:00<00:06, 17.15it/s]
  9%|▊         | 11/128 [00:00<00:07, 14.88it/s]
 10%|█         | 13/128 [00:00<00:08, 14.10it/s]
 12%|█▏        | 15/128 [00:00<00:08, 13.57it/s]
 13%|█▎        | 17/128 [00:01<00:08, 13.20it/s]
 15%|█▍        | 19/128 [00:01<00:08, 12.94it/s]
 16%|█▋        | 21/128 [00:01<00:08, 12.75it/s]
 18%|█▊        | 23/128 [00:01<00:08, 12.63it/s]
 20%|█▉        | 25/128 [00:01<00:08, 12.52it/s]
 21%|██        | 27/128 [00:01<00:08, 12.46it/s]
 23%|██▎       | 29/128 [00:02<00:07, 12.42it/s]
 24%|██▍       | 31/128 [00:02<00:07, 12.40it/s]
 26%|██▌       | 33/128 [00:02<00:07, 12.38it/s]
 27%|██▋       | 35/128 [00:02<00:07, 12.37it/s]
 29%|██▉       | 37/128 [00:02<00:07, 12.37it/s]
 30%|███       | 39/128 [00:02<00:07, 12.35it/s]
 32%|███▏      | 41/128 [00:03<00:07, 12.34it/s]
 34%|███▎      | 43/128 [00:03<00:06, 12.33it/s]
 35%|███▌      | 45/128 [00:03<00:06, 12.32it/s]
 37%|███▋      | 47/128 [00:03<00:06, 12.33it/s]
 38%|███▊      | 49/128 [00:03<00:06, 12.33it/s]
 40%|███▉      | 51/128 [00:03<00:06, 12.33it/s]
 41%|████▏     | 53/128 [00:04<00:06, 12.33it/s]
 43%|████▎     | 55/128 [00:04<00:05, 12.34it/s]
 45%|████▍     | 57/128 [00:04<00:05, 12.34it/s]
 46%|████▌     | 59/128 [00:04<00:05, 12.33it/s]
 48%|████▊     | 61/128 [00:04<00:05, 12.33it/s]
 49%|████▉     | 63/128 [00:04<00:05, 12.33it/s]
 51%|█████     | 65/128 [00:05<00:05, 12.32it/s]
 52%|█████▏    | 67/128 [00:05<00:04, 12.33it/s]
 54%|█████▍    | 69/128 [00:05<00:04, 12.33it/s]
 55%|█████▌    | 71/128 [00:05<00:04, 12.34it/s]
 57%|█████▋    | 73/128 [00:05<00:04, 12.34it/s]
 59%|█████▊    | 75/128 [00:05<00:04, 12.34it/s]
 60%|██████    | 77/128 [00:06<00:04, 12.33it/s]
 62%|██████▏   | 79/128 [00:06<00:03, 12.33it/s]
 63%|██████▎   | 81/128 [00:06<00:03, 12.33it/s]
 65%|██████▍   | 83/128 [00:06<00:03, 12.32it/s]
 66%|██████▋   | 85/128 [00:06<00:03, 12.33it/s]
 68%|██████▊   | 87/128 [00:06<00:03, 12.33it/s]
 70%|██████▉   | 89/128 [00:06<00:03, 12.34it/s]
 71%|███████   | 91/128 [00:07<00:02, 12.34it/s]
 73%|███████▎  | 93/128 [00:07<00:02, 12.34it/s]
 74%|███████▍  | 95/128 [00:07<00:02, 12.34it/s]
 76%|███████▌  | 97/128 [00:07<00:02, 12.34it/s]
 77%|███████▋  | 99/128 [00:07<00:02, 12.33it/s]
 79%|███████▉  | 101/128 [00:07<00:02, 12.32it/s]
 80%|████████  | 103/128 [00:08<00:02, 12.33it/s]
 82%|████████▏ | 105/128 [00:08<00:01, 12.33it/s]
 84%|████████▎ | 107/128 [00:08<00:01, 12.34it/s]
 85%|████████▌ | 109/128 [00:08<00:01, 12.34it/s]
 87%|████████▋ | 111/128 [00:08<00:01, 12.33it/s]
 88%|████████▊ | 113/128 [00:08<00:01, 12.33it/s]
 90%|████████▉ | 115/128 [00:09<00:01, 12.32it/s]
 91%|█████████▏| 117/128 [00:09<00:00, 12.31it/s]
 93%|█████████▎| 119/128 [00:09<00:00, 12.32it/s]
 95%|█████████▍| 121/128 [00:09<00:00, 12.32it/s]
 96%|█████████▌| 123/128 [00:09<00:00, 12.32it/s]
 98%|█████████▊| 125/128 [00:09<00:00, 12.33it/s]
 99%|█████████▉| 127/128 [00:10<00:00, 12.32it/s]
100%|██████████| 128/128 [00:10<00:00, 12.60it/s]
Version Details
Version ID
c8b589961b86d3fdffeef13e26fa8465b1935ac3350f2a332dddc1ee4be50df2
Version Created
January 18, 2024
Run on Replicate →