wyhsirius/lia ❓🖼️ → 🖼️

▶️ 21.5K runs 📅 Jun 2022 ⚙️ Cog 0.3.11 🔗 GitHub 📄 Paper ⚖️ License
image-to-video motion-transfer

About

Learning to Animate Images via Latent Space Navigation

Example Output

Output

Performance Metrics

17.69s Prediction Time
81.70s Total Time
All Input Parameters
{
  "model": "vox",
  "img_source": "https://replicate.delivery/mgxm/8140a5a9-16c5-42ee-90bb-cd755f8ca9bd/mona_lisa.png",
  "driving_video": "https://replicate.delivery/mgxm/1724727e-d9ea-449b-9cca-2c39a9004350/driving2.mp4"
}
Input Parameters
model Default: vox
Choose a dataset.
img_source (required) Type: string
Input source image.
driving_video (required) Type: string
Choose a driving video.
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
==> loading data

  0%|          | 0/221 [00:00<?, ?it/s]/src/networks/styledecoder.py:439: UserWarning: torch.qr is deprecated in favor of torch.linalg.qr and will be removed in a future PyTorch release.
The boolean parameter 'some' has been replaced with a string parameter 'mode'.
Q, R = torch.qr(A, some)
should be replaced with
Q, R = torch.linalg.qr(A, 'reduced' if some else 'complete') (Triggered internally at  ../aten/src/ATen/native/BatchLinearAlgebra.cpp:1937.)
  Q, R = torch.qr(weight)  # get eignvector, orthogonal [n1, n2, n3, n4]
/root/.pyenv/versions/3.8.13/lib/python3.8/site-packages/torch/nn/functional.py:4003: UserWarning: Default grid_sample and affine_grid behavior has changed to align_corners=False since 1.3.0. Please specify align_corners=True if the old behavior is desired. See the documentation of grid_sample for details.
  warnings.warn(

  0%|          | 1/221 [00:00<00:24,  9.01it/s]
  1%|▏         | 3/221 [00:00<00:19, 11.40it/s]
  2%|▏         | 5/221 [00:00<00:16, 13.35it/s]
  3%|▎         | 7/221 [00:00<00:14, 14.31it/s]
  4%|▍         | 9/221 [00:00<00:14, 14.73it/s]
  5%|▍         | 11/221 [00:00<00:13, 15.04it/s]
  6%|▌         | 13/221 [00:00<00:13, 15.34it/s]
  7%|▋         | 15/221 [00:01<00:13, 15.43it/s]
  8%|▊         | 17/221 [00:01<00:13, 15.44it/s]
  9%|▊         | 19/221 [00:01<00:12, 15.55it/s]
 10%|▉         | 21/221 [00:01<00:12, 15.59it/s]
 10%|█         | 23/221 [00:01<00:12, 15.57it/s]
 11%|█▏        | 25/221 [00:01<00:12, 15.63it/s]
 12%|█▏        | 27/221 [00:01<00:12, 15.64it/s]
 13%|█▎        | 29/221 [00:01<00:12, 15.64it/s]
 14%|█▍        | 31/221 [00:02<00:12, 15.66it/s]
 15%|█▍        | 33/221 [00:02<00:11, 15.68it/s]
 16%|█▌        | 35/221 [00:02<00:11, 15.63it/s]
 17%|█▋        | 37/221 [00:02<00:11, 15.61it/s]
 18%|█▊        | 39/221 [00:02<00:11, 15.63it/s]
 19%|█▊        | 41/221 [00:02<00:11, 15.55it/s]
 19%|█▉        | 43/221 [00:02<00:11, 15.63it/s]
 20%|██        | 45/221 [00:02<00:11, 15.64it/s]
 21%|██▏       | 47/221 [00:03<00:11, 15.55it/s]
 22%|██▏       | 49/221 [00:03<00:11, 15.57it/s]
 23%|██▎       | 51/221 [00:03<00:10, 15.61it/s]
 24%|██▍       | 53/221 [00:03<00:10, 15.52it/s]
 25%|██▍       | 55/221 [00:03<00:10, 15.59it/s]
 26%|██▌       | 57/221 [00:03<00:10, 15.62it/s]
 27%|██▋       | 59/221 [00:03<00:10, 15.56it/s]
 28%|██▊       | 61/221 [00:03<00:10, 15.61it/s]
 29%|██▊       | 63/221 [00:04<00:10, 15.61it/s]
 29%|██▉       | 65/221 [00:04<00:10, 15.56it/s]
 30%|███       | 67/221 [00:04<00:09, 15.60it/s]
 31%|███       | 69/221 [00:04<00:09, 15.64it/s]
 32%|███▏      | 71/221 [00:04<00:09, 15.58it/s]
 33%|███▎      | 73/221 [00:04<00:09, 15.58it/s]
 34%|███▍      | 75/221 [00:04<00:09, 15.59it/s]
 35%|███▍      | 77/221 [00:05<00:09, 15.51it/s]
 36%|███▌      | 79/221 [00:05<00:09, 15.53it/s]
 37%|███▋      | 81/221 [00:05<00:09, 15.45it/s]
 38%|███▊      | 83/221 [00:05<00:08, 15.45it/s]
 38%|███▊      | 85/221 [00:05<00:08, 15.45it/s]
 39%|███▉      | 87/221 [00:05<00:08, 15.45it/s]
 40%|████      | 89/221 [00:05<00:08, 15.48it/s]
 41%|████      | 91/221 [00:05<00:08, 15.46it/s]
 42%|████▏     | 93/221 [00:06<00:08, 15.48it/s]
 43%|████▎     | 95/221 [00:06<00:08, 15.52it/s]
 44%|████▍     | 97/221 [00:06<00:08, 15.42it/s]
 45%|████▍     | 99/221 [00:06<00:07, 15.47it/s]
 46%|████▌     | 101/221 [00:06<00:07, 15.46it/s]
 47%|████▋     | 103/221 [00:06<00:07, 15.48it/s]
 48%|████▊     | 105/221 [00:06<00:07, 15.48it/s]
 48%|████▊     | 107/221 [00:06<00:07, 15.37it/s]
 49%|████▉     | 109/221 [00:07<00:07, 15.45it/s]
 50%|█████     | 111/221 [00:07<00:07, 15.47it/s]
 51%|█████     | 113/221 [00:07<00:06, 15.45it/s]
 52%|█████▏    | 115/221 [00:07<00:06, 15.53it/s]
 53%|█████▎    | 117/221 [00:07<00:06, 15.52it/s]
 54%|█████▍    | 119/221 [00:07<00:06, 15.41it/s]
 55%|█████▍    | 121/221 [00:07<00:06, 15.40it/s]
 56%|█████▌    | 123/221 [00:07<00:06, 15.42it/s]
 57%|█████▋    | 125/221 [00:08<00:06, 15.45it/s]
 57%|█████▋    | 127/221 [00:08<00:06, 15.43it/s]
 58%|█████▊    | 129/221 [00:08<00:05, 15.47it/s]
 59%|█████▉    | 131/221 [00:08<00:05, 15.31it/s]
 60%|██████    | 133/221 [00:08<00:05, 15.38it/s]
 61%|██████    | 135/221 [00:08<00:05, 15.41it/s]
 62%|██████▏   | 137/221 [00:08<00:05, 15.40it/s]
 63%|██████▎   | 139/221 [00:09<00:05, 15.44it/s]
 64%|██████▍   | 141/221 [00:09<00:05, 15.40it/s]
 65%|██████▍   | 143/221 [00:09<00:05, 15.36it/s]
 66%|██████▌   | 145/221 [00:09<00:04, 15.42it/s]
 67%|██████▋   | 147/221 [00:09<00:04, 15.38it/s]
 67%|██████▋   | 149/221 [00:09<00:04, 15.40it/s]
 68%|██████▊   | 151/221 [00:09<00:04, 15.30it/s]
 69%|██████▉   | 153/221 [00:09<00:04, 15.34it/s]
 70%|███████   | 155/221 [00:10<00:04, 15.36it/s]
 71%|███████   | 157/221 [00:10<00:04, 15.37it/s]
 72%|███████▏  | 159/221 [00:10<00:04, 15.43it/s]
 73%|███████▎  | 161/221 [00:10<00:03, 15.35it/s]
 74%|███████▍  | 163/221 [00:10<00:03, 15.40it/s]
 75%|███████▍  | 165/221 [00:10<00:03, 15.39it/s]
 76%|███████▌  | 167/221 [00:10<00:03, 15.37it/s]
 76%|███████▋  | 169/221 [00:10<00:03, 15.41it/s]
 77%|███████▋  | 171/221 [00:11<00:03, 15.34it/s]
 78%|███████▊  | 173/221 [00:11<00:03, 15.30it/s]
 79%|███████▉  | 175/221 [00:11<00:03, 15.32it/s]
 80%|████████  | 177/221 [00:11<00:02, 15.31it/s]
 81%|████████  | 179/221 [00:11<00:02, 15.34it/s]
 82%|████████▏ | 181/221 [00:11<00:02, 15.30it/s]
 83%|████████▎ | 183/221 [00:11<00:02, 15.34it/s]
 84%|████████▎ | 185/221 [00:12<00:02, 15.32it/s]
 85%|████████▍ | 187/221 [00:12<00:02, 15.34it/s]
 86%|████████▌ | 189/221 [00:12<00:02, 15.31it/s]
 86%|████████▋ | 191/221 [00:12<00:01, 15.33it/s]
 87%|████████▋ | 193/221 [00:12<00:01, 15.35it/s]
 88%|████████▊ | 195/221 [00:12<00:01, 15.32it/s]
 89%|████████▉ | 197/221 [00:12<00:01, 15.38it/s]
 90%|█████████ | 199/221 [00:12<00:01, 15.30it/s]
 91%|█████████ | 201/221 [00:13<00:01, 15.35it/s]
 92%|█████████▏| 203/221 [00:13<00:01, 15.34it/s]
 93%|█████████▎| 205/221 [00:13<00:01, 15.26it/s]
 94%|█████████▎| 207/221 [00:13<00:00, 15.27it/s]
 95%|█████████▍| 209/221 [00:13<00:00, 15.22it/s]
 95%|█████████▌| 211/221 [00:13<00:00, 15.22it/s]
 96%|█████████▋| 213/221 [00:13<00:00, 15.20it/s]
 97%|█████████▋| 215/221 [00:13<00:00, 15.24it/s]
 98%|█████████▊| 217/221 [00:14<00:00, 15.26it/s]
 99%|█████████▉| 219/221 [00:14<00:00, 15.25it/s]
100%|██████████| 221/221 [00:14<00:00, 15.17it/s]
100%|██████████| 221/221 [00:14<00:00, 15.37it/s]
Version Details
Version ID
4ce4e4aff5bd28c6958b1e3e7628ea80718be56672d92ea8039039a3a152e67d
Version Created
June 28, 2022
Run on Replicate →