jimothyjohn/latentblending 🔢📝 → 🖼️

▶️ 1.3K runs 📅 Jul 2023 ⚙️ Cog 0.8.6 🔗 GitHub ⚖️ License
animation latent-blending text-to-video

About

Dream a seamless sequence of hallucinations.

Example Output

Output

Performance Metrics

248.02s Prediction Time
247.98s Total Time
All Input Parameters 
{
  "seed": 75,
  "text": "feathers",
  "transitions": 5,
  "transition_time": 8
}
Input Parameters
seed Type: integerDefault: 0Range: 0 - 1024
Starting seed
text (required) Type: string
What to dream
transitions Type: integerDefault: 4Range: 2 - 32
Number of images to dream
transition_time Type: integerDefault: 8Range: 1 - 15
Time to transition to next image
Output Schema

Output

Type: string • Format: uri

Example Execution Logs 
Dreaming...
  0%|          | 0/5 [00:00<?, ?it/s]
  0%|          | 0/480 [00:00<?, ?it/s]
  1%|          | 3/480 [00:00<00:16, 29.54it/s]
  3%|▎         | 15/480 [00:00<00:05, 80.03it/s]
  5%|▌         | 26/480 [00:00<00:04, 91.34it/s]
  8%|▊         | 37/480 [00:00<00:04, 95.53it/s]
 10%|▉         | 47/480 [00:00<00:04, 89.77it/s]
 12%|█▏        | 57/480 [00:00<00:04, 86.60it/s]
 14%|█▍        | 66/480 [00:00<00:04, 85.05it/s]
 16%|█▌        | 76/480 [00:00<00:04, 87.15it/s]
 18%|█▊        | 85/480 [00:00<00:04, 86.78it/s]
 20%|█▉        | 94/480 [00:01<00:04, 86.44it/s]
 21%|██▏       | 103/480 [00:01<00:04, 86.60it/s]
 23%|██▎       | 112/480 [00:01<00:04, 85.22it/s]
 25%|██▌       | 121/480 [00:01<00:04, 85.04it/s]
 27%|██▋       | 130/480 [00:01<00:04, 84.48it/s]
 29%|██▉       | 139/480 [00:01<00:04, 82.86it/s]
 31%|███       | 148/480 [00:01<00:03, 83.24it/s]
 33%|███▎      | 157/480 [00:01<00:03, 82.16it/s]
 35%|███▍      | 167/480 [00:01<00:03, 85.36it/s]
 37%|███▋      | 176/480 [00:02<00:03, 86.30it/s]
 39%|███▊      | 185/480 [00:02<00:03, 87.33it/s]
 40%|████      | 194/480 [00:02<00:03, 86.33it/s]
 42%|████▏     | 203/480 [00:02<00:03, 86.17it/s]
 44%|████▍     | 212/480 [00:02<00:03, 83.84it/s]
 46%|████▌     | 221/480 [00:02<00:03, 82.95it/s]
 48%|████▊     | 230/480 [00:02<00:03, 82.50it/s]
 50%|█████     | 240/480 [00:02<00:02, 87.09it/s]
 52%|█████▏    | 250/480 [00:02<00:02, 87.25it/s]
 54%|█████▍    | 259/480 [00:03<00:02, 86.68it/s]
 56%|█████▌    | 268/480 [00:03<00:02, 84.91it/s]
 58%|█████▊    | 277/480 [00:03<00:02, 84.46it/s]
 60%|█████▉    | 286/480 [00:03<00:02, 83.02it/s]
 62%|██████▏   | 296/480 [00:03<00:02, 85.34it/s]
 64%|██████▍   | 306/480 [00:03<00:01, 88.61it/s]
 66%|██████▌   | 316/480 [00:03<00:01, 89.97it/s]
 68%|██████▊   | 326/480 [00:03<00:01, 88.83it/s]
 70%|██████▉   | 335/480 [00:03<00:01, 87.99it/s]
 72%|███████▏  | 344/480 [00:04<00:01, 85.02it/s]
 74%|███████▍  | 354/480 [00:04<00:01, 86.61it/s]
 76%|███████▌  | 364/480 [00:04<00:01, 89.88it/s]
 78%|███████▊  | 374/480 [00:04<00:01, 90.85it/s]
 80%|████████  | 384/480 [00:04<00:01, 92.12it/s]
 82%|████████▏ | 394/480 [00:04<00:00, 92.47it/s]
 84%|████████▍ | 404/480 [00:04<00:00, 86.62it/s]
 86%|████████▌ | 413/480 [00:04<00:00, 85.06it/s]
 88%|████████▊ | 422/480 [00:04<00:00, 85.48it/s]
 90%|████████▉ | 431/480 [00:05<00:00, 83.33it/s]
 92%|█████████▏| 440/480 [00:05<00:00, 84.71it/s]
 94%|█████████▎| 449/480 [00:05<00:00, 83.28it/s]
 95%|█████████▌| 458/480 [00:05<00:00, 84.95it/s]
 97%|█████████▋| 467/480 [00:05<00:00, 82.55it/s]
 99%|█████████▉| 476/480 [00:05<00:00, 81.76it/s]
100%|██████████| 480/480 [00:05<00:00, 85.57it/s]
 20%|██        | 1/5 [00:58<03:52, 58.06s/it]
  0%|          | 0/480 [00:00<?, ?it/s]
  0%|          | 2/480 [00:00<00:33, 14.34it/s]
  2%|▏         | 11/480 [00:00<00:09, 50.30it/s]
  4%|▎         | 17/480 [00:00<00:16, 28.53it/s]
  5%|▍         | 22/480 [00:00<00:13, 33.29it/s]
  6%|▌         | 28/480 [00:00<00:11, 39.86it/s]
  7%|▋         | 35/480 [00:00<00:09, 46.69it/s]
  9%|▊         | 41/480 [00:01<00:09, 47.12it/s]
 10%|▉         | 47/480 [00:01<00:13, 31.31it/s]
 11%|█         | 52/480 [00:01<00:12, 34.35it/s]
 12%|█▏        | 57/480 [00:01<00:12, 34.57it/s]
 14%|█▎        | 65/480 [00:01<00:09, 44.03it/s]
 15%|█▌        | 74/480 [00:01<00:07, 54.19it/s]
 17%|█▋        | 83/480 [00:01<00:06, 61.50it/s]
 19%|█▉        | 92/480 [00:02<00:05, 67.37it/s]
 21%|██        | 100/480 [00:02<00:05, 69.43it/s]
 23%|██▎       | 109/480 [00:02<00:05, 73.53it/s]
 25%|██▍       | 118/480 [00:02<00:04, 76.83it/s]
 27%|██▋       | 128/480 [00:02<00:04, 80.35it/s]
 29%|██▊       | 137/480 [00:02<00:04, 82.31it/s]
 31%|███       | 147/480 [00:02<00:03, 85.12it/s]
 32%|███▎      | 156/480 [00:02<00:03, 85.85it/s]
 34%|███▍      | 165/480 [00:02<00:03, 86.00it/s]
 36%|███▋      | 174/480 [00:02<00:03, 86.96it/s]
 38%|███▊      | 183/480 [00:03<00:03, 86.15it/s]
 40%|████      | 193/480 [00:03<00:03, 89.08it/s]
 42%|████▏     | 203/480 [00:03<00:03, 90.69it/s]
 44%|████▍     | 213/480 [00:03<00:02, 90.95it/s]
 46%|████▋     | 223/480 [00:03<00:02, 85.88it/s]
 48%|████▊     | 232/480 [00:03<00:02, 85.27it/s]
 50%|█████     | 241/480 [00:03<00:02, 85.29it/s]
 52%|█████▏    | 250/480 [00:03<00:02, 85.04it/s]
 54%|█████▍    | 260/480 [00:03<00:02, 87.52it/s]
 56%|█████▌    | 269/480 [00:04<00:02, 85.44it/s]
 58%|█████▊    | 278/480 [00:04<00:02, 84.75it/s]
 60%|█████▉    | 287/480 [00:04<00:02, 83.55it/s]
 62%|██████▏   | 296/480 [00:04<00:02, 84.96it/s]
 64%|██████▍   | 306/480 [00:04<00:01, 88.09it/s]
 66%|██████▌   | 316/480 [00:04<00:01, 89.17it/s]
 68%|██████▊   | 325/480 [00:04<00:01, 88.19it/s]
 70%|██████▉   | 334/480 [00:04<00:01, 84.46it/s]
 71%|███████▏  | 343/480 [00:04<00:01, 83.60it/s]
 73%|███████▎  | 352/480 [00:05<00:01, 84.14it/s]
 75%|███████▌  | 362/480 [00:05<00:01, 87.88it/s]
 77%|███████▋  | 371/480 [00:05<00:01, 83.18it/s]
 79%|███████▉  | 380/480 [00:05<00:01, 84.48it/s]
 81%|████████  | 389/480 [00:05<00:01, 85.03it/s]
 83%|████████▎ | 398/480 [00:05<00:00, 83.34it/s]
 85%|████████▍ | 407/480 [00:05<00:00, 79.79it/s]
 87%|████████▋ | 417/480 [00:05<00:00, 82.62it/s]
 89%|████████▉ | 426/480 [00:05<00:00, 83.78it/s]
 91%|█████████ | 435/480 [00:06<00:00, 83.87it/s]
 92%|█████████▎| 444/480 [00:06<00:00, 84.64it/s]
 94%|█████████▍| 453/480 [00:06<00:00, 84.30it/s]
 96%|█████████▋| 462/480 [00:06<00:00, 85.75it/s]
 98%|█████████▊| 471/480 [00:06<00:00, 83.42it/s]
100%|██████████| 480/480 [00:06<00:00, 83.34it/s]
100%|██████████| 480/480 [00:06<00:00, 73.09it/s]
 40%|████      | 2/5 [01:50<02:43, 54.54s/it]
  0%|          | 0/480 [00:00<?, ?it/s]
  0%|          | 2/480 [00:00<00:34, 14.03it/s]
  3%|▎         | 13/480 [00:00<00:07, 59.14it/s]
  5%|▍         | 23/480 [00:00<00:06, 74.20it/s]
  7%|▋         | 33/480 [00:00<00:05, 82.45it/s]
  9%|▉         | 42/480 [00:00<00:07, 61.89it/s]
 10%|█         | 50/480 [00:00<00:06, 62.30it/s]
 12%|█▏        | 57/480 [00:00<00:06, 63.18it/s]
 14%|█▍        | 68/480 [00:01<00:05, 74.55it/s]
 16%|█▋        | 78/480 [00:01<00:04, 81.43it/s]
 18%|█▊        | 87/480 [00:01<00:04, 82.12it/s]
 20%|██        | 98/480 [00:01<00:04, 88.50it/s]
 22%|██▎       | 108/480 [00:01<00:04, 91.12it/s]
 25%|██▍       | 119/480 [00:01<00:03, 94.76it/s]
 27%|██▋       | 130/480 [00:01<00:03, 98.63it/s]
 29%|██▉       | 140/480 [00:01<00:03, 92.26it/s]
 32%|███▏      | 152/480 [00:01<00:03, 96.76it/s]
 34%|███▍      | 162/480 [00:01<00:03, 94.44it/s]
 36%|███▌      | 173/480 [00:02<00:03, 97.56it/s]
 38%|███▊      | 184/480 [00:02<00:02, 99.13it/s]
 41%|████      | 195/480 [00:02<00:02, 100.56it/s]
 43%|████▎     | 206/480 [00:02<00:02, 99.85it/s] 
 45%|████▌     | 217/480 [00:02<00:02, 102.09it/s]
 48%|████▊     | 229/480 [00:02<00:02, 106.14it/s]
 50%|█████     | 241/480 [00:02<00:02, 107.10it/s]
 52%|█████▎    | 252/480 [00:02<00:02, 103.36it/s]
 55%|█████▍    | 263/480 [00:02<00:02, 102.21it/s]
 57%|█████▋    | 274/480 [00:03<00:02, 100.02it/s]
 59%|█████▉    | 285/480 [00:03<00:02, 97.03it/s] 
 61%|██████▏   | 295/480 [00:03<00:01, 94.48it/s]
 64%|██████▍   | 307/480 [00:03<00:01, 99.89it/s]
 66%|██████▋   | 318/480 [00:03<00:01, 102.50it/s]
 69%|██████▊   | 329/480 [00:03<00:01, 100.76it/s]
 71%|███████   | 340/480 [00:03<00:01, 98.09it/s] 
 73%|███████▎  | 350/480 [00:03<00:01, 95.88it/s]
 75%|███████▌  | 361/480 [00:03<00:01, 98.75it/s]
 77%|███████▋  | 371/480 [00:04<00:01, 97.64it/s]
 80%|███████▉  | 383/480 [00:04<00:00, 101.58it/s]
 82%|████████▏ | 394/480 [00:04<00:00, 97.79it/s] 
 85%|████████▍ | 406/480 [00:04<00:00, 103.25it/s]
 87%|████████▋ | 417/480 [00:04<00:00, 100.75it/s]
 89%|████████▉ | 428/480 [00:04<00:00, 99.58it/s] 
 91%|█████████▏| 439/480 [00:04<00:00, 100.17it/s]
 94%|█████████▍| 450/480 [00:04<00:00, 96.45it/s] 
 96%|█████████▋| 462/480 [00:04<00:00, 101.92it/s]
 99%|█████████▊| 473/480 [00:05<00:00, 103.00it/s]
100%|██████████| 480/480 [00:05<00:00, 93.54it/s]
 60%|██████    | 3/5 [02:37<01:42, 51.35s/it]
  0%|          | 0/480 [00:00<?, ?it/s]
  0%|          | 2/480 [00:00<00:30, 15.51it/s]
  2%|▏         | 11/480 [00:00<00:08, 52.42it/s]
  4%|▎         | 17/480 [00:00<00:09, 46.44it/s]
  5%|▌         | 25/480 [00:00<00:07, 57.16it/s]
  7%|▋         | 34/480 [00:00<00:06, 66.09it/s]
  9%|▊         | 41/480 [00:00<00:06, 66.33it/s]
 10%|█         | 48/480 [00:00<00:06, 61.76it/s]
 11%|█▏        | 55/480 [00:00<00:06, 63.20it/s]
 13%|█▎        | 64/480 [00:01<00:05, 69.74it/s]
 15%|█▌        | 74/480 [00:01<00:05, 77.62it/s]
 18%|█▊        | 85/480 [00:01<00:04, 86.26it/s]
 20%|█▉        | 95/480 [00:01<00:04, 89.90it/s]
 22%|██▏       | 105/480 [00:01<00:04, 89.91it/s]
 24%|██▍       | 116/480 [00:01<00:03, 93.92it/s]
 26%|██▋       | 126/480 [00:01<00:03, 95.24it/s]
 29%|██▊       | 137/480 [00:01<00:03, 98.07it/s]
 31%|███       | 147/480 [00:01<00:03, 98.47it/s]
 33%|███▎      | 158/480 [00:01<00:03, 100.13it/s]
 35%|███▌      | 169/480 [00:02<00:03, 101.73it/s]
 38%|███▊      | 180/480 [00:02<00:03, 96.21it/s] 
 40%|███▉      | 191/480 [00:02<00:02, 98.54it/s]
 42%|████▏     | 203/480 [00:02<00:02, 103.99it/s]
 45%|████▍     | 214/480 [00:02<00:02, 101.56it/s]
 47%|████▋     | 225/480 [00:02<00:02, 100.83it/s]
 50%|████▉     | 238/480 [00:02<00:02, 106.88it/s]
 52%|█████▏    | 249/480 [00:02<00:02, 104.29it/s]
 54%|█████▍    | 260/480 [00:02<00:02, 100.70it/s]
 56%|█████▋    | 271/480 [00:03<00:02, 101.87it/s]
 59%|█████▉    | 282/480 [00:03<00:01, 100.27it/s]
 61%|██████    | 293/480 [00:03<00:01, 100.89it/s]
 63%|██████▎   | 304/480 [00:03<00:01, 102.04it/s]
 66%|██████▌   | 315/480 [00:03<00:01, 102.32it/s]
 68%|██████▊   | 326/480 [00:03<00:01, 101.32it/s]
 70%|███████   | 337/480 [00:03<00:01, 100.53it/s]
 72%|███████▎  | 348/480 [00:03<00:01, 100.15it/s]
 75%|███████▍  | 359/480 [00:03<00:01, 99.02it/s] 
 77%|███████▋  | 370/480 [00:04<00:01, 100.41it/s]
 79%|███████▉  | 381/480 [00:04<00:00, 100.61it/s]
 82%|████████▏ | 392/480 [00:04<00:00, 103.18it/s]
 84%|████████▍ | 403/480 [00:04<00:00, 104.62it/s]
 86%|████████▋ | 414/480 [00:04<00:00, 101.37it/s]
 89%|████████▊ | 425/480 [00:04<00:00, 97.72it/s] 
 91%|█████████ | 435/480 [00:04<00:00, 93.74it/s]
 93%|█████████▎| 445/480 [00:04<00:00, 94.55it/s]
 95%|█████████▍| 455/480 [00:04<00:00, 94.96it/s]
 97%|█████████▋| 465/480 [00:05<00:00, 92.76it/s]
 99%|█████████▉| 475/480 [00:05<00:00, 91.71it/s]
100%|██████████| 480/480 [00:05<00:00, 91.87it/s]
 80%|████████  | 4/5 [03:22<00:48, 48.66s/it]
  0%|          | 0/480 [00:00<?, ?it/s]
  1%|          | 4/480 [00:00<00:12, 38.56it/s]
  3%|▎         | 16/480 [00:00<00:05, 85.59it/s]
  6%|▌         | 29/480 [00:00<00:04, 102.30it/s]
  8%|▊         | 40/480 [00:00<00:04, 95.73it/s] 
 10%|█         | 50/480 [00:00<00:04, 93.71it/s]
 12%|█▎        | 60/480 [00:00<00:04, 90.54it/s]
 15%|█▍        | 71/480 [00:00<00:04, 95.99it/s]
 17%|█▋        | 82/480 [00:00<00:04, 96.66it/s]
 19%|█▉        | 92/480 [00:00<00:04, 96.62it/s]
 21%|██▏       | 103/480 [00:01<00:03, 100.05it/s]
 24%|██▍       | 114/480 [00:01<00:03, 98.87it/s] 
 26%|██▋       | 126/480 [00:01<00:03, 101.35it/s]
 29%|██▊       | 137/480 [00:01<00:03, 99.41it/s] 
 31%|███       | 149/480 [00:01<00:03, 104.13it/s]
 33%|███▎      | 160/480 [00:01<00:03, 101.42it/s]
 36%|███▌      | 172/480 [00:01<00:02, 105.92it/s]
 38%|███▊      | 183/480 [00:01<00:02, 103.00it/s]
 40%|████      | 194/480 [00:01<00:02, 104.80it/s]
 43%|████▎     | 206/480 [00:02<00:02, 106.87it/s]
 45%|████▌     | 217/480 [00:02<00:02, 104.89it/s]
 48%|████▊     | 228/480 [00:02<00:02, 102.55it/s]
 50%|████▉     | 239/480 [00:02<00:02, 99.10it/s] 
 52%|█████▏    | 249/480 [00:02<00:02, 92.62it/s]
 54%|█████▍    | 261/480 [00:02<00:02, 98.23it/s]
 56%|█████▋    | 271/480 [00:02<00:02, 96.65it/s]
 59%|█████▊    | 281/480 [00:02<00:02, 94.92it/s]
 61%|██████▏   | 294/480 [00:02<00:01, 103.33it/s]
 64%|██████▎   | 305/480 [00:03<00:01, 103.21it/s]
 66%|██████▌   | 316/480 [00:03<00:01, 103.26it/s]
 68%|██████▊   | 327/480 [00:03<00:01, 103.09it/s]
 71%|███████   | 339/480 [00:03<00:01, 104.64it/s]
 73%|███████▎  | 350/480 [00:03<00:01, 100.44it/s]
 75%|███████▌  | 361/480 [00:03<00:01, 102.56it/s]
 78%|███████▊  | 373/480 [00:03<00:01, 105.02it/s]
 80%|████████  | 384/480 [00:03<00:00, 101.29it/s]
 82%|████████▎ | 396/480 [00:03<00:00, 103.85it/s]
 85%|████████▍ | 407/480 [00:04<00:00, 96.84it/s] 
 87%|████████▋ | 417/480 [00:04<00:00, 97.36it/s]
 89%|████████▉ | 428/480 [00:04<00:00, 99.89it/s]
 91%|█████████▏| 439/480 [00:04<00:00, 96.43it/s]
 94%|█████████▎| 449/480 [00:04<00:00, 96.91it/s]
 96%|█████████▌| 459/480 [00:04<00:00, 93.05it/s]
 98%|█████████▊| 470/480 [00:04<00:00, 96.52it/s]
100%|██████████| 480/480 [00:04<00:00, 99.14it/s]
100%|██████████| 5/5 [04:06<00:00, 47.15s/it]
100%|██████████| 5/5 [04:06<00:00, 49.34s/it]
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5aa6cbcbca40] Auto-inserting h264_mp4toannexb bitstream filter
Input #0, concat, from 'tmp_move.txt':
Duration: N/A, start: 0.000000, bitrate: 2236 kb/s
Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1024x1024, 2236 kb/s, 60 fps, 60 tbr, 15360 tbn, 120 tbc
Metadata:
handler_name    : VideoHandler
vendor_id       : [0][0][0][0]
Output #0, mp4, to 'output.mp4':
Metadata:
encoder         : Lavf58.76.100
Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1024x1024, q=2-31, 2236 kb/s, 60 fps, 60 tbr, 15360 tbn, 15360 tbc
Metadata:
handler_name    : VideoHandler
vendor_id       : [0][0][0][0]
Stream mapping:
Stream #0:0 -> #0:0 (copy)
Press [q] to stop, [?] for help
frame=    1 fps=0.0 q=-1.0 size=       0kB time=-00:00:00.03 bitrate=N/A speed=N/A
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5aa6cbcbdcc0] Auto-inserting h264_mp4toannexb bitstream filter
Last message repeated 1 times
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5aa6cbd7bc00] Auto-inserting h264_mp4toannexb bitstream filter
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5aa6cbcbe500] Auto-inserting h264_mp4toannexb bitstream filter
frame= 2400 fps=0.0 q=-1.0 Lsize=   18264kB time=00:00:39.95 bitrate=3745.2kbits/s speed= 286x
video:18248kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.087107%
concatenate_movies: success! Watch here: output.mp4
Version Details
Version ID
0e197e3a45d7cb48ee9568748a9a1c5fe4b6abb2b76727806ef9eb98aa971c94
Version Created
March 18, 2024
Run on Replicate →