wren93/consisti2v 🔢🖼️📝 → 🖼️

▶️ 3.2K runs 📅 Mar 2024 ⚙️ Cog 0.9.4 🔗 GitHub 📄 Paper ⚖️ License

image-to-video visual-consistency

About

A diffusion-based method to enhance visual consistency for I2V generation

Example Output

Prompt:

"timelapse at the snow land with aurora in the sky"

Output

Performance Metrics

37.08s Prediction Time

81.43s Total Time

All Input Parameters

{
  "image": "https://replicate.delivery/pbxt/KVX68CBiatzs0asnIyqWZJORA4g5K5TWjts1WSmonroU9kAv/example_01.png",
  "prompt": "timelapse at the snow land with aurora in the sky",
  "num_inference_steps": 50,
  "text_guidance_scale": 7.5,
  "image_guidance_scale": 1
}

Input Parameters

seed Type: integer: Random seed. Leave blank to randomize the seed
image (required) Type: string: Input image as the first frame of the video.
prompt Type: stringDefault: An astronaut riding a rainbow unicorn: Input prompt
negative_prompt Type: stringDefault:: Input Negative Prompt
num_inference_steps Type: integerDefault: 50Range: 1 - 500: Number of denoising steps
text_guidance_scale Type: numberDefault: 7.5Range: 1 - 50: Scale for classifier-free guidance from the text
image_guidance_scale Type: numberDefault: 1: Scale for classifier-free guidance from the image

Output Schema

Output

Type: string • Format: uri

Example Execution Logs

Using seed: 57509
  0%|          | 0/50 [00:00<?, ?it/s]
  2%|▏         | 1/50 [00:00<00:33,  1.45it/s]
  4%|▍         | 2/50 [00:01<00:32,  1.46it/s]
  6%|▌         | 3/50 [00:02<00:32,  1.46it/s]
  8%|▊         | 4/50 [00:02<00:31,  1.47it/s]
 10%|█         | 5/50 [00:03<00:30,  1.47it/s]
 12%|█▏        | 6/50 [00:04<00:29,  1.47it/s]
 14%|█▍        | 7/50 [00:04<00:29,  1.47it/s]
 16%|█▌        | 8/50 [00:05<00:28,  1.46it/s]
 18%|█▊        | 9/50 [00:06<00:28,  1.46it/s]
 20%|██        | 10/50 [00:06<00:27,  1.47it/s]
 22%|██▏       | 11/50 [00:07<00:26,  1.47it/s]
 24%|██▍       | 12/50 [00:08<00:25,  1.47it/s]
 26%|██▌       | 13/50 [00:08<00:25,  1.47it/s]
 28%|██▊       | 14/50 [00:09<00:24,  1.47it/s]
 30%|███       | 15/50 [00:10<00:23,  1.47it/s]
 32%|███▏      | 16/50 [00:10<00:23,  1.47it/s]
 34%|███▍      | 17/50 [00:11<00:22,  1.47it/s]
 36%|███▌      | 18/50 [00:12<00:21,  1.47it/s]
 38%|███▊      | 19/50 [00:12<00:21,  1.47it/s]
 40%|████      | 20/50 [00:13<00:20,  1.47it/s]
 42%|████▏     | 21/50 [00:14<00:19,  1.47it/s]
 44%|████▍     | 22/50 [00:14<00:19,  1.47it/s]
 46%|████▌     | 23/50 [00:15<00:18,  1.47it/s]
 48%|████▊     | 24/50 [00:16<00:17,  1.47it/s]
 50%|█████     | 25/50 [00:17<00:17,  1.47it/s]
 52%|█████▏    | 26/50 [00:17<00:16,  1.47it/s]
 54%|█████▍    | 27/50 [00:18<00:15,  1.47it/s]
 56%|█████▌    | 28/50 [00:19<00:15,  1.47it/s]
 58%|█████▊    | 29/50 [00:19<00:14,  1.46it/s]
 60%|██████    | 30/50 [00:20<00:13,  1.46it/s]
 62%|██████▏   | 31/50 [00:21<00:12,  1.46it/s]
 64%|██████▍   | 32/50 [00:21<00:12,  1.46it/s]
 66%|██████▌   | 33/50 [00:22<00:11,  1.46it/s]
 68%|██████▊   | 34/50 [00:23<00:10,  1.46it/s]
 70%|███████   | 35/50 [00:23<00:10,  1.46it/s]
 72%|███████▏  | 36/50 [00:24<00:09,  1.46it/s]
 74%|███████▍  | 37/50 [00:25<00:08,  1.46it/s]
 76%|███████▌  | 38/50 [00:25<00:08,  1.46it/s]
 78%|███████▊  | 39/50 [00:26<00:07,  1.46it/s]
 80%|████████  | 40/50 [00:27<00:06,  1.46it/s]
 82%|████████▏ | 41/50 [00:27<00:06,  1.46it/s]
 84%|████████▍ | 42/50 [00:28<00:05,  1.46it/s]
 86%|████████▌ | 43/50 [00:29<00:04,  1.46it/s]
 88%|████████▊ | 44/50 [00:30<00:04,  1.45it/s]
 90%|█████████ | 45/50 [00:30<00:03,  1.45it/s]
 92%|█████████▏| 46/50 [00:31<00:02,  1.45it/s]
 94%|█████████▍| 47/50 [00:32<00:02,  1.45it/s]
 96%|█████████▌| 48/50 [00:32<00:01,  1.45it/s]
 98%|█████████▊| 49/50 [00:33<00:00,  1.46it/s]
100%|██████████| 50/50 [00:34<00:00,  1.46it/s]
100%|██████████| 50/50 [00:34<00:00,  1.46it/s]
  0%|          | 0/16 [00:00<?, ?it/s]
 50%|█████     | 8/16 [00:00<00:00, 67.44it/s]
 94%|█████████▍| 15/16 [00:00<00:00, 51.03it/s]
100%|██████████| 16/16 [00:00<00:00, 52.30it/s]

Version Details

Version ID: ce1f2912887d0e1926988004122f9049ff69f4b749b6221ed1dfcfc9487dc71b
Version Created: March 3, 2024

Run on Replicate →