lucataco/wan2.1-i2v-lora 🔢🖼️📝❓ → 🖼️

▶️ 688 runs 📅 Mar 2025 ⚙️ Cog 0.13.6 🔗 GitHub ⚖️ License

image-to-video lora

About

Wan2.1 14B 480p LoRA inference via Diffusers (Work in progress)

Example Output

Prompt:

"In the video, a miniature dog is presented. The dog is held in a person's hands. The person then presses on the dog, causing a sq41sh squish effect. The person keeps pressing down on the dog, further showing the sq41sh squish effect."

Output

Performance Metrics

243.79s Prediction Time

243.80s Total Time

All Input Parameters

{
  "fps": 16,
  "image": "https://replicate.delivery/pbxt/Mf7Um7V1nQjebWjOi3RndihR5sK95269LxZDY8s17mqW5jda/dog-1024.png",
  "prompt": "In the video, a miniature dog is presented. The dog is held in a person's hands. The person then presses on the dog, causing a sq41sh squish effect. The person keeps pressing down on the dog, further showing the sq41sh squish effect.",
  "duration": 3,
  "lora_url": "https://huggingface.co/Remade-AI/Squish/resolve/main/squish_18.safetensors",
  "resize_mode": "auto",
  "lora_strength": 1,
  "guidance_scale": 5,
  "negative_prompt": "low quality, bad quality, blurry, pixelated, watermark",
  "num_inference_steps": 40
}

Input Parameters

fps Type: integerDefault: 16Range: 7 - 30: Frames per second
seed Type: integer: Random seed for generation
image (required) Type: string: Input image
prompt (required) Type: string: Text prompt describing the desired video effect
duration Type: numberDefault: 3Range: 1 - 5: Video duration in seconds
lora_url (required) Type: string: URL to the LoRA weights (HuggingFace or CivitAI)
resize_mode Default: auto: Image resizing strategy
lora_strength Type: numberDefault: 1Range: 0 - 2: LoRA effect strength
guidance_scale Type: numberDefault: 5Range: 1 - 20: Guidance scale for generation
negative_prompt Type: stringDefault: low quality, bad quality, blurry, pixelated, watermark: Text prompt describing what to avoid in the video
num_inference_steps Type: integerDefault: 28Range: 1 - 100: Number of inference steps

Output Schema

Output

Type: string • Format: uri

Example Execution Logs

Starting prediction with: prompt='In the video, a miniature dog is presented. The dog is held in a person's hands. The person then presses on the dog, causing a sq41sh squish effect. The person keeps pressing down on the dog, further showing the sq41sh squish effect.', lora_strength=1.0, duration=3.0s
Calculated 49 frames for 3.0s at 16 fps
Loading input image from: /tmp/tmpl6fn4nyqdog-1024.png
Image loaded successfully: 1001x991
Auto-selected fixed square dimensions: 512x512 for aspect ratio 0.99
Final dimensions: 512x512
Downloading LoRA from: https://huggingface.co/Remade-AI/Squish/resolve/main/squish_18.safetensors
Downloading from HuggingFace: repo_id=Remade-AI/Squish, filename=squish_18.safetensors
Loading LoRA weights from: /root/.cache/huggingface/hub/models--Remade-AI--Squish/snapshots/70e32c7d833743c88352e2ac973968417fb5b051/squish_18.safetensors with strength: 1.0
LoRA weights loaded successfully
Starting video generation: 49 frames, 40 steps, guidance=5.0
  0%|          | 0/40 [00:00<?, ?it/s]
  2%|▎         | 1/40 [00:05<03:48,  5.87s/it]
  5%|▌         | 2/40 [00:11<03:31,  5.55s/it]
  8%|▊         | 3/40 [00:17<03:31,  5.71s/it]
 10%|█         | 4/40 [00:22<03:28,  5.78s/it]
 12%|█▎        | 5/40 [00:28<03:23,  5.82s/it]
 15%|█▌        | 6/40 [00:34<03:19,  5.85s/it]
 18%|█▊        | 7/40 [00:40<03:13,  5.87s/it]
 20%|██        | 8/40 [00:46<03:08,  5.89s/it]
 22%|██▎       | 9/40 [00:52<03:02,  5.90s/it]
 25%|██▌       | 10/40 [00:58<02:57,  5.91s/it]
 28%|██▊       | 11/40 [01:04<02:51,  5.91s/it]
 30%|███       | 12/40 [01:10<02:45,  5.92s/it]
 32%|███▎      | 13/40 [01:16<02:39,  5.92s/it]
 35%|███▌      | 14/40 [01:22<02:33,  5.92s/it]
 38%|███▊      | 15/40 [01:28<02:28,  5.92s/it]
 40%|████      | 16/40 [01:34<02:22,  5.92s/it]
 42%|████▎     | 17/40 [01:39<02:16,  5.92s/it]
 45%|████▌     | 18/40 [01:45<02:10,  5.92s/it]
 48%|████▊     | 19/40 [01:51<02:04,  5.92s/it]
 50%|█████     | 20/40 [01:57<01:58,  5.92s/it]
 52%|█████▎    | 21/40 [02:03<01:52,  5.92s/it]
 55%|█████▌    | 22/40 [02:09<01:46,  5.92s/it]
 57%|█████▊    | 23/40 [02:15<01:40,  5.92s/it]
 60%|██████    | 24/40 [02:21<01:34,  5.92s/it]
 62%|██████▎   | 25/40 [02:27<01:28,  5.92s/it]
 65%|██████▌   | 26/40 [02:33<01:22,  5.92s/it]
 68%|██████▊   | 27/40 [02:39<01:17,  5.92s/it]
 70%|███████   | 28/40 [02:45<01:11,  5.93s/it]
 72%|███████▎  | 29/40 [02:51<01:05,  5.92s/it]
 75%|███████▌  | 30/40 [02:56<00:59,  5.93s/it]
 78%|███████▊  | 31/40 [03:02<00:53,  5.93s/it]
 80%|████████  | 32/40 [03:08<00:47,  5.92s/it]
 82%|████████▎ | 33/40 [03:14<00:41,  5.93s/it]
 85%|████████▌ | 34/40 [03:20<00:35,  5.92s/it]
 88%|████████▊ | 35/40 [03:26<00:29,  5.92s/it]
 90%|█████████ | 36/40 [03:32<00:23,  5.92s/it]
 92%|█████████▎| 37/40 [03:38<00:17,  5.92s/it]
 95%|█████████▌| 38/40 [03:44<00:11,  5.92s/it]
 98%|█████████▊| 39/40 [03:50<00:05,  5.92s/it]
100%|██████████| 40/40 [03:56<00:00,  5.92s/it]
100%|██████████| 40/40 [03:56<00:00,  5.90s/it]
Video generation completed in 240.27 seconds
Exporting video to: /tmp/tmpbh4k1cz0/output.mp4 at 16 fps
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
Video saved successfully to: /tmp/tmpbh4k1cz0/output.mp4
Cleaned up temporary LoRA file: /root/.cache/huggingface/hub/models--Remade-AI--Squish/snapshots/70e32c7d833743c88352e2ac973968417fb5b051/squish_18.safetensors

Version Details

Version ID: f130c663a974802a8e5826a49b82064a27d5ffeec8f008ae3195a70e49527a97
Version Created: March 15, 2025

Run on Replicate →