shridharathi/ghibli-vid 🔢🖼️❓📝 → 🖼️

▶️ 109 runs 📅 Mar 2025 ⚙️ Cog 0.13.7
ghibli-style image-to-video lora text-to-video

About

Make a video of anything in Studio Ghibli style

Example Output

Prompt:

"GHIBLI style, anime, a girl running through new york city"

Output

Performance Metrics

168.62s Prediction Time
168.62s Total Time
All Input Parameters
{
  "frames": 81,
  "prompt": "GHIBLI style, anime, a girl running through new york city",
  "fast_mode": "Balanced",
  "resolution": "480p",
  "aspect_ratio": "16:9",
  "sample_shift": 8,
  "sample_steps": 30,
  "negative_prompt": "",
  "lora_strength_clip": 1,
  "sample_guide_scale": 5,
  "lora_strength_model": 1
}
Input Parameters
seed Type: integer
Set a seed for reproducibility. Random by default.
image Type: string
Image to use as a starting frame for image to video generation.
frames Default: 81
The number of frames to generate (1 to 5 seconds)
prompt (required) Type: string
Text prompt for video generation
fast_mode Default: Balanced
Speed up generation with different levels of acceleration. Faster modes may degrade quality somewhat. The speedup is dependent on the content, so different videos may see different speedups.
resolution Default: 480p
The resolution of the video. 720p is not supported for 1.3b.
aspect_ratio Default: 16:9
The aspect ratio of the video. 16:9, 9:16, 1:1, etc.
sample_shift Type: numberDefault: 8Range: 0 - 10
Sample shift factor
sample_steps Type: integerDefault: 30Range: 1 - 60
Number of generation steps. Fewer steps means faster generation, at the expensive of output quality. 30 steps is sufficient for most prompts
negative_prompt Type: stringDefault:
Things you do not want to see in your video
replicate_weights Type: string
Replicate LoRA weights to use. Leave blank to use the default weights.
lora_strength_clip Type: numberDefault: 1
Strength of the LORA applied to the CLIP model. 0.0 is no LORA.
sample_guide_scale Type: numberDefault: 5Range: 0 - 10
Higher guide scale makes prompt adherence better, but can reduce variation
lora_strength_model Type: numberDefault: 1
Strength of the LORA applied to the model. 0.0 is no LORA.
Output Schema

Output

Type: arrayItems Type: stringItems Format: uri

Example Execution Logs
Random seed set to: 874149996
✅ 14b_d21761924b1fb223ad93c834ec74afd9.safetensors already cached
Checking inputs
====================================
Checking weights
✅ 14b_d21761924b1fb223ad93c834ec74afd9.safetensors exists in loras directory
✅ umt5_xxl_fp16.safetensors exists in ComfyUI/models/text_encoders
✅ wan2.1_t2v_14B_bf16.safetensors exists in ComfyUI/models/diffusion_models
✅ wan_2.1_vae.safetensors exists in ComfyUI/models/vae
====================================
Running workflow
[ComfyUI] got prompt
Executing node 6, title: CLIP Text Encode (Positive Prompt), class type: CLIPTextEncode
Executing node 3, title: KSampler, class type: KSampler
[ComfyUI]
[ComfyUI] 0%|          | 0/30 [00:00<?, ?it/s]
[ComfyUI] Resetting TeaCache state
[ComfyUI]
[ComfyUI] 3%|▎         | 1/30 [00:06<03:12,  6.62s/it]
[ComfyUI] 7%|▋         | 2/30 [00:16<03:51,  8.28s/it]
[ComfyUI] 10%|█         | 3/30 [00:25<03:57,  8.80s/it]
[ComfyUI] TeaCache: Initialized
[ComfyUI]
[ComfyUI] 13%|█▎        | 4/30 [00:37<04:26, 10.26s/it]
[ComfyUI] 20%|██        | 6/30 [00:47<02:58,  7.42s/it]
[ComfyUI] 27%|██▋       | 8/30 [00:57<02:19,  6.34s/it]
[ComfyUI] 33%|███▎      | 10/30 [01:07<01:55,  5.80s/it]
[ComfyUI] 40%|████      | 12/30 [01:17<01:38,  5.48s/it]
[ComfyUI] 47%|████▋     | 14/30 [01:27<01:24,  5.29s/it]
[ComfyUI] 53%|█████▎    | 16/30 [01:36<01:12,  5.17s/it]
[ComfyUI] 60%|██████    | 18/30 [01:46<01:00,  5.08s/it]
[ComfyUI] 67%|██████▋   | 20/30 [01:56<00:50,  5.03s/it]
[ComfyUI] 73%|███████▎  | 22/30 [02:06<00:39,  4.99s/it]
[ComfyUI] 80%|████████  | 24/30 [02:16<00:29,  4.97s/it]
[ComfyUI] 87%|████████▋ | 26/30 [02:25<00:19,  4.95s/it]
[ComfyUI] 93%|█████████▎| 28/30 [02:35<00:09,  4.94s/it]
[ComfyUI] 100%|██████████| 30/30 [02:45<00:00,  4.93s/it]
Executing node 8, title: VAE Decode, class type: VAEDecode
Executing node 50, title: Video Combine 🎥🅥🅗🅢, class type: VHS_VideoCombine
[ComfyUI] 100%|██████████| 30/30 [02:45<00:00,  5.52s/it]
[ComfyUI] Prompt executed in 168.43 seconds
outputs:  {'50': {'gifs': [{'filename': 'R8_Wan_00001.mp4', 'subfolder': '', 'type': 'output', 'format': 'video/h264-mp4', 'frame_rate': 16.0, 'workflow': 'R8_Wan_00001.png', 'fullpath': '/tmp/outputs/R8_Wan_00001.mp4'}]}}
====================================
R8_Wan_00001.png
R8_Wan_00001.mp4
Version Details
Version ID
e65c22b73e9df842276a6321a718152d591ddad2e36eb6441606bc06c3d133d0
Version Created
March 27, 2025
Run on Replicate →