cloneofsimo/hotshot-xl-lora-controlnet 🖼️🔢📝❓ → 🖼️
Performance
23.4sTypical run time
3.8KTotal runs
About
Text-to-gif using SDXL, with controlnet and lora support
Example Output
Prompt:
"anime, animated establishing shot of a volcano erupting, bright sunshine and snow"
Output
Performance Metrics
23.42s
Prediction Time
23.42s
Total Time
All Input Parameters
{
"gif": null,
"seed": 1002,
"steps": 30,
"width": 672,
"height": 384,
"prompt": "anime, animated establishing shot of a volcano erupting, bright sunshine and snow",
"hf_lora_url": null,
"control_type": "depth",
"target_width": 512,
"video_length": 8,
"target_height": 512,
"original_width": 1920,
"video_duration": 1000,
"negative_prompt": "dark, underexposed",
"original_height": 1080,
"control_guidance_end": 0.7,
"replicate_weights_url": "",
"control_guidance_start": 0,
"controlnet_conditioning_scale": 0.8
}
Input Parameters
- gif
- Input GIF for controlnet condition.
- seed
- The seed for the random number generator.
- steps
- The number of steps for the prediction.
- width
- The width of the generated images.
- height
- The height of the generated images.
- prompt
- The main prompt that guides the image generation.
- hf_lora_url
- The Hugginface URL for LoRA. For example, `fofr/barbie`
- control_type
- The type of control net to use for conditional generation.
- target_width
- The `target_size width` of the images.
- video_length
- The length of the video in frames.
- target_height
- The `target_size height` of the images.
- original_width
- The width of the `original_size` of images. If `original_size` is not the same as `target_size` the image will appear to be down- or upsampled. `original_size` defaults to `(width, height)` if not specified. Part of SDXL's micro-conditioning as explained in section 2.2 of https://arxiv.org/abs/2307.01952
- video_duration
- The duration of the video in milliseconds.
- negative_prompt
- A negative prompt to avoid certain features in the generated images.
- original_height
- The `original_size height` of the images.
- control_guidance_end
- The end of the control guidance.
- replicate_weights_url
- Replicate LoRA weights to use. Leave blank to use the default weights.
- control_guidance_start
- The start of the control guidance.
- controlnet_conditioning_scale
- The scale of the controlnet conditioning.
Output Schema
Output
Example Execution Logs
Warning - setting num_images_per_prompt = 1 because video_length = 8 0%| | 0/30 [00:00<?, ?it/s] 3%|▎ | 1/30 [00:00<00:19, 1.45it/s] 7%|▋ | 2/30 [00:01<00:19, 1.45it/s] 10%|█ | 3/30 [00:02<00:18, 1.45it/s] 13%|█▎ | 4/30 [00:02<00:17, 1.45it/s] 17%|█▋ | 5/30 [00:03<00:17, 1.45it/s] 20%|██ | 6/30 [00:04<00:16, 1.45it/s] 23%|██▎ | 7/30 [00:04<00:15, 1.46it/s] 27%|██▋ | 8/30 [00:05<00:15, 1.46it/s] 30%|███ | 9/30 [00:06<00:14, 1.46it/s] 33%|███▎ | 10/30 [00:06<00:13, 1.46it/s] 37%|███▋ | 11/30 [00:07<00:13, 1.45it/s] 40%|████ | 12/30 [00:08<00:12, 1.45it/s] 43%|████▎ | 13/30 [00:08<00:11, 1.45it/s] 47%|████▋ | 14/30 [00:09<00:10, 1.45it/s] 50%|█████ | 15/30 [00:10<00:10, 1.45it/s] 53%|█████▎ | 16/30 [00:11<00:09, 1.45it/s] 57%|█████▋ | 17/30 [00:11<00:08, 1.45it/s] 60%|██████ | 18/30 [00:12<00:08, 1.45it/s] 63%|██████▎ | 19/30 [00:13<00:07, 1.45it/s] 67%|██████▋ | 20/30 [00:13<00:06, 1.45it/s] 70%|███████ | 21/30 [00:14<00:06, 1.45it/s] 73%|███████▎ | 22/30 [00:15<00:05, 1.45it/s] 77%|███████▋ | 23/30 [00:15<00:04, 1.45it/s] 80%|████████ | 24/30 [00:16<00:04, 1.45it/s] 83%|████████▎ | 25/30 [00:17<00:03, 1.45it/s] 87%|████████▋ | 26/30 [00:17<00:02, 1.45it/s] 90%|█████████ | 27/30 [00:18<00:02, 1.45it/s] 93%|█████████▎| 28/30 [00:19<00:01, 1.45it/s] 97%|█████████▋| 29/30 [00:19<00:00, 1.45it/s] 100%|██████████| 30/30 [00:20<00:00, 1.45it/s] 100%|██████████| 30/30 [00:20<00:00, 1.45it/s] 0%| | 0/8 [00:00<?, ?it/s] 50%|█████ | 4/8 [00:00<00:00, 35.64it/s] 100%|██████████| 8/8 [00:00<00:00, 19.58it/s] 100%|██████████| 8/8 [00:00<00:00, 20.99it/s]
Version Details
- Version ID
c447ef9fc621af091e2c06d08fd2a22d9f5906389a2f8103c851a2f7cf9c4e63- Version Created
- October 6, 2023