fermatresearch/sdxl-lcm-lora-controlnet 🖼️🔢📝❓✓ → 🖼️

▶️ 15.0K runs 📅 Nov 2023 ⚙️ Cog 0.8.6 🔗 GitHub
image-inpainting image-to-image text-to-image

About

An extremely fast all-in-one model to use LCM with SDXL, ControlNet and custom LoRA url's!

Example Output

Prompt:

"shot in the style of sksfer, a boy playing with some toys"

Output

Example output

Performance Metrics

3.72s Prediction Time
3.77s Total Time
All Input Parameters 
{
  "width": 1024,
  "height": 1024,
  "prompt": "shot in the style of sksfer, a boy playing with some toys",
  "scheduler": "LCM",
  "lora_scale": 0.9,
  "num_outputs": 1,
  "lora_weights": "https://pbxt.replicate.delivery/QmdRkthSZmqTEBMgVi17OqpdKkafyLTS6TGmzTF5Qbo9d13IA/trained_model.tar",
  "batched_prompt": false,
  "guidance_scale": 2,
  "apply_watermark": true,
  "condition_scale": 0.45,
  "negative_prompt": "",
  "prompt_strength": 0.8,
  "controlnet_image": "https://replicate.delivery/pbxt/JsNziYC0Ha190bMKRDwkR5FpRGDrewOXzGH7mneGnHG4jREV/1f8edf0a-6ae1-4021-8ad2-e866e98d6efd.png",
  "num_inference_steps": 6
}
Input Parameters
mask Type: string
Input mask for inpaint mode. Black areas will be preserved, white areas will be inpainted.
seed Type: integer
Random seed. Leave blank to randomize the seed
image Type: string
Input image for img2img or inpaint mode
width Type: integerDefault: 1024
Width of output image
height Type: integerDefault: 1024
Height of output image
prompt Type: stringDefault: An astronaut riding a rainbow unicorn, cinematic, dramatic
Input prompt
scheduler Default: LCM
scheduler
lora_scale Type: numberDefault: 0.6Range: 0 - 1
LoRA additive scale. Only applicable on trained models.
num_outputs Type: integerDefault: 1Range: 1 - 4
Number of images to output.
lora_weights Type: string
Replicate LoRA weights to use. Leave blank to use the default weights.
batched_prompt Type: booleanDefault: false
When active, your prompt will be split by newlines and images will be generated for each individual line
guidance_scale Type: numberDefault: 2Range: 1 - 20
Scale for classifier-free guidance
apply_watermark Type: booleanDefault: true
Applies a watermark to enable determining if an image is generated in downstream applications. If you have other provisions for generating or deploying images safely, you can use this to disable watermarking.
condition_scale Type: numberDefault: 0.5Range: 0 - 1
The bigger this number is, the more ControlNet interferes
negative_prompt Type: stringDefault:
Input Negative Prompt
prompt_strength Type: numberDefault: 0.8Range: 0 - 1
Prompt strength when using img2img / inpaint. 1.0 corresponds to full destruction of information in image
controlnet_image Type: string
Input image for controlnet, it will be converted to a canny edge image.
replicate_weights Type: string
Replicate LoRA weights to use. Leave blank to use the default weights.
num_inference_steps Type: integerDefault: 6Range: 1 - 20
Number of denoising steps
disable_safety_checker Type: booleanDefault: false
Disable safety checker for generated images. This feature is only available through the API. See [https://replicate.com/docs/how-does-replicate-work#safety](https://replicate.com/docs/how-does-replicate-work#safety)
Output Schema

Output

Type: array • Items Type: string • Items Format: uri

Example Execution Logs 
Using seed: 59453
skipping loading .. weights already loaded
Prompt: shot in the style of <s0><s1>, a boy playing with some toys
The config attributes {'skip_prk_steps': True} were passed to LCMScheduler, but are not expected and will be ignored. Please verify your scheduler_config.json configuration file.
  0%|          | 0/6 [00:00<?, ?it/s]
 17%|█▋        | 1/6 [00:00<00:01,  4.77it/s]
 33%|███▎      | 2/6 [00:00<00:00,  4.77it/s]
 50%|█████     | 3/6 [00:00<00:00,  4.77it/s]
 67%|██████▋   | 4/6 [00:00<00:00,  4.76it/s]
 83%|████████▎ | 5/6 [00:01<00:00,  4.76it/s]
100%|██████████| 6/6 [00:01<00:00,  4.76it/s]
100%|██████████| 6/6 [00:01<00:00,  4.76it/s]
Version Details
Version ID
d9db096aec79855d1f42d2bd4fc89f2b1ddf7dcd00118a0e21b8f1d5c03be099
Version Created
November 14, 2023
Run on Replicate →