roblester/editorial-cartoon 🖼️🔢📝❓✓ → 🖼️

▶️ 1.6K runs 📅 Jul 2024 ⚙️ Cog 0.9.5
image-inpainting image-to-image text-to-image

About

An SDXL model Finetuned for style on a bespoke dataset of Stylized Illustrations

Example Output

Prompt:

"illustration in the style of TOK of A nurse on the street in NYC"

Output

Example output

Performance Metrics

30.09s Prediction Time
32.87s Total Time
All Input Parameters
{
  "width": 1024,
  "height": 1024,
  "prompt": "illustration in the style of TOK of A nurse on the street in NYC",
  "refine": "expert_ensemble_refiner",
  "scheduler": "K_EULER_ANCESTRAL",
  "lora_scale": 0.8,
  "num_outputs": 1,
  "guidance_scale": 7.5,
  "apply_watermark": true,
  "high_noise_frac": 0.8,
  "negative_prompt": "",
  "prompt_strength": 0.8,
  "num_inference_steps": 100
}
Input Parameters
mask Type: string
Input mask for inpaint mode. Black areas will be preserved, white areas will be inpainted.
seed Type: integer
Random seed. Leave blank to randomize the seed
image Type: string
Input image for img2img or inpaint mode
width Type: integerDefault: 1024
Width of output image
height Type: integerDefault: 1024
Height of output image
prompt Type: stringDefault: An astronaut riding a rainbow unicorn
Input prompt
refine Default: no_refiner
Which refine style to use
scheduler Default: K_EULER
scheduler
lora_scale Type: numberDefault: 0.6Range: 0 - 1
LoRA additive scale. Only applicable on trained models.
num_outputs Type: integerDefault: 1Range: 1 - 4
Number of images to output.
refine_steps Type: integer
For base_image_refiner, the number of steps to refine, defaults to num_inference_steps
guidance_scale Type: numberDefault: 7.5Range: 1 - 50
Scale for classifier-free guidance
apply_watermark Type: booleanDefault: true
Applies a watermark to enable determining if an image is generated in downstream applications. If you have other provisions for generating or deploying images safely, you can use this to disable watermarking.
high_noise_frac Type: numberDefault: 0.8Range: 0 - 1
For expert_ensemble_refiner, the fraction of noise to use
negative_prompt Type: stringDefault:
Input Negative Prompt
prompt_strength Type: numberDefault: 0.8Range: 0 - 1
Prompt strength when using img2img / inpaint. 1.0 corresponds to full destruction of information in image
replicate_weights Type: string
Replicate LoRA weights to use. Leave blank to use the default weights.
num_inference_steps Type: integerDefault: 50Range: 1 - 500
Number of denoising steps
disable_safety_checker Type: booleanDefault: false
Disable safety checker for generated images. This feature is only available through the API. See [https://replicate.com/docs/how-does-replicate-work#safety](https://replicate.com/docs/how-does-replicate-work#safety)
Output Schema

Output

Type: arrayItems Type: stringItems Format: uri

Example Execution Logs
Using seed: 6691
Ensuring enough disk space...
Free disk space: 1609035563008
Downloading weights: https://replicate.delivery/pbxt/EsFWqRfmVkzlS6RuZMMAbUbGaB7DNYYYLCl0zmFX3LXCJ4lJA/trained_model.tar
2024-07-24T20:14:29Z | INFO  | [ Initiating ] chunk_size=150M dest=/src/weights-cache/b3834eb6ecebe924 url=https://replicate.delivery/pbxt/EsFWqRfmVkzlS6RuZMMAbUbGaB7DNYYYLCl0zmFX3LXCJ4lJA/trained_model.tar
2024-07-24T20:14:32Z | INFO  | [ Complete ] dest=/src/weights-cache/b3834eb6ecebe924 size="186 MB" total_elapsed=2.598s url=https://replicate.delivery/pbxt/EsFWqRfmVkzlS6RuZMMAbUbGaB7DNYYYLCl0zmFX3LXCJ4lJA/trained_model.tar
b''
Downloaded weights in 2.7233593463897705 seconds
Loading fine-tuned model
Does not have Unet. assume we are using LoRA
Loading Unet LoRA
Prompt: illustration in the style of <s0><s1> of A nurse on the street in NYC
txt2img mode
  0%|          | 0/80 [00:00<?, ?it/s]/usr/local/lib/python3.9/site-packages/torch/nn/modules/conv.py:459: UserWarning: Applied workaround for CuDNN issue, install nvrtc.so (Triggered internally at ../aten/src/ATen/native/cudnn/Conv_v8.cpp:80.)
return F.conv2d(input, weight, bias, self.stride,
/usr/local/lib/python3.9/site-packages/diffusers/models/attention_processor.py:1946: FutureWarning: `LoRAAttnProcessor2_0` is deprecated and will be removed in version 0.26.0. Make sure use AttnProcessor2_0 instead by settingLoRA layers to `self.{to_q,to_k,to_v,to_out[0]}.lora_layer` respectively. This will be done automatically when using `LoraLoaderMixin.load_lora_weights`
deprecate(
  1%|▏         | 1/80 [00:00<00:33,  2.36it/s]
  2%|▎         | 2/80 [00:00<00:20,  3.72it/s]
  4%|▍         | 3/80 [00:00<00:19,  3.95it/s]
  5%|▌         | 4/80 [00:01<00:18,  4.07it/s]
  6%|▋         | 5/80 [00:01<00:18,  4.13it/s]
  8%|▊         | 6/80 [00:01<00:17,  4.16it/s]
  9%|▉         | 7/80 [00:01<00:17,  4.19it/s]
 10%|█         | 8/80 [00:01<00:17,  4.21it/s]
 11%|█▏        | 9/80 [00:02<00:16,  4.21it/s]
 12%|█▎        | 10/80 [00:02<00:16,  4.21it/s]
 14%|█▍        | 11/80 [00:02<00:16,  4.22it/s]
 15%|█▌        | 12/80 [00:02<00:16,  4.22it/s]
 16%|█▋        | 13/80 [00:03<00:15,  4.23it/s]
 18%|█▊        | 14/80 [00:03<00:15,  4.23it/s]
 19%|█▉        | 15/80 [00:03<00:15,  4.22it/s]
 20%|██        | 16/80 [00:03<00:15,  4.22it/s]
 21%|██▏       | 17/80 [00:04<00:14,  4.23it/s]
 22%|██▎       | 18/80 [00:04<00:14,  4.22it/s]
 24%|██▍       | 19/80 [00:04<00:14,  4.23it/s]
 25%|██▌       | 20/80 [00:04<00:14,  4.24it/s]
 26%|██▋       | 21/80 [00:05<00:13,  4.24it/s]
 28%|██▊       | 22/80 [00:05<00:13,  4.25it/s]
 29%|██▉       | 23/80 [00:05<00:13,  4.25it/s]
 30%|███       | 24/80 [00:05<00:13,  4.25it/s]
 31%|███▏      | 25/80 [00:06<00:12,  4.25it/s]
 32%|███▎      | 26/80 [00:06<00:12,  4.25it/s]
 34%|███▍      | 27/80 [00:06<00:12,  4.25it/s]
 35%|███▌      | 28/80 [00:06<00:12,  4.26it/s]
 36%|███▋      | 29/80 [00:06<00:11,  4.25it/s]
 38%|███▊      | 30/80 [00:07<00:11,  4.25it/s]
 39%|███▉      | 31/80 [00:07<00:11,  4.25it/s]
 40%|████      | 32/80 [00:07<00:11,  4.25it/s]
 41%|████▏     | 33/80 [00:07<00:11,  4.25it/s]
 42%|████▎     | 34/80 [00:08<00:10,  4.25it/s]
 44%|████▍     | 35/80 [00:08<00:10,  4.25it/s]
 45%|████▌     | 36/80 [00:08<00:10,  4.25it/s]
 46%|████▋     | 37/80 [00:08<00:10,  4.24it/s]
 48%|████▊     | 38/80 [00:09<00:09,  4.24it/s]
 49%|████▉     | 39/80 [00:09<00:09,  4.24it/s]
 50%|█████     | 40/80 [00:09<00:09,  4.24it/s]
 51%|█████▏    | 41/80 [00:09<00:09,  4.24it/s]
 52%|█████▎    | 42/80 [00:10<00:08,  4.24it/s]
 54%|█████▍    | 43/80 [00:10<00:08,  4.24it/s]
 55%|█████▌    | 44/80 [00:10<00:08,  4.24it/s]
 56%|█████▋    | 45/80 [00:10<00:08,  4.24it/s]
 57%|█████▊    | 46/80 [00:10<00:08,  4.25it/s]
 59%|█████▉    | 47/80 [00:11<00:07,  4.25it/s]
 60%|██████    | 48/80 [00:11<00:07,  4.25it/s]
 61%|██████▏   | 49/80 [00:11<00:07,  4.24it/s]
 62%|██████▎   | 50/80 [00:11<00:07,  4.24it/s]
 64%|██████▍   | 51/80 [00:12<00:06,  4.24it/s]
 65%|██████▌   | 52/80 [00:12<00:06,  4.24it/s]
 66%|██████▋   | 53/80 [00:12<00:06,  4.24it/s]
 68%|██████▊   | 54/80 [00:12<00:06,  4.24it/s]
 69%|██████▉   | 55/80 [00:13<00:05,  4.24it/s]
 70%|███████   | 56/80 [00:13<00:05,  4.24it/s]
 71%|███████▏  | 57/80 [00:13<00:05,  4.24it/s]
 72%|███████▎  | 58/80 [00:13<00:05,  4.24it/s]
 74%|███████▍  | 59/80 [00:14<00:04,  4.24it/s]
 75%|███████▌  | 60/80 [00:14<00:04,  4.24it/s]
 76%|███████▋  | 61/80 [00:14<00:04,  4.24it/s]
 78%|███████▊  | 62/80 [00:14<00:04,  4.23it/s]
 79%|███████▉  | 63/80 [00:14<00:04,  4.23it/s]
 80%|████████  | 64/80 [00:15<00:03,  4.23it/s]
 81%|████████▏ | 65/80 [00:15<00:03,  4.23it/s]
 82%|████████▎ | 66/80 [00:15<00:03,  4.23it/s]
 84%|████████▍ | 67/80 [00:15<00:03,  4.22it/s]
 85%|████████▌ | 68/80 [00:16<00:02,  4.23it/s]
 86%|████████▋ | 69/80 [00:16<00:02,  4.22it/s]
 88%|████████▊ | 70/80 [00:16<00:02,  4.22it/s]
 89%|████████▉ | 71/80 [00:16<00:02,  4.22it/s]
 90%|█████████ | 72/80 [00:17<00:01,  4.22it/s]
 91%|█████████▏| 73/80 [00:17<00:01,  4.22it/s]
 92%|█████████▎| 74/80 [00:17<00:01,  4.22it/s]
 94%|█████████▍| 75/80 [00:17<00:01,  4.22it/s]
 95%|█████████▌| 76/80 [00:18<00:00,  4.22it/s]
 96%|█████████▋| 77/80 [00:18<00:00,  4.22it/s]
 98%|█████████▊| 78/80 [00:18<00:00,  4.22it/s]
 99%|█████████▉| 79/80 [00:18<00:00,  4.22it/s]
100%|██████████| 80/80 [00:18<00:00,  4.22it/s]
100%|██████████| 80/80 [00:18<00:00,  4.21it/s]
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:00<00:05,  3.66it/s]
 10%|█         | 2/20 [00:00<00:04,  3.96it/s]
 15%|█▌        | 3/20 [00:00<00:04,  4.07it/s]
 20%|██        | 4/20 [00:00<00:03,  4.12it/s]
 25%|██▌       | 5/20 [00:01<00:03,  4.14it/s]
 30%|███       | 6/20 [00:01<00:03,  4.16it/s]
 35%|███▌      | 7/20 [00:01<00:03,  4.18it/s]
 40%|████      | 8/20 [00:01<00:02,  4.19it/s]
 45%|████▌     | 9/20 [00:02<00:02,  4.20it/s]
 50%|█████     | 10/20 [00:02<00:02,  4.20it/s]
 55%|█████▌    | 11/20 [00:02<00:02,  4.20it/s]
 60%|██████    | 12/20 [00:02<00:01,  4.20it/s]
 65%|██████▌   | 13/20 [00:03<00:01,  4.20it/s]
 70%|███████   | 14/20 [00:03<00:01,  4.20it/s]
 75%|███████▌  | 15/20 [00:03<00:01,  4.20it/s]
 80%|████████  | 16/20 [00:03<00:00,  4.20it/s]
 85%|████████▌ | 17/20 [00:04<00:00,  4.20it/s]
 90%|█████████ | 18/20 [00:04<00:00,  4.20it/s]
 95%|█████████▌| 19/20 [00:04<00:00,  4.20it/s]
100%|██████████| 20/20 [00:04<00:00,  4.21it/s]
100%|██████████| 20/20 [00:04<00:00,  4.17it/s]
Version Details
Version ID
873e1db54db20146e5bb885a9e6e1dc268a62845d7fbfd3863f6507c938d844b
Version Created
July 24, 2024
Run on Replicate →