fewjative/ultimate-sd-upscale 🔢🖼️❓📝✓ → 🖼️

▶️ 165.4K runs 📅 Nov 2023 ⚙️ Cog 0.8.6 🔗 GitHub

controlnet-tile image-restoration image-to-image image-upscaling

About

Ultimate SD Upscale with ControlNet Tile

Example Output

Output

Performance Metrics

58.92s Prediction Time

178.19s Total Time

All Input Parameters

{
  "cfg": 8,
  "image": "https://replicate.delivery/pbxt/JscFNQCfj4ohzBKyv1qkBs8Kw7gOsV8YOfImxF3v1A3HKmpC/ComfyUI_00476_.png",
  "steps": 20,
  "denoise": 0.2,
  "upscaler": "4x-UltraSharp",
  "mask_blur": 8,
  "mode_type": "Linear",
  "scheduler": "normal",
  "tile_width": 512,
  "upscale_by": 2,
  "tile_height": 512,
  "sampler_name": "euler",
  "tile_padding": 32,
  "seam_fix_mode": "None",
  "seam_fix_width": 64,
  "negative_prompt": "",
  "positive_prompt": "a dirty rust mech looking down at a kid wearing a backpack, in a jungle, low saturation, dirty, green foliage",
  "seam_fix_denoise": 1,
  "seam_fix_padding": 16,
  "seam_fix_mask_blur": 8,
  "controlnet_strength": 1,
  "force_uniform_tiles": true,
  "use_controlnet_tile": true
}

Input Parameters

cfg Type: numberDefault: 8: CFG
seed Type: integer: Sampling seed, leave Empty for Random
image (required) Type: string: Input image
steps Type: integerDefault: 20: Steps
denoise Type: numberDefault: 0.2: Denoise
upscaler Default: 4x-UltraSharp: Upscaler
mask_blur Type: integerDefault: 8: Mask Blur
mode_type Default: Linear: Mode Type
scheduler Default: normal: Scheduler
tile_width Type: integerDefault: 512: Tile Width
upscale_by Type: numberDefault: 2: Upscale By
tile_height Type: integerDefault: 512: Tile Height
sampler_name Default: euler: Sampler
tile_padding Type: integerDefault: 32: Tile Padding
seam_fix_mode Default: None: Seam Fix Mode
seam_fix_width Type: integerDefault: 64: Seam Fix Width
negative_prompt Type: stringDefault:: Negative Prompt
positive_prompt Type: stringDefault: Hey! Have a nice day :D: Positive Prompt
seam_fix_denoise Type: numberDefault: 1: Seam Fix Denoise
seam_fix_padding Type: integerDefault: 16: Seam Fix Padding
seam_fix_mask_blur Type: integerDefault: 8: Seam Fix Mask Blur
controlnet_strength Type: numberDefault: 1: ControlNet Strength
force_uniform_tiles Type: booleanDefault: true: Force Uniform Tiles
use_controlnet_tile Type: booleanDefault: true: Use ControlNet Tile

Output Schema

Output

Type: string • Format: uri

Example Execution Logs

Using seed: 16063994
Using ControlNet tile with Ultimate SD Upscale
got prompt
model_type EPS
adm 0
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
missing {'cond_stage_model.clip_l.logit_scale', 'cond_stage_model.clip_l.text_projection'}
left over keys: dict_keys(['cond_stage_model.clip_l.transformer.text_model.embeddings.position_ids'])
Requested to load SD1ClipModel
Loading 1 new model
/root/.pyenv/versions/3.10.6/lib/python3.10/site-packages/torch/_utils.py:831: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
return self.fget.__get__(instance, owner)()
[] []
Canva size: 1664x2432
Image size: 832x1216
Scale factor: 2
Upscaling iteration 1 with scale factor 2
Tile size: 512x512
Tiles amount: 20
Grid: 5x4
Redraw enabled: True
Seams fix mode: NONE
Requested to load BaseModel
Requested to load ControlNet
Loading 2 new models
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:00<00:07,  2.67it/s]
 15%|█▌        | 3/20 [00:00<00:02,  6.96it/s]
 25%|██▌       | 5/20 [00:00<00:01,  9.83it/s]
 35%|███▌      | 7/20 [00:00<00:01, 11.36it/s]
 45%|████▌     | 9/20 [00:00<00:00, 12.71it/s]
 55%|█████▌    | 11/20 [00:01<00:00, 12.70it/s]
 65%|██████▌   | 13/20 [00:01<00:00, 13.59it/s]
 75%|███████▌  | 15/20 [00:01<00:00, 13.79it/s]
 85%|████████▌ | 17/20 [00:01<00:00, 14.45it/s]
 95%|█████████▌| 19/20 [00:01<00:00, 14.49it/s]
100%|██████████| 20/20 [00:01<00:00, 12.18it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 15.50it/s]
 20%|██        | 4/20 [00:00<00:01, 15.90it/s]
 30%|███       | 6/20 [00:00<00:00, 15.60it/s]
 40%|████      | 8/20 [00:00<00:00, 15.62it/s]
 50%|█████     | 10/20 [00:00<00:00, 15.12it/s]
 60%|██████    | 12/20 [00:00<00:00, 15.41it/s]
 70%|███████   | 14/20 [00:00<00:00, 15.57it/s]
 80%|████████  | 16/20 [00:01<00:00, 15.64it/s]
 90%|█████████ | 18/20 [00:01<00:00, 15.78it/s]
100%|██████████| 20/20 [00:01<00:00, 15.65it/s]
100%|██████████| 20/20 [00:01<00:00, 15.59it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 15.80it/s]
 20%|██        | 4/20 [00:00<00:01, 15.01it/s]
 30%|███       | 6/20 [00:00<00:00, 15.33it/s]
 40%|████      | 8/20 [00:00<00:00, 14.66it/s]
 50%|█████     | 10/20 [00:00<00:00, 14.56it/s]
 60%|██████    | 12/20 [00:00<00:00, 14.57it/s]
 70%|███████   | 14/20 [00:00<00:00, 14.71it/s]
 80%|████████  | 16/20 [00:01<00:00, 14.92it/s]
 90%|█████████ | 18/20 [00:01<00:00, 15.24it/s]
100%|██████████| 20/20 [00:01<00:00, 14.86it/s]
100%|██████████| 20/20 [00:01<00:00, 14.88it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 15.62it/s]
 20%|██        | 4/20 [00:00<00:01, 15.71it/s]
 30%|███       | 6/20 [00:00<00:00, 14.86it/s]
 40%|████      | 8/20 [00:00<00:00, 15.11it/s]
 50%|█████     | 10/20 [00:00<00:00, 15.17it/s]
 60%|██████    | 12/20 [00:00<00:00, 15.33it/s]
 70%|███████   | 14/20 [00:00<00:00, 15.53it/s]
 80%|████████  | 16/20 [00:01<00:00, 15.71it/s]
 90%|█████████ | 18/20 [00:01<00:00, 15.56it/s]
100%|██████████| 20/20 [00:01<00:00, 15.22it/s]
100%|██████████| 20/20 [00:01<00:00, 15.33it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 15.51it/s]
 20%|██        | 4/20 [00:00<00:01, 14.56it/s]
 30%|███       | 6/20 [00:00<00:00, 14.44it/s]
 40%|████      | 8/20 [00:00<00:00, 14.89it/s]
 50%|█████     | 10/20 [00:00<00:00, 14.78it/s]
 60%|██████    | 12/20 [00:00<00:00, 14.91it/s]
 70%|███████   | 14/20 [00:00<00:00, 15.09it/s]
 80%|████████  | 16/20 [00:01<00:00, 15.14it/s]
 90%|█████████ | 18/20 [00:01<00:00, 14.91it/s]
100%|██████████| 20/20 [00:01<00:00, 14.64it/s]
100%|██████████| 20/20 [00:01<00:00, 14.81it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 15.21it/s]
 20%|██        | 4/20 [00:00<00:01, 14.37it/s]
 30%|███       | 6/20 [00:00<00:00, 14.87it/s]
 40%|████      | 8/20 [00:00<00:00, 14.82it/s]
 50%|█████     | 10/20 [00:00<00:00, 14.58it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.54it/s]
 70%|███████   | 14/20 [00:00<00:00, 13.59it/s]
 80%|████████  | 16/20 [00:01<00:00, 12.72it/s]
 90%|█████████ | 18/20 [00:01<00:00, 12.38it/s]
100%|██████████| 20/20 [00:01<00:00, 13.01it/s]
100%|██████████| 20/20 [00:01<00:00, 13.49it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 12.46it/s]
 20%|██        | 4/20 [00:00<00:01, 14.03it/s]
 30%|███       | 6/20 [00:00<00:01, 13.90it/s]
 40%|████      | 8/20 [00:00<00:00, 13.93it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.41it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.31it/s]
 70%|███████   | 14/20 [00:01<00:00, 12.60it/s]
 80%|████████  | 16/20 [00:01<00:00, 12.73it/s]
 90%|█████████ | 18/20 [00:01<00:00, 12.79it/s]
100%|██████████| 20/20 [00:01<00:00, 13.42it/s]
100%|██████████| 20/20 [00:01<00:00, 13.26it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 14.89it/s]
 20%|██        | 4/20 [00:00<00:01, 14.48it/s]
 30%|███       | 6/20 [00:00<00:00, 14.11it/s]
 40%|████      | 8/20 [00:00<00:00, 13.57it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.51it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.83it/s]
 70%|███████   | 14/20 [00:00<00:00, 14.26it/s]
 80%|████████  | 16/20 [00:01<00:00, 14.55it/s]
 90%|█████████ | 18/20 [00:01<00:00, 14.32it/s]
100%|██████████| 20/20 [00:01<00:00, 13.95it/s]
100%|██████████| 20/20 [00:01<00:00, 14.05it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 13.14it/s]
 20%|██        | 4/20 [00:00<00:01, 13.43it/s]
 30%|███       | 6/20 [00:00<00:01, 13.39it/s]
 40%|████      | 8/20 [00:00<00:00, 13.29it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.99it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.88it/s]
 70%|███████   | 14/20 [00:01<00:00, 14.13it/s]
 80%|████████  | 16/20 [00:01<00:00, 13.89it/s]
 90%|█████████ | 18/20 [00:01<00:00, 13.86it/s]
100%|██████████| 20/20 [00:01<00:00, 13.70it/s]
100%|██████████| 20/20 [00:01<00:00, 13.72it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 13.34it/s]
 20%|██        | 4/20 [00:00<00:01, 14.31it/s]
 30%|███       | 6/20 [00:00<00:01, 13.95it/s]
 40%|████      | 8/20 [00:00<00:00, 13.25it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.14it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.60it/s]
 70%|███████   | 14/20 [00:01<00:00, 13.75it/s]
 80%|████████  | 16/20 [00:01<00:00, 13.89it/s]
 90%|█████████ | 18/20 [00:01<00:00, 14.27it/s]
100%|██████████| 20/20 [00:01<00:00, 14.19it/s]
100%|██████████| 20/20 [00:01<00:00, 13.87it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 14.07it/s]
 20%|██        | 4/20 [00:00<00:01, 14.13it/s]
 30%|███       | 6/20 [00:00<00:01, 13.77it/s]
 40%|████      | 8/20 [00:00<00:00, 14.12it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.82it/s]
 60%|██████    | 12/20 [00:00<00:00, 14.16it/s]
 70%|███████   | 14/20 [00:00<00:00, 14.08it/s]
 80%|████████  | 16/20 [00:01<00:00, 14.09it/s]
 90%|█████████ | 18/20 [00:01<00:00, 14.47it/s]
100%|██████████| 20/20 [00:01<00:00, 14.05it/s]
100%|██████████| 20/20 [00:01<00:00, 14.07it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 12.65it/s]
 20%|██        | 4/20 [00:00<00:01, 12.88it/s]
 30%|███       | 6/20 [00:00<00:01, 13.44it/s]
 40%|████      | 8/20 [00:00<00:00, 13.77it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.68it/s]
 60%|██████    | 12/20 [00:00<00:00, 14.14it/s]
 70%|███████   | 14/20 [00:01<00:00, 14.43it/s]
 80%|████████  | 16/20 [00:01<00:00, 13.89it/s]
 90%|█████████ | 18/20 [00:01<00:00, 13.78it/s]
100%|██████████| 20/20 [00:01<00:00, 13.47it/s]
100%|██████████| 20/20 [00:01<00:00, 13.66it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 12.73it/s]
 20%|██        | 4/20 [00:00<00:01, 12.90it/s]
 30%|███       | 6/20 [00:00<00:01, 13.42it/s]
 40%|████      | 8/20 [00:00<00:00, 13.31it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.14it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.25it/s]
 70%|███████   | 14/20 [00:01<00:00, 13.45it/s]
 80%|████████  | 16/20 [00:01<00:00, 13.05it/s]
 90%|█████████ | 18/20 [00:01<00:00, 12.65it/s]
100%|██████████| 20/20 [00:01<00:00, 12.93it/s]
100%|██████████| 20/20 [00:01<00:00, 13.06it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 11.38it/s]
 20%|██        | 4/20 [00:00<00:01, 12.35it/s]
 30%|███       | 6/20 [00:00<00:01, 12.50it/s]
 40%|████      | 8/20 [00:00<00:00, 12.80it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.09it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.31it/s]
 70%|███████   | 14/20 [00:01<00:00, 13.09it/s]
 80%|████████  | 16/20 [00:01<00:00, 13.56it/s]
 90%|█████████ | 18/20 [00:01<00:00, 13.27it/s]
100%|██████████| 20/20 [00:01<00:00, 13.26it/s]
100%|██████████| 20/20 [00:01<00:00, 13.06it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 14.15it/s]
 20%|██        | 4/20 [00:00<00:01, 13.75it/s]
 30%|███       | 6/20 [00:00<00:01, 13.10it/s]
 40%|████      | 8/20 [00:00<00:00, 13.46it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.72it/s]
 60%|██████    | 12/20 [00:00<00:00, 14.20it/s]
 70%|███████   | 14/20 [00:01<00:00, 13.48it/s]
 80%|████████  | 16/20 [00:01<00:00, 13.20it/s]
 90%|█████████ | 18/20 [00:01<00:00, 13.10it/s]
100%|██████████| 20/20 [00:01<00:00, 12.86it/s]
100%|██████████| 20/20 [00:01<00:00, 13.29it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 14.57it/s]
 20%|██        | 4/20 [00:00<00:01, 13.05it/s]
 30%|███       | 6/20 [00:00<00:01, 13.23it/s]
 40%|████      | 8/20 [00:00<00:00, 13.15it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.09it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.36it/s]
 70%|███████   | 14/20 [00:01<00:00, 13.96it/s]
 80%|████████  | 16/20 [00:01<00:00, 14.35it/s]
 90%|█████████ | 18/20 [00:01<00:00, 13.37it/s]
100%|██████████| 20/20 [00:01<00:00, 13.66it/s]
100%|██████████| 20/20 [00:01<00:00, 13.56it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 12.54it/s]
 20%|██        | 4/20 [00:00<00:01, 13.18it/s]
 30%|███       | 6/20 [00:00<00:01, 13.28it/s]
 40%|████      | 8/20 [00:00<00:00, 13.55it/s]
 50%|█████     | 10/20 [00:00<00:00, 14.13it/s]
 60%|██████    | 12/20 [00:00<00:00, 14.58it/s]
 70%|███████   | 14/20 [00:00<00:00, 14.91it/s]
 80%|████████  | 16/20 [00:01<00:00, 14.73it/s]
 90%|█████████ | 18/20 [00:01<00:00, 14.09it/s]
100%|██████████| 20/20 [00:01<00:00, 14.06it/s]
100%|██████████| 20/20 [00:01<00:00, 14.05it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 13.05it/s]
 20%|██        | 4/20 [00:00<00:01, 13.87it/s]
 30%|███       | 6/20 [00:00<00:01, 13.58it/s]
 40%|████      | 8/20 [00:00<00:00, 14.26it/s]
 50%|█████     | 10/20 [00:00<00:00, 14.72it/s]
 60%|██████    | 12/20 [00:00<00:00, 14.21it/s]
 70%|███████   | 14/20 [00:00<00:00, 14.13it/s]
 80%|████████  | 16/20 [00:01<00:00, 14.67it/s]
 90%|█████████ | 18/20 [00:01<00:00, 14.91it/s]
100%|██████████| 20/20 [00:01<00:00, 15.21it/s]
100%|██████████| 20/20 [00:01<00:00, 14.56it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 15.66it/s]
 20%|██        | 4/20 [00:00<00:01, 14.24it/s]
 30%|███       | 6/20 [00:00<00:00, 14.13it/s]
 40%|████      | 8/20 [00:00<00:00, 14.03it/s]
 50%|█████     | 10/20 [00:00<00:00, 13.92it/s]
 60%|██████    | 12/20 [00:00<00:00, 13.38it/s]
 70%|███████   | 14/20 [00:01<00:00, 13.39it/s]
 80%|████████  | 16/20 [00:01<00:00, 13.52it/s]
 90%|█████████ | 18/20 [00:01<00:00, 13.55it/s]
100%|██████████| 20/20 [00:01<00:00, 13.50it/s]
100%|██████████| 20/20 [00:01<00:00, 13.69it/s]
Requested to load ControlNet
Loading 1 new model
unload clone 1
  0%|          | 0/20 [00:00<?, ?it/s]
 10%|█         | 2/20 [00:00<00:01, 12.56it/s]
 20%|██        | 4/20 [00:00<00:01, 13.31it/s]
 30%|███       | 6/20 [00:00<00:01, 13.15it/s]
 40%|████      | 8/20 [00:00<00:00, 13.82it/s]
 50%|█████     | 10/20 [00:00<00:00, 14.37it/s]
 60%|██████    | 12/20 [00:00<00:00, 14.16it/s]
 70%|███████   | 14/20 [00:01<00:00, 14.20it/s]
 80%|████████  | 16/20 [00:01<00:00, 13.48it/s]
 90%|█████████ | 18/20 [00:01<00:00, 13.49it/s]
100%|██████████| 20/20 [00:01<00:00, 12.94it/s]
100%|██████████| 20/20 [00:01<00:00, 13.45it/s]
Prompt executed in 54.65 seconds
node output:  {'images': [{'filename': 'ComfyUI_00007_.png', 'subfolder': '', 'type': 'output'}]}
output

Version Details

Version ID: 5daf1012d946160622cd1bd45ed8f12d9675d24659276ccfe24804035f3b3ad7
Version Created: November 15, 2023

Run on Replicate →