cjwbw/prompt-free-diffusion 🔢🖼️❓ → 🖼️

▶️ 749 runs 📅 Jun 2023 ⚙️ Cog 0.7.2 🔗 GitHub 📄 Paper ⚖️ License
controlnet image-to-image sketch-to-image

About

Prompt-free Diffusion

Example Output

Output

Example output

Performance Metrics

85.66s Prediction Time
627.07s Total Time
All Input Parameters
{
  "image": "https://replicate.delivery/pbxt/IvpLPCeH4QTQomgDkJy4NHla7zk2lSz4Tdv6f9x6vywCsMTs/astronautridinghouse-input.jpg",
  "control": "https://replicate.delivery/pbxt/IvpLP71kyA7Zz7BiLnjoskVpbCHnaflLHVMa6DNQWwvacF9u/astronautridinghouse-canny.png",
  "out_width": 768,
  "out_height": 512,
  "control_net": "canny",
  "tag_diffuser": "Deliberate-v2.0",
  "guidance_scale": 2,
  "context_encoder": "SeeCoder",
  "preprocess_type": "canny",
  "num_inference_steps": 50
}
Input Parameters
seed Type: integer
Random seed. Leave blank to randomize the seed
image (required) Type: string
Input image
control (required) Type: string
Control input
out_width Type: integerDefault: 512Range: 512 - 1536
Width of output image. Reduce if hits the memory limit
out_height Type: integerDefault: 512Range: 512 - 1536
Height of output image. Reduce if hits the memory limit
control_net Default: canny
Choose ControlNet
tag_diffuser Default: Deliberate-v2.0
Choose a diffusion model
guidance_scale Type: numberDefault: 2Range: 0 - 10
Scale for classifier-free guidance
context_encoder Default: SeeCoder
Choose a context encoder
preprocess_type Default: canny
Choose a Preprocess Type
num_inference_steps Type: integerDefault: 50Range: 1 - 500
Number of denoising steps
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
Using seed: 12119
#######################
# Running in eps mode #
#######################
making attention of type 'vanilla' with 512 in_channels
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
making attention of type 'vanilla' with 512 in_channels
Load model from [pretrained/pfd/vae/sd-v2-0-base-autokl.pth] strict [True].
Load autoencoderkl with total 83653863 parameters,79145.299 parameter sum.
Load swin with total 195201204 parameters,44522.425 parameter sum.
Load seecoder_decoder with total 27783168 parameters,13929.608 parameter sum.
Load seecoder_query_transformer with total 71130624 parameters,21163.731 parameter sum.
Load seecoder with total 294114996 parameters,79615.763 parameter sum.
Load openai_unet_2d_next with total 859520964 parameters,100102.951 parameter sum.
Load controlnet with total 361279120 parameters,41433.391 parameter sum.
Load pfd_with_control with total 1598568943 parameters,300297.405 parameter sum.
Load context encoder from [pretrained/pfd/seecoder/seecoder-v1-0.safetensors] strict [True].
Load diffuser from [pretrained/pfd/diffuser/Deliberate-v2-0.safetensors] strict [True].
Load controlnet from [pretrained/controlnet/control_sd15_canny_slimmed.safetensors] strict [True].
###################
# Running in FP16 #
###################
Data shape for DDIM sampling is [1, 4, 64, 96], eta 0.0
DDIM Sampler:   0%|          | 0/50 [00:00<?, ?it/s]
DDIM Sampler:   2%|▏         | 1/50 [00:00<00:33,  1.44it/s]
DDIM Sampler:   4%|▍         | 2/50 [00:01<00:27,  1.73it/s]
DDIM Sampler:   6%|▌         | 3/50 [00:01<00:25,  1.85it/s]
DDIM Sampler:   8%|▊         | 4/50 [00:02<00:24,  1.92it/s]
DDIM Sampler:  10%|█         | 5/50 [00:02<00:23,  1.95it/s]
DDIM Sampler:  12%|█▏        | 6/50 [00:03<00:22,  1.97it/s]
DDIM Sampler:  14%|█▍        | 7/50 [00:03<00:21,  1.98it/s]
DDIM Sampler:  16%|█▌        | 8/50 [00:04<00:21,  1.99it/s]
DDIM Sampler:  18%|█▊        | 9/50 [00:04<00:20,  2.00it/s]
DDIM Sampler:  20%|██        | 10/50 [00:05<00:19,  2.00it/s]
DDIM Sampler:  22%|██▏       | 11/50 [00:05<00:19,  2.00it/s]
DDIM Sampler:  24%|██▍       | 12/50 [00:06<00:18,  2.01it/s]
DDIM Sampler:  26%|██▌       | 13/50 [00:06<00:18,  2.01it/s]
DDIM Sampler:  28%|██▊       | 14/50 [00:07<00:17,  2.01it/s]
DDIM Sampler:  30%|███       | 15/50 [00:07<00:17,  2.01it/s]
DDIM Sampler:  32%|███▏      | 16/50 [00:08<00:16,  2.01it/s]
DDIM Sampler:  34%|███▍      | 17/50 [00:08<00:16,  2.00it/s]
DDIM Sampler:  36%|███▌      | 18/50 [00:09<00:15,  2.00it/s]
DDIM Sampler:  38%|███▊      | 19/50 [00:09<00:15,  2.01it/s]
DDIM Sampler:  40%|████      | 20/50 [00:10<00:14,  2.01it/s]
DDIM Sampler:  42%|████▏     | 21/50 [00:10<00:14,  2.01it/s]
DDIM Sampler:  44%|████▍     | 22/50 [00:11<00:13,  2.01it/s]
DDIM Sampler:  46%|████▌     | 23/50 [00:11<00:13,  2.01it/s]
DDIM Sampler:  48%|████▊     | 24/50 [00:12<00:12,  2.01it/s]
DDIM Sampler:  50%|█████     | 25/50 [00:12<00:12,  2.00it/s]
DDIM Sampler:  52%|█████▏    | 26/50 [00:13<00:11,  2.00it/s]
DDIM Sampler:  54%|█████▍    | 27/50 [00:13<00:11,  2.01it/s]
DDIM Sampler:  56%|█████▌    | 28/50 [00:14<00:10,  2.00it/s]
DDIM Sampler:  58%|█████▊    | 29/50 [00:14<00:10,  2.00it/s]
DDIM Sampler:  60%|██████    | 30/50 [00:15<00:09,  2.00it/s]
DDIM Sampler:  62%|██████▏   | 31/50 [00:15<00:09,  2.00it/s]
DDIM Sampler:  64%|██████▍   | 32/50 [00:16<00:08,  2.00it/s]
DDIM Sampler:  66%|██████▌   | 33/50 [00:16<00:08,  2.00it/s]
DDIM Sampler:  68%|██████▊   | 34/50 [00:17<00:07,  2.00it/s]
DDIM Sampler:  70%|███████   | 35/50 [00:17<00:07,  2.00it/s]
DDIM Sampler:  72%|███████▏  | 36/50 [00:18<00:06,  2.01it/s]
DDIM Sampler:  74%|███████▍  | 37/50 [00:18<00:06,  2.01it/s]
DDIM Sampler:  76%|███████▌  | 38/50 [00:19<00:05,  2.01it/s]
DDIM Sampler:  78%|███████▊  | 39/50 [00:19<00:05,  2.00it/s]
DDIM Sampler:  80%|████████  | 40/50 [00:20<00:04,  2.00it/s]
DDIM Sampler:  82%|████████▏ | 41/50 [00:20<00:04,  2.00it/s]
DDIM Sampler:  84%|████████▍ | 42/50 [00:21<00:03,  2.00it/s]
DDIM Sampler:  86%|████████▌ | 43/50 [00:21<00:03,  2.00it/s]
DDIM Sampler:  88%|████████▊ | 44/50 [00:22<00:02,  2.00it/s]
DDIM Sampler:  90%|█████████ | 45/50 [00:22<00:02,  2.00it/s]
DDIM Sampler:  92%|█████████▏| 46/50 [00:23<00:01,  2.00it/s]
DDIM Sampler:  94%|█████████▍| 47/50 [00:23<00:01,  2.00it/s]
DDIM Sampler:  96%|█████████▌| 48/50 [00:24<00:01,  2.00it/s]
DDIM Sampler:  98%|█████████▊| 49/50 [00:24<00:00,  2.00it/s]
DDIM Sampler: 100%|██████████| 50/50 [00:25<00:00,  2.00it/s]
DDIM Sampler: 100%|██████████| 50/50 [00:25<00:00,  1.99it/s]
Version Details
Version ID
8ffe43fe7298a95554ea24047fb144b921ca1a85f661527b34b2c02b2573579f
Version Created
June 2, 2023
Run on Replicate →