usamaehsan/controlnet-x-ip-adapter-realistic-vision-v5 🔢📝❓✓🖼️ → 🖼️

▶️ 678.1K runs 📅 Nov 2023 ⚙️ Cog 0.9.4
image-inpainting image-to-image text-to-image

About

Inpainting || multi-controlnet || single-controlnet || ip-adapter || ip adapter face || ip adapter plus || No ip adapter

Example Output

Prompt:

"a bookmark showcasing rippling water in a forest, depicted in a detailed illustration style. The artwork captures the moonlit water, accentuated by the reflection of the moon above. Rich and vibrant colors intensify the moonlit ambiance. The lighting casts dramatic shadows, enhancing the depth and texture of the scene. Pro vector, perfect MINIMALISTIC art HIGH QUALITY details, Ultra high details, full design, victoria, vibrant vector, deep lines, heavy strokes"

Output

Example output

Performance Metrics

9.83s Prediction Time
117.95s Total Time
All Input Parameters 
{
  "eta": 0,
  "prompt": "a bookmark showcasing rippling water in a forest, depicted in a detailed illustration style. The artwork captures the moonlit water, accentuated by the reflection of the moon above. Rich and vibrant colors intensify the moonlit ambiance. The lighting casts dramatic shadows, enhancing the depth and texture of the scene. Pro vector, perfect MINIMALISTIC art HIGH QUALITY details, Ultra high details, full design, victoria, vibrant vector, deep lines, heavy strokes",
  "max_width": 512,
  "scheduler": "K_EULER_ANCESTRAL",
  "guess_mode": false,
  "int_kwargs": "",
  "max_height": 1024,
  "num_outputs": 1,
  "guidance_scale": 7,
  "scribble_image": "https://replicate.delivery/pbxt/K7J0YI1KOZ88qUL7eT6HORXPIlXTXvuSkZv99Z1MIEAP5Lq6/Screenshot_20231226-060658.jpg",
  "ip_adapter_ckpt": "ip-adapter-plus-face_sd15.bin",
  "negative_prompt": "(worst quality)++ ,(low quality)++ ,(normal quality)++ , lowres ,watermark ,",
  "img2img_strength": 0.5,
  "ip_adapter_weight": 0.7,
  "sorted_controlnets": "tile, inpainting, lineart",
  "num_inference_steps": 20,
  "disable_safety_check": false,
  "film_grain_lora_weight": 0,
  "tile_conditioning_scale": 1,
  "add_more_detail_lora_scale": 0,
  "detail_tweaker_lora_weight": 0,
  "lineart_conditioning_scale": 0.6,
  "scribble_conditioning_scale": 0,
  "epi_noise_offset_lora_weight": 0,
  "brightness_conditioning_scale": 1,
  "inpainting_conditioning_scale": 1,
  "color_temprature_slider_lora_weight": 0
}
Input Parameters
eta Type: numberDefault: 0
Controls the amount of noise that is added to the input data during the denoising diffusion process. Higher value -> more noise
seed Type: integer
Seed
prompt (required) Type: string
Prompt - using compel, use +++ to increase words weight:: doc: https://github.com/damian0815/compel/tree/main/doc || https://invoke-ai.github.io/InvokeAI/features/PROMPTS/#attention-weighting
max_width Type: integerDefault: 512
Max width/Resolution of image
scheduler Default: DDIM
Choose a scheduler.
guess_mode Type: booleanDefault: false
In this mode, the ControlNet encoder will try best to recognize the content of the input image even if you remove all prompts. The `guidance_scale` between 3.0 and 5.0 is recommended.
int_kwargs Type: stringDefault:
mask_image Type: string
mask image for inpainting controlnet
max_height Type: integerDefault: 512
Max height/Resolution of image
tile_image Type: string
Control image for tile controlnet
num_outputs Type: integerDefault: 1Range: 1 - 10
Number of images to generate
img2img_image Type: string
Image2image image
lineart_image Type: string
Control image for canny controlnet
guidance_scale Type: numberDefault: 7Range: 0.1 - 30
Scale for classifier-free guidance
scribble_image Type: string
Control image for scribble controlnet
ip_adapter_ckpt Default: ip-adapter_sd15.bin
IP Adapter checkpoint
negative_prompt Type: stringDefault: Longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality
Negative prompt - using compel, use +++ to increase words weight//// negative-embeddings available ///// FastNegativeV2 , boring_e621_v4 , verybadimagenegative_v1 || to use them, write their keyword in negative prompt
brightness_image Type: string
Control image for brightness controlnet
img2img_strength Type: numberDefault: 0.5
img2img strength, does not work when inpainting image is given, 0.1-same image, 0.99-complete destruction of image
inpainting_image Type: string
Control image for inpainting controlnet
ip_adapter_image Type: string
IP Adapter image
ip_adapter_weight Type: numberDefault: 1
IP Adapter weight
sorted_controlnets Type: stringDefault: lineart, tile, inpainting
Comma seperated string of controlnet names, list of names: tile, inpainting, lineart,depth ,scribble , brightness /// example value: tile, inpainting, lineart
inpainting_strength Type: numberDefault: 1
inpainting strength
num_inference_steps Type: integerDefault: 20
Steps to run denoising
disable_safety_check Type: booleanDefault: false
Disable safety check. Use at your own risk!
film_grain_lora_weight Type: numberDefault: 0
disabled on 0
negative_auto_mask_text Type: string
// seperated list of objects you dont want to mask - 'hairs // eyes // cloth'
positive_auto_mask_text Type: string
// seperated list of objects for mask, AI will auto create mask of these objects, if mask text is given, mask image will not work - 'hairs // eyes // cloth'
tile_conditioning_scale Type: numberDefault: 1
Conditioning scale for tile controlnet
add_more_detail_lora_scale Type: numberDefault: 0.5
Scale/ weight of more_details lora, more scale = more details, disabled on 0
detail_tweaker_lora_weight Type: numberDefault: 0
disabled on 0
lineart_conditioning_scale Type: numberDefault: 1
Conditioning scale for canny controlnet
scribble_conditioning_scale Type: numberDefault: 1
Conditioning scale for scribble controlnet
epi_noise_offset_lora_weight Type: numberDefault: 0
disabled on 0
brightness_conditioning_scale Type: numberDefault: 1
Conditioning scale for brightness controlnet
inpainting_conditioning_scale Type: numberDefault: 1
Conditioning scale for inpaint controlnet
color_temprature_slider_lora_weight Type: numberDefault: 0
disabled on 0
Output Schema

Output

Type: array • Items Type: string • Items Format: uri

Example Execution Logs 
Time taken until build pipe: 0.00 seconds
using ip adapter:: example/cat.png
loading ip adapter
Time taken to load IP adapter model: 0.12 seconds
Time taken to load image encoder model: 0.00 seconds
Time taken to build pipe: 1.80 seconds
Time taken to apply scheduler-- : 0.00 seconds
Time taken to cuda-- : 0.00 seconds
Using seed: 59960
Time taken until ip -- : 0.04 seconds
Time taken to load ip-- : 4.80 seconds
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:00<00:04,  3.98it/s]
 15%|█▌        | 3/20 [00:00<00:02,  7.71it/s]
 20%|██        | 4/20 [00:00<00:01,  8.09it/s]
 25%|██▌       | 5/20 [00:00<00:01,  8.34it/s]
 30%|███       | 6/20 [00:00<00:01,  8.51it/s]
 35%|███▌      | 7/20 [00:00<00:01,  8.63it/s]
 40%|████      | 8/20 [00:00<00:01,  8.62it/s]
 45%|████▌     | 9/20 [00:01<00:01,  8.75it/s]
 50%|█████     | 10/20 [00:01<00:01,  8.79it/s]
 55%|█████▌    | 11/20 [00:01<00:01,  8.81it/s]
 60%|██████    | 12/20 [00:01<00:00,  8.87it/s]
 65%|██████▌   | 13/20 [00:01<00:00,  8.86it/s]
 70%|███████   | 14/20 [00:01<00:00,  8.85it/s]
 75%|███████▌  | 15/20 [00:01<00:00,  8.88it/s]
 80%|████████  | 16/20 [00:01<00:00,  8.88it/s]
 85%|████████▌ | 17/20 [00:02<00:00,  8.83it/s]
 90%|█████████ | 18/20 [00:02<00:00,  8.87it/s]
 95%|█████████▌| 19/20 [00:02<00:00,  8.86it/s]
100%|██████████| 20/20 [00:02<00:00,  8.78it/s]
100%|██████████| 20/20 [00:02<00:00,  8.53it/s]
Time taken to generate image-- : 2.60 seconds
/root/.pyenv/versions/3.9.18/lib/python3.9/site-packages/peft/tuners/lora/layer.py:595: UserWarning: Already unmerged. Nothing to do.
warnings.warn("Already unmerged. Nothing to do.")
/root/.pyenv/versions/3.9.18/lib/python3.9/site-packages/peft/tuners/lora/layer.py:256: UserWarning: Already unmerged. Nothing to do.
warnings.warn("Already unmerged. Nothing to do.")
not returning processed
Version Details
Version ID
50ac06bb9bcf30e7b5dc66d3fe6e67262059a11ade572a35afa0ef686f55db82
Version Created
March 17, 2024
Run on Replicate →