cjwbw/ledits 🔢🖼️📝 → 🖼️

▶️ 937 runs 📅 Jul 2023 ⚙️ Cog 0.7.0-beta19 🔗 GitHub 📄 Paper
image-editing image-object-removal

About

Real Image Editing with DDPM Inversion and Semantic Guidance

Example Output

Output

Example output

Performance Metrics

88.08s Prediction Time
361.82s Total Time
All Input Parameters
{
  "skip_steps": 36,
  "input_image": "https://replicate.delivery/pbxt/JDedEcItJwW879d82oqU8sanlCuaymF6EATC33j9zISnXVE6/lemons_input.jpg",
  "target_prompt": "a ceramic bowl",
  "concept_to_add": "apples",
  "guidance_scale": 7,
  "concept_to_remove": "lemons",
  "neg_guidance_scale": 7,
  "num_diffusion_steps": 100,
  "target_guidance_scale": 15
}
Input Parameters
seed Type: integer
Random seed. Leave blank to randomize the seed
skip_steps Type: integerDefault: 36
DDPM denoising steps to skip
input_image (required) Type: string
Input image
target_prompt Type: string
DDPM Inversion Prompt. Can help with global changes, modify to what you would like to see. This is optional
concept_to_add (required) Type: string
concept to add in the target image
guidance_scale Type: numberDefault: 15
guidance scale to add the above concept
concept_to_remove (required) Type: string
concept to remove from the original image
neg_guidance_scale Type: numberDefault: 7
guidance scale to remove the above concept
num_diffusion_steps Type: integerDefault: 100
number of diffusion steps
target_guidance_scale Type: numberDefault: 20
guidance scale for the target_prompt provided above
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
/src/inversion_utils.py:156: FutureWarning: Accessing config attribute `in_channels` directly via 'UNet2DConditionModel' object attribute is deprecated. Please access 'in_channels' over 'UNet2DConditionModel's config object instead, e.g. 'unet.config.in_channels'.
model.unet.in_channels,
/src/inversion_utils.py:63: FutureWarning: Accessing config attribute `in_channels` directly via 'UNet2DConditionModel' object attribute is deprecated. Please access 'in_channels' over 'UNet2DConditionModel's config object instead, e.g. 'unet.config.in_channels'.
model.unet.in_channels,
Inverting...:   0%|          | 0/100 [00:00<?, ?it/s]
Inverting...:   1%|          | 1/100 [00:00<00:26,  3.75it/s]
Inverting...:   2%|▏         | 2/100 [00:00<00:23,  4.09it/s]
Inverting...:   3%|▎         | 3/100 [00:00<00:23,  4.19it/s]
Inverting...:   4%|▍         | 4/100 [00:00<00:22,  4.25it/s]
Inverting...:   5%|▌         | 5/100 [00:01<00:22,  4.27it/s]
Inverting...:   6%|▌         | 6/100 [00:01<00:21,  4.27it/s]
Inverting...:   7%|▋         | 7/100 [00:01<00:21,  4.30it/s]
Inverting...:   8%|▊         | 8/100 [00:01<00:21,  4.30it/s]
Inverting...:   9%|▉         | 9/100 [00:02<00:21,  4.32it/s]
Inverting...:  10%|█         | 10/100 [00:02<00:20,  4.29it/s]
Inverting...:  11%|█         | 11/100 [00:02<00:20,  4.30it/s]
Inverting...:  12%|█▏        | 12/100 [00:02<00:20,  4.34it/s]
Inverting...:  13%|█▎        | 13/100 [00:03<00:20,  4.34it/s]
Inverting...:  14%|█▍        | 14/100 [00:03<00:19,  4.32it/s]
Inverting...:  15%|█▌        | 15/100 [00:03<00:19,  4.33it/s]
Inverting...:  16%|█▌        | 16/100 [00:03<00:19,  4.30it/s]
Inverting...:  17%|█▋        | 17/100 [00:03<00:19,  4.30it/s]
Inverting...:  18%|█▊        | 18/100 [00:04<00:19,  4.29it/s]
Inverting...:  19%|█▉        | 19/100 [00:04<00:18,  4.29it/s]
Inverting...:  20%|██        | 20/100 [00:04<00:18,  4.28it/s]
Inverting...:  21%|██        | 21/100 [00:04<00:18,  4.28it/s]
Inverting...:  22%|██▏       | 22/100 [00:05<00:18,  4.29it/s]
Inverting...:  23%|██▎       | 23/100 [00:05<00:17,  4.29it/s]
Inverting...:  24%|██▍       | 24/100 [00:05<00:17,  4.30it/s]
Inverting...:  25%|██▌       | 25/100 [00:05<00:17,  4.29it/s]
Inverting...:  26%|██▌       | 26/100 [00:06<00:17,  4.29it/s]
Inverting...:  27%|██▋       | 27/100 [00:06<00:17,  4.28it/s]
Inverting...:  28%|██▊       | 28/100 [00:06<00:16,  4.29it/s]
Inverting...:  29%|██▉       | 29/100 [00:06<00:16,  4.29it/s]
Inverting...:  30%|███       | 30/100 [00:07<00:16,  4.29it/s]
Inverting...:  31%|███       | 31/100 [00:07<00:16,  4.28it/s]
Inverting...:  32%|███▏      | 32/100 [00:07<00:15,  4.29it/s]
Inverting...:  33%|███▎      | 33/100 [00:07<00:15,  4.28it/s]
Inverting...:  34%|███▍      | 34/100 [00:07<00:15,  4.28it/s]
Inverting...:  35%|███▌      | 35/100 [00:08<00:15,  4.27it/s]
Inverting...:  36%|███▌      | 36/100 [00:08<00:14,  4.27it/s]
Inverting...:  37%|███▋      | 37/100 [00:08<00:14,  4.28it/s]
Inverting...:  38%|███▊      | 38/100 [00:08<00:14,  4.27it/s]
Inverting...:  39%|███▉      | 39/100 [00:09<00:14,  4.27it/s]
Inverting...:  40%|████      | 40/100 [00:09<00:14,  4.27it/s]
Inverting...:  41%|████      | 41/100 [00:09<00:13,  4.26it/s]
Inverting...:  42%|████▏     | 42/100 [00:09<00:13,  4.26it/s]
Inverting...:  43%|████▎     | 43/100 [00:10<00:13,  4.25it/s]
Inverting...:  44%|████▍     | 44/100 [00:10<00:13,  4.26it/s]
Inverting...:  45%|████▌     | 45/100 [00:10<00:12,  4.26it/s]
Inverting...:  46%|████▌     | 46/100 [00:10<00:12,  4.25it/s]
Inverting...:  47%|████▋     | 47/100 [00:10<00:12,  4.25it/s]
Inverting...:  48%|████▊     | 48/100 [00:11<00:12,  4.25it/s]
Inverting...:  49%|████▉     | 49/100 [00:11<00:11,  4.26it/s]
Inverting...:  50%|█████     | 50/100 [00:11<00:11,  4.25it/s]
Inverting...:  51%|█████     | 51/100 [00:11<00:11,  4.25it/s]
Inverting...:  52%|█████▏    | 52/100 [00:12<00:11,  4.26it/s]
Inverting...:  53%|█████▎    | 53/100 [00:12<00:11,  4.25it/s]
Inverting...:  54%|█████▍    | 54/100 [00:12<00:10,  4.24it/s]
Inverting...:  55%|█████▌    | 55/100 [00:12<00:10,  4.23it/s]
Inverting...:  56%|█████▌    | 56/100 [00:13<00:10,  4.24it/s]
Inverting...:  57%|█████▋    | 57/100 [00:13<00:10,  4.25it/s]
Inverting...:  58%|█████▊    | 58/100 [00:13<00:09,  4.26it/s]
Inverting...:  59%|█████▉    | 59/100 [00:13<00:09,  4.24it/s]
Inverting...:  60%|██████    | 60/100 [00:14<00:09,  4.25it/s]
Inverting...:  61%|██████    | 61/100 [00:14<00:09,  4.25it/s]
Inverting...:  62%|██████▏   | 62/100 [00:14<00:08,  4.23it/s]
Inverting...:  63%|██████▎   | 63/100 [00:14<00:08,  4.25it/s]
Inverting...:  64%|██████▍   | 64/100 [00:14<00:08,  4.24it/s]
Inverting...:  65%|██████▌   | 65/100 [00:15<00:08,  4.23it/s]
Inverting...:  66%|██████▌   | 66/100 [00:15<00:08,  4.25it/s]
Inverting...:  67%|██████▋   | 67/100 [00:15<00:07,  4.25it/s]
Inverting...:  68%|██████▊   | 68/100 [00:15<00:07,  4.23it/s]
Inverting...:  69%|██████▉   | 69/100 [00:16<00:07,  4.23it/s]
Inverting...:  70%|███████   | 70/100 [00:16<00:07,  4.22it/s]
Inverting...:  71%|███████   | 71/100 [00:16<00:06,  4.22it/s]
Inverting...:  72%|███████▏  | 72/100 [00:16<00:06,  4.24it/s]
Inverting...:  73%|███████▎  | 73/100 [00:17<00:06,  4.23it/s]
Inverting...:  74%|███████▍  | 74/100 [00:17<00:06,  4.21it/s]
Inverting...:  75%|███████▌  | 75/100 [00:17<00:05,  4.21it/s]
Inverting...:  76%|███████▌  | 76/100 [00:17<00:05,  4.23it/s]
Inverting...:  77%|███████▋  | 77/100 [00:18<00:05,  4.23it/s]
Inverting...:  78%|███████▊  | 78/100 [00:18<00:05,  4.21it/s]
Inverting...:  79%|███████▉  | 79/100 [00:18<00:04,  4.22it/s]
Inverting...:  80%|████████  | 80/100 [00:18<00:04,  4.20it/s]
Inverting...:  81%|████████  | 81/100 [00:19<00:04,  4.21it/s]
Inverting...:  82%|████████▏ | 82/100 [00:19<00:04,  4.21it/s]
Inverting...:  83%|████████▎ | 83/100 [00:19<00:04,  4.22it/s]
Inverting...:  84%|████████▍ | 84/100 [00:19<00:03,  4.20it/s]
Inverting...:  85%|████████▌ | 85/100 [00:19<00:03,  4.21it/s]
Inverting...:  86%|████████▌ | 86/100 [00:20<00:03,  4.22it/s]
Inverting...:  87%|████████▋ | 87/100 [00:20<00:03,  4.22it/s]
Inverting...:  88%|████████▊ | 88/100 [00:20<00:02,  4.20it/s]
Inverting...:  89%|████████▉ | 89/100 [00:20<00:02,  4.19it/s]
Inverting...:  90%|█████████ | 90/100 [00:21<00:02,  4.20it/s]
Inverting...:  91%|█████████ | 91/100 [00:21<00:02,  4.21it/s]
Inverting...:  92%|█████████▏| 92/100 [00:21<00:01,  4.19it/s]
Inverting...:  93%|█████████▎| 93/100 [00:21<00:01,  4.19it/s]
Inverting...:  94%|█████████▍| 94/100 [00:22<00:01,  4.19it/s]
Inverting...:  95%|█████████▌| 95/100 [00:22<00:01,  4.18it/s]
Inverting...:  96%|█████████▌| 96/100 [00:22<00:00,  4.17it/s]
Inverting...:  97%|█████████▋| 97/100 [00:22<00:00,  4.18it/s]
Inverting...:  98%|█████████▊| 98/100 [00:23<00:00,  4.20it/s]
Inverting...:  99%|█████████▉| 99/100 [00:23<00:00,  4.18it/s]
Inverting...: 100%|██████████| 100/100 [00:23<00:00,  4.18it/s]
Inverting...: 100%|██████████| 100/100 [00:23<00:00,  4.25it/s]
  0%|          | 0/64 [00:00<?, ?it/s]
  2%|▏         | 1/64 [00:00<00:55,  1.13it/s]
  3%|▎         | 2/64 [00:01<00:53,  1.16it/s]
  5%|▍         | 3/64 [00:02<00:52,  1.16it/s]
  6%|▋         | 4/64 [00:03<00:51,  1.16it/s]
  8%|▊         | 5/64 [00:04<00:50,  1.16it/s]
  9%|▉         | 6/64 [00:05<00:50,  1.16it/s]
 11%|█         | 7/64 [00:06<00:49,  1.16it/s]
 12%|█▎        | 8/64 [00:06<00:48,  1.16it/s]
 14%|█▍        | 9/64 [00:07<00:47,  1.16it/s]
 16%|█▌        | 10/64 [00:08<00:46,  1.15it/s]
 17%|█▋        | 11/64 [00:09<00:45,  1.15it/s]
 19%|█▉        | 12/64 [00:10<00:44,  1.16it/s]
 20%|██        | 13/64 [00:11<00:44,  1.15it/s]
 22%|██▏       | 14/64 [00:12<00:43,  1.15it/s]
 23%|██▎       | 15/64 [00:12<00:42,  1.15it/s]
 25%|██▌       | 16/64 [00:13<00:41,  1.15it/s]
 27%|██▋       | 17/64 [00:14<00:40,  1.15it/s]
 28%|██▊       | 18/64 [00:15<00:40,  1.14it/s]
 30%|██▉       | 19/64 [00:16<00:39,  1.14it/s]
 31%|███▏      | 20/64 [00:17<00:38,  1.14it/s]
 33%|███▎      | 21/64 [00:18<00:37,  1.14it/s]
 34%|███▍      | 22/64 [00:19<00:36,  1.14it/s]
 36%|███▌      | 23/64 [00:20<00:36,  1.13it/s]
 38%|███▊      | 24/64 [00:20<00:35,  1.13it/s]
 39%|███▉      | 25/64 [00:21<00:34,  1.13it/s]
 41%|████      | 26/64 [00:22<00:33,  1.13it/s]
 42%|████▏     | 27/64 [00:23<00:32,  1.13it/s]
 44%|████▍     | 28/64 [00:24<00:32,  1.12it/s]
 45%|████▌     | 29/64 [00:25<00:31,  1.12it/s]
 47%|████▋     | 30/64 [00:26<00:30,  1.12it/s]
 48%|████▊     | 31/64 [00:27<00:29,  1.12it/s]
 50%|█████     | 32/64 [00:28<00:28,  1.11it/s]
 52%|█████▏    | 33/64 [00:28<00:27,  1.11it/s]
 53%|█████▎    | 34/64 [00:29<00:26,  1.11it/s]
 55%|█████▍    | 35/64 [00:30<00:26,  1.11it/s]
 56%|█████▋    | 36/64 [00:31<00:25,  1.11it/s]
 58%|█████▊    | 37/64 [00:32<00:24,  1.10it/s]
 59%|█████▉    | 38/64 [00:33<00:23,  1.10it/s]
 61%|██████    | 39/64 [00:34<00:22,  1.10it/s]
 62%|██████▎   | 40/64 [00:35<00:21,  1.11it/s]
 64%|██████▍   | 41/64 [00:36<00:20,  1.11it/s]
 66%|██████▌   | 42/64 [00:37<00:19,  1.10it/s]
 67%|██████▋   | 43/64 [00:38<00:19,  1.10it/s]
 69%|██████▉   | 44/64 [00:38<00:18,  1.10it/s]
 70%|███████   | 45/64 [00:39<00:17,  1.10it/s]
 72%|███████▏  | 46/64 [00:40<00:16,  1.10it/s]
 73%|███████▎  | 47/64 [00:41<00:15,  1.09it/s]
 75%|███████▌  | 48/64 [00:42<00:14,  1.09it/s]
 77%|███████▋  | 49/64 [00:43<00:13,  1.09it/s]
 78%|███████▊  | 50/64 [00:44<00:12,  1.09it/s]
 80%|███████▉  | 51/64 [00:45<00:11,  1.08it/s]
 81%|████████▏ | 52/64 [00:46<00:11,  1.08it/s]
 83%|████████▎ | 53/64 [00:47<00:10,  1.08it/s]
 84%|████████▍ | 54/64 [00:48<00:09,  1.08it/s]
 86%|████████▌ | 55/64 [00:49<00:08,  1.07it/s]
 88%|████████▊ | 56/64 [00:50<00:07,  1.07it/s]
 89%|████████▉ | 57/64 [00:50<00:06,  1.07it/s]
 91%|█████████ | 58/64 [00:51<00:05,  1.07it/s]
 92%|█████████▏| 59/64 [00:52<00:04,  1.07it/s]
 94%|█████████▍| 60/64 [00:53<00:03,  1.06it/s]
 95%|█████████▌| 61/64 [00:54<00:02,  1.06it/s]
 97%|█████████▋| 62/64 [00:55<00:01,  1.06it/s]
 98%|█████████▊| 63/64 [00:56<00:00,  1.06it/s]
100%|██████████| 64/64 [00:57<00:00,  1.05it/s]
100%|██████████| 64/64 [00:57<00:00,  1.11it/s]
Version Details
Version ID
2d2893516879bba01c08607089a8382d0910f1060470cfa65fcbbfdcbdc66abb
Version Created
July 22, 2023
Run on Replicate →