piyushk52/ad_interpolation_2 🔢❓📝🖼️ → 🖼️

▶️ 78 runs 📅 Sep 2023 ⚙️ Cog 0.8.6
image-interpolation image-morphing image-to-video

About

Example Output

Output

Example output

Performance Metrics

57.23s Prediction Time
210.84s Total Time
All Input Parameters 
{
  "cfg": 8,
  "seed": -1,
  "model": "Counterfeit-V3.0_fp32.safetensors",
  "sampler": "dpmpp_2m",
  "motion_module": "mm_sd_v15_v2.ckpt",
  "sampling_steps": 30,
  "image_dimension": "512x512",
  "negative_prompt": "bad, ugly, weird",
  "positive_prompt": "griffith from berserk anime, beautiful artwork",
  "ending_image_path": "https://replicate.delivery/pbxt/Jc053BtJWuOACOb95M13oqyGlq4AzVpUl2fvc9VacjAoTPpH/22.jpg",
  "starting_image_path": "https://replicate.delivery/pbxt/Jc052btNFmCnabdaiBT8Nw0eYnaIMN8RznffkR12qagazzCp/21.jpg",
  "ending_img_controlnet_weight": 0.8,
  "starting_img_controlnet_weight": 0.8
}
Input Parameters
cfg Type: numberDefault: 8Range: 0 - 30
Interpolation sampler cfg
seed Type: integerDefault: -1
Sampling seed
model Default: Counterfeit-V3.0_fp32.safetensors
Select a Module
sampler Default: dpmpp_2m
Sampler
motion_module Default: mm_sd_v14.ckpt
Select a Motion Model
sampling_steps Type: integerDefault: 30
Sampling steps
image_dimension Default: 512x512
Select image dimenstions
negative_prompt (required) Type: string
Negative Prompt
positive_prompt (required) Type: string
Positive Prompt
ending_image_path (required) Type: string
Ending Image
starting_image_path (required) Type: string
Starting Image
ending_img_controlnet_weight Type: numberDefault: 0.8Range: 0 - 1
Controlnet weight for ending image
ending_image_latent_cn_weights Type: stringDefault: 0=0.0, 1=0.13, 2=0.24, 3=0.34, 4=0.43, 5=0.50, 6=0.57, 7=0.63, 8=0.68, 9=0.72, 10=1.0, 11=1.0, 12=1.0, 13=1.0, 14=1.0, 15=1.0
weights for how cn will affect the latents
starting_img_controlnet_weight Type: numberDefault: 0.8Range: 0 - 1
Controlnet weight for starting image
starting_image_latent_cn_weights Type: stringDefault: 0=1.0, 1=0.87, 2=0.76, 3=0.66, 4=0.57, 5=0.50, 6=0.43, 7=0.37, 8=0.32, 9=0.28, 10=0.0, 11=0.0, 12=0.0, 13=0.0, 14=0.0, 15=0.0
weights for how cn will affect the latents
Output Schema

Output

Type: string • Format: uri

Example Execution Logs 
got prompt
loading new
making attention of type 'vanilla-pytorch' with 512 in_channels
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
making attention of type 'vanilla-pytorch' with 512 in_channels
----------------------------------------
Efficient Loader Models Cache:
Ckpt:
[1] Counterfeit-V3.0_fp32
Vae:
[1] vae-ft-mse-840000-ema-pruned
[AnimateDiffEvo] - INFO - Loading motion module mm_sd_v15_v2.ckpt
[AnimateDiffEvo] - INFO - Using fp16, converting motion module to fp16
/root/.pyenv/versions/3.10.6/lib/python3.10/site-packages/torch/_utils.py:776: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
return self.fget.__get__(instance, owner)()
[] []
[] []
[AnimateDiffEvo] - INFO - Regular AnimateDiff activated - latents passed in (16) less or equal to context_length 16.
[AnimateDiffEvo] - INFO - Injecting motion module mm_sd_v15_v2.ckpt version v2.
loading new
  0%|          | 0/28 [00:00<?, ?it/s]
  4%|▌         | 1/28 [00:00<00:22,  1.22it/s]
  7%|▌         | 2/28 [00:01<00:18,  1.39it/s]
 11%|█         | 3/28 [00:02<00:17,  1.45it/s]
 14%|█▌        | 4/28 [00:02<00:16,  1.48it/s]
 18%|█▌        | 5/28 [00:03<00:15,  1.50it/s]
 21%|██▌       | 6/28 [00:04<00:14,  1.51it/s]
 25%|██▌       | 7/28 [00:04<00:13,  1.52it/s]
 29%|██▌       | 8/28 [00:05<00:13,  1.52it/s]
 32%|███▌      | 9/28 [00:06<00:12,  1.53it/s]
 36%|███▌      | 10/28 [00:06<00:11,  1.53it/s]
 39%|███▌      | 11/28 [00:07<00:11,  1.53it/s]
 43%|████▌     | 12/28 [00:08<00:10,  1.53it/s]
 46%|████▌     | 13/28 [00:08<00:09,  1.53it/s]
 50%|█████     | 14/28 [00:09<00:09,  1.53it/s]
 54%|█████▌    | 15/28 [00:09<00:08,  1.53it/s]
 57%|█████▌    | 16/28 [00:10<00:07,  1.53it/s]
 61%|██████    | 17/28 [00:11<00:07,  1.53it/s]
 64%|██████▌   | 18/28 [00:11<00:06,  1.53it/s]
 68%|██████▌   | 19/28 [00:12<00:05,  1.53it/s]
 71%|███████▌  | 20/28 [00:13<00:05,  1.53it/s]
 75%|███████▌  | 21/28 [00:13<00:04,  1.53it/s]
 79%|███████▌  | 22/28 [00:14<00:03,  1.53it/s]
 82%|████████▌ | 23/28 [00:15<00:03,  1.53it/s]
 86%|████████▌ | 24/28 [00:15<00:02,  1.53it/s]
 89%|████████▌ | 25/28 [00:16<00:01,  1.53it/s]
 93%|█████████▌| 26/28 [00:17<00:01,  1.53it/s]
 96%|█████████▌| 27/28 [00:17<00:00,  1.52it/s]
100%|██████████| 28/28 [00:18<00:00,  1.52it/s]
100%|██████████| 28/28 [00:18<00:00,  1.51it/s]
[AnimateDiffEvo] - INFO - Ejecting motion module mm_sd_v15_v2.ckpt version v2.
[AnimateDiffEvo] - INFO - Cleaning motion module from unet.
[AnimateDiffEvo] - INFO - Removing motion module mm_sd_v15_v2.ckpt from cache
/src/ComfyUI/comfy/model_base.py:47: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
self.register_buffer('betas', torch.tensor(betas, dtype=torch.float32))
/src/ComfyUI/comfy/model_base.py:48: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
self.register_buffer('alphas_cumprod', torch.tensor(alphas_cumprod, dtype=torch.float32))
[] []
[AnimateDiffEvo] - INFO - Loading motion module mm_sd_v15_v2.ckpt
[AnimateDiffEvo] - INFO - Using fp16, converting motion module to fp16
[AnimateDiffEvo] - INFO - Regular AnimateDiff activated - latents passed in (16) less or equal to context_length 16.
[AnimateDiffEvo] - INFO - Injecting motion module mm_sd_v15_v2.ckpt version v2.
loading new
unload clone 2
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:00<00:12,  1.57it/s]
 10%|█         | 2/20 [00:01<00:10,  1.71it/s]
 15%|█▌        | 3/20 [00:01<00:09,  1.77it/s]
 20%|██        | 4/20 [00:02<00:08,  1.79it/s]
 25%|██▌       | 5/20 [00:02<00:08,  1.81it/s]
 30%|███       | 6/20 [00:03<00:07,  1.81it/s]
 35%|███▌      | 7/20 [00:03<00:07,  1.82it/s]
 40%|████      | 8/20 [00:04<00:06,  1.82it/s]
 45%|████▌     | 9/20 [00:05<00:06,  1.82it/s]
 50%|█████     | 10/20 [00:05<00:05,  1.82it/s]
 55%|█████▌    | 11/20 [00:06<00:04,  1.82it/s]
 60%|██████    | 12/20 [00:06<00:04,  1.82it/s]
 65%|██████▌   | 13/20 [00:07<00:03,  1.82it/s]
 70%|███████   | 14/20 [00:07<00:03,  1.95it/s]
 75%|███████▌  | 15/20 [00:08<00:02,  2.06it/s]
 80%|████████  | 16/20 [00:08<00:01,  2.14it/s]
 85%|████████▌ | 17/20 [00:08<00:01,  2.20it/s]
 90%|█████████ | 18/20 [00:09<00:00,  2.24it/s]
 95%|█████████▌| 19/20 [00:09<00:00,  2.27it/s]
100%|██████████| 20/20 [00:10<00:00,  2.29it/s]
100%|██████████| 20/20 [00:10<00:00,  1.96it/s]
[AnimateDiffEvo] - INFO - Ejecting motion module mm_sd_v15_v2.ckpt version v2.
[AnimateDiffEvo] - INFO - Cleaning motion module from unet.
[AnimateDiffEvo] - INFO - Removing motion module mm_sd_v15_v2.ckpt from cache
Prompt executed in 55.57 seconds
node output:  {'images': [{'filename': 'KSeff_207_00001_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00002_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00003_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00004_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00005_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00006_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00007_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00008_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00009_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00010_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00011_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00012_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00013_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00014_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00015_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00016_.png', 'subfolder': '', 'type': 'temp'}]}
node output:  {'images': [{'filename': 'KSeff_246_00001_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00002_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00003_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00004_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00005_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00006_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00007_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00008_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00009_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00010_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00011_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00012_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00013_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00014_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00015_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00016_.png', 'subfolder': '', 'type': 'temp'}]}
node output:  {'gifs': [{'filename': 'AD__00003_.gif', 'subfolder': 'AnimateDiff', 'type': 'output', 'format': 'image/gif'}]}
node output:  {'images': [{'filename': 'KSeff_207_00001_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00002_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00003_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00004_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00005_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00006_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00007_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00008_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00009_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00010_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00011_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00012_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00013_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00014_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00015_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00016_.png', 'subfolder': '', 'type': 'temp'}]}
node output:  {'images': [{'filename': 'KSeff_246_00001_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00002_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00003_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00004_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00005_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00006_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00007_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00008_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00009_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00010_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00011_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00012_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00013_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00014_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00015_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00016_.png', 'subfolder': '', 'type': 'temp'}]}
node output:  {'gifs': [{'filename': 'AD__00003_.gif', 'subfolder': 'AnimateDiff', 'type': 'output', 'format': 'image/gif'}]}
node output:  {'images': [{'filename': 'KSeff_207_00001_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00002_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00003_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00004_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00005_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00006_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00007_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00008_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00009_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00010_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00011_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00012_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00013_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00014_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00015_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_207_00016_.png', 'subfolder': '', 'type': 'temp'}]}
node output:  {'images': [{'filename': 'KSeff_246_00001_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00002_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00003_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00004_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00005_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00006_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00007_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00008_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00009_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00010_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00011_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00012_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00013_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00014_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00015_.png', 'subfolder': '', 'type': 'temp'}, {'filename': 'KSeff_246_00016_.png', 'subfolder': '', 'type': 'temp'}]}
node output:  {'gifs': [{'filename': 'AD__00003_.gif', 'subfolder': 'AnimateDiff', 'type': 'output', 'format': 'image/gif'}]}
************* final video output:  ./ComfyUI/output/AnimateDiff/AD__00003_.gif
Version Details
Version ID
1bf7d2a322ea2d6f95983fa833f1870db966164dde62e584e15954d5556fd01a
Version Created
September 29, 2023
Run on Replicate →