voku682/video_style_transfer 🖼️📝 → 🖼️

▶️ 286 runs 📅 Jan 2024 ⚙️ Cog 0.9.2
video-style-transfer video-to-video

About

Example Output

Output

Example output

Performance Metrics

742.28s Prediction Time
1577.09s Total Time
All Input Parameters
{
  "video_fit": "abstractly",
  "image_list": "https://replicate.delivery/pbxt/KEmKr2fd3sidz6zhs8X7280hINVDcyM3B5kdcwI0Sy9K3TSD/test2.zip",
  "input_video": "https://replicate.delivery/pbxt/KEmKr92hgXMg3UZqCAdv5ZasMicuy4Ex4poKZf2q45zOwU5M/ppi_2%20%281%29.mp4",
  "num_of_frames": 50,
  "image_dimension": "512x512"
}
Input Parameters
input_file Type: string
Input image, tar or zip file
workflow_json Type: stringDefault:
JSON workflow
Output Schema

Output

Type: arrayItems Type: stringItems Format: uri

Example Execution Logs
** ComfyUI startup time: 2024-01-16 17:43:55.068778
** Platform: Linux
** Python version: 3.10.6 (main, Jan 16 2024, 11:13:17) [GCC 11.4.0]
** Python executable: /root/.pyenv/versions/3.10.6/bin/python
** Log path: /src/comfyui.log
Prestartup times for custom nodes:
   0.0 seconds: /src/ComfyUI/custom_nodes/rgthree-comfy
   0.0 seconds: /src/ComfyUI/custom_nodes/ComfyUI-Manager
Total VRAM 48679 MB, total RAM 773873 MB
xformers version: 0.0.23
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA A40 : cudaMallocAsync
VAE dtype: torch.bfloat16
Using xformers cross attention
### Loading: ComfyUI-Manager (V2.1)
## ComfyUI-Manager: installing dependencies
Collecting GitPython
Downloading GitPython-3.1.41-py3-none-any.whl (196 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 196.4/196.4 kB 1.6 MB/s eta 0:00:00
Collecting matrix-client==0.4.0
Downloading matrix_client-0.4.0-py2.py3-none-any.whl (43 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.5/43.5 kB 7.7 MB/s eta 0:00:00
Requirement already satisfied: transformers in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from -r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (4.36.2)
Requirement already satisfied: huggingface-hub>0.20 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from -r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 4)) (0.20.2)
Collecting urllib3~=1.21
Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 8.6 MB/s eta 0:00:00
Requirement already satisfied: requests~=2.22 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from matrix-client==0.4.0->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 2)) (2.31.0)
Collecting gitdb<5,>=4.0.1
Downloading gitdb-4.0.11-py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.7/62.7 kB 10.7 MB/s eta 0:00:00
Requirement already satisfied: packaging>=20.0 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from transformers->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (23.2)
Requirement already satisfied: numpy>=1.17 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from transformers->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (1.26.3)
Requirement already satisfied: tqdm>=4.27 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from transformers->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (4.66.1)
Requirement already satisfied: tokenizers<0.19,>=0.14 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from transformers->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (0.15.0)
Requirement already satisfied: filelock in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from transformers->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (3.13.1)
Requirement already satisfied: safetensors>=0.3.1 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from transformers->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (0.4.1)
Requirement already satisfied: pyyaml>=5.1 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from transformers->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (6.0.1)
Requirement already satisfied: regex!=2019.12.17 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from transformers->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 3)) (2023.12.25)
Requirement already satisfied: fsspec>=2023.5.0 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from huggingface-hub>0.20->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 4)) (2023.12.2)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from huggingface-hub>0.20->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 4)) (4.9.0)
Collecting smmap<6,>=3.0.1
Downloading smmap-5.0.1-py3-none-any.whl (24 kB)
Requirement already satisfied: certifi>=2017.4.17 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from requests~=2.22->matrix-client==0.4.0->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 2)) (2023.11.17)
Requirement already satisfied: idna<4,>=2.5 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from requests~=2.22->matrix-client==0.4.0->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 2)) (3.6)
Requirement already satisfied: charset-normalizer<4,>=2 in /root/.pyenv/versions/3.10.6/lib/python3.10/site-packages (from requests~=2.22->matrix-client==0.4.0->-r /src/ComfyUI/custom_nodes/ComfyUI-Manager/requirements.txt (line 2)) (3.3.2)
Installing collected packages: urllib3, smmap, gitdb, matrix-client, GitPython
Attempting uninstall: urllib3
Found existing installation: urllib3 2.1.0
Uninstalling urllib3-2.1.0:
Successfully uninstalled urllib3-2.1.0
Successfully installed GitPython-3.1.41 gitdb-4.0.11 matrix-client-0.4.0 smmap-5.0.1 urllib3-1.26.18
[!] WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[!] 
[!] [notice] A new release of pip available: 22.2.1 -> 23.3.2
[!] [notice] To update, run: pip install --upgrade pip
## ComfyUI-Manager: installing dependencies done.
### ComfyUI Revision: 1911 [f9e55d84] | Released on '2024-01-15'
FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
FizzleDorf Custom Nodes: Loaded
Total VRAM 48679 MB, total RAM 773873 MB
xformers version: 0.0.23
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA A40 : cudaMallocAsync
VAE dtype: torch.bfloat16
Torch version: 2.1.1+cu121
[comfyui_controlnet_aux] | INFO -> Using ckpts path: /src/ComfyUI/custom_nodes/comfyui_controlnet_aux/ckpts
[comfyui_controlnet_aux] | INFO -> Using symlinks: False
[comfyui_controlnet_aux] | INFO -> Using ort providers: ['CUDAExecutionProvider', 'DirectMLExecutionProvider', 'OpenVINOExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider', 'CoreMLExecutionProvider']
Downloading: "https://download.pytorch.org/models/mobilenet_v2-b0353104.pth" to /root/.cache/torch/hub/checkpoints/mobilenet_v2-b0353104.pth
DWPose: Onnxruntime with acceleration providers detected
Efficiency Nodes: Attempting to add Control Net options to the 'HiRes-Fix Script' Node (comfyui_controlnet_aux add-on)...Success!
Total VRAM 48679 MB, total RAM 773873 MB
xformers version: 0.0.23
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA A40 : cudaMallocAsync
VAE dtype: torch.bfloat16
[rgthree] Loaded 22 exciting nodes.
[rgthree] Optimizing ComfyUI recursive execution. If queueing and/or re-queueing seems broken, change "patch_recursive_execution" to false in rgthree_config.json 
WAS Node Suite: OpenCV Python FFMPEG support is enabled
WAS Node Suite Warning: `ffmpeg_bin_path` is not set in `/src/ComfyUI/custom_nodes/was-node-suite-comfyui/was_suite_config.json` config file. Will attempt to use system ffmpeg binaries if available.
WAS Node Suite: Finished. Loaded 204 nodes successfully.
"Success is not the key to happiness. Happiness is the key to success." - Albert Schweitzer
Import times for custom nodes:
   0.0 seconds: /src/ComfyUI/custom_nodes/ComfyUI_IPAdapter_plus
0.0 seconds: /src/ComfyUI/custom_nodes/ComfyUI-Advanced-ControlNet
   0.0 seconds: /src/ComfyUI/custom_nodes/ComfyUI-AnimateDiff
0.0 seconds: /src/ComfyUI/custom_nodes/Derfuu_ComfyUI_ModdedNodes
   0.0 seconds: /src/ComfyUI/custom_nodes/rgthree-comfy
0.0 seconds: /src/ComfyUI/custom_nodes/efficiency-nodes-comfyui
0.0 seconds: /src/ComfyUI/custom_nodes/facerestore_cf
   0.1 seconds: /src/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
   0.2 seconds: /src/ComfyUI/custom_nodes/ComfyUI_FizzNodes
   0.8 seconds: /src/ComfyUI/custom_nodes/comfyui-reactor-node
0.9 seconds: /src/ComfyUI/custom_nodes/was-node-suite-comfyui
   1.6 seconds: /src/ComfyUI/custom_nodes/comfyui_controlnet_aux
   3.2 seconds: /src/ComfyUI/custom_nodes/ComfyUI-Manager
Starting server
To see the GUI go to: http://127.0.0.1:8188
Server is up and running!
<ZipInfo filename='3978530469-3091544718-(masterpiece), (extremely intricate), fantasy, (((photorealistic photo of an evil hermit, male, villain, anti hero, evil face, m (1).png' compress_type=deflate filemode='-rw-r--r--' file_size=462322 compress_size=462431>  ----  3978530469-3091544718-(masterpiece), (extremely intricate), fantasy, (((photorealistic photo of an evil hermit, male, villain, anti hero, evil face, m (1).png
<ZipInfo filename='3978530473-94858146-photo of a caucasian man (1).png' compress_type=deflate filemode='-rw-r--r--' file_size=425158 compress_size=424910>  ----  3978530473-94858146-photo of a caucasian man (1).png
Current Working Directory: /src
filepath in array:  /tmp/3978530469-3091544718-(masterpiece), (extremely intricate), fantasy, (((photorealistic photo of an evil hermit, male, villain, anti hero, evil face, m (1).png
copying file:  3978530469-3091544718-(masterpiece), (extremely intricate), fantasy, (((photorealistic photo of an evil hermit, male, villain, anti hero, evil face, m (1).png ./ComfyUI/input/input
filepath in array:  /tmp/3978530473-94858146-photo of a caucasian man (1).png
copying file:  3978530473-94858146-photo of a caucasian man (1).png ./ComfyUI/input/input
Current Working Directory: /src
filepath in array:  /tmp/tmpbbwt5qzippi_2 (1).mp4
copying file:  tmpbbwt5qzippi_2 (1).mp4 ./ComfyUI/input
got prompt
Requested to load CLIPVisionModelProjection
Loading 1 new model
model_type EPS
adm 0
Using xformers attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using xformers attention in VAE
missing {'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
left over keys: dict_keys(['cond_stage_model.clip_l.transformer.text_model.embeddings.position_ids'])
[AnimateDiffEvo] - INFO - Loading motion module v3_sd15_mm.ckpt
WARNING: Sequential prompt keyframes 1:1300 and 2:50 are not monotonously increasing; skipping interpolation.
 Max Frames:  50 
 frame index:  0 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  1.0 
 Max Frames:  50 
 frame index:  1 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9992307692307693 
 Max Frames:  50 
 frame index:  2 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors
Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors
 Strength :  0.9984615384615385 
 Max Frames:  50 
 frame index:  3 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9976923076923077 
 Max Frames:  50 
 frame index:  4 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9969230769230769 
 Max Frames:  50 
 frame index:  5 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9961538461538462 
 Max Frames:  50 
 frame index:  6 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9953846153846154 
 Max Frames:  50 
 frame index:  7 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors
 Strength :  0.9946153846153846 
 Max Frames:  50 
 frame index:  8 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9938461538461538 
 Max Frames:  50 
 frame index:  9 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9930769230769231 
 Max Frames:  50 
 frame index:  10 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9923076923076923 
 Max Frames:  50 
 frame index:  11 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9915384615384616 
 Max Frames:  50 
 frame index:  12 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9907692307692307 
 Max Frames:  50 
 frame index:  13 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.99 
 Max Frames:  50 
 frame index:  14 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9892307692307692 
 Max Frames:  50 
 frame index:  15 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9884615384615385 
 Max Frames:  50 
 frame index:  16 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9876923076923076 
 Max Frames:  50 
 frame index:  17
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9869230769230769 
 Max Frames:  50 
 frame index:  18 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9861538461538462 
 Max Frames:  50 
 frame index:  19 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9853846153846154 
 Max Frames:  50 
 frame index:  20 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9846153846153847 
 Max Frames:  50 
 frame index:  21 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9838461538461538 
 Max Frames:  50 
 frame index:  22
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors
 Strength :  0.9830769230769231 
 Max Frames:  50 
 frame index:  23 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9823076923076923 
 Max Frames:  50 
 frame index:  24 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9815384615384616 
 Max Frames:  50 
 frame index:  25 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9807692307692307 
 Max Frames:  50 
 frame index:  26 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.98 
 Max Frames:  50 
 frame index:  27 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors
 Strength :  0.9792307692307692 
 Max Frames:  50 
 frame index:  28 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9784615384615385 
 Max Frames:  50 
 frame index:  29 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9776923076923076 
 Max Frames:  50 
 frame index:  30 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9769230769230769 
 Max Frames:  50 
 frame index:  31 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors
 Strength :  0.9761538461538461 
 Max Frames:  50 
 frame index:  32 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9753846153846154
 Max Frames:  50 
 frame index:  33 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9746153846153847 
 Max Frames:  50 
 frame index:  34 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9738461538461538 
 Max Frames:  50 
 frame index:  35 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9730769230769231 
 Max Frames:  50 
 frame index:  36 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9723076923076923 
 Max Frames:  50 
 frame index:  37 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9715384615384616
 Max Frames:  50 
 frame index:  38 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9707692307692307 
 Max Frames:  50 
 frame index:  39 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.97 
 Max Frames:  50 
 frame index:  40 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9692307692307692 
 Max Frames:  50 
 frame index:  41 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9684615384615385 
 Max Frames:  50 
 frame index:  42 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9676923076923077 
 Max Frames:  50 
 frame index:  43 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9669230769230769 
 Max Frames:  50 
 frame index:  44 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9661538461538461 
 Max Frames:  50 
 frame index:  45 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9653846153846154 
 Max Frames:  50 
 frame index:  46 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9646153846153847 
 Max Frames:  50 
 frame index:  47 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9638461538461538 
 Max Frames:  50 
 frame index:  48 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.963076923076923 
 Max Frames:  50 
 frame index:  49 
 Current Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Next Prompt:  Sharp and consistent color scheme  fantastic, masterpiece, cinematic lights, natural colors 
 Strength :  0.9623076923076923 
Requested to load SD1ClipModel
Loading 1 new model
WARNING: Sequential prompt keyframes 1:1300 and 2:50 are not monotonously increasing; skipping interpolation.
Max Frames:  50
frame index:  0
 Current Prompt:   
 Next Prompt:   
 Strength :  1.0 
 Max Frames:  50 
 frame index:  1
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9992307692307693 
 Max Frames:  50 
 frame index:  2 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9984615384615385 
 Max Frames:  50 
 frame index:  3 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9976923076923077 
 Max Frames:  50 
 frame index:  4 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9969230769230769 
 Max Frames:  50 
 frame index:  5 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9961538461538462 
 Max Frames:  50 
 frame index:  6 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9953846153846154 
 Max Frames:  50 
 frame index:  7 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9946153846153846 
 Max Frames:  50 
 frame index:  8 
Current Prompt:
Next Prompt:
Strength :  0.9938461538461538
 Max Frames:  50 
 frame index:  9
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9930769230769231 
 Max Frames:  50 
 frame index:  10 
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9923076923076923 
 Max Frames:  50 
 frame index:  11
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9915384615384616
 Max Frames:  50 
 frame index:  12
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9907692307692307 
 Max Frames:  50 
 frame index:  13 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.99 
 Max Frames:  50 
 frame index:  14 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9892307692307692 
 Max Frames:  50 
 frame index:  15 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9884615384615385 
 Max Frames:  50 
 frame index:  16 
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9876923076923076 
 Max Frames:  50 
 frame index:  17 
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9869230769230769 
 Max Frames:  50 
 frame index:  18 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9861538461538462 
 Max Frames:  50 
 frame index:  19 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9853846153846154 
 Max Frames:  50 
 frame index:  20 
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9846153846153847 
 Max Frames:  50 
 frame index:  21 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9838461538461538 
 Max Frames:  50 
 frame index:  22 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9830769230769231 
 Max Frames:  50 
 frame index:  23 
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9823076923076923 
 Max Frames:  50 
 frame index:  24
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9815384615384616 
 Max Frames:  50 
 frame index:  25
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9807692307692307 
 Max Frames:  50 
 frame index:  26 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.98 
 Max Frames:  50 
 frame index:  27
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9792307692307692 
 Max Frames:  50 
 frame index:  28 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9784615384615385 
 Max Frames:  50 
 frame index:  29 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9776923076923076 
 Max Frames:  50 
 frame index:  30 
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9769230769230769 
 Max Frames:  50 
 frame index:  31
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9761538461538461 
 Max Frames:  50 
 frame index:  32 
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9753846153846154 
 Max Frames:  50 
 frame index:  33 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9746153846153847 
 Max Frames:  50 
 frame index:  34 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9738461538461538 
 Max Frames:  50 
 frame index:  35 
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9730769230769231 
 Max Frames:  50 
 frame index:  36 
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9723076923076923 
 Max Frames:  50 
 frame index:  37 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9715384615384616 
 Max Frames:  50 
 frame index:  38
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9707692307692307 
 Max Frames:  50 
 frame index:  39
 Current Prompt:  
 Next Prompt:   
 Strength :  0.97 
 Max Frames:  50 
 frame index:  40 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9692307692307692 
 Max Frames:  50 
 frame index:  41 
 Current Prompt:  
 Next Prompt:   
 Strength :  0.9684615384615385 
 Max Frames:  50 
 frame index:  42 
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9676923076923077 
 Max Frames:  50 
 frame index:  43 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9669230769230769 
 Max Frames:  50 
 frame index:  44 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9661538461538461 
 Max Frames:  50 
 frame index:  45 
 Current Prompt:   
 Next Prompt:   
 Strength :  0.9653846153846154
 Max Frames:  50 
 frame index:  46 
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9646153846153847 
 Max Frames:  50 
 frame index:  47 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.9638461538461538 
 Max Frames:  50 
 frame index:  48 
 Current Prompt:  
 Next Prompt:  
 Strength :  0.963076923076923 
 Max Frames:  50 
 frame index:  49 
 Current Prompt:   
 Next Prompt:  
 Strength :  0.9623076923076923 
[] []
[] []
Using xformers attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using xformers attention in VAE
Leftover VAE keys ['model_ema.decay', 'model_ema.num_updates']
Requested to load AutoencoderKL
Loading 1 new model
[AnimateDiffEvo] - INFO - Sliding context window activated - latents passed in (50) greater than context_length 16.
[AnimateDiffEvo] - INFO - Using motion module v3_sd15_mm.ckpt version v3.
Requested to load BaseModel
Requested to load ControlNet
Requested to load ControlNet
Requested to load AnimateDiffModel
Loading 4 new models
  0%|          | 0/50 [00:00<?, ?it/s]
  2%|▏         | 1/50 [00:04<03:59,  4.88s/it]
  4%|▍         | 2/50 [00:09<03:46,  4.71s/it]
  6%|▌         | 3/50 [00:14<03:37,  4.63s/it]
  8%|▊         | 4/50 [00:18<03:32,  4.62s/it]
 10%|█         | 5/50 [00:23<03:27,  4.61s/it]
 12%|█▏        | 6/50 [00:27<03:22,  4.61s/it]
 14%|█▍        | 7/50 [00:32<03:18,  4.62s/it]
 16%|█▌        | 8/50 [00:37<03:13,  4.61s/it]
 18%|█▊        | 9/50 [00:41<03:08,  4.61s/it]
 20%|██        | 10/50 [00:46<03:04,  4.62s/it]
 22%|██▏       | 11/50 [00:50<03:00,  4.62s/it]
 24%|██▍       | 12/50 [00:55<02:56,  4.65s/it]
 26%|██▌       | 13/50 [01:00<02:50,  4.62s/it]
 28%|██▊       | 14/50 [01:04<02:45,  4.60s/it]
 30%|███       | 15/50 [01:09<02:41,  4.62s/it]
 32%|███▏      | 16/50 [01:14<02:39,  4.68s/it]
 34%|███▍      | 17/50 [01:18<02:34,  4.67s/it]
 36%|███▌      | 18/50 [01:23<02:28,  4.64s/it]
 38%|███▊      | 19/50 [01:28<02:23,  4.62s/it]
 40%|████      | 20/50 [01:32<02:18,  4.62s/it]
 42%|████▏     | 21/50 [01:37<02:13,  4.61s/it]
 44%|████▍     | 22/50 [01:41<02:09,  4.61s/it]
 46%|████▌     | 23/50 [01:46<02:04,  4.60s/it]
 48%|████▊     | 24/50 [01:50<01:53,  4.36s/it]
 50%|█████     | 25/50 [01:54<01:44,  4.20s/it]
 52%|█████▏    | 26/50 [01:57<01:38,  4.09s/it]
 54%|█████▍    | 27/50 [02:01<01:32,  4.02s/it]
 56%|█████▌    | 28/50 [02:05<01:27,  3.97s/it]
 58%|█████▊    | 29/50 [02:09<01:22,  3.92s/it]
 60%|██████    | 30/50 [02:13<01:17,  3.88s/it]
 62%|██████▏   | 31/50 [02:16<01:13,  3.86s/it]
 64%|██████▍   | 32/50 [02:20<01:09,  3.84s/it]
 66%|██████▌   | 33/50 [02:24<01:04,  3.82s/it]
 68%|██████▊   | 34/50 [02:28<01:00,  3.80s/it]
 70%|███████   | 35/50 [02:31<00:53,  3.59s/it]
 72%|███████▏  | 36/50 [02:34<00:47,  3.42s/it]
 74%|███████▍  | 37/50 [02:37<00:43,  3.32s/it]
 76%|███████▌  | 38/50 [02:40<00:38,  3.24s/it]
 78%|███████▊  | 39/50 [02:43<00:35,  3.18s/it]
 80%|████████  | 40/50 [02:46<00:31,  3.15s/it]
 82%|████████▏ | 41/50 [02:49<00:27,  3.10s/it]
 84%|████████▍ | 42/50 [02:52<00:24,  3.08s/it]
 86%|████████▌ | 43/50 [02:55<00:21,  3.04s/it]
 88%|████████▊ | 44/50 [02:58<00:18,  3.02s/it]
 90%|█████████ | 45/50 [03:01<00:14,  3.00s/it]
 92%|█████████▏| 46/50 [03:04<00:11,  2.99s/it]
 94%|█████████▍| 47/50 [03:07<00:08,  2.99s/it]
 96%|█████████▌| 48/50 [03:10<00:06,  3.00s/it]
 98%|█████████▊| 49/50 [03:13<00:02,  2.96s/it]
100%|██████████| 50/50 [03:16<00:00,  2.89s/it]
100%|██████████| 50/50 [03:16<00:00,  3.92s/it]
[] []
[] []
[AnimateDiffEvo] - INFO - Sliding context window activated - latents passed in (50) greater than context_length 16.
[AnimateDiffEvo] - INFO - Using motion module v3_sd15_mm.ckpt version v3.
Requested to load BaseModel
Requested to load ControlNet
Requested to load ControlNet
Loading 3 new models
unload clone 4
  0%|          | 0/30 [00:00<?, ?it/s]
  3%|▎         | 1/30 [00:21<10:35, 21.90s/it]
  7%|▋         | 2/30 [00:44<10:23, 22.26s/it]
 10%|█         | 3/30 [01:06<10:04, 22.38s/it]
 13%|█▎        | 4/30 [01:25<09:00, 20.78s/it]
 17%|█▋        | 5/30 [01:43<08:18, 19.95s/it]
 20%|██        | 6/30 [02:01<07:44, 19.37s/it]
 23%|██▎       | 7/30 [02:20<07:18, 19.05s/it]
 27%|██▋       | 8/30 [02:38<06:55, 18.89s/it]
 30%|███       | 9/30 [02:57<06:32, 18.70s/it]
 33%|███▎      | 10/30 [03:15<06:10, 18.52s/it]
 37%|███▋      | 11/30 [03:33<05:50, 18.42s/it]
 40%|████      | 12/30 [03:51<05:31, 18.40s/it]
 43%|████▎     | 13/30 [04:05<04:49, 17.05s/it]
 47%|████▋     | 14/30 [04:19<04:17, 16.09s/it]
 50%|█████     | 15/30 [04:33<03:51, 15.42s/it]
 53%|█████▎    | 16/30 [04:47<03:29, 14.99s/it]
 57%|█████▋    | 17/30 [05:01<03:10, 14.65s/it]
 60%|██████    | 18/30 [05:15<02:53, 14.46s/it]
 63%|██████▎   | 19/30 [05:29<02:37, 14.28s/it]
 67%|██████▋   | 20/30 [05:43<02:21, 14.18s/it]
 70%|███████   | 21/30 [05:57<02:06, 14.10s/it]
 73%|███████▎  | 22/30 [06:11<01:52, 14.03s/it]
 77%|███████▋  | 23/30 [06:24<01:38, 14.01s/it]
 80%|████████  | 24/30 [06:38<01:23, 13.93s/it]
 83%|████████▎ | 25/30 [06:52<01:09, 13.90s/it]
 87%|████████▋ | 26/30 [07:06<00:55, 13.92s/it]
 90%|█████████ | 27/30 [07:20<00:41, 13.92s/it]
 93%|█████████▎| 28/30 [07:34<00:27, 13.85s/it]
 97%|█████████▋| 29/30 [07:47<00:13, 13.61s/it]
100%|██████████| 30/30 [08:00<00:00, 13.40s/it]
100%|██████████| 30/30 [08:00<00:00, 16.00s/it]
Requested to load AutoencoderKL
Loading 1 new model
Prompt executed in 726.62 seconds
------------- gif list:  ['AnimateDiff_00011.gif', 'AnimateDiff_00011.gif', 'AnimateDiff_00011.gif', 'AnimateDiff_00011.gif', 'AnimateDiff_00011.gif', 'AnimateDiff_00011.gif']
The folder './ComfyUI/input/input' has been successfully deleted.
************* final video output:  ./ComfyUI/output/AnimateDiff_00011.gif
Version Details
Version ID
794d1af0d09ad1d0f48769420990099cbbb6d5ccd36d2b7957d01bee463734ad
Version Created
January 19, 2024
Run on Replicate →