zsxkib/animatediff-illusions ✓🔢❓📝🖼️ → 🖼️

▶️ 10.5K runs 📅 Oct 2023 ⚙️ Cog 0.8.6 🔗 GitHub 📄 Paper ⚖️ License

controlnet qr-code video-to-video

About

Monster Labs' Controlnet QR Code Monster v2 For SD-1.5 on top of AnimateDiff Prompt Travel (Motion Module SD 1.5 v2)

Example Output

Output

Performance Metrics

103.01s Prediction Time

315.05s Total Time

All Input Parameters

{
  "loop": true,
  "seed": -1,
  "steps": 25,
  "width": 384,
  "frames": 32,
  "height": 256,
  "context": 16,
  "clip_skip": 2,
  "scheduler": "k_dpmpp_sde",
  "base_model": "majicmixRealistic_v5Preview",
  "prompt_map": "0: rolling waves",
  "head_prompt": "a beautiful ocean",
  "tail_prompt": "flashes of lightning, eerie, mysterious",
  "output_format": "mp4",
  "guidance_scale": 7.5,
  "negative_prompt": "ugly, broken",
  "controlnet_video": "https://replicate.delivery/pbxt/JlbPomk5xQXYw3Mao6B9eoFJS0moaYjCGSRhFPcMLCXNu0w8/spiral.gif",
  "film_interpolation": true,
  "prompt_fixed_ratio": 0.5,
  "custom_base_model_url": "",
  "num_interpolation_steps": 3,
  "enable_qr_code_monster_v2": true,
  "playback_frames_per_second": 16,
  "controlnet_conditioning_scale": 0.25,
  "qr_code_monster_v2_guess_mode": false,
  "qr_code_monster_v2_preprocessor": true
}

Input Parameters

loop Type: booleanDefault: true: Flag to loop the video. Use when you have an 'infinitely' repeating video/gif ControlNet video
seed Type: integer: Seed for different images and reproducibility. Leave blank to randomise seed
steps Type: integerDefault: 25Range: 1 - 100: Number of inference steps
width Type: integerDefault: 256Range: 64 - 2160: Width of generated video in pixels, must be divisable by 8
frames Type: integerDefault: 128Range: 1 - 1024: Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)
height Type: integerDefault: 384Range: 64 - 2160: Height of generated video in pixels, must be divisable by 8
context Type: integerDefault: 16Range: 1 - 32: Number of frames to condition on (default: max of <length> or 32). max for motion module v1 is 24
clip_skip Type: integerDefault: 2Range: 1 - 6: Skip the last N-1 layers of the CLIP text encoder (lower values follow prompt more closely)
scheduler Default: k_dpmpp_sde: Diffusion scheduler
base_model Default: majicmixRealistic_v5Preview: Choose the base model for animation generation. If 'CUSTOM' is selected, provide a custom model URL in the next parameter
prompt_map Type: stringDefault:: Prompt for changes in animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the length of video (frames)
head_prompt Type: stringDefault: masterpiece, best quality, a haunting and detailed depiction of a ship at sea, battered by waves, ominous,((dark clouds:1.3)),distant lightning, rough seas, rain, silhouette of the ship against the stormy sky: Primary animation prompt. If a prompt map is provided, this will be prefixed at the start of every individual prompt in the map
tail_prompt Type: stringDefault:: Additional prompt that will be appended at the end of the main prompt or individual prompts in the map
output_format Default: mp4: Output format of the video. Can be 'mp4' or 'gif'
guidance_scale Type: numberDefault: 7.5Range: 0 - 20: Guidance Scale. How closely do we want to adhere to the prompt and its contents
negative_prompt Type: stringDefault:
controlnet_video Type: string: A short video/gif that will be used as the keyframes for QR Code Monster to use, Please note, all of the frames will be used as keyframes
film_interpolation Type: booleanDefault: true: Whether to use FILM for between-frame interpolation (film-net.github.io)
prompt_fixed_ratio Type: numberDefault: 0.5Range: 0 - 1: Defines the ratio of adherence to the fixed part of the prompt versus the dynamic part (from prompt map). Value should be between 0 (only dynamic) to 1 (only fixed).
custom_base_model_url Type: stringDefault:: Only used when base model is set to 'CUSTOM'. URL of the custom model to download if 'CUSTOM' is selected in the base model. Only downloads from 'https://civitai.com/api/download/models/' are allowed
num_interpolation_steps Type: integerDefault: 3Range: 1 - 50: Number of steps to interpolate between animation frames
enable_qr_code_monster_v2 Type: booleanDefault: true: Flag to enable QR Code Monster V2 ControlNet
playback_frames_per_second Type: integerDefault: 8Range: 1 - 60
controlnet_conditioning_scale Type: numberDefault: 0.18: Strength of ControlNet. The outputs of the ControlNet are multiplied by `controlnet_conditioning_scale` before they are added to the residual in the original UNet
qr_code_monster_v2_guess_mode Type: booleanDefault: false: Flag to enable guess mode (un-guided) for QR Code Monster V2 ControlNet
qr_code_monster_v2_preprocessor Type: booleanDefault: true: Flag to pre-process keyframes for QR Code Monster V2 ControlNet

Output Schema

Output

Type: string • Format: uri

Example Execution Logs

Using ControlNet
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
Input #0, gif, from '/tmp/tmpck8v5no9spiral.gif':
Duration: 00:00:14.39, start: 0.000000, bitrate: 2292 kb/s
Stream #0:0: Video: gif, bgra, 480x270, 15 fps, 15 tbr, 100 tbn, 100 tbc
Stream mapping:
Stream #0:0 -> #0:0 (gif (native) -> png (native))
Press [q] to stop, [?] for help
Output #0, image2, to 'data/controlnet_image/test/qr_code_monster_v2/%04d.png':
Metadata:
encoder         : Lavf58.76.100
Stream #0:0: Video: png, rgba(pc, gbr/unknown/unknown, progressive), 480x270, q=2-31, 200 kb/s, 15 fps, 15 tbn
Metadata:
encoder         : Lavc58.134.100 png
frame=    1 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x
frame=   32 fps=0.0 q=-0.0 Lsize=N/A time=00:00:02.13 bitrate=N/A speed=36.4x
video:938kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
--------------------------------------------------------------------------------
{
"name": "sample",
"path": "share/Stable-diffusion/majicmixRealistic_v5Preview.safetensors",
"motion_module": "models/motion-module/mm_sd_v15_v2.ckpt",
"compile": false,
"seed": [
-1
],
"scheduler": "k_dpmpp_sde",
"steps": 25,
"guidance_scale": 7.5,
"clip_skip": 2,
"prompt_fixed_ratio": 0.5,
"head_prompt": "a beautiful ocean",
"prompt_map": {
"0": "rolling waves"
},
"tail_prompt": "flashes of lightning, eerie, mysterious",
"n_prompt": [
"ugly, broken"
],
"controlnet_map": {
"input_image_dir": "controlnet_image/test",
"max_samples_on_vram": 200,
"max_models_on_vram": 3,
"save_detectmap": true,
"preprocess_on_gpu": true,
"is_loop": true,
"qr_code_monster_v2": {
"enable": true,
"use_preprocessor": true,
"guess_mode": false,
"controlnet_conditioning_scale": 0.25,
"control_guidance_start": 0.0,
"control_guidance_end": 1.0,
"control_scale_list": [
0.5,
0.4,
0.3,
0.2,
0.1
]
}
},
"output":{
"format" : "mp4",
"fps" : 16,
"encode_param":{
"crf": 10
}
}
}
--------------------------------------------------------------------------------
Running command: animatediff generate -c config/prompts/custom_prompt_travel.json -W 384 -H 256 -L 32 -C 16
10:23:32 INFO     Using generation config:                            cli.py:291
config/prompts/custom_prompt_travel.json
10:23:33 INFO     is_v2=True                                         util.py:361
INFO     Using base model: runwayml/stable-diffusion-v1-5    cli.py:309
INFO     Will save outputs to                                cli.py:317
./output/2023-11-01T10-23-33-sample-majicmixrealist
ic_v5preview
Preprocessing images (qr_code_monster_v2)  72% ━━╸  23/… [ 0:0… < 0:0… , 126   ]
it/s
Saving Preprocessed images (qr_code_monster_v2)  94% ━━╸ 29… [ 0:… < 0:… , 25  ]
it…
10:23:34 INFO     Checking motion module...                      generate.py:331
INFO     Loading tokenizer...                           generate.py:345
INFO     Loading text encoder...                        generate.py:347
10:23:36 INFO     Loading VAE...                                 generate.py:349
INFO     Loading UNet...                                generate.py:351
10:23:44 INFO     Loaded 453.20928M-parameter motion module          unet.py:578
INFO     Using scheduler "k_dpmpp_sde"                  generate.py:363
(DPMSolverSinglestepScheduler)
INFO     Loading weights from                           generate.py:368
/src/data/share/Stable-diffusion/majicmixReali
stic_v5Preview.safetensors
10:23:47 INFO     Merging weights into UNet...                   generate.py:385
INFO     Creating AnimationPipeline...                  generate.py:431
INFO     No TI embeddings found                               ti.py:102
INFO     loading c='qr_code_monster_v2' model           generate.py:460
10:23:54 INFO     Sending pipeline to device "cuda"               pipeline.py:22
INFO     Selected data types: unet_dtype=torch.float16,    device.py:90
tenc_dtype=torch.float16,
vae_dtype=torch.bfloat16
INFO     Using channels_last memory format for UNet and   device.py:111
VAE
10:23:56 INFO     Saving prompt config to output directory            cli.py:364
INFO     Initialization complete!                            cli.py:372
INFO     Generating 1 animations                             cli.py:373
INFO     Running generation 1 of 1                           cli.py:383
INFO     Generation seed: 2186829154798718332                cli.py:389
INFO     len( region_condi_list )=1                    generate.py:1153
INFO     len( region_list )=1                          generate.py:1154
100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75/75  [ 0:00:39 < 0:00:00 , 2 it/s ]
10:24:37 INFO     Generation complete, saving...                generate.py:1185
10:24:38 INFO     Creating ffmpeg encoder...                    generate.py:1084
INFO     Encoding interpolated frames with ffmpeg...   generate.py:1094
10:24:39 INFO     Saved sample to                               generate.py:1189
output/2023-11-01T10-23-33-sample-majicmixrea
listic_v5preview/00_2186829154798718332_a-bea
utiful-ocean_rolling-waves_flashes-of-lightni
INFO     Generation complete!                                cli.py:429
INFO     Done, exiting...                                    cli.py:435
Error:
Downloading (…)lve/main/config.json:   0%|          | 0.00/4.52k [00:00<?, ?B/s]
Downloading (…)lve/main/config.json: 100%|██████████| 4.52k/4.52k [00:00<00:00, 29.1MB/s]
Downloading (…)okenizer_config.json:   0%|          | 0.00/905 [00:00<?, ?B/s]
Downloading (…)okenizer_config.json: 100%|██████████| 905/905 [00:00<00:00, 6.24MB/s]
Downloading (…)olve/main/vocab.json:   0%|          | 0.00/961k [00:00<?, ?B/s]
Downloading (…)olve/main/vocab.json: 100%|██████████| 961k/961k [00:00<00:00, 4.25MB/s]
Downloading (…)olve/main/vocab.json: 100%|██████████| 961k/961k [00:00<00:00, 4.25MB/s]
Downloading (…)olve/main/merges.txt:   0%|          | 0.00/525k [00:00<?, ?B/s]
Downloading (…)olve/main/merges.txt: 100%|██████████| 525k/525k [00:00<00:00, 30.1MB/s]
Downloading (…)cial_tokens_map.json:   0%|          | 0.00/389 [00:00<?, ?B/s]
Downloading (…)cial_tokens_map.json: 100%|██████████| 389/389 [00:00<00:00, 3.49MB/s]
Downloading (…)/main/tokenizer.json:   0%|          | 0.00/2.22M [00:00<?, ?B/s]
Downloading (…)/main/tokenizer.json: 100%|██████████| 2.22M/2.22M [00:00<00:00, 25.4MB/s]
Downloading (…)/main/v2/config.json:   0%|          | 0.00/955 [00:00<?, ?B/s]
Downloading (…)/main/v2/config.json: 100%|██████████| 955/955 [00:00<00:00, 8.43MB/s]
Downloading (…)ch_model.safetensors:   0%|          | 0.00/1.45G [00:00<?, ?B/s]
Downloading (…)ch_model.safetensors:   1%|          | 10.5M/1.45G [00:00<00:57, 24.8MB/s]
Downloading (…)ch_model.safetensors:   3%|▎         | 41.9M/1.45G [00:00<00:15, 91.9MB/s]
Downloading (…)ch_model.safetensors:   5%|▌         | 73.4M/1.45G [00:00<00:09, 144MB/s]
Downloading (…)ch_model.safetensors:   7%|▋         | 105M/1.45G [00:00<00:07, 180MB/s]
Downloading (…)ch_model.safetensors:   9%|▉         | 136M/1.45G [00:00<00:06, 205MB/s]
Downloading (…)ch_model.safetensors:  12%|█▏        | 168M/1.45G [00:01<00:05, 225MB/s]
Downloading (…)ch_model.safetensors:  14%|█▍        | 199M/1.45G [00:01<00:05, 238MB/s]
Downloading (…)ch_model.safetensors:  16%|█▌        | 231M/1.45G [00:01<00:04, 246MB/s]
Downloading (…)ch_model.safetensors:  18%|█▊        | 262M/1.45G [00:01<00:04, 253MB/s]
Downloading (…)ch_model.safetensors:  20%|██        | 294M/1.45G [00:01<00:04, 261MB/s]
Downloading (…)ch_model.safetensors:  22%|██▏       | 325M/1.45G [00:01<00:04, 259MB/s]
Downloading (…)ch_model.safetensors:  25%|██▍       | 357M/1.45G [00:01<00:04, 263MB/s]
Downloading (…)ch_model.safetensors:  27%|██▋       | 388M/1.45G [00:01<00:04, 261MB/s]
Downloading (…)ch_model.safetensors:  29%|██▉       | 419M/1.45G [00:01<00:03, 267MB/s]
Downloading (…)ch_model.safetensors:  31%|███       | 451M/1.45G [00:02<00:03, 265MB/s]
Downloading (…)ch_model.safetensors:  33%|███▎      | 482M/1.45G [00:02<00:03, 266MB/s]
Downloading (…)ch_model.safetensors:  36%|███▌      | 514M/1.45G [00:02<00:03, 268MB/s]
Downloading (…)ch_model.safetensors:  38%|███▊      | 545M/1.45G [00:02<00:03, 269MB/s]
Downloading (…)ch_model.safetensors:  40%|███▉      | 577M/1.45G [00:02<00:03, 270MB/s]
Downloading (…)ch_model.safetensors:  42%|████▏     | 608M/1.45G [00:02<00:03, 271MB/s]
Downloading (…)ch_model.safetensors:  44%|████▍     | 640M/1.45G [00:02<00:02, 272MB/s]
Downloading (…)ch_model.safetensors:  46%|████▋     | 671M/1.45G [00:02<00:02, 271MB/s]
Downloading (…)ch_model.safetensors:  49%|████▊     | 703M/1.45G [00:03<00:02, 268MB/s]
Downloading (…)ch_model.safetensors:  51%|█████     | 734M/1.45G [00:03<00:02, 269MB/s]
Downloading (…)ch_model.safetensors:  53%|█████▎    | 765M/1.45G [00:03<00:02, 268MB/s]
Downloading (…)ch_model.safetensors:  55%|█████▌    | 797M/1.45G [00:03<00:02, 270MB/s]
Downloading (…)ch_model.safetensors:  57%|█████▋    | 828M/1.45G [00:03<00:02, 269MB/s]
Downloading (…)ch_model.safetensors:  59%|█████▉    | 860M/1.45G [00:03<00:02, 271MB/s]
Downloading (…)ch_model.safetensors:  62%|██████▏   | 891M/1.45G [00:03<00:02, 269MB/s]
Downloading (…)ch_model.safetensors:  64%|██████▍   | 923M/1.45G [00:03<00:01, 270MB/s]
Downloading (…)ch_model.safetensors:  66%|██████▌   | 954M/1.45G [00:03<00:01, 270MB/s]
Downloading (…)ch_model.safetensors:  68%|██████▊   | 986M/1.45G [00:04<00:01, 270MB/s]
Downloading (…)ch_model.safetensors:  70%|███████   | 1.02G/1.45G [00:04<00:01, 269MB/s]
Downloading (…)ch_model.safetensors:  73%|███████▎  | 1.05G/1.45G [00:04<00:01, 268MB/s]
Downloading (…)ch_model.safetensors:  75%|███████▍  | 1.08G/1.45G [00:04<00:01, 268MB/s]
Downloading (…)ch_model.safetensors:  77%|███████▋  | 1.11G/1.45G [00:04<00:01, 268MB/s]
Downloading (…)ch_model.safetensors:  79%|███████▉  | 1.14G/1.45G [00:04<00:01, 265MB/s]
Downloading (…)ch_model.safetensors:  81%|████████▏ | 1.17G/1.45G [00:04<00:01, 266MB/s]
Downloading (…)ch_model.safetensors:  83%|████████▎ | 1.21G/1.45G [00:04<00:00, 264MB/s]
Downloading (…)ch_model.safetensors:  86%|████████▌ | 1.24G/1.45G [00:05<00:00, 264MB/s]
Downloading (…)ch_model.safetensors:  88%|████████▊ | 1.27G/1.45G [00:05<00:00, 254MB/s]
Downloading (…)ch_model.safetensors:  90%|████████▉ | 1.30G/1.45G [00:05<00:00, 243MB/s]
Downloading (…)ch_model.safetensors:  92%|█████████▏| 1.33G/1.45G [00:05<00:00, 242MB/s]
Downloading (…)ch_model.safetensors:  94%|█████████▍| 1.36G/1.45G [00:05<00:00, 248MB/s]
Downloading (…)ch_model.safetensors:  97%|█████████▋| 1.39G/1.45G [00:05<00:00, 249MB/s]
Downloading (…)ch_model.safetensors:  99%|█████████▊| 1.43G/1.45G [00:05<00:00, 250MB/s]
Downloading (…)ch_model.safetensors: 100%|██████████| 1.45G/1.45G [00:05<00:00, 247MB/s]
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
Input #0, image2, from '/src/output/2023-11-01T10-23-33-sample-majicmixrealistic_v5preview/00-2186829154798718332/%08d.png':
Duration: 00:00:02.00, start: 0.000000, bitrate: N/A
Stream #0:0: Video: png, rgb24(pc), 384x256, 16 fps, 16 tbr, 16 tbn, 16 tbc
Stream mapping:
Stream #0:0 (png) -> fps
fps -> Stream #0:0 (libx264)
Press [q] to stop, [?] for help
[libx264 @ 0x55ccc7fe48c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x55ccc7fe48c0] profile High, level 1.3, 4:2:0, 8-bit
[libx264 @ 0x55ccc7fe48c0] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=6 deblock=1:1:1 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=0.40:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=8 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=5 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=10.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:0.60
Output #0, mp4, to '/src/output/2023-11-01T10-23-33-sample-majicmixrealistic_v5preview/00_2186829154798718332_a-beautiful-ocean_rolling-waves_flashes-of-lightni.mp4':
Metadata:
encoder         : Lavf58.76.100
Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 384x256, q=2-31, 16 fps, 16384 tbn
Metadata:
encoder         : Lavc58.134.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x
frame=   32 fps=0.0 q=-1.0 Lsize=     524kB time=00:00:01.81 bitrate=2366.9kbits/s speed=13.3x
video:523kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.222025%
[libx264 @ 0x55ccc7fe48c0] frame I:1     Avg QP:12.86  size: 23891
[libx264 @ 0x55ccc7fe48c0] frame P:6     Avg QP:12.73  size: 21566
[libx264 @ 0x55ccc7fe48c0] frame B:25    Avg QP:13.80  size: 15244
[libx264 @ 0x55ccc7fe48c0] consecutive B-frames:  3.1%  0.0%  0.0% 25.0% 15.6% 56.2%
[libx264 @ 0x55ccc7fe48c0] mb I  I16..4:  8.3% 57.0% 34.6%
[libx264 @ 0x55ccc7fe48c0] mb P  I16..4:  6.0% 49.6% 35.9%  P16..4:  2.2%  4.0%  2.4%  0.0%  0.0%    skip: 0.0%
[libx264 @ 0x55ccc7fe48c0] mb B  I16..4:  1.4% 12.5% 12.8%  B16..8: 23.5% 27.2% 10.2%  direct:11.8%  skip: 0.6%  L0:26.3% L1:25.1% BI:48.6%
[libx264 @ 0x55ccc7fe48c0] 8x8 transform intra:50.7% inter:55.8%
[libx264 @ 0x55ccc7fe48c0] coded y,uvDC,uvAC intra: 94.9% 99.0% 96.0% inter: 81.6% 92.3% 46.5%
[libx264 @ 0x55ccc7fe48c0] i16 v,h,dc,p: 14%  5%  4% 77%
[libx264 @ 0x55ccc7fe48c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 31% 12%  7%  4%  7% 15%  9% 10%  5%
[libx264 @ 0x55ccc7fe48c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 16% 14%  6%  6% 14% 13% 16%  8%  7%
[libx264 @ 0x55ccc7fe48c0] i8c dc,h,v,p: 34% 20% 28% 18%
[libx264 @ 0x55ccc7fe48c0] Weighted P-Frames: Y:50.0% UV:33.3%
[libx264 @ 0x55ccc7fe48c0] ref P L0: 36.4% 23.0% 14.0%  7.6%  4.5%  7.6%  6.9%
[libx264 @ 0x55ccc7fe48c0] ref B L0: 94.9%  3.3%  1.3%  0.3%  0.3%
[libx264 @ 0x55ccc7fe48c0] ref B L1: 98.9%  1.1%
[libx264 @ 0x55ccc7fe48c0] kb/s:2137.54
Identifying the GIF path from the generated outputs...
Identified directory: output/2023-11-01T10-23-33-sample-majicmixrealistic_v5preview
Identified Media Path: output/2023-11-01T10-23-33-sample-majicmixrealistic_v5preview/00_2186829154798718332_a-beautiful-ocean_rolling-waves_flashes-of-lightni.mp4
Identified PNG Folder Path: output/2023-11-01T10-23-33-sample-majicmixrealistic_v5preview/00-2186829154798718332
Interpolating frames with FILM...
  0%|[32m                                                                       [0m| 0/217 [00:00<?, ?it/s][0m2023-11-01 10:24:42.721289: I tensorflow/stream_executor/cuda/cuda_dnn.cc:368] Loaded cuDNN version 8900
  0%|[32m▎                                                              [0m| 1/217 [00:04<16:13,  4.51s/it][0m
  2%|[32m█▏                                                             [0m| 4/217 [00:04<03:10,  1.12it/s][0m
  3%|[32m██                                                             [0m| 7/217 [00:04<01:32,  2.27it/s][0m
  4%|[32m██▌                                                            [0m| 9/217 [00:04<01:04,  3.23it/s][0m
  6%|[32m███▍                                                          [0m| 12/217 [00:05<00:41,  4.99it/s][0m
  6%|[32m████                                                          [0m| 14/217 [00:05<00:31,  6.35it/s][0m
  7%|[32m████▌                                                         [0m| 16/217 [00:05<00:25,  7.87it/s][0m
  8%|[32m█████▏                                                        [0m| 18/217 [00:05<00:20,  9.56it/s][0m
  9%|[32m█████▋                                                        [0m| 20/217 [00:05<00:17, 11.30it/s][0m
 10%|[32m██████▎                                                       [0m| 22/217 [00:05<00:15, 12.85it/s][0m
 12%|[32m███████▏                                                      [0m| 25/217 [00:05<00:12, 14.93it/s][0m
 13%|[32m████████                                                      [0m| 28/217 [00:05<00:11, 16.49it/s][0m
 14%|[32m████████▌                                                     [0m| 30/217 [00:05<00:10, 17.05it/s][0m
 15%|[32m█████████▍                                                    [0m| 33/217 [00:06<00:10, 18.02it/s][0m
 17%|[32m██████████▎                                                   [0m| 36/217 [00:06<00:09, 18.39it/s][0m
 18%|[32m██████████▊                                                   [0m| 38/217 [00:06<00:09, 18.70it/s][0m
 18%|[32m███████████▍                                                  [0m| 40/217 [00:06<00:09, 18.99it/s][0m
 20%|[32m████████████▎                                                 [0m| 43/217 [00:06<00:09, 19.16it/s][0m
 21%|[32m█████████████▏                                                [0m| 46/217 [00:06<00:08, 19.46it/s][0m
 23%|[32m██████████████                                                [0m| 49/217 [00:06<00:08, 19.62it/s][0m
 24%|[32m██████████████▌                                               [0m| 51/217 [00:07<00:08, 19.45it/s][0m
 25%|[32m███████████████▍                                              [0m| 54/217 [00:07<00:08, 19.67it/s][0m
 26%|[32m████████████████▎                                             [0m| 57/217 [00:07<00:08, 19.57it/s][0m
 28%|[32m█████████████████▏                                            [0m| 60/217 [00:07<00:07, 19.77it/s][0m
 29%|[32m██████████████████                                            [0m| 63/217 [00:07<00:07, 19.91it/s][0m
 30%|[32m██████████████████▌                                           [0m| 65/217 [00:07<00:07, 19.67it/s][0m
 31%|[32m███████████████████▍                                          [0m| 68/217 [00:07<00:07, 19.85it/s][0m
 33%|[32m████████████████████▎                                         [0m| 71/217 [00:08<00:07, 19.69it/s][0m
 34%|[32m█████████████████████▏                                        [0m| 74/217 [00:08<00:07, 19.86it/s][0m
 35%|[32m██████████████████████                                        [0m| 77/217 [00:08<00:07, 19.95it/s][0m
 36%|[32m██████████████████████▌                                       [0m| 79/217 [00:08<00:07, 19.71it/s][0m
 38%|[32m███████████████████████▍                                      [0m| 82/217 [00:08<00:06, 19.80it/s][0m
 39%|[32m████████████████████████▎                                     [0m| 85/217 [00:08<00:06, 19.71it/s][0m
 41%|[32m█████████████████████████▏                                    [0m| 88/217 [00:08<00:06, 19.90it/s][0m
 42%|[32m██████████████████████████                                    [0m| 91/217 [00:09<00:06, 20.00it/s][0m
 43%|[32m██████████████████████████▌                                   [0m| 93/217 [00:09<00:06, 19.82it/s][0m
 44%|[32m███████████████████████████▍                                  [0m| 96/217 [00:09<00:06, 19.99it/s][0m
 46%|[32m████████████████████████████▎                                 [0m| 99/217 [00:09<00:05, 19.84it/s][0m
 47%|[32m████████████████████████████▋                                [0m| 102/217 [00:09<00:05, 19.97it/s][0m
 48%|[32m█████████████████████████████▌                               [0m| 105/217 [00:09<00:05, 20.10it/s][0m
 50%|[32m██████████████████████████████▎                              [0m| 108/217 [00:09<00:05, 19.81it/s][0m
 51%|[32m███████████████████████████████▏                             [0m| 111/217 [00:10<00:05, 19.94it/s][0m
 52%|[32m███████████████████████████████▊                             [0m| 113/217 [00:10<00:05, 19.74it/s][0m
 53%|[32m████████████████████████████████▌                            [0m| 116/217 [00:10<00:05, 19.86it/s][0m
 55%|[32m█████████████████████████████████▍                           [0m| 119/217 [00:10<00:04, 19.97it/s][0m
 56%|[32m██████████████████████████████████                           [0m| 121/217 [00:10<00:04, 19.77it/s][0m
 57%|[32m██████████████████████████████████▊                          [0m| 124/217 [00:10<00:04, 19.89it/s][0m
 59%|[32m███████████████████████████████████▋                         [0m| 127/217 [00:10<00:04, 19.75it/s][0m
 59%|[32m████████████████████████████████████▎                        [0m| 129/217 [00:10<00:04, 19.80it/s][0m
 61%|[32m█████████████████████████████████████                        [0m| 132/217 [00:11<00:04, 19.89it/s][0m
 62%|[32m█████████████████████████████████████▋                       [0m| 134/217 [00:11<00:04, 19.70it/s][0m
 63%|[32m██████████████████████████████████████▌                      [0m| 137/217 [00:11<00:04, 19.86it/s][0m
 64%|[32m███████████████████████████████████████                      [0m| 139/217 [00:11<00:03, 19.88it/s][0m
 65%|[32m███████████████████████████████████████▋                     [0m| 141/217 [00:11<00:03, 19.59it/s][0m
 66%|[32m████████████████████████████████████████▍                    [0m| 144/217 [00:11<00:03, 19.81it/s][0m
 68%|[32m█████████████████████████████████████████▎                   [0m| 147/217 [00:11<00:03, 19.93it/s][0m
 69%|[32m█████████████████████████████████████████▉                   [0m| 149/217 [00:11<00:03, 19.74it/s][0m
 70%|[32m██████████████████████████████████████████▋                  [0m| 152/217 [00:12<00:03, 19.94it/s][0m
 71%|[32m███████████████████████████████████████████▌                 [0m| 155/217 [00:12<00:03, 19.78it/s][0m
 73%|[32m████████████████████████████████████████████▍                [0m| 158/217 [00:12<00:02, 19.87it/s][0m
 74%|[32m████████████████████████████████████████████▉                [0m| 160/217 [00:12<00:02, 19.83it/s][0m
 75%|[32m█████████████████████████████████████████████▌               [0m| 162/217 [00:12<00:02, 19.40it/s][0m
 76%|[32m██████████████████████████████████████████████               [0m| 164/217 [00:12<00:02, 19.34it/s][0m
 76%|[32m██████████████████████████████████████████████▋              [0m| 166/217 [00:12<00:02, 19.33it/s][0m
 77%|[32m███████████████████████████████████████████████▏             [0m| 168/217 [00:12<00:02, 19.33it/s][0m
 78%|[32m███████████████████████████████████████████████▊             [0m| 170/217 [00:13<00:02, 19.03it/s][0m
 79%|[32m████████████████████████████████████████████████▎            [0m| 172/217 [00:13<00:02, 19.15it/s][0m
 80%|[32m████████████████████████████████████████████████▉            [0m| 174/217 [00:13<00:02, 19.19it/s][0m
 81%|[32m█████████████████████████████████████████████████▍           [0m| 176/217 [00:13<00:02, 19.09it/s][0m
 82%|[32m██████████████████████████████████████████████████▎          [0m| 179/217 [00:13<00:01, 19.55it/s][0m
 84%|[32m███████████████████████████████████████████████████▏         [0m| 182/217 [00:13<00:01, 19.75it/s][0m
 85%|[32m███████████████████████████████████████████████████▋         [0m| 184/217 [00:13<00:01, 19.50it/s][0m
 86%|[32m████████████████████████████████████████████████████▎        [0m| 186/217 [00:13<00:01, 19.50it/s][0m
 87%|[32m████████████████████████████████████████████████████▊        [0m| 188/217 [00:13<00:01, 19.59it/s][0m
 88%|[32m█████████████████████████████████████████████████████▍       [0m| 190/217 [00:14<00:01, 19.23it/s][0m
 88%|[32m█████████████████████████████████████████████████████▉       [0m| 192/217 [00:14<00:01, 19.43it/s][0m
 90%|[32m██████████████████████████████████████████████████████▊      [0m| 195/217 [00:14<00:01, 19.68it/s][0m
 91%|[32m███████████████████████████████████████████████████████▍     [0m| 197/217 [00:14<00:01, 19.43it/s][0m
 92%|[32m███████████████████████████████████████████████████████▉     [0m| 199/217 [00:14<00:00, 19.45it/s][0m
 93%|[32m████████████████████████████████████████████████████████▊    [0m| 202/217 [00:14<00:00, 19.70it/s][0m
 94%|[32m█████████████████████████████████████████████████████████▎   [0m| 204/217 [00:14<00:00, 19.43it/s][0m
 95%|[32m██████████████████████████████████████████████████████████▏  [0m| 207/217 [00:14<00:00, 19.71it/s][0m
 96%|[32m██████████████████████████████████████████████████████████▊  [0m| 209/217 [00:15<00:00, 19.70it/s][0m
 97%|[32m███████████████████████████████████████████████████████████▎ [0m| 211/217 [00:15<00:00, 19.35it/s][0m
 98%|[32m███████████████████████████████████████████████████████████▉ [0m| 213/217 [00:15<00:00, 19.45it/s][0m
 99%|[32m████████████████████████████████████████████████████████████▍[0m| 215/217 [00:15<00:00, 19.57it/s][0m
100%|[32m█████████████████████████████████████████████████████████████[0m| 217/217 [00:15<00:00, 19.66it/s][0m
100%|[32m█████████████████████████████████████████████████████████████[0m| 217/217 [00:15<00:00, 14.03it/s][0m
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
Input #0, image2, from 'output/2023-11-01T10-23-33-sample-majicmixrealistic_v5preview/interpolated_frames/%08d.png':
Duration: 00:00:09.96, start: 0.000000, bitrate: N/A
Stream #0:0: Video: png, rgb24(pc), 384x256, 25 fps, 25 tbr, 25 tbn, 25 tbc
Stream mapping:
Stream #0:0 -> #0:0 (png (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 0x55a4851d88c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x55a4851d88c0] profile High, level 1.3, 4:2:0, 8-bit
[libx264 @ 0x55a4851d88c0] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=8 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=16 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=1.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'output/2023-11-01T10-23-33-sample-majicmixrealistic_v5preview/output_video.mp4':
Metadata:
encoder         : Lavf58.76.100
Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 384x256, q=2-31, 16 fps, 16384 tbn
Metadata:
encoder         : Lavc58.134.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x
frame=  224 fps=0.0 q=5.0 size=    3840kB time=00:00:10.56 bitrate=2978.2kbits/s speed=20.9x
frame=  249 fps=0.0 q=-1.0 Lsize=    5769kB time=00:00:15.37 bitrate=3073.7kbits/s speed=21.9x
video:5765kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.066522%
[libx264 @ 0x55a4851d88c0] frame I:1     Avg QP: 1.61  size: 60169
[libx264 @ 0x55a4851d88c0] frame P:62    Avg QP: 1.61  size: 47471
[libx264 @ 0x55a4851d88c0] frame B:186   Avg QP: 4.70  size: 15588
[libx264 @ 0x55a4851d88c0] consecutive B-frames:  0.4%  0.0%  0.0% 99.6%
[libx264 @ 0x55a4851d88c0] mb I  I16..4: 12.0% 18.0% 70.1%
[libx264 @ 0x55a4851d88c0] mb P  I16..4:  4.0% 10.4% 17.8%  P16..4: 18.7% 30.1% 19.1%  0.0%  0.0%    skip: 0.0%
[libx264 @ 0x55a4851d88c0] mb B  I16..4:  0.2%  1.3%  0.4%  B16..8: 34.3%  9.9%  8.2%  direct:34.2%  skip:11.6%  L0:22.7% L1:20.3% BI:57.0%
[libx264 @ 0x55a4851d88c0] 8x8 transform intra:36.9% inter:29.7%
[libx264 @ 0x55a4851d88c0] coded y,uvDC,uvAC intra: 99.4% 99.9% 99.8% inter: 85.5% 82.3% 77.5%
[libx264 @ 0x55a4851d88c0] i16 v,h,dc,p: 29%  6%  8% 56%
[libx264 @ 0x55a4851d88c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 48%  9% 11%  3%  6% 10%  4%  6%  3%
[libx264 @ 0x55a4851d88c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 30% 11% 11%  5% 11% 15%  7%  7%  4%
[libx264 @ 0x55a4851d88c0] i8c dc,h,v,p: 32% 12% 39% 17%
[libx264 @ 0x55a4851d88c0] Weighted P-Frames: Y:24.2% UV:21.0%
[libx264 @ 0x55a4851d88c0] ref P L0: 50.5% 32.9% 13.1%  3.0%  0.5%
[libx264 @ 0x55a4851d88c0] ref B L0: 97.2%  2.5%  0.3%
[libx264 @ 0x55a4851d88c0] ref B L1: 99.8%  0.2%
[libx264 @ 0x55a4851d88c0] kb/s:3034.29

Version Details

Version ID: b3ccb0101402aafd04bfea042950be606223e2abedbad93cf848bfffa072bb61
Version Created: October 31, 2023

Run on Replicate →