pollinations/rife-video-interpolation 🖼️🔢 → 🖼️
About

Example Output
Output
Performance Metrics
27.15s
Prediction Time
191.28s
Total Time
All Input Parameters
{ "video": "https://replicate.delivery/pbxt/IAblt4FfiF0Dpr7iaueezAUtK0g5UE0sYWzgihVwAxi16ub5/acidtho.mov", "interpolation_factor": 2 }
Input Parameters
- video (required)
- input video
- interpolation_factor
- interpolation factor. 4 means generate 4 intermediate frames for each input frame
Output Schema
Output
Example Execution Logs
predict Loaded v3.x HD model. /tmp/tmpn1xr0wpiacidtho.mp4, 99.0 frames in total, 24.08905651195328FPS to 96.35622604781312FPS The audio will be merged after interpolation process 0%| | 0/99.0 [00:00<?, ?it/s] 1%| | 1/99.0 [00:03<06:28, 3.96s/it] 3%|▎ | 3/99.0 [00:04<04:28, 2.80s/it] 5%|▌ | 5/99.0 [00:04<03:06, 1.99s/it] 7%|▋ | 7/99.0 [00:04<02:10, 1.42s/it] 9%|▉ | 9/99.0 [00:04<01:31, 1.02s/it] 11%|█ | 11/99.0 [00:04<01:05, 1.35it/s] 13%|█▎ | 13/99.0 [00:05<00:47, 1.82it/s] 15%|█▌ | 15/99.0 [00:05<00:34, 2.43it/s] 16%|█▌ | 16/99.0 [00:05<00:26, 3.12it/s] 17%|█▋ | 17/99.0 [00:05<00:21, 3.89it/s] 18%|█▊ | 18/99.0 [00:05<00:17, 4.70it/s] 19%|█▉ | 19/99.0 [00:05<00:14, 5.47it/s] 21%|██ | 21/99.0 [00:05<00:12, 6.40it/s] 22%|██▏ | 22/99.0 [00:06<00:10, 7.05it/s] 23%|██▎ | 23/99.0 [00:06<00:10, 7.58it/s] 24%|██▍ | 24/99.0 [00:06<00:09, 7.96it/s] 25%|██▌ | 25/99.0 [00:06<00:08, 8.27it/s] 27%|██▋ | 27/99.0 [00:06<00:08, 8.90it/s] 28%|██▊ | 28/99.0 [00:06<00:07, 8.91it/s] 29%|██▉ | 29/99.0 [00:06<00:07, 9.01it/s] 30%|███ | 30/99.0 [00:06<00:07, 9.05it/s] 31%|███▏ | 31/99.0 [00:06<00:07, 9.06it/s] 33%|███▎ | 33/99.0 [00:07<00:06, 9.51it/s] 34%|███▍ | 34/99.0 [00:07<00:06, 9.31it/s] 35%|███▌ | 35/99.0 [00:07<00:06, 9.27it/s] 37%|███▋ | 37/99.0 [00:07<00:06, 9.61it/s] 39%|███▉ | 39/99.0 [00:07<00:06, 9.85it/s] 41%|████▏ | 41/99.0 [00:07<00:05, 10.12it/s] 43%|████▎ | 43/99.0 [00:08<00:05, 10.15it/s] 45%|████▌ | 45/99.0 [00:08<00:05, 10.21it/s] 47%|████▋ | 47/99.0 [00:08<00:05, 10.26it/s] 49%|████▉ | 49/99.0 [00:08<00:04, 10.40it/s] 52%|█████▏ | 51/99.0 [00:08<00:04, 10.49it/s] 54%|█████▎ | 53/99.0 [00:09<00:04, 10.56it/s] 56%|█████▌ | 55/99.0 [00:09<00:04, 10.55it/s] 58%|█████▊ | 57/99.0 [00:09<00:03, 10.58it/s] 60%|█████▉ | 59/99.0 [00:09<00:03, 10.53it/s] 62%|██████▏ | 61/99.0 [00:09<00:03, 10.61it/s] 64%|██████▎ | 63/99.0 [00:10<00:03, 10.63it/s] 66%|██████▌ | 65/99.0 [00:10<00:03, 10.61it/s] 68%|██████▊ | 67/99.0 [00:10<00:03, 10.59it/s] 70%|██████▉ | 69/99.0 [00:10<00:02, 10.58it/s] 72%|███████▏ | 71/99.0 [00:10<00:02, 10.58it/s] 74%|███████▎ | 73/99.0 [00:10<00:02, 10.59it/s] 76%|███████▌ | 75/99.0 [00:11<00:02, 10.61it/s] 78%|███████▊ | 77/99.0 [00:11<00:02, 10.56it/s] 80%|███████▉ | 79/99.0 [00:11<00:01, 10.53it/s] 82%|████████▏ | 81/99.0 [00:11<00:01, 10.46it/s] 84%|████████▍ | 83/99.0 [00:11<00:01, 10.48it/s] 86%|████████▌ | 85/99.0 [00:12<00:01, 10.53it/s] 88%|████████▊ | 87/99.0 [00:12<00:01, 10.58it/s] 90%|████████▉ | 89/99.0 [00:12<00:00, 10.59it/s] 92%|█████████▏| 91/99.0 [00:12<00:00, 10.52it/s] 94%|█████████▍| 93/99.0 [00:12<00:00, 10.59it/s] 96%|█████████▌| 95/99.0 [00:13<00:00, 10.59it/s] 98%|█████████▊| 97/99.0 [00:13<00:00, 10.57it/s] 99%|█████████▉| 98/99.0 [00:13<00:00, 7.30it/s] ffmpeg version 4.2.7-0ubuntu0.1 Copyright (c) 2000-2022 the FFmpeg developers built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1) configuration: --prefix=/usr --extra-version=0ubuntu0.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-nvenc --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 31.100 / 56. 31.100 libavcodec 58. 54.100 / 58. 54.100 libavformat 58. 29.100 / 58. 29.100 libavdevice 58. 8.100 / 58. 8.100 libavfilter 7. 57.100 / 7. 57.100 libavresample 4. 0. 0 / 4. 0. 0 libswscale 5. 5.100 / 5. 5.100 libswresample 3. 5.100 / 3. 5.100 libpostproc 55. 5.100 / 55. 5.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/tmpn1xr0wpiacidtho.mov': Metadata: major_brand : qt minor_version : 0 compatible_brands: qt creation_time : 2023-01-20T14:51:31.000000Z Duration: 00:00:04.11, start: 0.000000, bitrate: 1781 kb/s Stream #0:0(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 125 kb/s (default) Metadata: creation_time : 2023-01-20T14:51:31.000000Z handler_name : Core Media Audio Stream #0:1(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, smpte170m/smpte170m/bt709), 640x360, 1646 kb/s, 24.09 fps, 23.98 tbr, 24k tbn, 48k tbc (default) Metadata: creation_time : 2023-01-20T14:51:31.000000Z handler_name : Core Media Video encoder : H.264 Output #0, matroska, to './temp/audio.mkv': Metadata: major_brand : qt minor_version : 0 compatible_brands: qt encoder : Lavf58.29.100 Stream #0:0(und): Audio: aac (LC) ([255][0][0][0] / 0x00FF), 44100 Hz, stereo, fltp, 125 kb/s (default) Metadata: creation_time : 2023-01-20T14:51:31.000000Z handler_name : Core Media Audio Stream mapping: Stream #0:0 -> #0:0 (copy) Press [q] to stop, [?] for help size= 66kB time=00:00:04.10 bitrate= 131.9kbits/s speed= 199x video:0kB audio:64kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 3.068213% ffmpeg version 4.2.7-0ubuntu0.1 Copyright (c) 2000-2022 the FFmpeg developers built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1) configuration: --prefix=/usr --extra-version=0ubuntu0.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-nvenc --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 31.100 / 56. 31.100 libavcodec 58. 54.100 / 58. 54.100 libavformat 58. 29.100 / 58. 29.100 libavdevice 58. 8.100 / 58. 8.100 libavfilter 7. 57.100 / 7. 57.100 libavresample 4. 0. 0 / 4. 0. 0 libswscale 5. 5.100 / 5. 5.100 libswresample 3. 5.100 / 3. 5.100 libpostproc 55. 5.100 / 55. 5.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/interpolated_noaudio.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2mp41 encoder : Lavf58.35.100 Duration: 00:00:04.08, start: 0.000000, bitrate: 3148 kb/s Stream #0:0(und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 3143 kb/s, 96.36 fps, 96.36 tbr, 96356 tbn, 24089 tbc (default) Metadata: handler_name : VideoHandler Input #1, matroska,webm, from './temp/audio.mkv': Metadata: COMPATIBLE_BRANDS: qt MAJOR_BRAND : qt MINOR_VERSION : 0 ENCODER : Lavf58.29.100 Duration: 00:00:04.16, start: 0.000000, bitrate: 130 kb/s Stream #1:0: Audio: aac (LC), 44100 Hz, stereo, fltp (default) Metadata: HANDLER_NAME : Core Media Audio DURATION : 00:00:04.157000000 Output #0, mp4, to '/tmp/interpolated.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2mp41 encoder : Lavf58.29.100 Stream #0:0(und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 640x360 [SAR 1:1 DAR 16:9], q=2-31, 3143 kb/s, 96.36 fps, 96.36 tbr, 96356 tbn, 96356 tbc (default) Metadata: handler_name : VideoHandler Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp (default) Metadata: HANDLER_NAME : Core Media Audio DURATION : 00:00:04.157000000 Stream mapping: Stream #0:0 -> #0:0 (copy) Stream #1:0 -> #0:1 (copy) Press [q] to stop, [?] for help frame= 393 fps=0.0 q=-1.0 Lsize= 1635kB time=00:00:04.15 bitrate=3223.2kbits/s speed= 578x video:1565kB audio:64kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.379001% ffmpeg version 4.2.7-0ubuntu0.1 Copyright (c) 2000-2022 the FFmpeg developers built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1) configuration: --prefix=/usr --extra-version=0ubuntu0.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-nvenc --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared libavutil 56. 31.100 / 56. 31.100 libavcodec 58. 54.100 / 58. 54.100 libavformat 58. 29.100 / 58. 29.100 libavdevice 58. 8.100 / 58. 8.100 libavfilter 7. 57.100 / 7. 57.100 libavresample 4. 0. 0 / 4. 0. 0 libswscale 5. 5.100 / 5. 5.100 libswresample 3. 5.100 / 3. 5.100 libpostproc 55. 5.100 / 55. 5.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/interpolated.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2mp41 encoder : Lavf58.29.100 Duration: 00:00:04.18, start: 0.000000, bitrate: 3205 kb/s Stream #0:0(und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 3143 kb/s, 96.36 fps, 96.36 tbr, 96356 tbn, 24089 tbc (default) Metadata: handler_name : VideoHandler Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 125 kb/s (default) Metadata: handler_name : Core Media Audio Stream mapping: Stream #0:0 -> #0:0 (mpeg4 (native) -> h264 (libx264)) Stream #0:1 -> #0:1 (aac (native) -> aac (native)) Press [q] to stop, [?] for help [libx264 @ 0x55b57e0935c0] using SAR=1/1 [libx264 @ 0x55b57e0935c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 [libx264 @ 0x55b57e0935c0] profile High, level 3.1 [libx264 @ 0x55b57e0935c0] 264 - core 155 r2917 0a84d98 - H.264/MPEG-4 AVC codec - Copyleft 2003-2018 - http://www.videolan.org/x264.html - options: cabac=1 ref=5 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=8 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=2 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=11 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=crf mbtree=1 crf=20.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/tmp/interpolated_2x.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2mp41 encoder : Lavf58.29.100 Stream #0:0(und): Video: h264 (libx264) (avc1 / 0x31637661), yuv420p, 640x360 [SAR 1:1 DAR 16:9], q=-1--1, 96.36 fps, 24089 tbn, 96.36 tbc (default) Metadata: handler_name : VideoHandler encoder : Lavc58.54.100 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1 Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 128 kb/s (default) Metadata: handler_name : Core Media Audio encoder : Lavc58.54.100 aac frame= 111 fps=0.0 q=30.0 size= 0kB time=00:00:01.20 bitrate= 0.3kbits/s speed=2.37x frame= 218 fps=215 q=30.0 size= 0kB time=00:00:02.32 bitrate= 0.2kbits/s speed=2.29x frame= 315 fps=207 q=30.0 size= 256kB time=00:00:03.32 bitrate= 631.7kbits/s speed=2.19x [mp4 @ 0x55b57e0a8dc0] Starting second pass: moving the moov atom to the beginning of the file frame= 393 fps=179 q=-1.0 Lsize= 449kB time=00:00:04.17 bitrate= 880.1kbits/s speed= 1.9x video:372kB audio:68kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 2.012863% [libx264 @ 0x55b57e0935c0] frame I:2 Avg QP:21.75 size: 7820 [libx264 @ 0x55b57e0935c0] frame P:129 Avg QP:22.82 size: 2025 [libx264 @ 0x55b57e0935c0] frame B:262 Avg QP:24.02 size: 395 [libx264 @ 0x55b57e0935c0] consecutive B-frames: 10.2% 2.5% 0.8% 86.5% [libx264 @ 0x55b57e0935c0] mb I I16..4: 29.4% 59.5% 11.1% [libx264 @ 0x55b57e0935c0] mb P I16..4: 4.2% 9.1% 0.2% P16..4: 38.6% 7.3% 3.4% 0.0% 0.0% skip:37.1% [libx264 @ 0x55b57e0935c0] mb B I16..4: 0.5% 0.7% 0.0% B16..8: 34.6% 0.8% 0.0% direct: 0.2% skip:63.2% L0:45.8% L1:52.5% BI: 1.7% [libx264 @ 0x55b57e0935c0] 8x8 transform intra:65.6% inter:75.4% [libx264 @ 0x55b57e0935c0] direct mvs spatial:97.7% temporal:2.3% [libx264 @ 0x55b57e0935c0] coded y,uvDC,uvAC intra: 30.3% 44.1% 3.3% inter: 2.4% 5.1% 0.1% [libx264 @ 0x55b57e0935c0] i16 v,h,dc,p: 22% 50% 19% 9% [libx264 @ 0x55b57e0935c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 19% 28% 45% 2% 1% 1% 1% 1% 3% [libx264 @ 0x55b57e0935c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 37% 35% 14% 2% 2% 2% 3% 2% 2% [libx264 @ 0x55b57e0935c0] i8c dc,h,v,p: 39% 37% 21% 3% [libx264 @ 0x55b57e0935c0] Weighted P-Frames: Y:0.0% UV:0.0% [libx264 @ 0x55b57e0935c0] ref P L0: 63.1% 10.0% 17.2% 5.2% 3.7% 0.7% [libx264 @ 0x55b57e0935c0] ref B L0: 80.9% 14.5% 3.7% 0.9% [libx264 @ 0x55b57e0935c0] ref B L1: 93.3% 6.7% [libx264 @ 0x55b57e0935c0] kb/s:746.20 [aac @ 0x55b57e078640] Qavg: 1051.758 total 96 -rw-rw-r-- 1 root root 3276 Jan 19 13:38 Colab_demo.ipynb -rw-rw-r-- 1 root root 1066 Jan 19 13:38 LICENSE -rw-rw-r-- 1 root root 9766 Jan 19 13:38 README.md drwxr-xr-x 1 root root 4096 Jan 20 15:26 __pycache__ drwxrwxr-x 2 root root 4096 Jan 20 15:22 benchmark -rw-rw-r-- 1 root root 860 Jan 19 14:34 cog.yaml -rw-rw-r-- 1 root root 4337 Jan 19 13:38 dataset.py drwxrwxr-x 2 root root 4096 Jan 20 15:22 demo drwxrwxr-x 2 root root 4096 Jan 20 15:22 docker -rw-rw-r-- 1 root root 4187 Jan 19 13:38 inference_img.py -rw-rw-r-- 1 root root 11184 Jan 20 14:15 inference_video.py drwxrwxr-x 5 root root 4096 Jan 20 15:22 model -rw-rw-r-- 1 root root 1191 Jan 20 15:23 predict.py -rw-rw-r-- 1 root root 110 Jan 19 13:38 requirements.txt -rw-rw-r-- 1 root root 7217 Jan 19 13:38 train.py drwxr-xr-x 1 root root 4096 Jan 20 15:22 train_log total 4464 -rw-r--r-- 1 root root 40181 Jan 19 21:10 cog-0.0.1.dev-py3-none-any.whl -rw-r--r-- 1 root root 1674656 Jan 20 15:26 interpolated.mp4 -rw-r--r-- 1 root root 459824 Jan 20 15:26 interpolated_2x.mp4 -rw-r--r-- 1 root root 918913 Jan 19 21:12 python-build.20230119211018.206.log -rw------- 1 root root 14560 Jan 19 21:10 python-patch.HnY0l8 -rw-r--r-- 1 root root 129 Jan 19 21:10 requirements.txt -rw------- 1 root root 265969 Jan 19 21:12 tmpa24cmjz_ -rw------- 1 root root 915373 Jan 20 15:26 tmpn1xr0wpiacidtho.mov -rw------- 1 root root 265969 Jan 19 21:12 tmpp3wa944t
Version Details
- Version ID
e4df805c481234a312c9e28f862ea0fb70bc01c9deb0e1fcd2965a2e5d866d52
- Version Created
- July 31, 2023