lucataco/interpany-clearer 🔢🖼️ → 🖼️

▶️ 12.0K runs 📅 Nov 2023 ⚙️ Cog 0.8.6 🔗 GitHub 📄 Paper ⚖️ License
video-frame-interpolation

About

InterpAny-Clearer: Clearer anytime frame interpolation & Manipulated interpolation

Example Output

Output

Performance Metrics

7.60s Prediction Time
7.64s Total Time
All Input Parameters
{
  "num": 3,
  "video": "https://replicate.delivery/pbxt/JxiqfzxJxZnU8Bi5O8g5df2Eku2mGKtritaKqtWW4Z2WUvhf/replicate-prediction-exworydboq3i52tdwyikzkidce.mp4"
}
Input Parameters
fps Type: integerDefault: 15
Fps of the output video. Leave blank to keep the same fps
num Type: integerDefault: 3Range: 0 - 10
number of extracted images
video (required) Type: string
Input video
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
Input file path: /tmp/tmp7ghi1eggreplicate-prediction-exworydboq3i52tdwyikzkidce.mp4
7ghi1eggreplicate-prediction-exworydboq3i52tdwyikzkidce.mp4
Running subprocess command
Before interpolate, the video has 14 frames
After interpolate, the video has 53 frames
Finished subprocess command
ffmpeg version 4.2.7-0ubuntu0.1 Copyright (c) 2000-2022 the FFmpeg developers
built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1)
configuration: --prefix=/usr --extra-version=0ubuntu0.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-nvenc --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 31.100 / 56. 31.100
libavcodec     58. 54.100 / 58. 54.100
libavformat    58. 29.100 / 58. 29.100
libavdevice    58.  8.100 / 58.  8.100
libavfilter     7. 57.100 /  7. 57.100
libavresample   4.  0.  0 /  4.  0.  0
libswscale      5.  5.100 /  5.  5.100
libswresample   3.  5.100 /  3.  5.100
libpostproc    55.  5.100 / 55.  5.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/InterpAny/results/video_results/7ghi1eggreplicate-prediction-exworydboq3i52tdwyikzkidce.mp4':
Metadata:
major_brand     : isom
minor_version   : 512
compatible_brands: isomiso2mp41
encoder         : Lavf59.27.100
Duration: 00:00:03.53, start: 0.000000, bitrate: 898 kb/s
Stream #0:0(und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 1024x576 [SAR 1:1 DAR 16:9], 895 kb/s, 15 fps, 15 tbr, 15360 tbn, 15 tbc (default)
Metadata:
handler_name    : VideoHandler
Stream mapping:
Stream #0:0 -> #0:0 (mpeg4 (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 0x55f85e411740] using SAR=1/1
[libx264 @ 0x55f85e411740] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x55f85e411740] profile High, level 3.1
[libx264 @ 0x55f85e411740] 264 - core 155 r2917 0a84d98 - H.264/MPEG-4 AVC codec - Copyleft 2003-2018 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=15 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=15 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to '/tmp/output.mp4':
Metadata:
major_brand     : isom
minor_version   : 512
compatible_brands: isomiso2mp41
encoder         : Lavf58.29.100
Stream #0:0(und): Video: h264 (libx264) (avc1 / 0x31637661), yuv420p, 1024x576 [SAR 1:1 DAR 16:9], q=-1--1, 15 fps, 15360 tbn, 15 tbc (default)
Metadata:
handler_name    : VideoHandler
encoder         : Lavc58.54.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
frame=   53 fps=0.0 q=-1.0 Lsize=     272kB time=00:00:03.33 bitrate= 669.3kbits/s speed=10.3x
video:271kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.504899%
[libx264 @ 0x55f85e411740] frame I:1     Avg QP:18.55  size: 17611
[libx264 @ 0x55f85e411740] frame P:33    Avg QP:19.58  size:  6810
[libx264 @ 0x55f85e411740] frame B:19    Avg QP:22.15  size:  1814
[libx264 @ 0x55f85e411740] consecutive B-frames: 35.8% 41.5% 22.6%  0.0%
[libx264 @ 0x55f85e411740] mb I  I16..4: 17.5% 80.2%  2.3%
[libx264 @ 0x55f85e411740] mb P  I16..4:  1.8% 11.7%  0.1%  P16..4: 55.5%  7.3%  3.8%  0.0%  0.0%    skip:19.6%
[libx264 @ 0x55f85e411740] mb B  I16..4:  0.1%  0.3%  0.0%  B16..8: 42.2%  1.2%  0.1%  direct: 0.3%  skip:55.8%  L0:65.4% L1:27.6% BI: 7.0%
[libx264 @ 0x55f85e411740] 8x8 transform intra:84.5% inter:86.0%
[libx264 @ 0x55f85e411740] coded y,uvDC,uvAC intra: 39.0% 54.0% 10.9% inter: 8.3% 12.9% 0.2%
[libx264 @ 0x55f85e411740] i16 v,h,dc,p: 12% 66% 16%  5%
[libx264 @ 0x55f85e411740] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 15% 48% 33%  0%  0%  0%  1%  0%  2%
[libx264 @ 0x55f85e411740] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 37% 36% 10%  2%  3%  4%  3%  3%  3%
[libx264 @ 0x55f85e411740] i8c dc,h,v,p: 36% 44% 16%  4%
[libx264 @ 0x55f85e411740] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x55f85e411740] ref P L0: 73.9%  5.4% 15.7%  5.1%
[libx264 @ 0x55f85e411740] ref B L0: 76.7% 21.8%  1.5%
[libx264 @ 0x55f85e411740] kb/s:626.70
Version Details
Version ID
d5df8241c4805b46a14901f0c0ac174f2004bb35387ea8e29909c0d7c58088af
Version Created
November 29, 2023
Run on Replicate →