lucataco/vid2densepose 🖼️ → 🖼️

▶️ 6.6K runs 📅 Dec 2023 ⚙️ Cog 0.8.6 🔗 GitHub ⚖️ License
pose-estimation video-to-video

Performance

30.1sTypical run time
6.6KTotal runs

About

Convert your videos to DensePose and use it with MagicAnimate

Example Output

Output

Performance Metrics

30.14s Prediction Time
42.10s Total Time
Input Parameters
input_video (required) Type: string
Input video path
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
/root/.pyenv/versions/3.10.13/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/output_video.mp4':
Metadata:
major_brand     : isom
minor_version   : 512
compatible_brands: isomiso2mp41
encoder         : Lavf59.27.100
Duration: 00:00:12.23, start: 0.000000, bitrate: 4876 kb/s
Stream #0:0(und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 576x1024 [SAR 1:1 DAR 9:16], 4875 kb/s, 30 fps, 30 tbr, 15360 tbn, 30 tbc (default)
Metadata:
handler_name    : VideoHandler
vendor_id       : [0][0][0][0]
Stream mapping:
Stream #0:0 -> #0:0 (mpeg4 (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 0x5591c57140c0] using SAR=1/1
[libx264 @ 0x5591c57140c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x5591c57140c0] profile High, level 3.1, 4:2:0, 8-bit
[libx264 @ 0x5591c57140c0] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=15 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to '/tmp/converted.mp4':
Metadata:
major_brand     : isom
minor_version   : 512
compatible_brands: isomiso2mp41
encoder         : Lavf58.76.100
Stream #0:0(und): Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 576x1024 [SAR 1:1 DAR 9:16], q=2-31, 30 fps, 15360 tbn (default)
Metadata:
handler_name    : VideoHandler
vendor_id       : [0][0][0][0]
encoder         : Lavc58.134.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x
frame=  235 fps=0.0 q=29.0 size=     512kB time=00:00:05.76 bitrate= 727.4kbits/s speed=11.2x
frame=  367 fps=0.0 q=-1.0 Lsize=    1235kB time=00:00:12.13 bitrate= 833.7kbits/s speed=13.2x
video:1230kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.414635%
[libx264 @ 0x5591c57140c0] frame I:2     Avg QP:15.98  size: 10556
[libx264 @ 0x5591c57140c0] frame P:96    Avg QP:24.03  size:  5304
[libx264 @ 0x5591c57140c0] frame B:269   Avg QP:27.41  size:  2707
[libx264 @ 0x5591c57140c0] consecutive B-frames:  1.1%  1.1%  7.4% 90.5%
[libx264 @ 0x5591c57140c0] mb I  I16..4: 54.8% 35.1% 10.1%
[libx264 @ 0x5591c57140c0] mb P  I16..4:  2.1%  6.9%  2.3%  P16..4:  6.1%  5.2%  1.9%  0.0%  0.0%    skip:75.4%
[libx264 @ 0x5591c57140c0] mb B  I16..4:  0.5%  0.6%  0.4%  B16..8: 12.8%  6.0%  1.0%  direct: 0.5%  skip:78.3%  L0:52.8% L1:45.7% BI: 1.5%
[libx264 @ 0x5591c57140c0] 8x8 transform intra:53.4% inter:15.5%
[libx264 @ 0x5591c57140c0] coded y,uvDC,uvAC intra: 12.2% 42.8% 37.0% inter: 1.8% 4.5% 3.0%
[libx264 @ 0x5591c57140c0] i16 v,h,dc,p: 79% 15%  5%  0%
[libx264 @ 0x5591c57140c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 21%  8% 67%  1%  1%  1%  1%  0%  0%
[libx264 @ 0x5591c57140c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 31% 15% 38%  3%  2%  4%  2%  3%  2%
[libx264 @ 0x5591c57140c0] i8c dc,h,v,p: 54% 17% 27%  2%
[libx264 @ 0x5591c57140c0] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x5591c57140c0] ref P L0: 56.3%  3.4% 24.7% 15.6%
[libx264 @ 0x5591c57140c0] ref B L0: 82.0% 14.4%  3.6%
[libx264 @ 0x5591c57140c0] ref B L1: 93.3%  6.7%
[libx264 @ 0x5591c57140c0] kb/s:822.99
Version Details
Version ID
9a70781b13ecafe3b49c98aa7f24373cbe7589f79605c9b48b3c77496a8a1361
Version Created
December 6, 2023
Run on Replicate →