charlesmccarthy/hotshot-a40 🔢📝❓ → 🖼️

▶️ 4.4K runs 📅 Oct 2023 ⚙️ Cog 0.8.6 🔗 GitHub ⚖️ License
looping-animation text-to-video

About

Hotshot XL using SDXL for generating one second clips of high quality! Running on a40 Made by the greats at hotshot.co and brought to you by your friends at FullJourney! Thanks to LucaTaco for the MVP!

Example Output

Prompt:

"A photo Taylor swift smiling"

Output

Performance Metrics

22.65s Prediction Time
22.68s Total Time
All Input Parameters
{
  "steps": 30,
  "width": 384,
  "height": 672,
  "prompt": "A photo Taylor swift smiling",
  "scheduler": "EulerAncestralDiscreteScheduler",
  "negative_prompt": "blurry"
}
Input Parameters
seed Type: integer
Random seed. Leave blank to randomize the seed
steps Type: integerDefault: 30Range: 1 - 500
Number of denoising steps
width Type: integerDefault: 672
width
height Type: integerDefault: 384
Height
prompt Type: stringDefault: a camel smoking a cigarette, hd, high quality
Input prompt
scheduler Default: EulerAncestralDiscreteScheduler
Select a Scheduler
negative_prompt Type: stringDefault: blurry
Negative prompt
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
Loading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]
Loading pipeline components...:  29%|██▊       | 2/7 [00:00<00:01,  4.29it/s]
Loading pipeline components...:  57%|█████▋    | 4/7 [00:01<00:00,  3.46it/s]
Loading pipeline components...:  71%|███████▏  | 5/7 [00:03<00:01,  1.13it/s]
Loading pipeline components...:  86%|████████▌ | 6/7 [00:03<00:00,  1.44it/s]
Loading pipeline components...: 100%|██████████| 7/7 [00:03<00:00,  1.89it/s]
Using seed: 23103
Warning - setting num_images_per_prompt = 1 because video_length = 8
  0%|          | 0/30 [00:00<?, ?it/s]
  3%|▎         | 1/30 [00:00<00:14,  2.02it/s]
  7%|▋         | 2/30 [00:00<00:13,  2.02it/s]
 10%|█         | 3/30 [00:01<00:13,  2.01it/s]
 13%|█▎        | 4/30 [00:01<00:12,  2.01it/s]
 17%|█▋        | 5/30 [00:02<00:12,  2.01it/s]
 20%|██        | 6/30 [00:02<00:11,  2.01it/s]
 23%|██▎       | 7/30 [00:03<00:11,  2.01it/s]
 27%|██▋       | 8/30 [00:03<00:10,  2.01it/s]
 30%|███       | 9/30 [00:04<00:10,  2.01it/s]
 33%|███▎      | 10/30 [00:04<00:09,  2.01it/s]
 37%|███▋      | 11/30 [00:05<00:09,  2.01it/s]
 40%|████      | 12/30 [00:05<00:08,  2.01it/s]
 43%|████▎     | 13/30 [00:06<00:08,  2.01it/s]
 47%|████▋     | 14/30 [00:06<00:07,  2.01it/s]
 50%|█████     | 15/30 [00:07<00:07,  2.01it/s]
 53%|█████▎    | 16/30 [00:07<00:06,  2.01it/s]
 57%|█████▋    | 17/30 [00:08<00:06,  2.01it/s]
 60%|██████    | 18/30 [00:08<00:05,  2.01it/s]
 63%|██████▎   | 19/30 [00:09<00:05,  2.01it/s]
 67%|██████▋   | 20/30 [00:09<00:04,  2.01it/s]
 70%|███████   | 21/30 [00:10<00:04,  2.01it/s]
 73%|███████▎  | 22/30 [00:10<00:03,  2.01it/s]
 77%|███████▋  | 23/30 [00:11<00:03,  2.01it/s]
 80%|████████  | 24/30 [00:11<00:02,  2.01it/s]
 83%|████████▎ | 25/30 [00:12<00:02,  2.01it/s]
 87%|████████▋ | 26/30 [00:12<00:01,  2.01it/s]
 90%|█████████ | 27/30 [00:13<00:01,  2.01it/s]
 93%|█████████▎| 28/30 [00:13<00:00,  2.01it/s]
 97%|█████████▋| 29/30 [00:14<00:00,  2.01it/s]
100%|██████████| 30/30 [00:14<00:00,  2.01it/s]
100%|██████████| 30/30 [00:14<00:00,  2.01it/s]
  0%|          | 0/8 [00:00<?, ?it/s]
 62%|██████▎   | 5/8 [00:00<00:00, 33.28it/s]
100%|██████████| 8/8 [00:00<00:00, 19.54it/s]
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil      56. 70.100 / 56. 70.100
libavcodec     58.134.100 / 58.134.100
libavformat    58. 76.100 / 58. 76.100
libavdevice    58. 13.100 / 58. 13.100
libavfilter     7.110.100 /  7.110.100
libswscale      5.  9.100 /  5.  9.100
libswresample   3.  9.100 /  3.  9.100
libpostproc    55.  9.100 / 55.  9.100
Input #0, gif, from 'output.gif':
Duration: 00:00:00.96, start: 0.000000, bitrate: 11511 kb/s
Stream #0:0: Video: gif, bgra, 384x672, 8.33 fps, 8.33 tbr, 100 tbn, 100 tbc
Stream mapping:
Stream #0:0 -> #0:0 (gif (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 0x5637406deb80] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x5637406deb80] profile High, level 2.2, 4:2:0, 8-bit
[libx264 @ 0x5637406deb80] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=8 scenecut=40 intra_refresh=0 rc=cqp mbtree=0 qp=17 ip_ratio=1.40 pb_ratio=1.30 aq=0
Output #0, mp4, to '/tmp/tmprjgba3ux/out.mp4':
Metadata:
encoder         : Lavf58.76.100
Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 384x672, q=2-31, 8.33 fps, 12800 tbn
Metadata:
encoder         : Lavc58.134.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=N/A
[mp4 @ 0x5637406dd1c0] Starting second pass: moving the moov atom to the beginning of the file
frame=    8 fps=0.0 q=-1.0 Lsize=     323kB time=00:00:00.60 bitrate=4405.8kbits/s speed=4.68x
video:322kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.287379%
[libx264 @ 0x5637406deb80] frame I:1     Avg QP:14.00  size: 67187
[libx264 @ 0x5637406deb80] frame P:2     Avg QP:17.00  size: 42704
[libx264 @ 0x5637406deb80] frame B:5     Avg QP:18.60  size: 35259
[libx264 @ 0x5637406deb80] consecutive B-frames: 12.5%  0.0% 37.5% 50.0%
[libx264 @ 0x5637406deb80] mb I  I16..4: 13.4% 48.9% 37.7%
[libx264 @ 0x5637406deb80] mb P  I16..4:  6.4% 44.4% 26.2%  P16..4: 12.1%  7.1%  3.7%  0.0%  0.0%    skip: 0.0%
[libx264 @ 0x5637406deb80] mb B  I16..4:  2.4% 23.7% 16.0%  B16..8: 21.8% 19.4%  5.9%  direct: 7.5%  skip: 3.3%  L0:50.6% L1:27.5% BI:21.8%
[libx264 @ 0x5637406deb80] 8x8 transform intra:55.1% inter:59.1%
[libx264 @ 0x5637406deb80] coded y,uvDC,uvAC intra: 97.0% 92.7% 73.7% inter: 72.7% 79.6% 6.4%
[libx264 @ 0x5637406deb80] i16 v,h,dc,p: 49%  2% 12% 37%
[libx264 @ 0x5637406deb80] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 32%  8% 15%  8%  5%  6%  6% 12%  8%
[libx264 @ 0x5637406deb80] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 15% 12% 16% 10%  8%  8% 11% 10% 11%
[libx264 @ 0x5637406deb80] i8c dc,h,v,p: 36% 15% 32% 17%
[libx264 @ 0x5637406deb80] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x5637406deb80] ref P L0: 59.0% 12.5% 15.7% 12.8%
[libx264 @ 0x5637406deb80] ref B L0: 87.4% 12.2%  0.4%
[libx264 @ 0x5637406deb80] ref B L1: 96.8%  3.2%
[libx264 @ 0x5637406deb80] kb/s:2740.74
Version Details
Version ID
d3f8df5a0a70bbf80db76b781c559f80cdf5eed2b26b116aac590e20f9022655
Version Created
October 5, 2023
Run on Replicate →