zsxkib/pyramid-flow 🖼️📝🔢❓ → 🖼️

▶️ 8.9K runs 📅 Oct 2024 ⚙️ Cog 0.9.25 🔗 GitHub 📄 Paper ⚖️ License
image-to-video text-to-video

About

Text-to-Video + Image-to-Video: Pyramid Flow Autoregressive Video Generation method based on Flow Matching

Example Output

Prompt:

"A gripping movie trailer showcasing a young female astronaut in a iridescent spacesuit, sporting a red wool knitted space helmet. She explores a bioluminescent alien forest under twin moons, filmed in vivid IMAX quality. Retro sci-fi aesthetic, lens flares"

Output

Performance Metrics

256.11s Prediction Time
256.13s Total Time
All Input Parameters 
{
  "prompt": "A gripping movie trailer showcasing a young female astronaut in a iridescent spacesuit, sporting a red wool knitted space helmet. She explores a bioluminescent alien forest under twin moons, filmed in vivid IMAX quality. Retro sci-fi aesthetic, lens flares",
  "duration": 5,
  "guidance_scale": 9,
  "frames_per_second": 24,
  "video_guidance_scale": 5
}
Input Parameters
image Type: string
Optional input image for image-to-video generation
prompt (required) Type: string
Text prompt for video generation
duration Type: integerDefault: 3Range: 1 - 10
Duration of the video in seconds (1-3 for canonical mode, 1-10 for non-canonical mode)
guidance_scale Type: numberDefault: 9Range: 1 - 15
Guidance Scale for text-to-video generation
frames_per_second Default: 8
Frames per second (8 or 24, only applicable in canonical mode)
video_guidance_scale Type: numberDefault: 5Range: 1 - 15
Video Guidance Scale
Output Schema

Output

Type: string • Format: uri

Example Execution Logs 
0%|          | 0/16 [00:00<?, ?it/s]
  6%|▋         | 1/16 [00:08<02:01,  8.13s/it]
 12%|█▎        | 2/16 [00:17<02:01,  8.69s/it]
 19%|█▉        | 3/16 [00:27<02:03,  9.46s/it]
 25%|██▌       | 4/16 [00:38<02:01, 10.13s/it]
 31%|███▏      | 5/16 [00:50<01:58, 10.73s/it]
 38%|███▊      | 6/16 [01:02<01:52, 11.27s/it]
 44%|████▍     | 7/16 [01:15<01:46, 11.81s/it]
 50%|█████     | 8/16 [01:29<01:38, 12.33s/it]
 56%|█████▋    | 9/16 [01:43<01:30, 12.94s/it]
 62%|██████▎   | 10/16 [01:58<01:21, 13.57s/it]
 69%|██████▉   | 11/16 [02:13<01:10, 14.17s/it]
 75%|███████▌  | 12/16 [02:30<00:59, 14.82s/it]
 81%|████████▏ | 13/16 [02:47<00:46, 15.45s/it]
 88%|████████▊ | 14/16 [03:05<00:32, 16.16s/it]
 94%|█████████▍| 15/16 [03:23<00:16, 16.83s/it]
100%|██████████| 16/16 [03:42<00:00, 17.58s/it]
100%|██████████| 16/16 [03:42<00:00, 13.92s/it]
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
- Avoid using `tokenizers` before the fork if possible
- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
Version Details
Version ID
8e221e66498a52bb3a928a4b49d85379c99ca60fec41511265deec35d547c1fb
Version Created
October 10, 2024
Run on Replicate →