Models tagged "audio-to-video"

🤖 Model 📝 → 🎥

wan-video/wan-2.5-t2v

Generate videos with audio from a text prompt. Produce 5–10 second clips at 480p, 720p, or 1080p across six aspect ratio...

📝 → 🎥 • text-to-video-with-audio • multilingual • 24.7K runs

🤖 Model 🎥

wan-video/wan-2.2-s2v

Generate lip-synced character video from an audio clip and a reference image. Animate a still portrait into speech or si...

🎥 • audio-to-video • lipsync • video-consistent-character-generation • 4.3K runs

🤖 Model 🎥

fofr/audio-to-waveform

Generate a waveform video from an audio file. Convert music, podcasts, or voice tracks into a bar-style audio visualizer...

🎥 • audio-to-video • audio-visualizer • 383.6K runs

🤖 Model 📝 → 🎥

wan-video/wan-2.5-t2v-fast

Generate short videos from a text prompt, optimized for fast turnaround. Optionally condition on an input audio clip to...

📝 → 🎥 • text-to-video • audio-to-video • 18.7K runs

🤖 Model 🖼️ → 🎥

lucataco/talking-avatar

Generate talking avatars by combining an input image of a person and an audio file for lip synchronization. The model in...

🖼️ → 🎥 • talking-avatar • lip-sync • video-generation • 291 runs

🤖 Model 🖼️ → 🎥

lucataco/stable-avatar

Generate audio-driven talking avatar videos from a single reference image and an input audio track. Synchronize lip move...

🖼️ → 🎥 • lipsync • image-to-video-with-audio • video-consistent-character-generation • 206 runs

🤖 Model 🖼️ → 🎥

cjwbw/aniportrait-audio2vid

Generate a talking-head video with audio from a single portrait image and an audio track. Animate the face with audio-dr...

🖼️ → 🎥 • lipsync • image-to-video-with-audio • 14.7K runs

🤖 Model 🎥

camenduru/emage

Generate co-speech gesture animations from audio input using expressive masked audio gesture modeling. This model output...

🎥 • gesture-generation • audio-to-video • co-speech-gestures • 109 runs

🤖 Model 🎥

pipeline-examples/talking-avatar

Generate lip-synced talking avatar videos from an input image and audio file, suitable for UGC, TikTok, and Reels conten...

🎥 • lip-sync • talking-avatar • video-generation • 1 runs

🤖 Model

ddvinh1/audio-lip

Generate lip-synced talking-head video from a face image or face video and an audio track. Align mouth movements to spee...

lipsync • 86 runs

🤖 Model 🖼️ → 🎥

zsxkib/multitalk

Generate conversational talking‑head videos from a reference image and one or two audio tracks. Provide an image with on...

🖼️ → 🎥 • lipsync • image-to-video-with-audio • audio-to-video • 2.3K runs

🤖 Model 🎥

stefan-st/face-diffuser

Generate lip-synced talking-head video from speech audio. Animate a preset face identity (F1–F8, M1–M6) with an optional...

🎥 • audio-to-video • lipsync • 205 runs

🤖 Model 🖼️ → 🎥

bytedance/omni-human

Generate talking or singing videos from a single image and an audio clip. Provide a portrait, half-body, or full-body im...

🖼️ → 🎥 • lipsync • image-to-video • 144.2K runs

🤖 Model 🎥

yuanxunlu/livespeechportraits

Generate lip-synced talking-head videos from an input audio clip. Provide a driving audio file (only the first 20 second...

🎥 • lipsync • audio-to-video • 9.8K runs

🤖 Model 🖼️ → 🎥

lucataco/img-and-audio2video

Create a video from a still image and an audio track. Provide one image and one audio file; the model loops the image fo...

🖼️ → 🎥 • audio-to-video • image-to-video • 10.5K runs

🤖 Model 🎥

zsxkib/memo

Generate talking head videos from a single image and an audio clip. Animate lip movements and emotion-aligned facial exp...

🎥 • lipsync • audio-to-video • talking-head • 986 runs

🤖 Model 📝 → 🎥

zsxkib/humo

Generate short videos from a text prompt, optionally syncing lip movements and body motion to an input audio track. Acce...

📝 → 🎥 • text-to-video • lipsync • video-consistent-character-generation • 61 runs

🤖 Model 🎥

cjwbw/sadtalker

Animate a single image into a lip-synced talking-head video from an audio clip. Provide a source portrait and speech aud...

🎥 • lipsync • audio-to-video • 145.8K runs

🤖 Model 🎥

cyberdude/stable-diffusion-dance

Generate audio-reactive video frames from a text prompt and an audio file. Use a Stable Diffusion pipeline to synthesize...

🎥 • audio-to-video • music-visualization • 7 runs

🤖 Model 📝 → 🎥

voodoohop/stable-diffusion-dance

Generate audio‑reactive video from text prompts and an input audio file. Provide one or multiple newline‑separated promp...

📝 → 🎥 • text-to-video • audio-to-video • audio-reactive • 21 runs