video-to-audio AI Models

🤖 Model 🎥

nicolascoutureau/video-utils

Edit and convert videos from an input video, image, or zipped frames, returning video, GIF, audio, or extracted frames....

🎥 • video-editing • video-to-video • video-to-audio • 5.6M runs

🤖 Model 🎥

zsxkib/mmaudio

Generate synchronized environmental sounds and sound effects from a video input. Produce context-aware audio aligned to...

🎥 • video-to-audio • sound-effect-generation • 3.8M runs

🤖 Model 🎥

zsxkib/thinksound

Generate contextual audio for videos from a video input with optional text guidance, returning a video with a synchroniz...

🎥 • video-to-audio • sound-effect-generation • 6.3K runs

🤖 Model 🎥

lucataco/extract-audio

Extract audio from a video file. Accepts a video input and returns an audio file in mp3, wav, aac, m4a, or ogg. Control...

🎥 • video-to-audio • audio-extraction • 664 runs

🤖 Model 🎥

acappemin/video-to-audio-and-piano

Generate synchronized audio for a video from a video input and optional text prompt, with an option to produce piano acc...

🎥 • video-to-audio • music-generation • sound-effect-generation • 138 runs

🤖 Model 🎥

zsxkib/mmaudio-t4

Add synchronized environmental sound and foley to videos based on visual content. Accepts a video and an optional text p...

🎥 • video-to-audio • image-to-audio • 1.6K runs

🤖 Model 🎥

tencent/hunyuanvideo-foley

Generate synchronized Foley sound effects from a video input and optional text prompt. Condition on visual content and s...

🎥 • video-to-audio • sound-effect-generation • foley • 6.7K runs

🤖 Model 📝 → 🔊

acappemin/deepaudio-v1

Generate speech and soundtracks from a video input. Condition speech on a provided transcript (text) and optionally a re...

📝 → 🔊 • video-to-audio • text-to-speech • 63 runs

🤖 Model 🎥

amaai-lab/video2music

Generate background music from a video input. Analyze visual and affective cues with an Affective Multimodal Transformer...

🎥 • video-to-audio • music-generation • 1.2K runs

🤖 Model 🔊

zsxkib/hibiki

Translate spoken French to English in real time while preserving the original speaker’s voice, returning English speech...

🔊 • speech-translation • audio-to-audio • 17 runs

🤖 Model 🎥

hexiaochun/video2mp3

Extract audio from a video input and return an MP3 file. Provide a single video and receive the soundtrack as audio for...

🎥 • video-to-audio • 87 runs

🤖 Model 🎥

mirelo/video-to-sfx

Generate synced sound effects for a silent video and return the video with a new soundtrack. Take a video input (max 10s...

🎥 • video-to-audio • sound-effect-generation • 2.2K runs

🤖 Model 🎥

mirelo/video-to-sfx-v1

Generate synchronized sound effects for a silent video and return the video with a new soundtrack. Accepts a video (up t...

🎥 • video-to-audio • sound-effect-generation • 2.6K runs

🤖 Model 🎥

mirelo/video-to-sfx-v1.5

Generate synchronized sound effects for silent videos and return the video with a new soundtrack. Takes a video input (u...

🎥 • video-to-audio • sound-effect-generation • 1.1K runs

🤖 Model 📝 → 🔊

lucataco/interactiveomni-8b

Processes multiple inputs simultaneously including images, audio, text, and video to generate coherent text and speech r...

📝 → 🔊 • text-generation • image-to-text • video-to-text • 86 runs