music-understanding AI Models

🤖 Model 🔊

zsxkib/audio-flamingo-3

Analyze audio and answer questions about speech, music, and sound effects. Accepts an audio file and an optional text pr...

🔊 • speech-to-text • music-understanding • audio-analysis • 3.1K runs

🤖 Model 🔊

aiviostudio/salmonn-2025

Generate natural-language descriptions of audio from an input audio file and a guiding text prompt. Perform music analys...

🔊 • audio-to-text • music-understanding • 47 runs

🤖 Model 🔊

aiviostudio/salmonn

Caption and analyze audio and music from an audio file using a text prompt. Provide free-form text responses to instruct...

🔊 • audio-to-text • music-understanding • 86 runs

🤖 Model 🔊

pengdaqian2020/music-label

Classify music audio into genre and instrument tags from an input audio clip. Takes an audio file and returns a list of...

🔊 • music-understanding • audio-classification • instrument-recognition • 198 runs

🤖 Model 🔊

mtg/music-approachability-engagement

Classify music approachability and engagement from an audio file or YouTube URL. Return either binary labels (low/high),...

🔊 • music-understanding • audio-classification • 40.1K runs

🤖 Model 🔊

mtg/effnet-discogs

Classify music style and genre from audio. Accepts an audio file or YouTube link and predicts the top-N Discogs styles (...

🔊 • music-understanding • audio-classification • music-genre-classification • 321.0K runs

🤖 Model 🔊

bytedance/piano-transcription

Transcribe piano audio into MIDI note events. Accepts a piano recording and outputs a MIDI file with polyphonic notes, o...

🔊 • music-understanding • music-transcription • audio-to-midi • 4.3K runs

🤖 Model 🔊

sakemin/all-in-one-music-structure-analyzer

Analyze music structure from an audio file. Return tempo (BPM), beats, downbeats, segment boundaries, and functional seg...

🔊 • music-understanding • audio-embedding • 72.4K runs

🤖 Model

mtg/music-arousal-valence

Predict arousal and valence (music emotion) from an audio input. Accepts an audio file or YouTube URL and returns either...

music-understanding • music-emotion-recognition • 9.1K runs

🤖 Model 🔊

mtg/music-classifiers

Classify music by genre, mood, and instrumentation from an audio file or YouTube URL. Analyze audio using transfer-learn...

🔊 • music-understanding • audio-classification • 10.9K runs

🤖 Model 🔊

cwalo/all-in-one-music-structure-analysis

Analyze music to extract song structure, tempo (BPM), and downbeats, and optionally separate stems. Takes an audio file...

🔊 • music-understanding • music-source-separation • audio-embedding • 707 runs

🤖 Model 🔊

turian/multi-task-music-transcription

Transcribe music audio into MIDI. Accepts an audio file and outputs a MIDI transcription capturing pitches, onsets, and...

🔊 • music-transcription • audio-to-midi • music-understanding • 168 runs

🤖 Model 🔊

mtg/maest

Classify music into up to 400 styles from an audio file or YouTube link, returning the top-N predictions as a bar-chart...

🔊 • music-understanding • audio-classification • music-genre-classification • 9.4K runs

🤖 Model

mtg/essentia-bpm

Estimate tempo (BPM) from an audio file or YouTube URL. Run Essentia’s tempo algorithms—degara, multifeature, percival,...

music-understanding • tempo-estimation • 18.5K runs

🤖 Model

erickluis00/all-in-one-audio

Analyze music structure and separate stems from a music audio input. Uses Harmonix models for structure analysis and Dem...

music-understanding • music-source-separation • 88.9K runs

🤖 Model 🔊

riffgen/auto-tune

Auto-tune vocals from an input audio file, returning a pitch-corrected audio track and an optional pitch-correction visu...

🔊 • audio-to-audio • pitch-correction • 90 runs

🤖 Model 🔊

rhelsing/basic-pitch

Transcribe musical audio into MIDI. Accepts an audio file and outputs a MIDI file with note events, capturing pitch, ons...

🔊 • audio-to-midi • music-understanding • 13.1K runs

🤖 Model 🔊

e7mac/omnizart

Transcribe music from an audio input to MIDI. Choose modes for piano transcription (music-piano, music-piano-v2), multi-...

🔊 • music-understanding • music-transcription • audio-to-midi • 290 runs

🤖 Model 🔊

xavriley/sax_transcription

Transcribe saxophone solos from audio or YouTube links into MIDI and MusicXML sheet music. Accept an audio file or YouTu...

🔊 • music-transcription • music-understanding • audio-to-midi • 207 runs