video-to-text AI Models

🤖 Model 🎥

chenxwh/cogvlm2-video

Caption and answer questions about videos. Accepts a video and a text prompt and returns text outputs such as descriptio...

🎥 • video-to-text • video-auto-captioning • 664.1K runs

🤖 Model 🎥

uncensored-com/llava-next-video

Answer questions about a video and generate detailed descriptions from a video input. Takes a video and a natural-langua...

🎥 • video-to-text • video-analysis • 3.6K runs

🤖 Model 🎥

lucataco/apollo-7b

Answer questions about videos. Take a video and a text prompt, then generate text answers, detailed captions, summaries,...

🎥 • video-to-text • video-question-answering • 124.8K runs

🤖 Model 🎥

lucataco/videollama3-7b

Analyze videos and return text responses to prompts. Takes a video and a text prompt as input and outputs text for video...

🎥 • video-to-text • video-auto-captioning • 8.3K runs

🤖 Model 🎥

n1jl0091/video-llava-7b-hf_replicate_n1jl0091

Answer questions and generate descriptions from video input. Provide one or more videos and a text prompt, and receive t...

🎥 • video-to-text • video-question-answering • 112 runs

🤖 Model 🖼️ → 📝

lucataco/qwen2-vl-7b-instruct

Generate captions, answers, and summaries for images and videos. Accepts an image or video plus a text prompt and output...

🖼️ → 📝 • image-to-text • video-to-text • ocr • 262.9K runs

🤖 Model 🎥

aodianyun/qwen2-vl-7b

Generate text descriptions and answers about video content from a video input. Accept a video plus an optional prompt (d...

🎥 • video-to-text • 1.6K runs

🤖 Model 🎥

cuuupid/qwen2-vl-2b

Generate text from a video input. Take a video and an instruction prompt, and return captions, summaries, or answers to...

🎥 • video-to-text • video-auto-captioning • 601 runs

🤖 Model 🎥

aodianyun/qwen2-vl-2b

Caption and answer questions about videos. Accepts a video and an optional text prompt (instruction or question) and ret...

🎥 • video-to-text • video-auto-captioning • 130 runs

🤖 Model 🖼️ → 📝

sai88uk/minicpm-v-45-v9

Answer questions about images and videos, perform OCR, and describe scenes, returning text. Accepts an image or a video...

🖼️ → 📝 • image-to-text • video-to-text • ocr • 2.5K runs

🤖 Model 🖼️ → 📝

lucataco/minicpm-v-4

Analyze images and videos to generate captions, answer visual questions, and summarize scenes. Accepts an image or a vid...

🖼️ → 📝 • image-to-text • video-to-text • ocr • 229 runs

🤖 Model

jigsawstack/speech-to-text

Transcribe speech from audio or video into text. Outputs a full transcript with optional per-segment timestamps and spea...

speech-to-text • speaker-diarization • 6 runs

🤖 Model 🎥

tomasruizt/apollo-7b-multiturn

Answer questions about videos in multi-turn conversations. Accepts a video and a chat message history, and returns text...

🎥 • video-to-text • video-auto-captioning • video-question-answering • 25 runs

🤖 Model 🖼️ → 📝

aodianyun/minicpm-v-26

Caption images and videos. Take an image or video plus an optional prompt and return text that describes the visual cont...

🖼️ → 📝 • image-to-text • video-to-text • 15 runs

🤖 Model 🖼️ → 📝

hexiaochun/minicpm_v26

Generate text descriptions and answers from an input image or video. Accept an optional instruction or question prompt t...

🖼️ → 📝 • image-to-text • video-to-text • visual-question-answering • 518 runs

🤖 Model 🖼️ → 📝

aodianyun/minicpm-v-26-int4

Generate text descriptions for images and videos. Accepts a single image or video plus an optional instruction prompt, a...

🖼️ → 📝 • image-to-text • video-to-text • 12 runs

🤖 Model 🎥

lucataco/apollo-3b

Answer questions about videos and generate detailed descriptions from a video input and a text prompt. Handle long-form...

🎥 • video-to-text • video-question-answering • 142 runs

🤖 Model 🎥

turian/dover-video-quality-assessment

Assess video quality from a video input, returning separate aesthetic, technical, and overall scores. Use to evaluate us...

🎥 • video-quality-assessment • 28 runs

🤖 Model 📝 → 🔊

lucataco/qwen2.5-omni-7b

Process text, images, audio, and video inputs to generate text and speech responses simultaneously. Features a novel Thi...

📝 → 🔊 • text-generation • image-to-text • video-to-text • 32.9K runs

🤖 Model 🎥

basord/lip-reading-ai-vsr

Transcribe speech from silent or muted videos into text using visual speech recognition (lip reading). Accepts a video c...

🎥 • video-to-text • lip-reading • visual-speech-recognition • 10.7K runs