tomasruizt/apollo-7b-multiturn 🔢🖼️📝 → 📝

▶️ 25 runs 📅 Dec 2024 ⚙️ Cog 0.13.6 🔗 GitHub ⚖️ License
multi-turn-chat video-qa video-question-answering video-to-text

About

Fork / Remix of Apollo 7B by Luis C. (https://replicate.com/lucataco/apollo-7b) to support multi-turn conversations.

Example Output

Output

Yes

Performance Metrics

0.83s Prediction Time
0.84s Total Time
All Input Parameters
{
  "top_p": 0.7,
  "video": "https://replicate.delivery/pbxt/M9kGHuJMeAKZs0eSbaEk6hCc7zqY4Tg94IxWwDpC5hRiuBPY/astro.mp4",
  "messages": "[\n    {\"role\": \"user\", \"content\": \"Is there a dog in the video?\"}, \n    {\"role\": \"assistant\", \"content\": \"No\"},\n    {\"role\": \"user\", \"content\": \"Is there an astronaut in the video?\"}\n]",
  "temperature": 0.4,
  "max_new_tokens": 256
}
Input Parameters
top_p Type: numberDefault: 0.7Range: 0 - 1
Top-p sampling probability
video (required) Type: string
Input video file
messages Type: stringDefault: [{"role": "user", "content": "Describe this video in detail"}]
Question or prompt about the video
temperature Type: numberDefault: 0.4Range: 0.1 - 2
Sampling temperature
max_new_tokens Type: integerDefault: 256Range: 32 - 1024
Maximum number of tokens to generate
Output Schema

Output

Type: string

Example Execution Logs
Full prompt: 'A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: You are provided the following series of three, 2 second clips from a 0:00:05.375000 [H:MM:SS] video.
0.0-1.5 seconds: <|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|>,
1.7-3.2 seconds: <|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|>,
3.3-4.8 seconds: <|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|><|video_token|>
Is there a dog in the video? ASSISTANT: No<|endoftext|>USER: Is there an astronaut in the video? ASSISTANT:'
/root/.pyenv/versions/3.11.10/lib/python3.11/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
warnings.warn(
/root/.pyenv/versions/3.11.10/lib/python3.11/site-packages/torch/utils/checkpoint.py:61: UserWarning: None of the inputs have requires_grad=True. Gradients will be None
warnings.warn(
The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
Version Details
Version ID
1120d3a705916a77c094d3bfc180089f6a4e46f840218bd1663b00b889da2951
Version Created
December 28, 2024
Run on Replicate →