antoinelyset/openhermes-2.5-mistral-7b 🔢📝 → 📝

▶️ 12.1K runs 📅 Nov 2023 ⚙️ Cog 0.8.6
chat chat-completion code-generation question-answering text-generation text-translation

Example Output

Prompt:

"[
{
"role": "system",
"content": "You are a helpful assistant."
},
{
"role": "user",
"content": "What is Slite?"
}
]"

Output

Slite is a cloud-based knowledge management platform designed to help teams organize, share, and collaborate on important information and documents. It allows users to create, edit, and search for documents, notes, and files in one centralized location. Slite is commonly used for internal communication, knowledge sharing, and project management within organizations.

Performance Metrics

3.18s Prediction Time
4.86s Total Time
All Input Parameters
{
  "top_k": 50,
  "top_p": 0.9,
  "prompt": "[\n      {\n        \"role\": \"system\",\n        \"content\": \"You are a helpful assistant.\"\n      },\n      {\n        \"role\": \"user\",\n        \"content\": \"What is Slite?\"\n      }\n    ]",
  "temperature": 0.75,
  "max_new_tokens": 512
}
Input Parameters
top_k Type: integerDefault: 50Range: 0 - ∞
When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens
top_p Type: numberDefault: 0.9Range: 0 - 1
When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
prompt (required) Type: string
The JSON stringified of the messages (array of objects with role/content like OpenAI) to predict on
temperature Type: numberDefault: 0.75Range: 0.01 - 5
Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
max_new_tokens Type: integerDefault: 512Range: 1 - ∞
Max new tokens
Output Schema

Output

Type: arrayItems Type: string

Example Execution Logs
The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
Setting `pad_token_id` to `eos_token_id`:32000 for open-end generation.
Version Details
Version ID
d7ccd25700fb11c1787c25b580ac8d715d2b677202fe54b77f9b4a1eb7d73e2b
Version Created
November 7, 2023
Run on Replicate →