dsingal0/mixtral-single-gpu 🔢📝 → 📝
About
Runs Mixtral 8x7B on a single A40 GPU
Example Output
"Tell me the story of the boy who cried wolf."
Output
Once upon a time, in a small village, there lived a lonely shepherer boy named Samuel. He was known to be mischievous and often played pranks on the villagers.
One day, Samuel thought of a new prank to play on the villagers. He cried out, "Wolf! Wolf! The sheeps are being attacked by a wolf!" The villagers were startled and rushed to help Samuel, but when they arrived, they found that there was no wolf and Samuel was laughing at their reactions.
The villagers were not happy with Samuel's prank, but they decided to let it go this time. However, Samuel thought that the villagers' reactions were very funny, and he decided to play the same prank again the next day.
Once again, Samuel cried out, "Wolf! Wolf! The sheeps are being attacked by a wolf!" The villagers were once again startled and rushed to help, only to find that Samuel was once again laughing at their reactions.
The villagers were getting frustrated with Samuel's constant pranks, but they didn't want to encourage him by scolding him too much. They warned him that if he kept playing pranks, they would not believe him in case of a real emergency.
Days passed, and Samuel continued to play his pranks, crying "Wolf!" whenever he felt like it. But the villagers were now cautious and did not believe him. One day, while Samuel was tending to his sheep, a real wolf appeared and attacked the herd. Samuel cried out in terror, "Wolf! Wolf! A real wolf is attacking my sheeps!"
The villagers heard Samuel's cries, but they did not believe him, assuming it was just another one of his pranks. They did not come to help, and the wolf was able to attack and kill many of Samuel's sheep before it finally left.
Samuel was left alone with his few remaining sheep, feeling foolish and ashamed. He had learned a valuable lesson about the consequences of lying and playing pranks. The villagers eventually forgave him, but they never forgot the time when the boy who cried wolf lost his herd because no one believed him.
So the story of the boy who cried wolf serves as a reminder to always tell the truth, even if it's not what people want to hear, because lying and playing
Performance Metrics
All Input Parameters
{
"top_k": 50,
"top_p": 0.9,
"prompt": "Tell me the story of the boy who cried wolf.",
"temperature": 0.6,
"max_new_tokens": 512
}
Input Parameters
- top_k
- The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).
- top_p
- A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).
- prompt (required)
- temperature
- The value used to modulate the next token probabilities.
- max_new_tokens
- The maximum number of tokens the model should generate as output.
Output Schema
Output
Example Execution Logs
=== Formatted Prompt === Tell me the story of the boy who cried wolf. ========================
Version Details
- Version ID
8b31ec594c950df05731f41c8badf570a44caff114591e0234ac01d8a6f4cd10- Version Created
- January 25, 2024