adirik/mamba-370m 🔢📝 → 📝
About
Base version of Mamba 370M, a 370 million parameter state space language model
Example Output
Prompt:
"How are you doing today?"
Output
I'm fine. I just got a call from my boss, and he said that they're going to be closing down the store for a while because of the economy."
"Oh," she says with a smile as she looks at her watch again "Well it's not too late then?" She asks him in an attempt to lighten up his mood somewhat before continuing on about her day work duties which include cleaning the shelves behind one countertop after another until finally getting around back into the kitchen
"Oh," she says with a smile as she looks at her watch again "Well it's not too late then?" She asks him in an attempt to lighten up his mood somewhat before continuing on about her day work duties which include cleaning the shelves behind one countertop after another until finally getting around back into the kitchen
Performance Metrics
5.26s
Prediction Time
128.05s
Total Time
All Input Parameters
{
"top_k": 1,
"top_p": 1,
"prompt": "How are you doing today?",
"max_length": 100,
"temperature": 1,
"repetition_penalty": 1.2
}
Input Parameters
- seed
- The seed for the random number generator
- top_k
- When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.
- top_p
- When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.
- prompt (required)
- Text prompt to send to the model.
- max_length
- Maximum number of tokens to generate. A word is generally 2-3 tokens.
- temperature
- Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
- repetition_penalty
- Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.
Output Schema
Output
Version Details
- Version ID
e6a271d772f0eef0703af2d246e45bace40ce365e04a7bf464af66bf548852c7- Version Created
- February 5, 2024