adirik/mamba-790m 🔢📝 → 📝

▶️ 117 runs 📅 Feb 2024 ⚙️ Cog 0.9.4 🔗 GitHub 📄 Paper ⚖️ License

document-summarization question-answering text-generation

About

Base version of Mamba 790M, a 790 million parameter state space language model

Example Output

Prompt:

"How are you doing today?"

Output

I'm good. I just got back from the doctor's office, and he said that my blood pressure is normal for me at this age... so it was a little bit of an adjustment to get used too but overall everything has been great! So thank God!! :)<|endoftext|>Q:

tag in HTML5 not working properly with IE9

// works fine in all

Performance Metrics

8.32s Prediction Time

92.24s Total Time

All Input Parameters

{
  "top_k": 1,
  "top_p": 1,
  "prompt": "How are you doing today?",
  "max_length": 100,
  "temperature": 1,
  "repetition_penalty": 1.2
}

Input Parameters

seed Type: integer: The seed for the random number generator
top_k Type: integerDefault: 1: When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens.
top_p Type: numberDefault: 1Range: 0.01 - 1: When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens.
prompt (required) Type: string: Text prompt to send to the model.
max_length Type: integerDefault: 100Range: 1 - 5000: Maximum number of tokens to generate. A word is generally 2-3 tokens.
temperature Type: numberDefault: 1Range: 0.1 - 5: Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
repetition_penalty Type: numberDefault: 1.2Range: 0.01 - 10: Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.

Output Schema

Output

Type: array • Items Type: string

Version Details

Version ID: 77782448285ebc03a24c2e90cc12b6cebbdaf325c071eaee2e315320308d9748
Version Created: February 5, 2024

Run on Replicate →