replicate/gpt-j-6b 🔢📝❓ → 📝
About
A large language model by EleutherAI
Example Output
Prompt:
"Is a hot dog a sandwich?"
Output
A. Yes, it is a sandwich because it's eaten between two pieces of bread or other edible products and served in the same way as sandwiches. An open-faced sandwich would be an example
Performance Metrics
1.92s
Prediction Time
2.11s
Total Time
All Input Parameters
{
"top_k": 50,
"top_p": 1,
"prompt": "Is a hot dog a sandwich?",
"decoding": "top_p",
"max_length": 50,
"temperature": 0.75,
"repetition_penalty": 1.2
}
Input Parameters
- top_k
- Valid if you choose top_k decoding. The number of highest probability vocabulary tokens to keep for top-k-filtering
- top_p
- Valid if you choose top_p decoding. When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
- prompt (required)
- Input Prompt.
- decoding
- Choose a decoding method
- max_length
- Maximum number of tokens to generate. A word is generally 2-3 tokens
- temperature
- Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
- repetition_penalty
- Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.
Output Schema
Output
Example Execution Logs
The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results. Setting `pad_token_id` to `eos_token_id`:50256 for open-end generation.
Version Details
- Version ID
b3546aeec6c9891f0dd9929c2d3bedbf013c12e02e7dd0346af09c37e008c827- Version Created
- April 6, 2023