replicate/flan-t5-small ✓🔢📝 → 📝

▶️ 730 runs 📅 Apr 2023 ⚙️ Cog 0.7.0-beta17 🔗 GitHub 📄 Paper ⚖️ License
document-summarization text-generation text-translation

About

A small language model for tasks like classification, summarization, and more.

Example Output

Prompt:

"Q: Answer the following yes/no question by reasoning step-by-step. Can a dog drive a car?"

Output

Dogs are mammals. Dogs are not mammals. Therefore, the final answer is no.

Performance Metrics

0.81s Prediction Time
306.67s Total Time
All Input Parameters
{
  "debug": false,
  "top_p": 1,
  "prompt": "Q: Answer the following yes/no question by reasoning step-by-step. Can a dog drive a car?",
  "max_length": 50,
  "temperature": 0.75,
  "repetition_penalty": 1
}
Input Parameters
debug Type: booleanDefault: false
provide debugging output in logs
top_p Type: numberDefault: 1Range: 0.01 - 1
When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
prompt (required) Type: string
Prompt to send to FLAN-T5.
max_length Type: integerDefault: 50Range: 1 - ∞
Maximum number of tokens to generate. A word is generally 2-3 tokens
temperature Type: numberDefault: 0.75Range: 0.01 - 5
Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
repetition_penalty Type: numberDefault: 1Range: 0.01 - 5
Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.
Output Schema

Output

Type: arrayItems Type: string

Version Details
Version ID
d76ce8f0610c0ac215caec685e7e2f4b488ae57239e640617ca11087580db2c3
Version Created
April 5, 2023
Run on Replicate →