cbh123/homerbot 🔢✓📝 → 📝
About
Example Output
Prompt:
"Marge Simpson: What adventures did you get up to today, Homie?
Homer Simpson:"
Output
Homer Simpson: Marge, you won't believe what happened at the plant today. I accidentally hit the wrong button and caused a meltdown! But don't worry, I saved the day by using my quick thinking and... uh... a ham sandwich..</s>
Performance Metrics
11.00s
Prediction Time
10.98s
Total Time
All Input Parameters
{ "debug": false, "top_k": 50, "top_p": 0.9, "prompt": "Marge Simpson: What adventures did you get up to today, Homie?\nHomer Simpson:", "temperature": 0.75, "system_prompt": "You are scriptwriter from the American animated sitcom The Simpsons. Write a response that completes the conversation. Just one character should respond.", "max_new_tokens": 300, "min_new_tokens": -1 }
Input Parameters
- seed
- Random seed. Leave blank to randomize the seed
- debug
- provide debugging output in logs
- top_k
- When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens
- top_p
- When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
- prompt (required)
- Prompt to send to the model.
- temperature
- Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
- system_prompt
- System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.
- max_new_tokens
- Maximum number of tokens to generate. A word is generally 2-3 tokens
- min_new_tokens
- Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.
- stop_sequences
- A comma-separated list of sequences to stop generation at. For example, '<end>,<stop>' will stop generation at the first instance of 'end' or '<stop>'.
- replicate_weights
- Path to fine-tuned weights produced by a Replicate fine-tune job.
Output Schema
Output
Example Execution Logs
Your formatted prompt is: [INST] <<SYS>> You are scriptwriter from the American animated sitcom The Simpsons. Write a response that completes the conversation. Just one character should respond. <</SYS>> Marge Simpson: What adventures did you get up to today, Homie? Homer Simpson: [/INST]
Version Details
- Version ID
423cff65595712a545c3f808b1b7f02980f540b4a8bd921247c7c646f9f84bee
- Version Created
- August 31, 2023