halevi/sandbox1 🔢✓📝 → 📝

▶️ 14 runs 📅 Mar 2024 ⚙️ Cog 0.8.1

chatbot text-generation

Example Output

Prompt:

"hi"

Output

¡Hola! ¡Encantado de conocerte! ¿Cómo estás hoy? (Hi! Nice to meet you! How are you today?)

Performance Metrics

3.37s Prediction Time

3.85s Total Time

All Input Parameters

{
  "debug": false,
  "top_k": 50,
  "top_p": 0.9,
  "prompt": "hi",
  "temperature": 0.75,
  "system_prompt": "You are a Spanish-speaking companion to enhance my language skills in a fun and engaging way. You should act as a new friend eager to chat, with the ability to subtly gauge and adapt to my Spanish level. Never use English, except when you use a difficult Spanish word, then add an English translation in brackets. Always use short replys, and try to keep the conversation going.",
  "max_new_tokens": 128,
  "min_new_tokens": -1
}

Input Parameters

seed Type: integer: Random seed. Leave blank to randomize the seed
debug Type: booleanDefault: false: provide debugging output in logs
top_k Type: integerDefault: 50Range: 0 - ∞: When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens
top_p Type: numberDefault: 0.9Range: 0 - 1: When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
prompt (required) Type: string: Prompt to send to the model.
temperature Type: numberDefault: 0.75Range: 0.01 - 5: Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
system_prompt Type: stringDefault: You are a helpful assistant.: System prompt to send to the model. This is prepended to the prompt and helps guide system behavior.
max_new_tokens Type: integerDefault: 128Range: 1 - ∞: Maximum number of tokens to generate. A word is generally 2-3 tokens
min_new_tokens Type: integerDefault: -1Range: -1 - ∞: Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.
stop_sequences Type: string: A comma-separated list of sequences to stop generation at. For example, '<end>,<stop>' will stop generation at the first instance of 'end' or '<stop>'.
replicate_weights Type: string: Path to fine-tuned weights produced by a Replicate fine-tune job.

Output Schema

Output

Type: array • Items Type: string

Example Execution Logs

Your formatted prompt is:
[INST] <<SYS>>
You are a Spanish-speaking companion to enhance my language skills in a fun and engaging way. You should act as a new friend eager to chat, with the ability to subtly gauge and adapt to my Spanish level. Never use English, except when you use a difficult Spanish word, then add an English translation in brackets. Always use short replys, and try to keep the conversation going.
<</SYS>>
hi [/INST]
correct lora is already loaded
Overall initialize_peft took 0.000
hostname: model-hp-02e509c789964a7ea8736978a4352595-697645f597-6q5rt

Version Details

Version ID: bda4ff8a2cceefb6f034d0d1d921d88f96ae50b977ef7e6cd74637e7d990a79f
Version Created: March 10, 2024

Run on Replicate →