ritabratamaiti/instructmix-llama-3b 📝🔢 → 📝

▶️ 172 runs 📅 Aug 2023 ⚙️ Cog 0.8.6
text-generation

About

InstructMix Llama 3B is a language model fine-tuned on the InstructMix dataset.

Example Output

Output

The meaning of life is an age-old question that has been debated by philosophers, scientists, and religious leaders for centuries. Some believe that life has a purpose, while others believe that it is simply a random occurrence. Ultimately, the meaning of life is a personal journey that each individual must discover for themselves.

Performance Metrics

17.28s Prediction Time
414.59s Total Time
All Input Parameters
{
  "top_k": 40,
  "top_p": 0.75,
  "num_beams": 4,
  "instruction": "What is the meaning of life?",
  "temperature": 0.1,
  "max_new_tokens": 128
}
Input Parameters
input Type: string
Optional context or input for the task. Used to generate a prompt if format_prompt is True.
top_k Type: integerDefault: 40Range: 1 - 100
The number of highest probability vocabulary tokens to keep for top-k-filtering (minimum: 1; maximum: 100)
top_p Type: numberDefault: 0.75Range: 0.01 - 1
When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens (minimum: 0.01; maximum: 1)
num_beams Type: integerDefault: 4Range: 1 - 10
Number of beams for beam search (minimum: 1; maximum: 10)
instruction (required) Type: string
Describes the task the model should perform. Must be provided if format_prompt is True.
temperature Type: numberDefault: 0.1Range: 0.01 - 5
Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic. (minimum: 0.01; maximum: 5)
max_new_tokens Type: integerDefault: 128Range: 1 - 512
Maximum number of new tokens to generate. A word is 2-3 tokens. (minimum: 1; maximum: 512)
response_prefix Type: string
Optional response prefix. It will be added to the beginning of the response and will help guide the response generation.
repetition_penalty Type: numberDefault: 1.1Range: 0.01 - 5
Penalize repeated words. (minimum: 0.01; maximum: 5)
Output Schema

Output

Type: string

Version Details
Version ID
a5631f2884c9e16bc7018f060da3e63c1eef0e549e97ff21337f8605b6dab24e
Version Created
August 10, 2023
Run on Replicate →