nateraw/zephyr-7b-beta 🔢📝 → 📝

▶️ 5.7K runs 📅 Oct 2023 ⚙️ Cog 0.8.6 🔗 GitHub 📄 Paper ⚖️ License

code-generation question-answering text-generation

About

Zephyr-7B-beta, an LLM trained to act as a helpful assistant.

Example Output

Prompt:

"Write me an itinerary for my dog's birthday party"

Output

Dog's Birthday Party Itinerary:

Introduction and Greetings (5-10 minutes)

Welcome guests and ask them to introduce themselves and their furry friends
Explain the rules and expectations for the party (no aggressive dogs, no jumping on people or other dogs, no stealing of toys or treats)
Introduce the birthday dog and let them explore their surroundings

Games and Activities (30 minutes)

Fetch: Set up a designated area for fetch, and have some volunteers toss a ball or Frisbee to the birthday dog and let the other dogs have a turn
Tug-of-war: Using a strong rope, tie a knot at each end and let the dogs have a pull. You could also use a toy like a chew rope or a tennis ball tied to the rope
Puzzle Feeders: Set up some puzzle feeders with treats inside, and let the dogs work to figure out how to get the treats out

Doggie Cupcakes and Treats (15 minutes)

Bake or buy some dog-friendly cupcakes and treats, and let the dogs enjoy a sweet treat
You could also set up a DIY treat station, where guests can make their own doggie cupcakes or treats using ingredients like peanut butter, oats, and bananas

Birthday Wishes and Gifts (15 minutes)

Let the birthday dog open their presents, and have the guests cheer and applaud
Ask the guests to share their birthday wishes for the birthday dog

Farewell and Thank Yous (10 minutes)

Thank the guests for coming and for making the birthday party a success
Ask everyone to clean up after themselves and their dogs, and to say goodbye to the birthday dog

Tips:

Make sure all the dogs are comfortable around each other and that there are no aggressive dogs present
Provide plenty of water and shade for the dogs
Have some toys and balls on hand for the dogs to play with
Don't forget to have some cleanup supplies like poop bags and wet wipes
Make sure the birthday dog gets plenty of attention and love throughout the party
If you're having a large group, consider hiring a professional dog trainer to help manage the dogs and ensure

Performance Metrics

6.45s Prediction Time

8.63s Total Time

All Input Parameters

{
  "top_k": 50,
  "top_p": 0.95,
  "prompt": "Write me an itinerary for my dog's birthday party",
  "temperature": 0.8,
  "max_new_tokens": 512,
  "prompt_template": "<|system|>\n</s>\n<|user|>\n{prompt}</s>\n<|assistant|>\n",
  "presence_penalty": 0,
  "frequency_penalty": 0
}

Input Parameters

top_k Type: integerDefault: 50: The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).
top_p Type: numberDefault: 0.95: A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).
prompt (required) Type: string
temperature Type: numberDefault: 0.8: The value used to modulate the next token probabilities.
max_new_tokens Type: integerDefault: 512: The maximum number of tokens the model should generate as output.
prompt_template Type: stringDefault: <|system|> </s> <|user|> {prompt}</s> <|assistant|>: The template used to format the prompt. The input prompt is inserted into the template using the `{prompt}` placeholder.
presence_penalty Type: numberDefault: 0: Presence penalty
frequency_penalty Type: numberDefault: 0: Frequency penalty

Output Schema

Output

Type: array • Items Type: string

Example Execution Logs

Generated 512 tokens in 6.390033006668091 seconds.

Version Details

Version ID: b79f33de5c6c4e34087d44eaea4a9d98ce5d3f3a09522f7328eea0685003a931
Version Created: October 31, 2023

Run on Replicate →