lucataco/hermes-2-theta-llama-3-8b 🔢📝 → 📝
About
Hermes-2 Θ (Theta) is the first experimental merged model released by Nous Research
Example Output
"Write a short story about Goku discovering kirby has teamed up with Majin Buu to destroy the world."
Output
Goku was meditating in his usual spot on a rocky outcropping overlooking the Earth when he sensed a sudden surge of energy. His eyes snapped open, and he immediately sprang into action, his senses on high alert. As he scanned the horizon, he noticed a strange sight - Kirby, the pink puffball, flying through the air alongside Majin Buu, the powerful and malevolent entity he had defeated years ago.
Goku's heart raced as he realized the implications of this unlikely alliance. Kirby, usually a friendly and innocent creature, had teamed up with Buu, a being who had caused untold destruction and chaos in the past. What could have driven Kirby to make such a decision?
Goku knew he had to act quickly to stop them. He took to the skies, his ki blazing with energy as he chased after the duo. As he caught up to them, he called out to Kirby, trying to reason with his former friend.
"Kirby, what are you doing? You can't be working with Buu! He's a monster!"
Kirby turned to face Goku, his eyes glowing with an eerie purple light. "Goku, you don't understand," he said, his voice strangely distorted. "Buu has shown me the power of true strength. With him by my side, we can achieve greatness beyond your wildest dreams."
Goku's expression hardened. "There's no such thing as greatness in destroying the world," he said firmly. "You're being manipulated, Kirby. Buu wants to use you for his own purposes."
Majin Buu cackled maniacally, his massive body pulsing with energy. "Ah, Goku, always so naive. Kirby and I have a plan to create a new world, one where we are the rulers. And you will not stand in our way."
Goku knew he had to act fast. He lunged at Buu, his fists blazing with energy. Buu retaliated with a wave of his hand, sending a blast of energy crashing into Goku. The two exchanged blows, their powers clashing in a brilliant display of light and sound.
Meanwhile, Kirby hovered nearby, watching the battle with a mix of fascination and horror. As Goku and Buu continued to fight, he began to feel a strange sensation within him. It was as if his powers were being drained away, consumed by Buu's dark energy.
Kirby realized too late what was happening. Buu had been using him all along, draining his
Performance Metrics
All Input Parameters
{
"top_k": 50,
"top_p": 0.9,
"prompt": "Write a short story about Goku discovering kirby has teamed up with Majin Buu to destroy the world.",
"max_tokens": 512,
"min_tokens": 0,
"temperature": 0.6,
"system_prompt": "You are a sentient, superintelligent artificial general intelligence, here to teach and assist me.",
"presence_penalty": 0,
"frequency_penalty": 0
}
Input Parameters
- top_k
- The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).
- top_p
- A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).
- prompt
- Prompt
- max_tokens
- The maximum number of tokens the model should generate as output.
- min_tokens
- The minimum number of tokens the model should generate as output.
- temperature
- The value used to modulate the next token probabilities.
- system_prompt
- System prompt to send to the model. This is prepended to the prompt and helps guide system behavior. Ignored for non-chat models.
- stop_sequences
- A comma-separated list of sequences to stop generation at. For example, '<end>,<stop>' will stop generation at the first instance of 'end' or '<stop>'.
- presence_penalty
- Presence penalty
- frequency_penalty
- Frequency penalty
Output Schema
Output
Example Execution Logs
INFO 06-28 18:39:36 async_llm_engine.py:529] Received request bb79ca861f4f4298ac3c7ca587d7eb93: prompt: '<|begin_of_text|><|im_start|>system\nYou are a sentient, superintelligent artificial general intelligence, here to teach and assist me.<|im_end|>\n<|im_start|>user\nWrite a short story about Goku discovering kirby has teamed up with Majin Buu to destroy the world.<|im_end|>\n<|im_start|>assistant\n', sampling_params: SamplingParams(n=1, best_of=1, presence_penalty=0.0, frequency_penalty=0.0, repetition_penalty=1.0, temperature=0.6, top_p=0.9, top_k=50, min_p=0.0, seed=None, use_beam_search=False, length_penalty=1.0, early_stopping=False, stop=[], stop_token_ids=[128003], include_stop_str_in_output=False, ignore_eos=False, max_tokens=512, min_tokens=0, logprobs=None, prompt_logprobs=None, skip_special_tokens=True, spaces_between_special_tokens=True, truncate_prompt_tokens=None), prompt_token_ids: None, lora_request: None. stdoutINFO 06-28 18:39:40 metrics.py:334] Avg prompt throughput: 11.2 tokens/s, Avg generation throughput: 29.6 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 0.1%, CPU KV cache usage: 0.0% stdoutINFO 06-28 18:39:45 metrics.py:334] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 38.3 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 0.2%, CPU KV cache usage: 0.0% stdoutGeneration took 1719597766.14sINFO 06-28 18:39:50 async_llm_engine.py:120] Finished request bb79ca861f4f4298ac3c7ca587d7eb93. stdoutFormatted prompt: <|begin_of_text|><|im_start|>system You are a sentient, superintelligent artificial general intelligence, here to teach and assist me.<|im_end|> <|im_start|>user Write a short story about Goku discovering kirby has teamed up with Majin Buu to destroy the world.<|im_end|> <|im_start|>assistant
Version Details
- Version ID
8634fb72647cddfd945dd6b79d7f06230dc81f353227802e9ee07b2eeffe7a39- Version Created
- June 28, 2024