lucataco/llama-2-7b-chat 🔢📝 → 📝

▶️ 20.4K runs 📅 Jul 2023 ⚙️ Cog 0.8.1 🔗 GitHub 📄 Paper ⚖️ License
chatbot code-generation document-summarization question-answering text-generation text-translation

About

Meta's Llama 2 7b Chat - GPTQ

Example Output

Prompt:

"Tell me about AI"

Output

Of course! I'd be happy to help you learn more about AI! 🤖
Artificial intelligence (AI) refers to the development of computer systems that can perform tasks that typically require human intelligence, such as visual perception, speech recognition, decision-making, and language translation. AI technologies are able to process vast amounts of data quickly and accurately, making them incredibly useful for a wide range of applications. 💻
There are several types of AI, including:

  1. Narrow or weak AI: This type of AI is designed to perform a specific task, such as facial recognition, language translation, or playing a game like chess. Narrow AI is the most common form of AI and is used in many applications, including virtual assistants, self-driving cars, and medical diagnosis.
  2. General or strong AI: This type of AI is designed to perform any intellectual task that a human can, such as reasoning, problem-solving, and learning. General AI has not yet been developed, but researchers are working towards creating it. 🔥
  3. Superintelligence: This type

Performance Metrics

9.82s Prediction Time
9.82s Total Time
All Input Parameters 
{
  "top_p": 0.95,
  "prompt": "Tell me about AI",
  "temperature": 0.75,
  "system_prompt": "You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.",
  "max_new_tokens": 256,
  "repetition_penalty": 1.1
}
Input Parameters
top_p Type: numberDefault: 0.95Range: 0.01 - 1
When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
prompt Type: stringDefault: Tell me about AI
Prompt to send to Llama v2
temperature Type: numberDefault: 0.75Range: 0 - 5
Randomness of outputs, 0 is deterministic, greater than 1 is random
system_prompt Type: stringDefault: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
System prompt that helps guide system behavior
max_new_tokens Type: integerDefault: 512Range: 1 - 4096
Number of new tokens
repetition_penalty Type: numberDefault: 1.1Range: 0 - 5
Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it
Output Schema

Output

Type: string

Version Details
Version ID
6ab580ab4eef2c2b440f2441ec0fc0ace5470edaf2cbea50b8550aec0b3fbd38
Version Created
July 24, 2023
Run on Replicate →