niron1/llama-2-7b-chat 🔢📝 → 📝

▶️ 292 runs 📅 Aug 2023 ⚙️ Cog 0.8.0-beta3 🔗 GitHub 📄 Paper

chatbot code-generation question-answering text-generation

About

LLAMA-2 7b chat version by Meta. Stream support. Unaltered prompt. Temperature working properly. Economical hardware.

Example Output

Prompt:

"can ducks fly?"

Output

No, ducks cannot fly. However, they are excellent swimmers and can glide through the water with ease.

Performance Metrics

0.77s Prediction Time

0.73s Total Time

All Input Parameters

{
  "seed": -1,
  "prompt": "can ducks fly?",
  "temperature": 0.9,
  "max_new_tokens": 1000,
  "repetition_penalty": 1.1
}

Input Parameters

seed Type: integerDefault: -1: random number seed, -1=generate
prompt Type: stringDefault: Can ducks fly?: prompt
temperature Type: numberDefault: 0.9: temperature
max_new_tokens Type: integerDefault: 1000: max_new_tokens
repetition_penalty Type: numberDefault: 1.1: repetition_penalty

Output Schema

Output

Type: array • Items Type: string

Example Execution Logs

seed 1692285339
33333 can du 33333
33333 cks f 33333
33333 ly?  33333
1111 1111
33333 No, du 33333
2222 No, du 2222
33333 cks can 33333
2222 cks can 2222
33333 not f 33333
2222 not f 2222
33333 ly. Howev 33333
2222 ly. Howev 2222
33333 er, t 33333
2222 er, t 2222
33333 hey  33333
2222 hey 2222
33333 are excell 33333
2222 are excell 2222
33333 ent swimm33333
2222 ent swimm 2222
33333 ers  33333
2222 ers  2222
33333 and  33333
2222 and  2222
33333can gl 33333
2222 can gl 2222
33333 ide thro33333
2222 ide thro 2222
33333 ugh  33333
2222 ugh 2222
33333 the wa 33333
2222 the wa 2222
33333 ter w 33333
2222 ter w 2222
33333 ith ea 33333
2222 ith ea 2222
33333 s 33333
2222 s 2222
33333 e.
33333
2222 e.
 2222

Version Details

Version ID: 944b1de13c7c0449b96c4d7e14a1318ed2dd36628a1b478d23b39eea80fa918c
Version Created: September 8, 2023

Run on Replicate →