tomasmcm/sensei-7b-v1 📝🔢 → 📝

▶️ 38 runs 📅 Jan 2024 ⚙️ Cog 0.8.6 📄 Paper ⚖️ License
data-analysis document-summarization information-retrieval question-answering retrieval-augmented-generation text-generation web-search

About

Source: SciPhi/Sensei-7B-V1 ✦ Quant: TheBloke/Sensei-7B-V1-AWQ ✦ Sensei is specialized in performing RAG over detailed web search results

Example Output

Prompt:

"

Instruction: Your task is to perform retrieval augmented generation (RAG) over the given query and search results. Return your answer in a json format that includes a summary of the search results and a list of related queries.

Query:
What is Obama's middle name?

Search Results:

  1. Title: Obama's Middle Name -- My Last Name -- is 'Hussein.' So?
    URL: https://www.cair.com/cair_in_the_news/obamas-middle-name-my-last-name-is-hussein-so/
    Text: I wasn’t sure whether to laugh or cry a few days back listening to radio talk show host Bill Cunningham repeatedly scream Barack Obamas middle name — my last name — as if he had anti-Muslim Tourette’s. “Hussein,” Cunningham hissed like he was beckoning Satan when shouting the ...

  2. Title: What's up with Obama's middle name? - Quora
    URL: https://www.quora.com/Whats-up-with-Obamas-middle-name
    Text: Answer (1 of 15): A better question would be, “What’s up with Obama’s first name?” President Barack Hussein Obama’s father’s name was Barack Hussein Obama. He was named after his father. Hussein, Obamas middle name, is a very common Arabic name, meaning "good," "handsome," or ...

  3. Title: Barack Obama | Biography, Parents, Education, Presidency, Books, ...
    URL: https://www.britannica.com/biography/Barack-Obama
    Text: Barack Obama, in full Barack Hussein Obama II, (born August 4, 1961, Honolulu, Hawaii, U.S.), 44th president of the United States (2009–17) and the first African American to hold the office. Before winning the presidency, Obama represented Illinois in the U.S.

Query:
What is Obama's middle name?

Response:

{"summary":

"

Output

"
Barack Obama's middle name is "Hussein", which is also a common Arabic name meaning "good" or "handsome" [2]. This name holds personal significance as it was inherited from his father, also named Barack Hussein Obama, who was born in Kenya [1][3]. During his presidency, Obama's full name, Barack Hussein Obama II, was frequently used, emphasizing his heritage and cultural background [3]. However, due to political and cultural dynamics, his middle name sometimes attracted attention and became a subject of debate and speculation [1].

In summary, Barack Obama's middle name is "Hussein," reflecting his family lineage and his African heritage, which played a role in the historical context of his presidency.

", "other_queries": ["Political implications of Barack Obama's middle name", "Barack Obama's upbringing and cultural identity", "Barack Obama's response to questions about his middle name", "Influence of Obama's middle name on his presidential campaign", "Barack Obama's legacy and his middle name"]}

Performance Metrics

5.27s Prediction Time
5.35s Total Time
All Input Parameters
{
  "stop": "### Instruction:",
  "top_k": -1,
  "top_p": 0.95,
  "prompt": "### Instruction: Your task is to perform retrieval augmented generation (RAG) over the given query and search results. Return your answer in a json format that includes a summary of the search results and a list of related queries.\n\nQuery:\nWhat is Obama's middle name?\n\nSearch Results:\n1. Title: Obama's Middle Name -- My Last Name -- is 'Hussein.' So?\nURL: https://www.cair.com/cair_in_the_news/obamas-middle-name-my-last-name-is-hussein-so/\nText: I wasn’t sure whether to laugh or cry a few days back listening to radio talk show host Bill Cunningham repeatedly scream Barack <strong>Obama</strong>’<strong>s</strong> <strong>middle</strong> <strong>name</strong> — my last <strong>name</strong> — as if he had anti-Muslim Tourette’s. “Hussein,” Cunningham hissed like he was beckoning Satan when shouting the ...\n\n2. Title: What's up with Obama's middle name? - Quora\nURL: https://www.quora.com/Whats-up-with-Obamas-middle-name\nText: Answer (1 of 15): A better question would be, “What’s up with <strong>Obama</strong>’s first <strong>name</strong>?” President Barack Hussein <strong>Obama</strong>’s father’s <strong>name</strong> was Barack Hussein <strong>Obama</strong>. He was <strong>named</strong> after his father. Hussein, <strong>Obama</strong>’<strong>s</strong> <strong>middle</strong> <strong>name</strong>, is a very common Arabic <strong>name</strong>, meaning \"good,\" \"handsome,\" or ...\n\n3. Title: Barack Obama | Biography, Parents, Education, Presidency, Books, ...\nURL: https://www.britannica.com/biography/Barack-Obama\nText: Barack <strong>Obama</strong>, in full Barack Hussein <strong>Obama</strong> II, (born August 4, 1961, Honolulu, Hawaii, U.S.), 44th president of the United States (2009–17) and the first African American to hold the office. Before winning the presidency, <strong>Obama</strong> represented Illinois in the U.S.\n\n\n\nQuery:\nWhat is Obama's middle name?\n### Response:\n{\"summary\":",
  "max_tokens": 256,
  "temperature": 0.8,
  "presence_penalty": 0,
  "frequency_penalty": 0
}
Input Parameters
stop Type: string
List of strings that stop the generation when they are generated. The returned output will not contain the stop strings.
top_k Type: integerDefault: -1
Integer that controls the number of top tokens to consider. Set to -1 to consider all tokens.
top_p Type: numberDefault: 0.95Range: 0.01 - 1
Float that controls the cumulative probability of the top tokens to consider. Must be in (0, 1]. Set to 1 to consider all tokens.
prompt (required) Type: string
Text prompt to send to the model.
max_tokens Type: integerDefault: 128
Maximum number of tokens to generate per output sequence.
temperature Type: numberDefault: 0.8Range: 0.01 - 5
Float that controls the randomness of the sampling. Lower values make the model more deterministic, while higher values make the model more random. Zero means greedy sampling.
presence_penalty Type: numberDefault: 0Range: -5 - 5
Float that penalizes new tokens based on whether they appear in the generated text so far. Values > 0 encourage the model to use new tokens, while values < 0 encourage the model to repeat tokens.
frequency_penalty Type: numberDefault: 0Range: -5 - 5
Float that penalizes new tokens based on their frequency in the generated text so far. Values > 0 encourage the model to use new tokens, while values < 0 encourage the model to repeat tokens.
Output Schema

Output

Type: string

Example Execution Logs
Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.20s/it]
Generated 256 tokens in 5.2037529945373535 seconds.
Version Details
Version ID
53d592d6093d707ef58328051d289721dd2d1d56d55231e1165dd5d0cf55cfc6
Version Created
January 19, 2024
Run on Replicate →