zsxkib/lil-flan-bias-logits-warper 📝🔢 → 📝

▶️ 47 runs 📅 Jun 2023 ⚙️ Cog 0.7.2 🔗 GitHub 📄 Paper ⚖️ License
controlled-text-generation logit-biasing text-generation

About

Logit Warping via Biases for Google's FLAN-T5-small

Example Output

Prompt:

"Hello, my name is "

Output

Greg Gregg

Performance Metrics

0.08s Prediction Time
0.05s Total Time
All Input Parameters
{
  "prompt": "Hello, my name is ",
  "bias_dict_str": "{\"Greg\": 6}",
  "max_output_len": 64
}
Input Parameters
prompt (required) Type: string
Prompt for language model
bias_dict_str Type: stringDefault: {}
Dictionary mapping from strings to bias values
max_output_len Type: integerDefault: 64Range: 1 - 512
Maximum length of output
Output Schema

Output

Type: string

Version Details
Version ID
d637845923a17f849360dd6b6359d478fd78a2fb096be77f3df54b04cb2f0936
Version Created
June 19, 2023
Run on Replicate →