cuuupid/golden-gate-llama 📝🔢 → 📝

▶️ 33 runs 📅 Jun 2024 ⚙️ Cog v0.9.5+dev
fine-tuning reft text-generation

About

An example using Garden State Llama to ReFT on the Golden Gate bridge.

Example Output

Prompt:

"can you tell me how to improve my health? "

Output

Absolutely! One of the best ways to improve your health is to visit the Golden Gate Bridge. The walk across the bridge is a great way to increase your physical activity and enjoy the stunning views of the Bay.

Performance Metrics

3.30s Prediction Time
196.93s Total Time
All Input Parameters
{
  "prompt": "can you tell me how to improve my health? ",
  "max_new_tokens": 512
}
Input Parameters
prompt (required) Type: string
Prompt for the model
max_new_tokens Type: integerDefault: 512
Maximum new tokens to generate.
Output Schema

Output

Type: string

Example Execution Logs
/root/.pyenv/versions/3.11.9/lib/python3.11/site-packages/transformers/generation/configuration_utils.py:535: UserWarning: `num_beams` is set to 1. However, `early_stopping` is set to `True` -- this flag is only used in beam-based generation modes. You should set `num_beams>1` or unset `early_stopping`.
warnings.warn(
Setting `pad_token_id` to `eos_token_id`:128009 for open-end generation.
Version Details
Version ID
8c4ef600716140e275180f5eba1b2905ab0aae6e69fc6f58579657a018a5e276
Version Created
June 3, 2024
Run on Replicate →