cjwbw/lorahub 🔢📝 → 🖼️

▶️ 86 runs 📅 Aug 2023 ⚙️ Cog 0.8.5 🔗 GitHub 📄 Paper ⚖️ License
few-shot-learning lora-composition text-lora-training

About

Efficient Cross-Task Generalization via Dynamic LoRA Composition

Example Output

Output

Example output

Performance Metrics

146.18s Prediction Time
150.51s Total Time
All Input Parameters
{
  "example_inputs": "Infer the date from context.  Q: Today, 8/3/1997, is a day that we will never forget. What is the date one week ago from today in MM/DD/YYYY? Options: (A) 03/27/1998 (B) 09/02/1997 (C) 07/27/1997 (D) 06/29/1997 (E) 07/27/1973 (F) 12/27/1997 A:\nInfer the date from context.  Q: May 6, 1992 is like yesterday to Jane, but that is actually ten years ago. What is the date tomorrow in MM/DD/YYYY? Options: (A) 04/16/2002 (B) 04/07/2003 (C) 05/07/2036 (D) 05/28/2002 (E) 05/07/2002 A:\nInfer the date from context.  Q: Today is the second day of the third month of 1966. What is the date one week ago from today in MM/DD/YYYY? Options: (A) 02/26/1966 (B) 01/13/1966 (C) 02/02/1966 (D) 10/23/1966 (E) 02/23/1968 (F) 02/23/1966 A:",
  "example_outputs": "(C)\n(E)\n(F)",
  "max_inference_step": 40,
  "num_random_lora_modules": 20
}
Input Parameters
seed Type: integer
Random seed. Leave blank to randomize the seed.
example_inputs Type: stringDefault: Infer the date from context. Q: Today, 8/3/1997, is a day that we will never forget. What is the date one week ago from today in MM/DD/YYYY? Options: (A) 03/27/1998 (B) 09/02/1997 (C) 07/27/1997 (D) 06/29/1997 (E) 07/27/1973 (F) 12/27/1997 A: Infer the date from context. Q: May 6, 1992 is like yesterday to Jane, but that is actually ten years ago. What is the date tomorrow in MM/DD/YYYY? Options: (A) 04/16/2002 (B) 04/07/2003 (C) 05/07/2036 (D) 05/28/2002 (E) 05/07/2002 A: Infer the date from context. Q: Today is the second day of the third month of 1966. What is the date one week ago from today in MM/DD/YYYY? Options: (A) 02/26/1966 (B) 01/13/1966 (C) 02/02/1966 (D) 10/23/1966 (E) 02/23/1968 (F) 02/23/1966 A:
List of input examples, one Line one input.
example_outputs Type: stringDefault: (C) (E) (F)
List of output examples, one Line one output.
max_inference_step Type: integerDefault: 40Range: 10 - 100
Maximum iteration steps to maximise LoRA module composition. We suggest setting it to 40 steps if 20 modules were chosen, with more steps typically needed for more modules.
lora_modules_specified Type: string
Specify LoRA modules for the composition, options are from https://huggingface.co/models?search=lorahub, separated modules with comma, e.g. 'lorahub/flan_t5_large-quarel_logic_test, lorahub/flan_t5_large-coqa'
num_random_lora_modules Type: integerDefault: 20Range: 2 - 196
Set number of LoRA modules to use. Ignored if specified modules above.
Output Schema

Output

Type: stringFormat: uri

Example Execution Logs
Using seed: 15460
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.08MB/s]
Downloading (…)lve/main/config.json:   0%|          | 0.00/662 [00:00<?, ?B/s]
Downloading (…)lve/main/config.json: 100%|██████████| 662/662 [00:00<00:00, 2.15MB/s]
Downloading model.safetensors:   0%|          | 0.00/3.13G [00:00<?, ?B/s]
Downloading model.safetensors:   0%|          | 10.5M/3.13G [00:00<00:47, 65.2MB/s]
Downloading model.safetensors:   1%|          | 21.0M/3.13G [00:00<00:44, 70.0MB/s]
Downloading model.safetensors:   1%|          | 31.5M/3.13G [00:00<00:39, 78.7MB/s]
Downloading model.safetensors:   1%|▏         | 41.9M/3.13G [00:00<00:36, 85.2MB/s]
Downloading model.safetensors:   2%|▏         | 52.4M/3.13G [00:00<00:36, 85.3MB/s]
Downloading model.safetensors:   2%|▏         | 62.9M/3.13G [00:00<00:36, 85.2MB/s]
Downloading model.safetensors:   2%|▏         | 73.4M/3.13G [00:00<00:35, 85.7MB/s]
Downloading model.safetensors:   3%|▎         | 83.9M/3.13G [00:01<00:34, 87.7MB/s]
Downloading model.safetensors:   3%|▎         | 94.4M/3.13G [00:01<00:33, 90.0MB/s]
Downloading model.safetensors:   3%|▎         | 105M/3.13G [00:01<00:33, 90.5MB/s] 
Downloading model.safetensors:   4%|▎         | 115M/3.13G [00:01<00:32, 91.4MB/s]
Downloading model.safetensors:   4%|▍         | 126M/3.13G [00:01<00:32, 91.4MB/s]
Downloading model.safetensors:   4%|▍         | 136M/3.13G [00:01<00:32, 91.7MB/s]
Downloading model.safetensors:   5%|▍         | 147M/3.13G [00:01<00:33, 90.4MB/s]
Downloading model.safetensors:   5%|▌         | 157M/3.13G [00:01<00:34, 85.8MB/s]
Downloading model.safetensors:   5%|▌         | 168M/3.13G [00:01<00:34, 86.6MB/s]
Downloading model.safetensors:   6%|▌         | 178M/3.13G [00:02<00:33, 87.3MB/s]
Downloading model.safetensors:   6%|▌         | 189M/3.13G [00:02<00:33, 88.4MB/s]
Downloading model.safetensors:   6%|▋         | 199M/3.13G [00:02<00:32, 89.7MB/s]
Downloading model.safetensors:   7%|▋         | 210M/3.13G [00:02<00:32, 90.7MB/s]
Downloading model.safetensors:   7%|▋         | 220M/3.13G [00:02<00:32, 90.5MB/s]
Downloading model.safetensors:   7%|▋         | 231M/3.13G [00:02<00:31, 91.1MB/s]
Downloading model.safetensors:   8%|▊         | 241M/3.13G [00:02<00:31, 91.8MB/s]
Downloading model.safetensors:   8%|▊         | 252M/3.13G [00:02<00:31, 90.5MB/s]
Downloading model.safetensors:   8%|▊         | 262M/3.13G [00:02<00:31, 89.7MB/s]
Downloading model.safetensors:   9%|▊         | 273M/3.13G [00:03<00:31, 90.1MB/s]
Downloading model.safetensors:   9%|▉         | 283M/3.13G [00:03<00:31, 90.2MB/s]
Downloading model.safetensors:   9%|▉         | 294M/3.13G [00:03<00:31, 91.1MB/s]
Downloading model.safetensors:  10%|▉         | 304M/3.13G [00:03<00:30, 91.9MB/s]
Downloading model.safetensors:  10%|█         | 315M/3.13G [00:03<00:30, 92.4MB/s]
Downloading model.safetensors:  10%|█         | 325M/3.13G [00:03<00:30, 92.7MB/s]
Downloading model.safetensors:  11%|█         | 336M/3.13G [00:03<00:29, 93.3MB/s]
Downloading model.safetensors:  11%|█         | 346M/3.13G [00:03<00:29, 93.2MB/s]
Downloading model.safetensors:  11%|█▏        | 357M/3.13G [00:04<00:30, 92.2MB/s]
Downloading model.safetensors:  12%|█▏        | 367M/3.13G [00:04<00:29, 93.4MB/s]
Downloading model.safetensors:  12%|█▏        | 377M/3.13G [00:04<00:29, 92.1MB/s]
Downloading model.safetensors:  12%|█▏        | 388M/3.13G [00:04<00:29, 91.9MB/s]
Downloading model.safetensors:  13%|█▎        | 398M/3.13G [00:04<00:30, 91.1MB/s]
Downloading model.safetensors:  13%|█▎        | 409M/3.13G [00:04<00:29, 91.6MB/s]
Downloading model.safetensors:  13%|█▎        | 419M/3.13G [00:04<00:29, 92.0MB/s]
Downloading model.safetensors:  14%|█▎        | 430M/3.13G [00:04<00:29, 91.9MB/s]
Downloading model.safetensors:  14%|█▍        | 440M/3.13G [00:04<00:29, 91.7MB/s]
Downloading model.safetensors:  14%|█▍        | 451M/3.13G [00:05<00:29, 90.0MB/s]
Downloading model.safetensors:  15%|█▍        | 461M/3.13G [00:05<00:29, 89.2MB/s]
Downloading model.safetensors:  15%|█▌        | 472M/3.13G [00:05<00:30, 86.7MB/s]
Downloading model.safetensors:  15%|█▌        | 482M/3.13G [00:05<00:31, 84.6MB/s]
Downloading model.safetensors:  16%|█▌        | 493M/3.13G [00:05<00:30, 87.5MB/s]
Downloading model.safetensors:  16%|█▌        | 503M/3.13G [00:05<00:29, 89.3MB/s]
Downloading model.safetensors:  16%|█▋        | 514M/3.13G [00:05<00:30, 87.0MB/s]
Downloading model.safetensors:  17%|█▋        | 524M/3.13G [00:05<00:30, 86.0MB/s]
Downloading model.safetensors:  17%|█▋        | 535M/3.13G [00:06<00:29, 88.6MB/s]
Downloading model.safetensors:  17%|█▋        | 545M/3.13G [00:06<00:28, 89.8MB/s]
Downloading model.safetensors:  18%|█▊        | 556M/3.13G [00:06<00:28, 90.2MB/s]
Downloading model.safetensors:  18%|█▊        | 566M/3.13G [00:06<00:28, 90.0MB/s]
Downloading model.safetensors:  18%|█▊        | 577M/3.13G [00:06<00:28, 88.7MB/s]
Downloading model.safetensors:  19%|█▊        | 587M/3.13G [00:06<00:28, 88.8MB/s]
Downloading model.safetensors:  19%|█▉        | 598M/3.13G [00:06<00:28, 89.2MB/s]
Downloading model.safetensors:  19%|█▉        | 608M/3.13G [00:06<00:27, 91.1MB/s]
Downloading model.safetensors:  20%|█▉        | 619M/3.13G [00:06<00:27, 91.8MB/s]
Downloading model.safetensors:  20%|██        | 629M/3.13G [00:07<00:27, 91.3MB/s]
Downloading model.safetensors:  20%|██        | 640M/3.13G [00:07<00:27, 90.4MB/s]
Downloading model.safetensors:  21%|██        | 650M/3.13G [00:07<00:27, 89.4MB/s]
Downloading model.safetensors:  21%|██        | 661M/3.13G [00:07<00:28, 85.4MB/s]
Downloading model.safetensors:  21%|██▏       | 671M/3.13G [00:07<00:29, 83.9MB/s]
Downloading model.safetensors:  22%|██▏       | 682M/3.13G [00:07<00:28, 86.0MB/s]
Downloading model.safetensors:  22%|██▏       | 692M/3.13G [00:07<00:27, 87.4MB/s]
Downloading model.safetensors:  22%|██▏       | 703M/3.13G [00:07<00:27, 87.3MB/s]
Downloading model.safetensors:  23%|██▎       | 713M/3.13G [00:08<00:27, 88.4MB/s]
Downloading model.safetensors:  23%|██▎       | 724M/3.13G [00:08<00:27, 88.5MB/s]
Downloading model.safetensors:  23%|██▎       | 734M/3.13G [00:08<00:26, 89.8MB/s]
Downloading model.safetensors:  24%|██▍       | 744M/3.13G [00:08<00:27, 86.8MB/s]
Downloading model.safetensors:  24%|██▍       | 755M/3.13G [00:08<00:26, 88.6MB/s]
Downloading model.safetensors:  24%|██▍       | 765M/3.13G [00:08<00:26, 89.8MB/s]
Downloading model.safetensors:  25%|██▍       | 776M/3.13G [00:08<00:27, 85.9MB/s]
Downloading model.safetensors:  25%|██▌       | 786M/3.13G [00:08<00:26, 87.3MB/s]
Downloading model.safetensors:  25%|██▌       | 797M/3.13G [00:08<00:26, 88.5MB/s]
Downloading model.safetensors:  26%|██▌       | 807M/3.13G [00:09<00:26, 87.9MB/s]
Downloading model.safetensors:  26%|██▌       | 818M/3.13G [00:09<00:26, 87.9MB/s]
Downloading model.safetensors:  26%|██▋       | 828M/3.13G [00:09<00:26, 87.8MB/s]
Downloading model.safetensors:  27%|██▋       | 839M/3.13G [00:09<00:26, 87.9MB/s]
Downloading model.safetensors:  27%|██▋       | 849M/3.13G [00:09<00:26, 87.7MB/s]
Downloading model.safetensors:  27%|██▋       | 860M/3.13G [00:09<00:25, 88.5MB/s]
Downloading model.safetensors:  28%|██▊       | 870M/3.13G [00:09<00:25, 87.5MB/s]
Downloading model.safetensors:  28%|██▊       | 881M/3.13G [00:09<00:25, 87.4MB/s]
Downloading model.safetensors:  28%|██▊       | 891M/3.13G [00:10<00:26, 84.6MB/s]
Downloading model.safetensors:  29%|██▉       | 902M/3.13G [00:10<00:26, 83.0MB/s]
Downloading model.safetensors:  29%|██▉       | 912M/3.13G [00:10<00:27, 82.2MB/s]
Downloading model.safetensors:  29%|██▉       | 923M/3.13G [00:10<00:27, 81.8MB/s]
Downloading model.safetensors:  30%|██▉       | 933M/3.13G [00:10<00:26, 83.2MB/s]
Downloading model.safetensors:  30%|███       | 944M/3.13G [00:10<00:26, 81.2MB/s]
Downloading model.safetensors:  30%|███       | 954M/3.13G [00:10<00:26, 83.8MB/s]
Downloading model.safetensors:  31%|███       | 965M/3.13G [00:10<00:25, 84.1MB/s]
Downloading model.safetensors:  31%|███       | 975M/3.13G [00:11<00:25, 83.3MB/s]
Downloading model.safetensors:  31%|███▏      | 986M/3.13G [00:11<00:25, 84.7MB/s]
Downloading model.safetensors:  32%|███▏      | 996M/3.13G [00:11<00:25, 83.3MB/s]
Downloading model.safetensors:  32%|███▏      | 1.01G/3.13G [00:11<00:25, 84.3MB/s]
Downloading model.safetensors:  32%|███▏      | 1.02G/3.13G [00:11<00:24, 86.6MB/s]
Downloading model.safetensors:  33%|███▎      | 1.03G/3.13G [00:11<00:24, 86.4MB/s]
Downloading model.safetensors:  33%|███▎      | 1.04G/3.13G [00:11<00:24, 84.9MB/s]
Downloading model.safetensors:  33%|███▎      | 1.05G/3.13G [00:11<00:24, 83.8MB/s]
Downloading model.safetensors:  34%|███▍      | 1.06G/3.13G [00:12<00:24, 85.5MB/s]
Downloading model.safetensors:  34%|███▍      | 1.07G/3.13G [00:12<00:23, 86.6MB/s]
Downloading model.safetensors:  34%|███▍      | 1.08G/3.13G [00:12<00:23, 88.1MB/s]
Downloading model.safetensors:  35%|███▍      | 1.09G/3.13G [00:12<00:23, 87.1MB/s]
Downloading model.safetensors:  35%|███▌      | 1.10G/3.13G [00:12<00:22, 88.8MB/s]
Downloading model.safetensors:  35%|███▌      | 1.11G/3.13G [00:12<00:22, 89.3MB/s]
Downloading model.safetensors:  36%|███▌      | 1.12G/3.13G [00:12<00:22, 90.0MB/s]
Downloading model.safetensors:  36%|███▌      | 1.13G/3.13G [00:12<00:22, 90.3MB/s]
Downloading model.safetensors:  36%|███▋      | 1.14G/3.13G [00:12<00:22, 90.2MB/s]
Downloading model.safetensors:  37%|███▋      | 1.15G/3.13G [00:13<00:21, 91.0MB/s]
Downloading model.safetensors:  37%|███▋      | 1.16G/3.13G [00:13<00:21, 91.0MB/s]
Downloading model.safetensors:  37%|███▋      | 1.17G/3.13G [00:13<00:21, 91.4MB/s]
Downloading model.safetensors:  38%|███▊      | 1.18G/3.13G [00:13<00:21, 89.7MB/s]
Downloading model.safetensors:  38%|███▊      | 1.20G/3.13G [00:13<00:21, 90.1MB/s]
Downloading model.safetensors:  38%|███▊      | 1.21G/3.13G [00:13<00:21, 90.2MB/s]
Downloading model.safetensors:  39%|███▉      | 1.22G/3.13G [00:13<00:21, 89.4MB/s]
Downloading model.safetensors:  39%|███▉      | 1.23G/3.13G [00:13<00:22, 85.5MB/s]
Downloading model.safetensors:  39%|███▉      | 1.24G/3.13G [00:14<00:22, 86.1MB/s]
Downloading model.safetensors:  40%|███▉      | 1.25G/3.13G [00:14<00:21, 88.5MB/s]
Downloading model.safetensors:  40%|████      | 1.26G/3.13G [00:14<00:21, 88.6MB/s]
Downloading model.safetensors:  41%|████      | 1.27G/3.13G [00:14<00:21, 87.4MB/s]
Downloading model.safetensors:  41%|████      | 1.28G/3.13G [00:14<00:21, 86.9MB/s]
Downloading model.safetensors:  41%|████      | 1.29G/3.13G [00:14<00:21, 86.4MB/s]
Downloading model.safetensors:  42%|████▏     | 1.30G/3.13G [00:14<00:21, 87.1MB/s]
Downloading model.safetensors:  42%|████▏     | 1.31G/3.13G [00:14<00:21, 86.5MB/s]
Downloading model.safetensors:  42%|████▏     | 1.32G/3.13G [00:15<00:21, 86.2MB/s]
Downloading model.safetensors:  43%|████▎     | 1.33G/3.13G [00:15<00:20, 87.7MB/s]
Downloading model.safetensors:  43%|████▎     | 1.34G/3.13G [00:15<00:20, 88.8MB/s]
Downloading model.safetensors:  43%|████▎     | 1.35G/3.13G [00:15<00:19, 89.1MB/s]
Downloading model.safetensors:  44%|████▎     | 1.36G/3.13G [00:15<00:20, 87.5MB/s]
Downloading model.safetensors:  44%|████▍     | 1.37G/3.13G [00:15<00:19, 88.1MB/s]
Downloading model.safetensors:  44%|████▍     | 1.38G/3.13G [00:15<00:19, 87.5MB/s]
Downloading model.safetensors:  45%|████▍     | 1.39G/3.13G [00:15<00:19, 87.3MB/s]
Downloading model.safetensors:  45%|████▍     | 1.41G/3.13G [00:15<00:20, 85.9MB/s]
Downloading model.safetensors:  45%|████▌     | 1.42G/3.13G [00:16<00:19, 86.5MB/s]
Downloading model.safetensors:  46%|████▌     | 1.43G/3.13G [00:16<00:19, 88.2MB/s]
Downloading model.safetensors:  46%|████▌     | 1.44G/3.13G [00:16<00:20, 82.2MB/s]
Downloading model.safetensors:  46%|████▌     | 1.45G/3.13G [00:16<00:20, 82.8MB/s]
Downloading model.safetensors:  47%|████▋     | 1.46G/3.13G [00:16<00:19, 84.2MB/s]
Downloading model.safetensors:  47%|████▋     | 1.47G/3.13G [00:16<00:19, 84.2MB/s]
Downloading model.safetensors:  47%|████▋     | 1.48G/3.13G [00:16<00:19, 86.9MB/s]
Downloading model.safetensors:  48%|████▊     | 1.49G/3.13G [00:16<00:18, 87.1MB/s]
Downloading model.safetensors:  48%|████▊     | 1.50G/3.13G [00:17<00:18, 88.3MB/s]
Downloading model.safetensors:  48%|████▊     | 1.51G/3.13G [00:17<00:18, 88.6MB/s]
Downloading model.safetensors:  49%|████▊     | 1.52G/3.13G [00:17<00:18, 89.0MB/s]
Downloading model.safetensors:  49%|████▉     | 1.53G/3.13G [00:17<00:17, 89.3MB/s]
Downloading model.safetensors:  49%|████▉     | 1.54G/3.13G [00:17<00:18, 88.1MB/s]
Downloading model.safetensors:  50%|████▉     | 1.55G/3.13G [00:17<00:17, 89.7MB/s]
Downloading model.safetensors:  50%|████▉     | 1.56G/3.13G [00:17<00:17, 88.3MB/s]
Downloading model.safetensors:  50%|█████     | 1.57G/3.13G [00:17<00:17, 88.5MB/s]
Downloading model.safetensors:  51%|█████     | 1.58G/3.13G [00:18<00:17, 87.9MB/s]
Downloading model.safetensors:  51%|█████     | 1.59G/3.13G [00:18<00:17, 87.0MB/s]
Downloading model.safetensors:  51%|█████     | 1.60G/3.13G [00:18<00:26, 58.6MB/s]
Downloading model.safetensors:  52%|█████▏    | 1.63G/3.13G [00:18<00:20, 71.9MB/s]
Downloading model.safetensors:  52%|█████▏    | 1.64G/3.13G [00:18<00:19, 75.2MB/s]
Downloading model.safetensors:  53%|█████▎    | 1.65G/3.13G [00:18<00:18, 79.2MB/s]
Downloading model.safetensors:  53%|█████▎    | 1.66G/3.13G [00:19<00:17, 82.7MB/s]
Downloading model.safetensors:  53%|█████▎    | 1.67G/3.13G [00:19<00:17, 83.7MB/s]
Downloading model.safetensors:  54%|█████▎    | 1.68G/3.13G [00:19<00:17, 82.8MB/s]
Downloading model.safetensors:  54%|█████▍    | 1.69G/3.13G [00:19<00:17, 82.3MB/s]
Downloading model.safetensors:  54%|█████▍    | 1.70G/3.13G [00:19<00:17, 81.8MB/s]
Downloading model.safetensors:  55%|█████▍    | 1.71G/3.13G [00:19<00:17, 82.6MB/s]
Downloading model.safetensors:  55%|█████▍    | 1.72G/3.13G [00:19<00:16, 83.5MB/s]
Downloading model.safetensors:  55%|█████▌    | 1.73G/3.13G [00:19<00:16, 83.1MB/s]
Downloading model.safetensors:  56%|█████▌    | 1.74G/3.13G [00:20<00:16, 85.6MB/s]
Downloading model.safetensors:  56%|█████▌    | 1.75G/3.13G [00:20<00:16, 84.0MB/s]
Downloading model.safetensors:  56%|█████▌    | 1.76G/3.13G [00:20<00:15, 85.9MB/s]
Downloading model.safetensors:  57%|█████▋    | 1.77G/3.13G [00:20<00:15, 85.1MB/s]
Downloading model.safetensors:  57%|█████▋    | 1.78G/3.13G [00:20<00:15, 84.6MB/s]
Downloading model.safetensors:  57%|█████▋    | 1.79G/3.13G [00:20<00:15, 86.0MB/s]
Downloading model.safetensors:  58%|█████▊    | 1.80G/3.13G [00:20<00:15, 87.6MB/s]
Downloading model.safetensors:  58%|█████▊    | 1.81G/3.13G [00:21<00:22, 57.8MB/s]
Downloading model.safetensors:  58%|█████▊    | 1.82G/3.13G [00:21<00:20, 64.9MB/s]
Downloading model.safetensors:  59%|█████▉    | 1.85G/3.13G [00:21<00:15, 84.1MB/s]
Downloading model.safetensors:  59%|█████▉    | 1.86G/3.13G [00:21<00:16, 79.1MB/s]
Downloading model.safetensors:  60%|█████▉    | 1.87G/3.13G [00:21<00:16, 79.0MB/s]
Downloading model.safetensors:  60%|█████▉    | 1.88G/3.13G [00:21<00:23, 54.5MB/s]
Downloading model.safetensors:  60%|██████    | 1.89G/3.13G [00:22<00:21, 58.1MB/s]
Downloading model.safetensors:  61%|██████    | 1.91G/3.13G [00:22<00:16, 76.1MB/s]
Downloading model.safetensors:  61%|██████▏   | 1.92G/3.13G [00:22<00:15, 77.7MB/s]
Downloading model.safetensors:  62%|██████▏   | 1.93G/3.13G [00:22<00:15, 77.5MB/s]
Downloading model.safetensors:  62%|██████▏   | 1.94G/3.13G [00:22<00:15, 79.4MB/s]
Downloading model.safetensors:  62%|██████▏   | 1.95G/3.13G [00:22<00:15, 78.8MB/s]
Downloading model.safetensors:  63%|██████▎   | 1.96G/3.13G [00:22<00:14, 81.4MB/s]
Downloading model.safetensors:  63%|██████▎   | 1.97G/3.13G [00:23<00:14, 82.9MB/s]
Downloading model.safetensors:  63%|██████▎   | 1.98G/3.13G [00:23<00:13, 82.2MB/s]
Downloading model.safetensors:  64%|██████▎   | 1.99G/3.13G [00:23<00:13, 84.4MB/s]
Downloading model.safetensors:  64%|██████▍   | 2.00G/3.13G [00:23<00:13, 85.7MB/s]
Downloading model.safetensors:  64%|██████▍   | 2.01G/3.13G [00:23<00:13, 85.7MB/s]
Downloading model.safetensors:  65%|██████▍   | 2.02G/3.13G [00:23<00:12, 86.7MB/s]
Downloading model.safetensors:  65%|██████▍   | 2.03G/3.13G [00:23<00:12, 86.9MB/s]
Downloading model.safetensors:  65%|██████▌   | 2.04G/3.13G [00:23<00:12, 87.3MB/s]
Downloading model.safetensors:  66%|██████▌   | 2.06G/3.13G [00:24<00:13, 82.0MB/s]
Downloading model.safetensors:  66%|██████▌   | 2.07G/3.13G [00:24<00:12, 83.9MB/s]
Downloading model.safetensors:  66%|██████▋   | 2.08G/3.13G [00:24<00:12, 83.8MB/s]
Downloading model.safetensors:  67%|██████▋   | 2.09G/3.13G [00:24<00:12, 82.9MB/s]
Downloading model.safetensors:  67%|██████▋   | 2.10G/3.13G [00:24<00:12, 82.5MB/s]
Downloading model.safetensors:  67%|██████▋   | 2.11G/3.13G [00:24<00:12, 84.6MB/s]
Downloading model.safetensors:  68%|██████▊   | 2.12G/3.13G [00:24<00:11, 85.1MB/s]
Downloading model.safetensors:  68%|██████▊   | 2.13G/3.13G [00:24<00:11, 85.9MB/s]
Downloading model.safetensors:  68%|██████▊   | 2.14G/3.13G [00:25<00:11, 86.3MB/s]
Downloading model.safetensors:  69%|██████▊   | 2.15G/3.13G [00:25<00:11, 86.1MB/s]
Downloading model.safetensors:  69%|██████▉   | 2.16G/3.13G [00:25<00:11, 87.1MB/s]
Downloading model.safetensors:  69%|██████▉   | 2.17G/3.13G [00:25<00:11, 86.5MB/s]
Downloading model.safetensors:  70%|██████▉   | 2.18G/3.13G [00:25<00:11, 83.9MB/s]
Downloading model.safetensors:  70%|██████▉   | 2.19G/3.13G [00:25<00:11, 85.4MB/s]
Downloading model.safetensors:  70%|███████   | 2.20G/3.13G [00:25<00:10, 85.9MB/s]
Downloading model.safetensors:  71%|███████   | 2.21G/3.13G [00:25<00:10, 86.6MB/s]
Downloading model.safetensors:  71%|███████   | 2.22G/3.13G [00:26<00:10, 87.4MB/s]
Downloading model.safetensors:  71%|███████▏  | 2.23G/3.13G [00:26<00:10, 83.8MB/s]
Downloading model.safetensors:  72%|███████▏  | 2.24G/3.13G [00:26<00:10, 84.8MB/s]
Downloading model.safetensors:  72%|███████▏  | 2.25G/3.13G [00:26<00:10, 85.4MB/s]
Downloading model.safetensors:  72%|███████▏  | 2.26G/3.13G [00:26<00:10, 85.0MB/s]
Downloading model.safetensors:  73%|███████▎  | 2.28G/3.13G [00:26<00:09, 86.1MB/s]
Downloading model.safetensors:  73%|███████▎  | 2.29G/3.13G [00:26<00:09, 87.6MB/s]
Downloading model.safetensors:  73%|███████▎  | 2.30G/3.13G [00:26<00:09, 86.2MB/s]
Downloading model.safetensors:  74%|███████▎  | 2.31G/3.13G [00:26<00:09, 88.0MB/s]
Downloading model.safetensors:  74%|███████▍  | 2.32G/3.13G [00:27<00:09, 86.8MB/s]
Downloading model.safetensors:  74%|███████▍  | 2.33G/3.13G [00:27<00:09, 85.0MB/s]
Downloading model.safetensors:  75%|███████▍  | 2.34G/3.13G [00:27<00:10, 79.4MB/s]
Downloading model.safetensors:  75%|███████▍  | 2.35G/3.13G [00:27<00:09, 78.7MB/s]
Downloading model.safetensors:  75%|███████▌  | 2.36G/3.13G [00:27<00:09, 81.6MB/s]
Downloading model.safetensors:  76%|███████▌  | 2.37G/3.13G [00:27<00:09, 82.3MB/s]
Downloading model.safetensors:  76%|███████▌  | 2.38G/3.13G [00:27<00:09, 82.3MB/s]
Downloading model.safetensors:  76%|███████▋  | 2.39G/3.13G [00:28<00:08, 84.8MB/s]
Downloading model.safetensors:  77%|███████▋  | 2.40G/3.13G [00:28<00:08, 83.1MB/s]
Downloading model.safetensors:  77%|███████▋  | 2.41G/3.13G [00:28<00:08, 85.6MB/s]
Downloading model.safetensors:  77%|███████▋  | 2.42G/3.13G [00:28<00:08, 84.9MB/s]
Downloading model.safetensors:  78%|███████▊  | 2.43G/3.13G [00:28<00:08, 85.6MB/s]
Downloading model.safetensors:  78%|███████▊  | 2.44G/3.13G [00:28<00:08, 85.7MB/s]
Downloading model.safetensors:  78%|███████▊  | 2.45G/3.13G [00:28<00:07, 86.0MB/s]
Downloading model.safetensors:  79%|███████▊  | 2.46G/3.13G [00:28<00:07, 88.2MB/s]
Downloading model.safetensors:  79%|███████▉  | 2.47G/3.13G [00:28<00:07, 88.0MB/s]
Downloading model.safetensors:  79%|███████▉  | 2.49G/3.13G [00:29<00:07, 88.7MB/s]
Downloading model.safetensors:  80%|███████▉  | 2.50G/3.13G [00:29<00:07, 89.0MB/s]
Downloading model.safetensors:  80%|███████▉  | 2.51G/3.13G [00:29<00:07, 87.7MB/s]
Downloading model.safetensors:  80%|████████  | 2.52G/3.13G [00:29<00:07, 87.4MB/s]
Downloading model.safetensors:  81%|████████  | 2.53G/3.13G [00:29<00:07, 86.2MB/s]
Downloading model.safetensors:  81%|████████  | 2.54G/3.13G [00:29<00:06, 87.2MB/s]
Downloading model.safetensors:  81%|████████▏ | 2.55G/3.13G [00:29<00:06, 87.6MB/s]
Downloading model.safetensors:  82%|████████▏ | 2.56G/3.13G [00:29<00:06, 88.8MB/s]
Downloading model.safetensors:  82%|████████▏ | 2.57G/3.13G [00:30<00:06, 86.7MB/s]
Downloading model.safetensors:  82%|████████▏ | 2.58G/3.13G [00:30<00:06, 87.2MB/s]
Downloading model.safetensors:  83%|████████▎ | 2.59G/3.13G [00:30<00:06, 88.0MB/s]
Downloading model.safetensors:  83%|████████▎ | 2.60G/3.13G [00:30<00:05, 89.5MB/s]
Downloading model.safetensors:  83%|████████▎ | 2.61G/3.13G [00:30<00:05, 87.9MB/s]
Downloading model.safetensors:  84%|████████▎ | 2.62G/3.13G [00:30<00:05, 88.1MB/s]
Downloading model.safetensors:  84%|████████▍ | 2.63G/3.13G [00:30<00:05, 86.7MB/s]
Downloading model.safetensors:  84%|████████▍ | 2.64G/3.13G [00:30<00:05, 86.4MB/s]
Downloading model.safetensors:  85%|████████▍ | 2.65G/3.13G [00:31<00:05, 86.9MB/s]
Downloading model.safetensors:  85%|████████▌ | 2.66G/3.13G [00:31<00:05, 85.1MB/s]
Downloading model.safetensors:  85%|████████▌ | 2.67G/3.13G [00:31<00:05, 84.0MB/s]
Downloading model.safetensors:  86%|████████▌ | 2.68G/3.13G [00:31<00:05, 85.9MB/s]
Downloading model.safetensors:  86%|████████▌ | 2.69G/3.13G [00:31<00:05, 86.8MB/s]
Downloading model.safetensors:  86%|████████▋ | 2.71G/3.13G [00:31<00:05, 84.8MB/s]
Downloading model.safetensors:  87%|████████▋ | 2.72G/3.13G [00:31<00:04, 84.3MB/s]
Downloading model.safetensors:  87%|████████▋ | 2.73G/3.13G [00:31<00:04, 82.3MB/s]
Downloading model.safetensors:  87%|████████▋ | 2.74G/3.13G [00:32<00:04, 83.2MB/s]
Downloading model.safetensors:  88%|████████▊ | 2.75G/3.13G [00:32<00:04, 83.6MB/s]
Downloading model.safetensors:  88%|████████▊ | 2.76G/3.13G [00:32<00:04, 85.4MB/s]
Downloading model.safetensors:  88%|████████▊ | 2.77G/3.13G [00:32<00:04, 85.6MB/s]
Downloading model.safetensors:  89%|████████▊ | 2.78G/3.13G [00:32<00:04, 86.2MB/s]
Downloading model.safetensors:  89%|████████▉ | 2.79G/3.13G [00:32<00:03, 86.4MB/s]
Downloading model.safetensors:  89%|████████▉ | 2.80G/3.13G [00:32<00:03, 86.4MB/s]
Downloading model.safetensors:  90%|████████▉ | 2.81G/3.13G [00:32<00:03, 87.9MB/s]
Downloading model.safetensors:  90%|█████████ | 2.82G/3.13G [00:32<00:03, 88.1MB/s]
Downloading model.safetensors:  90%|█████████ | 2.83G/3.13G [00:33<00:03, 89.2MB/s]
Downloading model.safetensors:  91%|█████████ | 2.84G/3.13G [00:33<00:03, 89.2MB/s]
Downloading model.safetensors:  91%|█████████ | 2.85G/3.13G [00:33<00:03, 88.0MB/s]
Downloading model.safetensors:  91%|█████████▏| 2.86G/3.13G [00:33<00:03, 87.2MB/s]
Downloading model.safetensors:  92%|█████████▏| 2.87G/3.13G [00:33<00:02, 87.5MB/s]
Downloading model.safetensors:  92%|█████████▏| 2.88G/3.13G [00:33<00:02, 87.4MB/s]
Downloading model.safetensors:  92%|█████████▏| 2.89G/3.13G [00:33<00:02, 87.1MB/s]
Downloading model.safetensors:  93%|█████████▎| 2.90G/3.13G [00:33<00:02, 87.1MB/s]
Downloading model.safetensors:  93%|█████████▎| 2.92G/3.13G [00:34<00:02, 87.4MB/s]
Downloading model.safetensors:  93%|█████████▎| 2.93G/3.13G [00:34<00:02, 83.4MB/s]
Downloading model.safetensors:  94%|█████████▎| 2.94G/3.13G [00:34<00:02, 84.6MB/s]
Downloading model.safetensors:  94%|█████████▍| 2.95G/3.13G [00:34<00:02, 83.5MB/s]
Downloading model.safetensors:  94%|█████████▍| 2.96G/3.13G [00:34<00:02, 84.3MB/s]
Downloading model.safetensors:  95%|█████████▍| 2.97G/3.13G [00:34<00:02, 81.6MB/s]
Downloading model.safetensors:  95%|█████████▌| 2.98G/3.13G [00:34<00:01, 82.7MB/s]
Downloading model.safetensors:  95%|█████████▌| 2.99G/3.13G [00:34<00:01, 82.8MB/s]
Downloading model.safetensors:  96%|█████████▌| 3.00G/3.13G [00:35<00:01, 85.2MB/s]
Downloading model.safetensors:  96%|█████████▌| 3.01G/3.13G [00:35<00:01, 86.0MB/s]
Downloading model.safetensors:  96%|█████████▋| 3.02G/3.13G [00:35<00:01, 86.7MB/s]
Downloading model.safetensors:  97%|█████████▋| 3.03G/3.13G [00:35<00:01, 86.1MB/s]
Downloading model.safetensors:  97%|█████████▋| 3.04G/3.13G [00:35<00:01, 85.8MB/s]
Downloading model.safetensors:  97%|█████████▋| 3.05G/3.13G [00:35<00:00, 85.2MB/s]
Downloading model.safetensors:  98%|█████████▊| 3.06G/3.13G [00:35<00:00, 85.1MB/s]
Downloading model.safetensors:  98%|█████████▊| 3.07G/3.13G [00:35<00:00, 73.9MB/s]
Downloading model.safetensors:  98%|█████████▊| 3.08G/3.13G [00:36<00:00, 74.8MB/s]
Downloading model.safetensors:  99%|█████████▊| 3.09G/3.13G [00:36<00:00, 75.9MB/s]
Downloading model.safetensors:  99%|█████████▉| 3.10G/3.13G [00:36<00:00, 78.7MB/s]
Downloading model.safetensors:  99%|█████████▉| 3.11G/3.13G [00:36<00:00, 81.6MB/s]
Downloading model.safetensors: 100%|█████████▉| 3.12G/3.13G [00:36<00:00, 83.1MB/s]
Downloading model.safetensors: 100%|██████████| 3.13G/3.13G [00:36<00:00, 85.3MB/s]
Downloading (…)neration_config.json:   0%|          | 0.00/147 [00:00<?, ?B/s]
Downloading (…)neration_config.json: 100%|██████████| 147/147 [00:00<00:00, 331kB/s]
Downloading (…)okenizer_config.json:   0%|          | 0.00/2.54k [00:00<?, ?B/s]
Downloading (…)okenizer_config.json: 100%|██████████| 2.54k/2.54k [00:00<00:00, 8.41MB/s]
Downloading spiece.model:   0%|          | 0.00/792k [00:00<?, ?B/s]
Downloading spiece.model: 100%|██████████| 792k/792k [00:00<00:00, 102MB/s]
Downloading (…)/main/tokenizer.json:   0%|          | 0.00/2.42M [00:00<?, ?B/s]
Downloading (…)/main/tokenizer.json: 100%|██████████| 2.42M/2.42M [00:00<00:00, 27.6MB/s]
Downloading (…)cial_tokens_map.json:   0%|          | 0.00/2.20k [00:00<?, ?B/s]
Downloading (…)cial_tokens_map.json: 100%|██████████| 2.20k/2.20k [00:00<00:00, 7.88MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 121MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 113MB/s]
> Begin to load lora modules
> Loading lorahub/flan_t5_large-wmt16_translate_ro-en ...
  0%|          | 0/20 [00:00<?, ?it/s]
> Loading lorahub/flan_t5_large-anli_r2 ...
  5%|▌         | 1/20 [00:00<00:14,  1.30it/s]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.52MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 144MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 134MB/s]
> Loading lorahub/flan_t5_large-gem_e2e_nlg ...
 10%|█         | 2/20 [00:01<00:13,  1.31it/s]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.70MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 78.7MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 40.2MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 42.8MB/s]
> Loading lorahub/flan_t5_large-quartz_read_passage_below_choose ...
 15%|█▌        | 3/20 [00:02<00:17,  1.03s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 2.23MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 77.5MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 57.5MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 58.6MB/s]
> Loading lorahub/flan_t5_large-wiki_qa_Decide_good_answer ...
 20%|██        | 4/20 [00:04<00:17,  1.09s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.59MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 190MB/s]
> Loading lorahub/flan_t5_large-race_high_Select_the_best_answer_no_instructions_ ...
 25%|██▌       | 5/20 [00:04<00:15,  1.03s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 2.03MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 121MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 114MB/s]
> Loading lorahub/flan_t5_large-app_reviews_convert_to_rating ...
 30%|███       | 6/20 [00:05<00:13,  1.06it/s]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.13MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 83.7MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 40.6MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 43.4MB/s]
> Loading lorahub/flan_t5_large-glue_mnli ...
 35%|███▌      | 7/20 [00:07<00:13,  1.06s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 2.00MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 80.8MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 40.8MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 43.4MB/s]
> Loading lorahub/flan_t5_large-sentiment140 ...
 40%|████      | 8/20 [00:08<00:14,  1.18s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.56MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 132MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 123MB/s]
> Loading lorahub/flan_t5_large-quail_context_description_question_answer_id ...
 45%|████▌     | 9/20 [00:09<00:11,  1.08s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.92MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 57.3MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 73.2MB/s]
> Loading lorahub/flan_t5_large-snli ...
 50%|█████     | 10/20 [00:10<00:10,  1.10s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 2.04MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 48.3MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 37.1MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 37.9MB/s]
> Loading lorahub/flan_t5_large-dbpedia_14_pick_one_category_for_the_following_text ...
 55%|█████▌    | 11/20 [00:11<00:10,  1.22s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.38MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 14.0MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 24.1MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 21.3MB/s]
> Loading lorahub/flan_t5_large-quac ...
 60%|██████    | 12/20 [00:13<00:11,  1.40s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.61MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 81.5MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 95.8MB/s]
> Loading lorahub/flan_t5_large-quoref_What_Is_The_Answer ...
 65%|██████▌   | 13/20 [00:14<00:08,  1.25s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 2.11MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 80.4MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 65.6MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 65.2MB/s]
> Loading lorahub/flan_t5_large-wiqa_what_might_be_the_last_step_of_the_process ...
 70%|███████   | 14/20 [00:16<00:08,  1.39s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.23MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 59.9MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 58.5MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 56.9MB/s]
> Loading lorahub/flan_t5_large-super_glue_cb ...
 75%|███████▌  | 15/20 [00:17<00:06,  1.34s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.33MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 89.3MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 97.2MB/s]
> Loading lorahub/flan_t5_large-quarel_heres_a_story ...
 80%|████████  | 16/20 [00:18<00:05,  1.28s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.40MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 79.3MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 62.5MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 62.5MB/s]
> Loading lorahub/flan_t5_large-race_middle_Is_this_the_right_answer ...
 85%|████████▌ | 17/20 [00:20<00:03,  1.31s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.26MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 145MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 133MB/s]
> Loading lorahub/flan_t5_large-adversarial_qa_dbidaf_answer_the_following_q ...
 90%|█████████ | 18/20 [00:21<00:02,  1.23s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 655kB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 59.2MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 73.8MB/s]
> Loading lorahub/flan_t5_large-race_middle_Select_the_best_answer_generate_span_ ...
 95%|█████████▌| 19/20 [00:22<00:01,  1.23s/it]
Downloading (…)/adapter_config.json:   0%|          | 0.00/411 [00:00<?, ?B/s]
Downloading (…)/adapter_config.json: 100%|██████████| 411/411 [00:00<00:00, 1.31MB/s]
Downloading adapter_model.bin:   0%|          | 0.00/19.0M [00:00<?, ?B/s]
Downloading adapter_model.bin:  55%|█████▌    | 10.5M/19.0M [00:00<00:00, 93.8MB/s]
Downloading adapter_model.bin: 100%|██████████| 19.0M/19.0M [00:00<00:00, 107MB/s]
100%|██████████| 20/20 [00:23<00:00,  1.12s/it]
100%|██████████| 20/20 [00:23<00:00,  1.17s/it]
Running tokenizer on dataset:   0%|          | 0/3 [00:00<?, ? examples/s]
Running tokenizer on dataset: 100%|██████████| 3/3 [00:00<00:00, 112.81 examples/s]
> Begin to perform gradient-free optimization ...
Launching 1 jobs with new suggestions
Updating fitness with value 0.19794374704360962
39 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.19664074103037515
38 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.20196577151616416
37 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.18949530760447184
36 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.18646785974502564
35 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.18851580699284873
34 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.17956692457199097
33 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.18219556013743082
32 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.18811706304550171
31 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.18308404684066773
30 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.15466183026631675
29 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.13169783075650532
28 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.11195437947909037
27 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.14315053780873618
26 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.09870247999827067
25 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.09308040221532185
24 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.08350652158260345
23 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.1701445213953654
22 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.08785513858000438
21 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.18224913199742637
20 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.887497984568278
19 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.20113089762185843
18 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.08463106314341227
17 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.179056189929146
16 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.07683334509531657
15 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.17642755043471342
14 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.06571920676354828
13 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.0742276668098602
12 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.05183583021748306
11 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.12994661993059228
10 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.08364694323973731
9 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.08870862409630972
8 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.08821432639038829
7 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.05691506158264563
6 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.05956370060788695
5 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.13098620907509662
4 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.06969356769947482
3 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.09138107303580391
2 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.061673278693635536
1 remaining budget and 0 running jobs
Launching 1 jobs with new suggestions
Updating fitness with value 0.045564029637715844
0 remaining budget and 0 running jobs
The recommended weight set for the LoRA modules is:
0.4984: lorahub/flan_t5_large-wmt16_translate_ro-en
-0.2598: lorahub/flan_t5_large-anli_r2
0.4774: lorahub/flan_t5_large-gem_e2e_nlg
1.0626: lorahub/flan_t5_large-quartz_read_passage_below_choose
0.0428: lorahub/flan_t5_large-wiki_qa_Decide_good_answer
0.4685: lorahub/flan_t5_large-race_high_Select_the_best_answer_no_instructions_
-0.0285: lorahub/flan_t5_large-app_reviews_convert_to_rating
-0.0458: lorahub/flan_t5_large-glue_mnli
-0.0571: lorahub/flan_t5_large-sentiment140
0.5707: lorahub/flan_t5_large-quail_context_description_question_answer_id
0.5296: lorahub/flan_t5_large-snli
0.3255: lorahub/flan_t5_large-dbpedia_14_pick_one_category_for_the_following_text
-0.0600: lorahub/flan_t5_large-quac
0.5097: lorahub/flan_t5_large-quoref_What_Is_The_Answer
0.5041: lorahub/flan_t5_large-wiqa_what_might_be_the_last_step_of_the_process
0.5070: lorahub/flan_t5_large-super_glue_cb
-0.1103: lorahub/flan_t5_large-quarel_heres_a_story
-0.0032: lorahub/flan_t5_large-race_middle_Is_this_the_right_answer
-0.0723: lorahub/flan_t5_large-adversarial_qa_dbidaf_answer_the_following_q
0.0988: lorahub/flan_t5_large-race_middle_Select_the_best_answer_generate_span_
Version Details
Version ID
02a0166b0b1deeec3e794ced2dc6c670592302e158c9ec51b676279afd0e6238
Version Created
August 3, 2023
Run on Replicate →