zylim0702/sdxl-lora-customize-training 🔢✓🖼️❓📝 → 🖼️
About
Introducing a Lora Instant Training model for crafting stunning 1024x1024 visuals. Train your own Lora Model via zip photos for instant outputs. Try Lora Model using this link: https://replicate.com/zylim0702/sdxl-lora-customize-model.
Example Output
Output
Performance Metrics
423.74s
Prediction Time
425.89s
Total Time
All Input Parameters
{
"ti_lr": 0.0003,
"is_lora": true,
"lora_lr": 0.0001,
"verbose": true,
"lora_rank": 32,
"resolution": 768,
"input_images": "https://replicate.delivery/pbxt/JNkYrCKwBoZ1ZSs5JgkXJuKhSfmSIORzOwNFuVDn9pIMi8Xl/barbie.zip",
"lr_scheduler": "constant",
"token_string": "TOK",
"caption_prefix": "a photo of TOK, ",
"lr_warmup_steps": 100,
"max_train_steps": 1000,
"num_train_epochs": 4000,
"train_batch_size": 4,
"unet_learning_rate": 0.000001,
"checkpointing_steps": 999999,
"clipseg_temperature": 1,
"input_images_filetype": "infer",
"crop_based_on_salience": true,
"use_face_detection_instead": true
}
Input Parameters
- seed
- Random seed for reproducible training. Leave empty to use a random seed
- ti_lr
- Scaling of learning rate for training textual inversion embeddings. Don't alter unless you know what you're doing.
- is_lora
- Whether to use LoRA training. If set to False, will use Full fine tuning
- lora_lr
- Scaling of learning rate for training LoRA embeddings. Don't alter unless you know what you're doing.
- verbose
- verbose output
- lora_rank
- Rank of LoRA embeddings. Don't alter unless you know what you're doing.
- resolution
- Square pixel resolution which your images will be resized to for training
- input_images (required)
- A .zip or .tar file containing the image files that will be used for fine-tuning
- lr_scheduler
- Learning rate scheduler to use for training
- token_string
- A unique string that will be trained to refer to the concept in the input images. Can be anything, but TOK works well
- caption_prefix
- Text which will be used as prefix during automatic captioning. Must contain the `token_string`. For example, if caption text is 'a photo of TOK', automatic captioning will expand to 'a photo of TOK under a bridge', 'a photo of TOK holding a cup', etc.
- lr_warmup_steps
- Number of warmup steps for lr schedulers with warmups.
- max_train_steps
- Number of individual training steps. Takes precedence over num_train_epochs
- num_train_epochs
- Number of epochs to loop through your training dataset
- train_batch_size
- Batch size (per device) for training
- unet_learning_rate
- Learning rate for the U-Net. We recommend this value to be somewhere between `1e-6` to `1e-5`.
- checkpointing_steps
- Number of steps between saving checkpoints. Set to very very high number to disable checkpointing, because you don't need one.
- clipseg_temperature
- How blurry you want the CLIPSeg mask to be. We recommend this value be something between `0.5` to `1.0`. If you want to have more sharp mask (but thus more errorful), you can decrease this value.
- mask_target_prompts
- Prompt that describes part of the image that you will find important. For example, if you are fine-tuning your pet, `photo of a dog` will be a good prompt. Prompt-based masking is used to focus the fine-tuning process on the important/salient parts of the image
- input_images_filetype
- Filetype of the input images. Can be either `zip` or `tar`. By default its `infer`, and it will be inferred from the ext of input file.
- crop_based_on_salience
- If you want to crop the image to `target_size` based on the important parts of the image, set this to True. If you want to crop the image based on face detection, set this to False
- use_face_detection_instead
- If you want to use face detection instead of CLIPSeg for masking. For face applications, we recommend using this option.
Output Schema
Output
Example Execution Logs
['./temp_in/BAR-00238.jpg', './temp_in/Margot-Robbie-Barbie-750x422.jpg', './temp_in/_methode_sundaytimes_prod_web_bin_f173c0a2-1825-11ee-87bf-4c05f9202e96.jpg', './temp_in/imago0257930673h-768x432.jpg', './temp_in/margot-robbie-barbie-event-seoul-070323-1-21a1fad7406b4901bb5b7628beb0c551.jpg', './temp_in/rev-1-BAR-00362HighResJPEG-161c750-bf849b2-e1690197084134.jpg'] Generating 6 captions... Input captioning text: a photo of TOK, TOK a photo of tok, a blonde haired woman in a pink car 0%| | 0/6 [00:00<?, ?it/s] TOK a photo of tok, a very pretty, young lady in a pink dress 17%|█▋ | 1/6 [00:02<00:11, 2.22s/it] TOK a photo of tok, who is currently a actress, is also one of the stars in a film 33%|███▎ | 2/6 [00:02<00:04, 1.02s/it] TOK a photo of tok, a pretty blond in a pink hat 50%|█████ | 3/6 [00:02<00:01, 1.50it/s] TOK a photo of tok, a woman in a pink suit and white hat, holding a cell phone 67%|██████▋ | 4/6 [00:02<00:00, 2.19it/s] TOK a photo of tok, blonde, dress, pink, girl, fashion Generated captions ['a photo of tok, a blonde haired woman in a pink car', 'a photo of tok, a very pretty, young lady in a pink dress', 'a photo of tok, who is currently a actress, is also one of the stars in a film', 'a photo of tok, a pretty blond in a pink hat', 'a photo of tok, a woman in a pink suit and white hat, holding a cell phone', 'a photo of tok, blonde, dress, pink, girl, fashion'] 83%|████████▎ | 5/6 [00:03<00:00, 2.66it/s] 100%|██████████| 6/6 [00:03<00:00, 3.30it/s] 100%|██████████| 6/6 [00:03<00:00, 1.89it/s] Generating 6 masks... INFO: Created TensorFlow Lite XNNPACK delegate for CPU. 0%| | 0/6 [00:00<?, ?it/s] 83%|████████▎ | 5/6 [00:00<00:00, 43.49it/s] 100%|██████████| 6/6 [00:00<00:00, 45.12it/s] Upscaling 6 images... Downloading (…)lve/main/config.json: 0%| | 0.00/772 [00:00<?, ?B/s] Downloading (…)lve/main/config.json: 100%|██████████| 772/772 [00:00<00:00, 3.76MB/s] Downloading pytorch_model.bin: 0%| | 0.00/48.5M [00:00<?, ?B/s] Downloading pytorch_model.bin: 22%|██▏ | 10.5M/48.5M [00:00<00:01, 23.9MB/s] Downloading pytorch_model.bin: 87%|████████▋ | 41.9M/48.5M [00:00<00:00, 88.9MB/s] Downloading pytorch_model.bin: 100%|██████████| 48.5M/48.5M [00:00<00:00, 82.0MB/s] 0%| | 0/6 [00:00<?, ?it/s] 33%|███▎ | 2/6 [00:01<00:02, 1.75it/s] 67%|██████▋ | 4/6 [00:02<00:01, 1.68it/s] 100%|██████████| 6/6 [00:05<00:00, 1.06it/s] 100%|██████████| 6/6 [00:05<00:00, 1.18it/s] Using seed 3860335812 You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors. You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors. # PTI : Loaded models 0 text encodedr's std_token_embedding: 0.01531982421875 torch.Size([49410]) 1 text encodedr's std_token_embedding: 0.01446533203125 torch.Size([49410]) text_model.embeddings.token_embedding.weight text_model.embeddings.token_embedding.weight # PTI : Loading dataset, do_cache True Captions to train on: a photo of <s0><s1>, a blonde haired woman in a pink car a photo of <s0><s1>, a very pretty, young lady in a pink dress a photo of <s0><s1>, who is currently a actress, is also one of the stars in a film a photo of <s0><s1>, a pretty blond in a pink hat a photo of <s0><s1>, a woman in a pink suit and white hat, holding a cell phone a photo of <s0><s1>, blonde, dress, pink, girl, fashion # PTI : Loaded dataset # PTI : Running training # PTI : Num examples = 6 # PTI : Num batches each epoch = 2 # PTI : Num Epochs = 500 # PTI : Instantaneous batch size per device = 4 Total train batch size (w. parallel, distributed & accumulation) = 4 # PTI : Gradient Accumulation steps = 1 # PTI : Total optimization steps = 1000 0%| | 0/1000 [00:00<?, ?it/s] # PTI :step: 0, epoch: 0: 0%| | 1/1000 [00:00<00:14, 71.11it/s] # PTI :step: 0, epoch: 0: 0%| | 2/1000 [00:00<06:55, 2.40it/s] # PTI :step: 1, epoch: 0: 0%| | 2/1000 [00:00<06:55, 2.40it/s] # PTI :step: 1, epoch: 0: 0%| | 3/1000 [00:01<07:23, 2.25it/s] # PTI :step: 2, epoch: 1: 0%| | 3/1000 [00:01<07:23, 2.25it/s] # PTI :step: 2, epoch: 1: 0%| | 4/1000 [00:01<07:09, 2.32it/s] # PTI :step: 3, epoch: 1: 0%| | 4/1000 [00:01<07:09, 2.32it/s] # PTI :step: 3, epoch: 1: 0%| | 5/1000 [00:02<06:49, 2.43it/s] # PTI :step: 4, epoch: 2: 0%| | 5/1000 [00:02<06:49, 2.43it/s] # PTI :step: 4, epoch: 2: 1%| | 6/1000 [00:02<06:43, 2.46it/s] # PTI :step: 5, epoch: 2: 1%| | 6/1000 [00:02<06:43, 2.46it/s] # PTI :step: 5, epoch: 2: 1%| | 7/1000 [00:02<06:33, 2.52it/s] # PTI :step: 6, epoch: 3: 1%| | 7/1000 [00:02<06:33, 2.52it/s] # PTI :step: 6, epoch: 3: 1%| | 8/1000 [00:03<06:33, 2.52it/s] # PTI :step: 7, epoch: 3: 1%| | 8/1000 [00:03<06:33, 2.52it/s] # PTI :step: 7, epoch: 3: 1%| | 9/1000 [00:03<06:29, 2.54it/s] # PTI :step: 8, epoch: 4: 1%| | 9/1000 [00:03<06:29, 2.54it/s] # PTI :step: 8, epoch: 4: 1%| | 10/1000 [00:04<06:30, 2.54it/s] # PTI :step: 9, epoch: 4: 1%| | 10/1000 [00:04<06:30, 2.54it/s] # PTI :step: 9, epoch: 4: 1%| | 11/1000 [00:04<06:26, 2.56it/s] # PTI :step: 10, epoch: 5: 1%| | 11/1000 [00:04<06:26, 2.56it/s] # PTI :step: 10, epoch: 5: 1%| | 12/1000 [00:04<06:27, 2.55it/s] # PTI :step: 11, epoch: 5: 1%| | 12/1000 [00:04<06:27, 2.55it/s] # PTI :step: 11, epoch: 5: 1%|▏ | 13/1000 [00:05<06:24, 2.57it/s] # PTI :step: 12, epoch: 6: 1%|▏ | 13/1000 [00:05<06:24, 2.57it/s] # PTI :step: 12, epoch: 6: 1%|▏ | 14/1000 [00:05<06:28, 2.54it/s] # PTI :step: 13, epoch: 6: 1%|▏ | 14/1000 [00:05<06:28, 2.54it/s] # PTI :step: 13, epoch: 6: 2%|▏ | 15/1000 [00:05<06:22, 2.57it/s] # PTI :step: 14, epoch: 7: 2%|▏ | 15/1000 [00:05<06:22, 2.57it/s] # PTI :step: 14, epoch: 7: 2%|▏ | 16/1000 [00:06<06:24, 2.56it/s] # PTI :step: 15, epoch: 7: 2%|▏ | 16/1000 [00:06<06:24, 2.56it/s] # PTI :step: 15, epoch: 7: 2%|▏ | 17/1000 [00:06<06:24, 2.56it/s] # PTI :step: 16, epoch: 8: 2%|▏ | 17/1000 [00:06<06:24, 2.56it/s] # PTI :step: 16, epoch: 8: 2%|▏ | 18/1000 [00:07<06:25, 2.55it/s] # PTI :step: 17, epoch: 8: 2%|▏ | 18/1000 [00:07<06:25, 2.55it/s] # PTI :step: 17, epoch: 8: 2%|▏ | 19/1000 [00:07<06:22, 2.56it/s] # PTI :step: 18, epoch: 9: 2%|▏ | 19/1000 [00:07<06:22, 2.56it/s] # PTI :step: 18, epoch: 9: 2%|▏ | 20/1000 [00:07<06:23, 2.55it/s] # PTI :step: 19, epoch: 9: 2%|▏ | 20/1000 [00:07<06:23, 2.55it/s] # PTI :step: 19, epoch: 9: 2%|▏ | 21/1000 [00:08<06:17, 2.59it/s] # PTI :step: 20, epoch: 10: 2%|▏ | 21/1000 [00:08<06:17, 2.59it/s] # PTI :step: 20, epoch: 10: 2%|▏ | 22/1000 [00:08<06:24, 2.55it/s] # PTI :step: 21, epoch: 10: 2%|▏ | 22/1000 [00:08<06:24, 2.55it/s] # PTI :step: 21, epoch: 10: 2%|▏ | 23/1000 [00:09<06:19, 2.58it/s] # PTI :step: 22, epoch: 11: 2%|▏ | 23/1000 [00:09<06:19, 2.58it/s] # PTI :step: 22, epoch: 11: 2%|▏ | 24/1000 [00:09<06:20, 2.56it/s] # PTI :step: 23, epoch: 11: 2%|▏ | 24/1000 [00:09<06:20, 2.56it/s] # PTI :step: 23, epoch: 11: 2%|▎ | 25/1000 [00:09<06:16, 2.59it/s] # PTI :step: 24, epoch: 12: 2%|▎ | 25/1000 [00:09<06:16, 2.59it/s] # PTI :step: 24, epoch: 12: 3%|▎ | 26/1000 [00:10<06:19, 2.57it/s] # PTI :step: 25, epoch: 12: 3%|▎ | 26/1000 [00:10<06:19, 2.57it/s] # PTI :step: 25, epoch: 12: 3%|▎ | 27/1000 [00:10<06:17, 2.58it/s] # PTI :step: 26, epoch: 13: 3%|▎ | 27/1000 [00:10<06:17, 2.58it/s] # PTI :step: 26, epoch: 13: 3%|▎ | 28/1000 [00:11<06:19, 2.56it/s] # PTI :step: 27, epoch: 13: 3%|▎ | 28/1000 [00:11<06:19, 2.56it/s] # PTI :step: 27, epoch: 13: 3%|▎ | 29/1000 [00:11<06:15, 2.59it/s] # PTI :step: 28, epoch: 14: 3%|▎ | 29/1000 [00:11<06:15, 2.59it/s] # PTI :step: 28, epoch: 14: 3%|▎ | 30/1000 [00:11<06:17, 2.57it/s] # PTI :step: 29, epoch: 14: 3%|▎ | 30/1000 [00:11<06:17, 2.57it/s] # PTI :step: 29, epoch: 14: 3%|▎ | 31/1000 [00:12<06:14, 2.59it/s] # PTI :step: 30, epoch: 15: 3%|▎ | 31/1000 [00:12<06:14, 2.59it/s] # PTI :step: 30, epoch: 15: 3%|▎ | 32/1000 [00:12<06:16, 2.57it/s] # PTI :step: 31, epoch: 15: 3%|▎ | 32/1000 [00:12<06:16, 2.57it/s] # PTI :step: 31, epoch: 15: 3%|▎ | 33/1000 [00:12<06:12, 2.59it/s] # PTI :step: 32, epoch: 16: 3%|▎ | 33/1000 [00:12<06:12, 2.59it/s] # PTI :step: 32, epoch: 16: 3%|▎ | 34/1000 [00:13<06:15, 2.57it/s] # PTI :step: 33, epoch: 16: 3%|▎ | 34/1000 [00:13<06:15, 2.57it/s] # PTI :step: 33, epoch: 16: 4%|▎ | 35/1000 [00:13<06:12, 2.59it/s] # PTI :step: 34, epoch: 17: 4%|▎ | 35/1000 [00:13<06:12, 2.59it/s] # PTI :step: 34, epoch: 17: 4%|▎ | 36/1000 [00:14<06:15, 2.57it/s] # PTI :step: 35, epoch: 17: 4%|▎ | 36/1000 [00:14<06:15, 2.57it/s] # PTI :step: 35, epoch: 17: 4%|▎ | 37/1000 [00:14<06:13, 2.58it/s] # PTI :step: 36, epoch: 18: 4%|▎ | 37/1000 [00:14<06:13, 2.58it/s] # PTI :step: 36, epoch: 18: 4%|▍ | 38/1000 [00:14<06:15, 2.56it/s] # PTI :step: 37, epoch: 18: 4%|▍ | 38/1000 [00:14<06:15, 2.56it/s] # PTI :step: 37, epoch: 18: 4%|▍ | 39/1000 [00:15<06:10, 2.59it/s] # PTI :step: 38, epoch: 19: 4%|▍ | 39/1000 [00:15<06:10, 2.59it/s] # PTI :step: 38, epoch: 19: 4%|▍ | 40/1000 [00:15<06:17, 2.54it/s] # PTI :step: 39, epoch: 19: 4%|▍ | 40/1000 [00:15<06:17, 2.54it/s] # PTI :step: 39, epoch: 19: 4%|▍ | 41/1000 [00:16<06:13, 2.57it/s] # PTI :step: 40, epoch: 20: 4%|▍ | 41/1000 [00:16<06:13, 2.57it/s] # PTI :step: 40, epoch: 20: 4%|▍ | 42/1000 [00:16<06:15, 2.55it/s] # PTI :step: 41, epoch: 20: 4%|▍ | 42/1000 [00:16<06:15, 2.55it/s] # PTI :step: 41, epoch: 20: 4%|▍ | 43/1000 [00:16<06:10, 2.58it/s] # PTI :step: 42, epoch: 21: 4%|▍ | 43/1000 [00:16<06:10, 2.58it/s] # PTI :step: 42, epoch: 21: 4%|▍ | 44/1000 [00:17<06:13, 2.56it/s] # PTI :step: 43, epoch: 21: 4%|▍ | 44/1000 [00:17<06:13, 2.56it/s] # PTI :step: 43, epoch: 21: 4%|▍ | 45/1000 [00:17<06:10, 2.58it/s] # PTI :step: 44, epoch: 22: 4%|▍ | 45/1000 [00:17<06:10, 2.58it/s] # PTI :step: 44, epoch: 22: 5%|▍ | 46/1000 [00:18<06:41, 2.38it/s] # PTI :step: 45, epoch: 22: 5%|▍ | 46/1000 [00:18<06:41, 2.38it/s] # PTI :step: 45, epoch: 22: 5%|▍ | 47/1000 [00:18<06:29, 2.45it/s] # PTI :step: 46, epoch: 23: 5%|▍ | 47/1000 [00:18<06:29, 2.45it/s] # PTI :step: 46, epoch: 23: 5%|▍ | 48/1000 [00:18<06:26, 2.47it/s] # PTI :step: 47, epoch: 23: 5%|▍ | 48/1000 [00:18<06:26, 2.47it/s] # PTI :step: 47, epoch: 23: 5%|▍ | 49/1000 [00:19<06:18, 2.51it/s] # PTI :step: 48, epoch: 24: 5%|▍ | 49/1000 [00:19<06:18, 2.51it/s] # PTI :step: 48, epoch: 24: 5%|▌ | 50/1000 [00:19<06:18, 2.51it/s] # PTI :step: 49, epoch: 24: 5%|▌ | 50/1000 [00:19<06:18, 2.51it/s] # PTI :step: 49, epoch: 24: 5%|▌ | 51/1000 [00:20<06:11, 2.55it/s] # PTI :step: 50, epoch: 25: 5%|▌ | 51/1000 [00:20<06:11, 2.55it/s] # PTI :step: 50, epoch: 25: 5%|▌ | 52/1000 [00:20<06:12, 2.54it/s] # PTI :step: 51, epoch: 25: 5%|▌ | 52/1000 [00:20<06:12, 2.54it/s] # PTI :step: 51, epoch: 25: 5%|▌ | 53/1000 [00:20<06:07, 2.58it/s] # PTI :step: 52, epoch: 26: 5%|▌ | 53/1000 [00:20<06:07, 2.58it/s] # PTI :step: 52, epoch: 26: 5%|▌ | 54/1000 [00:21<06:09, 2.56it/s] # PTI :step: 53, epoch: 26: 5%|▌ | 54/1000 [00:21<06:09, 2.56it/s] # PTI :step: 53, epoch: 26: 6%|▌ | 55/1000 [00:21<06:08, 2.56it/s] # PTI :step: 54, epoch: 27: 6%|▌ | 55/1000 [00:21<06:08, 2.56it/s] # PTI :step: 54, epoch: 27: 6%|▌ | 56/1000 [00:22<06:11, 2.54it/s] # PTI :step: 55, epoch: 27: 6%|▌ | 56/1000 [00:22<06:11, 2.54it/s] # PTI :step: 55, epoch: 27: 6%|▌ | 57/1000 [00:22<06:09, 2.55it/s] # PTI :step: 56, epoch: 28: 6%|▌ | 57/1000 [00:22<06:09, 2.55it/s] # PTI :step: 56, epoch: 28: 6%|▌ | 58/1000 [00:22<06:10, 2.54it/s] # PTI :step: 57, epoch: 28: 6%|▌ | 58/1000 [00:22<06:10, 2.54it/s] # PTI :step: 57, epoch: 28: 6%|▌ | 59/1000 [00:23<06:05, 2.58it/s] # PTI :step: 58, epoch: 29: 6%|▌ | 59/1000 [00:23<06:05, 2.58it/s] # PTI :step: 58, epoch: 29: 6%|▌ | 60/1000 [00:23<06:09, 2.55it/s] # PTI :step: 59, epoch: 29: 6%|▌ | 60/1000 [00:23<06:09, 2.55it/s] # PTI :step: 59, epoch: 29: 6%|▌ | 61/1000 [00:23<06:04, 2.58it/s] # PTI :step: 60, epoch: 30: 6%|▌ | 61/1000 [00:23<06:04, 2.58it/s] # PTI :step: 60, epoch: 30: 6%|▌ | 62/1000 [00:24<06:11, 2.53it/s] # PTI :step: 61, epoch: 30: 6%|▌ | 62/1000 [00:24<06:11, 2.53it/s] # PTI :step: 61, epoch: 30: 6%|▋ | 63/1000 [00:24<06:06, 2.56it/s] # PTI :step: 62, epoch: 31: 6%|▋ | 63/1000 [00:24<06:06, 2.56it/s] # PTI :step: 62, epoch: 31: 6%|▋ | 64/1000 [00:25<06:07, 2.55it/s] # PTI :step: 63, epoch: 31: 6%|▋ | 64/1000 [00:25<06:07, 2.55it/s] # PTI :step: 63, epoch: 31: 6%|▋ | 65/1000 [00:25<06:04, 2.56it/s] # PTI :step: 64, epoch: 32: 6%|▋ | 65/1000 [00:25<06:04, 2.56it/s] # PTI :step: 64, epoch: 32: 7%|▋ | 66/1000 [00:25<06:06, 2.55it/s] # PTI :step: 65, epoch: 32: 7%|▋ | 66/1000 [00:25<06:06, 2.55it/s] # PTI :step: 65, epoch: 32: 7%|▋ | 67/1000 [00:26<06:01, 2.58it/s] # PTI :step: 66, epoch: 33: 7%|▋ | 67/1000 [00:26<06:01, 2.58it/s] # PTI :step: 66, epoch: 33: 7%|▋ | 68/1000 [00:26<06:04, 2.56it/s] # PTI :step: 67, epoch: 33: 7%|▋ | 68/1000 [00:26<06:04, 2.56it/s] # PTI :step: 67, epoch: 33: 7%|▋ | 69/1000 [00:27<05:59, 2.59it/s] # PTI :step: 68, epoch: 34: 7%|▋ | 69/1000 [00:27<05:59, 2.59it/s] # PTI :step: 68, epoch: 34: 7%|▋ | 70/1000 [00:27<06:02, 2.57it/s] # PTI :step: 69, epoch: 34: 7%|▋ | 70/1000 [00:27<06:02, 2.57it/s] # PTI :step: 69, epoch: 34: 7%|▋ | 71/1000 [00:27<05:58, 2.59it/s] # PTI :step: 70, epoch: 35: 7%|▋ | 71/1000 [00:27<05:58, 2.59it/s] # PTI :step: 70, epoch: 35: 7%|▋ | 72/1000 [00:28<06:01, 2.57it/s] # PTI :step: 71, epoch: 35: 7%|▋ | 72/1000 [00:28<06:01, 2.57it/s] # PTI :step: 71, epoch: 35: 7%|▋ | 73/1000 [00:28<06:00, 2.57it/s] # PTI :step: 72, epoch: 36: 7%|▋ | 73/1000 [00:28<06:00, 2.57it/s] # PTI :step: 72, epoch: 36: 7%|▋ | 74/1000 [00:29<06:02, 2.55it/s] # PTI :step: 73, epoch: 36: 7%|▋ | 74/1000 [00:29<06:02, 2.55it/s] # PTI :step: 73, epoch: 36: 8%|▊ | 75/1000 [00:29<06:02, 2.55it/s] # PTI :step: 74, epoch: 37: 8%|▊ | 75/1000 [00:29<06:02, 2.55it/s] # PTI :step: 74, epoch: 37: 8%|▊ | 76/1000 [00:29<06:03, 2.54it/s] # PTI :step: 75, epoch: 37: 8%|▊ | 76/1000 [00:29<06:03, 2.54it/s] # PTI :step: 75, epoch: 37: 8%|▊ | 77/1000 [00:30<05:57, 2.58it/s] # PTI :step: 76, epoch: 38: 8%|▊ | 77/1000 [00:30<05:57, 2.58it/s] # PTI :step: 76, epoch: 38: 8%|▊ | 78/1000 [00:30<06:02, 2.55it/s] # PTI :step: 77, epoch: 38: 8%|▊ | 78/1000 [00:30<06:02, 2.55it/s] # PTI :step: 77, epoch: 38: 8%|▊ | 79/1000 [00:31<05:59, 2.56it/s] # PTI :step: 78, epoch: 39: 8%|▊ | 79/1000 [00:31<05:59, 2.56it/s] # PTI :step: 78, epoch: 39: 8%|▊ | 80/1000 [00:31<06:01, 2.54it/s] # PTI :step: 79, epoch: 39: 8%|▊ | 80/1000 [00:31<06:01, 2.54it/s] # PTI :step: 79, epoch: 39: 8%|▊ | 81/1000 [00:31<05:56, 2.58it/s] # PTI :step: 80, epoch: 40: 8%|▊ | 81/1000 [00:31<05:56, 2.58it/s] # PTI :step: 80, epoch: 40: 8%|▊ | 82/1000 [00:32<05:58, 2.56it/s] # PTI :step: 81, epoch: 40: 8%|▊ | 82/1000 [00:32<05:58, 2.56it/s] # PTI :step: 81, epoch: 40: 8%|▊ | 83/1000 [00:32<05:56, 2.57it/s] # PTI :step: 82, epoch: 41: 8%|▊ | 83/1000 [00:32<05:56, 2.57it/s] # PTI :step: 82, epoch: 41: 8%|▊ | 84/1000 [00:32<06:00, 2.54it/s] # PTI :step: 83, epoch: 41: 8%|▊ | 84/1000 [00:32<06:00, 2.54it/s] # PTI :step: 83, epoch: 41: 8%|▊ | 85/1000 [00:33<05:55, 2.58it/s] # PTI :step: 84, epoch: 42: 8%|▊ | 85/1000 [00:33<05:55, 2.58it/s] # PTI :step: 84, epoch: 42: 9%|▊ | 86/1000 [00:33<06:01, 2.53it/s] # PTI :step: 85, epoch: 42: 9%|▊ | 86/1000 [00:33<06:01, 2.53it/s] # PTI :step: 85, epoch: 42: 9%|▊ | 87/1000 [00:34<05:56, 2.56it/s] # PTI :step: 86, epoch: 43: 9%|▊ | 87/1000 [00:34<05:56, 2.56it/s] # PTI :step: 86, epoch: 43: 9%|▉ | 88/1000 [00:34<05:57, 2.55it/s] # PTI :step: 87, epoch: 43: 9%|▉ | 88/1000 [00:34<05:57, 2.55it/s] # PTI :step: 87, epoch: 43: 9%|▉ | 89/1000 [00:34<05:52, 2.58it/s] # PTI :step: 88, epoch: 44: 9%|▉ | 89/1000 [00:34<05:52, 2.58it/s] # PTI :step: 88, epoch: 44: 9%|▉ | 90/1000 [00:35<05:54, 2.57it/s] # PTI :step: 89, epoch: 44: 9%|▉ | 90/1000 [00:35<05:54, 2.57it/s] # PTI :step: 89, epoch: 44: 9%|▉ | 91/1000 [00:35<05:54, 2.56it/s] # PTI :step: 90, epoch: 45: 9%|▉ | 91/1000 [00:35<05:54, 2.56it/s] # PTI :step: 90, epoch: 45: 9%|▉ | 92/1000 [00:36<05:56, 2.55it/s] # PTI :step: 91, epoch: 45: 9%|▉ | 92/1000 [00:36<05:56, 2.55it/s] # PTI :step: 91, epoch: 45: 9%|▉ | 93/1000 [00:36<05:53, 2.56it/s] # PTI :step: 92, epoch: 46: 9%|▉ | 93/1000 [00:36<05:53, 2.56it/s] # PTI :step: 92, epoch: 46: 9%|▉ | 94/1000 [00:36<05:56, 2.54it/s] # PTI :step: 93, epoch: 46: 9%|▉ | 94/1000 [00:36<05:56, 2.54it/s] # PTI :step: 93, epoch: 46: 10%|▉ | 95/1000 [00:37<05:51, 2.58it/s] # PTI :step: 94, epoch: 47: 10%|▉ | 95/1000 [00:37<05:51, 2.58it/s] # PTI :step: 94, epoch: 47: 10%|▉ | 96/1000 [00:37<05:56, 2.54it/s] # PTI :step: 95, epoch: 47: 10%|▉ | 96/1000 [00:37<05:56, 2.54it/s] # PTI :step: 95, epoch: 47: 10%|▉ | 97/1000 [00:38<05:51, 2.57it/s] # PTI :step: 96, epoch: 48: 10%|▉ | 97/1000 [00:38<05:51, 2.57it/s] # PTI :step: 96, epoch: 48: 10%|▉ | 98/1000 [00:38<05:52, 2.56it/s] # PTI :step: 97, epoch: 48: 10%|▉ | 98/1000 [00:38<05:52, 2.56it/s] # PTI :step: 97, epoch: 48: 10%|▉ | 99/1000 [00:38<05:50, 2.57it/s] # PTI :step: 98, epoch: 49: 10%|▉ | 99/1000 [00:38<05:50, 2.57it/s] # PTI :step: 98, epoch: 49: 10%|█ | 100/1000 [00:39<06:25, 2.33it/s] # PTI :step: 99, epoch: 49: 10%|█ | 100/1000 [00:39<06:25, 2.33it/s] # PTI :step: 99, epoch: 49: 10%|█ | 101/1000 [00:39<06:15, 2.39it/s] # PTI :step: 100, epoch: 50: 10%|█ | 101/1000 [00:39<06:15, 2.39it/s] # PTI :step: 100, epoch: 50: 10%|█ | 102/1000 [00:40<06:09, 2.43it/s] # PTI :step: 101, epoch: 50: 10%|█ | 102/1000 [00:40<06:09, 2.43it/s] # PTI :step: 101, epoch: 50: 10%|█ | 103/1000 [00:40<06:00, 2.49it/s] # PTI :step: 102, epoch: 51: 10%|█ | 103/1000 [00:40<06:00, 2.49it/s] # PTI :step: 102, epoch: 51: 10%|█ | 104/1000 [00:40<05:58, 2.50it/s] # PTI :step: 103, epoch: 51: 10%|█ | 104/1000 [00:40<05:58, 2.50it/s] # PTI :step: 103, epoch: 51: 10%|█ | 105/1000 [00:41<05:52, 2.54it/s] # PTI :step: 104, epoch: 52: 10%|█ | 105/1000 [00:41<05:52, 2.54it/s] # PTI :step: 104, epoch: 52: 11%|█ | 106/1000 [00:41<05:56, 2.51it/s] # PTI :step: 105, epoch: 52: 11%|█ | 106/1000 [00:41<05:56, 2.51it/s] # PTI :step: 105, epoch: 52: 11%|█ | 107/1000 [00:42<05:50, 2.55it/s] # PTI :step: 106, epoch: 53: 11%|█ | 107/1000 [00:42<05:50, 2.55it/s] # PTI :step: 106, epoch: 53: 11%|█ | 108/1000 [00:42<05:51, 2.54it/s] # PTI :step: 107, epoch: 53: 11%|█ | 108/1000 [00:42<05:51, 2.54it/s] # PTI :step: 107, epoch: 53: 11%|█ | 109/1000 [00:42<05:45, 2.58it/s] # PTI :step: 108, epoch: 54: 11%|█ | 109/1000 [00:42<05:45, 2.58it/s] # PTI :step: 108, epoch: 54: 11%|█ | 110/1000 [00:43<05:47, 2.56it/s] # PTI :step: 109, epoch: 54: 11%|█ | 110/1000 [00:43<05:47, 2.56it/s] # PTI :step: 109, epoch: 54: 11%|█ | 111/1000 [00:43<05:46, 2.57it/s] # PTI :step: 110, epoch: 55: 11%|█ | 111/1000 [00:43<05:46, 2.57it/s] # PTI :step: 110, epoch: 55: 11%|█ | 112/1000 [00:44<05:48, 2.55it/s] # PTI :step: 111, epoch: 55: 11%|█ | 112/1000 [00:44<05:48, 2.55it/s] # PTI :step: 111, epoch: 55: 11%|█▏ | 113/1000 [00:44<05:43, 2.58it/s] # PTI :step: 112, epoch: 56: 11%|█▏ | 113/1000 [00:44<05:43, 2.58it/s] # PTI :step: 112, epoch: 56: 11%|█▏ | 114/1000 [00:44<05:46, 2.56it/s] # PTI :step: 113, epoch: 56: 11%|█▏ | 114/1000 [00:44<05:46, 2.56it/s] # PTI :step: 113, epoch: 56: 12%|█▏ | 115/1000 [00:45<05:42, 2.58it/s] # PTI :step: 114, epoch: 57: 12%|█▏ | 115/1000 [00:45<05:42, 2.58it/s] # PTI :step: 114, epoch: 57: 12%|█▏ | 116/1000 [00:45<05:45, 2.56it/s] # PTI :step: 115, epoch: 57: 12%|█▏ | 116/1000 [00:45<05:45, 2.56it/s] # PTI :step: 115, epoch: 57: 12%|█▏ | 117/1000 [00:45<05:42, 2.58it/s] # PTI :step: 116, epoch: 58: 12%|█▏ | 117/1000 [00:45<05:42, 2.58it/s] # PTI :step: 116, epoch: 58: 12%|█▏ | 118/1000 [00:46<05:43, 2.57it/s] # PTI :step: 117, epoch: 58: 12%|█▏ | 118/1000 [00:46<05:43, 2.57it/s] # PTI :step: 117, epoch: 58: 12%|█▏ | 119/1000 [00:46<05:42, 2.57it/s] # PTI :step: 118, epoch: 59: 12%|█▏ | 119/1000 [00:46<05:42, 2.57it/s] # PTI :step: 118, epoch: 59: 12%|█▏ | 120/1000 [00:47<05:44, 2.55it/s] # PTI :step: 119, epoch: 59: 12%|█▏ | 120/1000 [00:47<05:44, 2.55it/s] # PTI :step: 119, epoch: 59: 12%|█▏ | 121/1000 [00:47<05:41, 2.58it/s] # PTI :step: 120, epoch: 60: 12%|█▏ | 121/1000 [00:47<05:41, 2.58it/s] # PTI :step: 120, epoch: 60: 12%|█▏ | 122/1000 [00:47<05:43, 2.55it/s] # PTI :step: 121, epoch: 60: 12%|█▏ | 122/1000 [00:47<05:43, 2.55it/s] # PTI :step: 121, epoch: 60: 12%|█▏ | 123/1000 [00:48<05:39, 2.58it/s] # PTI :step: 122, epoch: 61: 12%|█▏ | 123/1000 [00:48<05:39, 2.58it/s] # PTI :step: 122, epoch: 61: 12%|█▏ | 124/1000 [00:48<05:45, 2.54it/s] # PTI :step: 123, epoch: 61: 12%|█▏ | 124/1000 [00:48<05:45, 2.54it/s] # PTI :step: 123, epoch: 61: 12%|█▎ | 125/1000 [00:49<05:40, 2.57it/s] # PTI :step: 124, epoch: 62: 12%|█▎ | 125/1000 [00:49<05:40, 2.57it/s] # PTI :step: 124, epoch: 62: 13%|█▎ | 126/1000 [00:49<05:42, 2.55it/s] # PTI :step: 125, epoch: 62: 13%|█▎ | 126/1000 [00:49<05:42, 2.55it/s] # PTI :step: 125, epoch: 62: 13%|█▎ | 127/1000 [00:49<05:39, 2.57it/s] # PTI :step: 126, epoch: 63: 13%|█▎ | 127/1000 [00:49<05:39, 2.57it/s] # PTI :step: 126, epoch: 63: 13%|█▎ | 128/1000 [00:50<05:41, 2.56it/s] # PTI :step: 127, epoch: 63: 13%|█▎ | 128/1000 [00:50<05:41, 2.56it/s] # PTI :step: 127, epoch: 63: 13%|█▎ | 129/1000 [00:50<05:39, 2.56it/s] # PTI :step: 128, epoch: 64: 13%|█▎ | 129/1000 [00:50<05:39, 2.56it/s] # PTI :step: 128, epoch: 64: 13%|█▎ | 130/1000 [00:51<05:41, 2.55it/s] # PTI :step: 129, epoch: 64: 13%|█▎ | 130/1000 [00:51<05:41, 2.55it/s] # PTI :step: 129, epoch: 64: 13%|█▎ | 131/1000 [00:51<05:37, 2.58it/s] # PTI :step: 130, epoch: 65: 13%|█▎ | 131/1000 [00:51<05:37, 2.58it/s] # PTI :step: 130, epoch: 65: 13%|█▎ | 132/1000 [00:51<05:41, 2.54it/s] # PTI :step: 131, epoch: 65: 13%|█▎ | 132/1000 [00:51<05:41, 2.54it/s] # PTI :step: 131, epoch: 65: 13%|█▎ | 133/1000 [00:52<05:38, 2.56it/s] # PTI :step: 132, epoch: 66: 13%|█▎ | 133/1000 [00:52<05:38, 2.56it/s] # PTI :step: 132, epoch: 66: 13%|█▎ | 134/1000 [00:52<05:40, 2.54it/s] # PTI :step: 133, epoch: 66: 13%|█▎ | 134/1000 [00:52<05:40, 2.54it/s] # PTI :step: 133, epoch: 66: 14%|█▎ | 135/1000 [00:53<05:35, 2.58it/s] # PTI :step: 134, epoch: 67: 14%|█▎ | 135/1000 [00:53<05:35, 2.58it/s] # PTI :step: 134, epoch: 67: 14%|█▎ | 136/1000 [00:53<05:38, 2.55it/s] # PTI :step: 135, epoch: 67: 14%|█▎ | 136/1000 [00:53<05:38, 2.55it/s] # PTI :step: 135, epoch: 67: 14%|█▎ | 137/1000 [00:53<05:37, 2.56it/s] # PTI :step: 136, epoch: 68: 14%|█▎ | 137/1000 [00:53<05:37, 2.56it/s] # PTI :step: 136, epoch: 68: 14%|█▍ | 138/1000 [00:54<05:38, 2.54it/s] # PTI :step: 137, epoch: 68: 14%|█▍ | 138/1000 [00:54<05:38, 2.54it/s] # PTI :step: 137, epoch: 68: 14%|█▍ | 139/1000 [00:54<05:35, 2.57it/s] # PTI :step: 138, epoch: 69: 14%|█▍ | 139/1000 [00:54<05:35, 2.57it/s] # PTI :step: 138, epoch: 69: 14%|█▍ | 140/1000 [00:54<05:37, 2.54it/s] # PTI :step: 139, epoch: 69: 14%|█▍ | 140/1000 [00:54<05:37, 2.54it/s] # PTI :step: 139, epoch: 69: 14%|█▍ | 141/1000 [00:55<05:33, 2.57it/s] # PTI :step: 140, epoch: 70: 14%|█▍ | 141/1000 [00:55<05:33, 2.57it/s] # PTI :step: 140, epoch: 70: 14%|█▍ | 142/1000 [00:55<05:36, 2.55it/s] # PTI :step: 141, epoch: 70: 14%|█▍ | 142/1000 [00:55<05:36, 2.55it/s] # PTI :step: 141, epoch: 70: 14%|█▍ | 143/1000 [00:56<05:34, 2.56it/s] # PTI :step: 142, epoch: 71: 14%|█▍ | 143/1000 [00:56<05:34, 2.56it/s] # PTI :step: 142, epoch: 71: 14%|█▍ | 144/1000 [00:56<05:36, 2.54it/s] # PTI :step: 143, epoch: 71: 14%|█▍ | 144/1000 [00:56<05:36, 2.54it/s] # PTI :step: 143, epoch: 71: 14%|█▍ | 145/1000 [00:56<05:35, 2.55it/s] # PTI :step: 144, epoch: 72: 14%|█▍ | 145/1000 [00:56<05:35, 2.55it/s] # PTI :step: 144, epoch: 72: 15%|█▍ | 146/1000 [00:57<05:39, 2.52it/s] # PTI :step: 145, epoch: 72: 15%|█▍ | 146/1000 [00:57<05:39, 2.52it/s] # PTI :step: 145, epoch: 72: 15%|█▍ | 147/1000 [00:57<05:34, 2.55it/s] # PTI :step: 146, epoch: 73: 15%|█▍ | 147/1000 [00:57<05:34, 2.55it/s] # PTI :step: 146, epoch: 73: 15%|█▍ | 148/1000 [00:58<05:36, 2.53it/s] # PTI :step: 147, epoch: 73: 15%|█▍ | 148/1000 [00:58<05:36, 2.53it/s] # PTI :step: 147, epoch: 73: 15%|█▍ | 149/1000 [00:58<05:35, 2.53it/s] # PTI :step: 148, epoch: 74: 15%|█▍ | 149/1000 [00:58<05:35, 2.53it/s] # PTI :step: 148, epoch: 74: 15%|█▌ | 150/1000 [00:58<05:36, 2.53it/s] # PTI :step: 149, epoch: 74: 15%|█▌ | 150/1000 [00:58<05:36, 2.53it/s] # PTI :step: 149, epoch: 74: 15%|█▌ | 151/1000 [00:59<05:31, 2.56it/s] # PTI :step: 150, epoch: 75: 15%|█▌ | 151/1000 [00:59<05:31, 2.56it/s] # PTI :step: 150, epoch: 75: 15%|█▌ | 152/1000 [00:59<05:33, 2.54it/s] # PTI :step: 151, epoch: 75: 15%|█▌ | 152/1000 [00:59<05:33, 2.54it/s] # PTI :step: 151, epoch: 75: 15%|█▌ | 153/1000 [01:00<05:29, 2.57it/s] # PTI :step: 152, epoch: 76: 15%|█▌ | 153/1000 [01:00<05:29, 2.57it/s] # PTI :step: 152, epoch: 76: 15%|█▌ | 154/1000 [01:00<05:31, 2.55it/s] # PTI :step: 153, epoch: 76: 15%|█▌ | 154/1000 [01:00<05:31, 2.55it/s] # PTI :step: 153, epoch: 76: 16%|█▌ | 155/1000 [01:00<05:27, 2.58it/s] # PTI :step: 154, epoch: 77: 16%|█▌ | 155/1000 [01:00<05:27, 2.58it/s] # PTI :step: 154, epoch: 77: 16%|█▌ | 156/1000 [01:01<05:29, 2.56it/s] # PTI :step: 155, epoch: 77: 16%|█▌ | 156/1000 [01:01<05:29, 2.56it/s] # PTI :step: 155, epoch: 77: 16%|█▌ | 157/1000 [01:01<05:26, 2.58it/s] # PTI :step: 156, epoch: 78: 16%|█▌ | 157/1000 [01:01<05:26, 2.58it/s] # PTI :step: 156, epoch: 78: 16%|█▌ | 158/1000 [01:02<05:29, 2.56it/s] # PTI :step: 157, epoch: 78: 16%|█▌ | 158/1000 [01:02<05:29, 2.56it/s] # PTI :step: 157, epoch: 78: 16%|█▌ | 159/1000 [01:02<05:27, 2.57it/s] # PTI :step: 158, epoch: 79: 16%|█▌ | 159/1000 [01:02<05:27, 2.57it/s] # PTI :step: 158, epoch: 79: 16%|█▌ | 160/1000 [01:02<05:29, 2.55it/s] # PTI :step: 159, epoch: 79: 16%|█▌ | 160/1000 [01:02<05:29, 2.55it/s] # PTI :step: 159, epoch: 79: 16%|█▌ | 161/1000 [01:03<05:25, 2.58it/s] # PTI :step: 160, epoch: 80: 16%|█▌ | 161/1000 [01:03<05:25, 2.58it/s] # PTI :step: 160, epoch: 80: 16%|█▌ | 162/1000 [01:03<05:27, 2.56it/s] # PTI :step: 161, epoch: 80: 16%|█▌ | 162/1000 [01:03<05:27, 2.56it/s] # PTI :step: 161, epoch: 80: 16%|█▋ | 163/1000 [01:03<05:23, 2.59it/s] # PTI :step: 162, epoch: 81: 16%|█▋ | 163/1000 [01:03<05:23, 2.59it/s] # PTI :step: 162, epoch: 81: 16%|█▋ | 164/1000 [01:04<05:25, 2.57it/s] # PTI :step: 163, epoch: 81: 16%|█▋ | 164/1000 [01:04<05:25, 2.57it/s] # PTI :step: 163, epoch: 81: 16%|█▋ | 165/1000 [01:04<05:27, 2.55it/s] # PTI :step: 164, epoch: 82: 16%|█▋ | 165/1000 [01:04<05:27, 2.55it/s] # PTI :step: 164, epoch: 82: 17%|█▋ | 166/1000 [01:05<05:28, 2.54it/s] # PTI :step: 165, epoch: 82: 17%|█▋ | 166/1000 [01:05<05:28, 2.54it/s] # PTI :step: 165, epoch: 82: 17%|█▋ | 167/1000 [01:05<05:24, 2.57it/s] # PTI :step: 166, epoch: 83: 17%|█▋ | 167/1000 [01:05<05:24, 2.57it/s] # PTI :step: 166, epoch: 83: 17%|█▋ | 168/1000 [01:05<05:25, 2.56it/s] # PTI :step: 167, epoch: 83: 17%|█▋ | 168/1000 [01:05<05:25, 2.56it/s] # PTI :step: 167, epoch: 83: 17%|█▋ | 169/1000 [01:06<05:21, 2.58it/s] # PTI :step: 168, epoch: 84: 17%|█▋ | 169/1000 [01:06<05:21, 2.58it/s] # PTI :step: 168, epoch: 84: 17%|█▋ | 170/1000 [01:06<05:26, 2.54it/s] # PTI :step: 169, epoch: 84: 17%|█▋ | 170/1000 [01:06<05:26, 2.54it/s] # PTI :step: 169, epoch: 84: 17%|█▋ | 171/1000 [01:07<05:22, 2.57it/s] # PTI :step: 170, epoch: 85: 17%|█▋ | 171/1000 [01:07<05:22, 2.57it/s] # PTI :step: 170, epoch: 85: 17%|█▋ | 172/1000 [01:07<05:24, 2.55it/s] # PTI :step: 171, epoch: 85: 17%|█▋ | 172/1000 [01:07<05:24, 2.55it/s] # PTI :step: 171, epoch: 85: 17%|█▋ | 173/1000 [01:07<05:19, 2.59it/s] # PTI :step: 172, epoch: 86: 17%|█▋ | 173/1000 [01:07<05:19, 2.59it/s] # PTI :step: 172, epoch: 86: 17%|█▋ | 174/1000 [01:08<05:21, 2.57it/s] # PTI :step: 173, epoch: 86: 17%|█▋ | 174/1000 [01:08<05:21, 2.57it/s] # PTI :step: 173, epoch: 86: 18%|█▊ | 175/1000 [01:08<05:19, 2.58it/s] # PTI :step: 174, epoch: 87: 18%|█▊ | 175/1000 [01:08<05:19, 2.58it/s] # PTI :step: 174, epoch: 87: 18%|█▊ | 176/1000 [01:09<05:21, 2.56it/s] # PTI :step: 175, epoch: 87: 18%|█▊ | 176/1000 [01:09<05:21, 2.56it/s] # PTI :step: 175, epoch: 87: 18%|█▊ | 177/1000 [01:09<05:21, 2.56it/s] # PTI :step: 176, epoch: 88: 18%|█▊ | 177/1000 [01:09<05:21, 2.56it/s] # PTI :step: 176, epoch: 88: 18%|█▊ | 178/1000 [01:09<05:24, 2.53it/s] # PTI :step: 177, epoch: 88: 18%|█▊ | 178/1000 [01:09<05:24, 2.53it/s] # PTI :step: 177, epoch: 88: 18%|█▊ | 179/1000 [01:10<05:20, 2.56it/s] # PTI :step: 178, epoch: 89: 18%|█▊ | 179/1000 [01:10<05:20, 2.56it/s] # PTI :step: 178, epoch: 89: 18%|█▊ | 180/1000 [01:10<05:24, 2.53it/s] # PTI :step: 179, epoch: 89: 18%|█▊ | 180/1000 [01:10<05:24, 2.53it/s] # PTI :step: 179, epoch: 89: 18%|█▊ | 181/1000 [01:11<05:19, 2.57it/s] # PTI :step: 180, epoch: 90: 18%|█▊ | 181/1000 [01:11<05:19, 2.57it/s] # PTI :step: 180, epoch: 90: 18%|█▊ | 182/1000 [01:11<05:20, 2.55it/s] # PTI :step: 181, epoch: 90: 18%|█▊ | 182/1000 [01:11<05:20, 2.55it/s] # PTI :step: 181, epoch: 90: 18%|█▊ | 183/1000 [01:11<05:17, 2.57it/s] # PTI :step: 182, epoch: 91: 18%|█▊ | 183/1000 [01:11<05:17, 2.57it/s] # PTI :step: 182, epoch: 91: 18%|█▊ | 184/1000 [01:12<05:19, 2.56it/s] # PTI :step: 183, epoch: 91: 18%|█▊ | 184/1000 [01:12<05:19, 2.56it/s] # PTI :step: 183, epoch: 91: 18%|█▊ | 185/1000 [01:12<05:15, 2.58it/s] # PTI :step: 184, epoch: 92: 18%|█▊ | 185/1000 [01:12<05:15, 2.58it/s] # PTI :step: 184, epoch: 92: 19%|█▊ | 186/1000 [01:12<05:17, 2.57it/s] # PTI :step: 185, epoch: 92: 19%|█▊ | 186/1000 [01:12<05:17, 2.57it/s] # PTI :step: 185, epoch: 92: 19%|█▊ | 187/1000 [01:13<05:13, 2.60it/s] # PTI :step: 186, epoch: 93: 19%|█▊ | 187/1000 [01:13<05:13, 2.60it/s] # PTI :step: 186, epoch: 93: 19%|█▉ | 188/1000 [01:13<05:18, 2.55it/s] # PTI :step: 187, epoch: 93: 19%|█▉ | 188/1000 [01:13<05:18, 2.55it/s] # PTI :step: 187, epoch: 93: 19%|█▉ | 189/1000 [01:14<05:14, 2.58it/s] # PTI :step: 188, epoch: 94: 19%|█▉ | 189/1000 [01:14<05:14, 2.58it/s] # PTI :step: 188, epoch: 94: 19%|█▉ | 190/1000 [01:14<05:16, 2.56it/s] # PTI :step: 189, epoch: 94: 19%|█▉ | 190/1000 [01:14<05:16, 2.56it/s] # PTI :step: 189, epoch: 94: 19%|█▉ | 191/1000 [01:14<05:12, 2.59it/s] # PTI :step: 190, epoch: 95: 19%|█▉ | 191/1000 [01:14<05:12, 2.59it/s] # PTI :step: 190, epoch: 95: 19%|█▉ | 192/1000 [01:15<05:15, 2.56it/s] # PTI :step: 191, epoch: 95: 19%|█▉ | 192/1000 [01:15<05:15, 2.56it/s] # PTI :step: 191, epoch: 95: 19%|█▉ | 193/1000 [01:15<05:13, 2.57it/s] # PTI :step: 192, epoch: 96: 19%|█▉ | 193/1000 [01:15<05:13, 2.57it/s] # PTI :step: 192, epoch: 96: 19%|█▉ | 194/1000 [01:16<05:15, 2.55it/s] # PTI :step: 193, epoch: 96: 19%|█▉ | 194/1000 [01:16<05:15, 2.55it/s] # PTI :step: 193, epoch: 96: 20%|█▉ | 195/1000 [01:16<05:15, 2.55it/s] # PTI :step: 194, epoch: 97: 20%|█▉ | 195/1000 [01:16<05:15, 2.55it/s] # PTI :step: 194, epoch: 97: 20%|█▉ | 196/1000 [01:16<05:17, 2.53it/s] # PTI :step: 195, epoch: 97: 20%|█▉ | 196/1000 [01:16<05:17, 2.53it/s] # PTI :step: 195, epoch: 97: 20%|█▉ | 197/1000 [01:17<05:12, 2.57it/s] # PTI :step: 196, epoch: 98: 20%|█▉ | 197/1000 [01:17<05:12, 2.57it/s] # PTI :step: 196, epoch: 98: 20%|█▉ | 198/1000 [01:17<05:16, 2.54it/s] # PTI :step: 197, epoch: 98: 20%|█▉ | 198/1000 [01:17<05:16, 2.54it/s] # PTI :step: 197, epoch: 98: 20%|█▉ | 199/1000 [01:18<05:12, 2.57it/s] # PTI :step: 198, epoch: 99: 20%|█▉ | 199/1000 [01:18<05:12, 2.57it/s] # PTI :step: 198, epoch: 99: 20%|██ | 200/1000 [01:18<05:13, 2.55it/s] # PTI :step: 199, epoch: 99: 20%|██ | 200/1000 [01:18<05:13, 2.55it/s] # PTI :step: 199, epoch: 99: 20%|██ | 201/1000 [01:18<05:10, 2.57it/s] # PTI :step: 200, epoch: 100: 20%|██ | 201/1000 [01:18<05:10, 2.57it/s] # PTI :step: 200, epoch: 100: 20%|██ | 202/1000 [01:19<05:12, 2.55it/s] # PTI :step: 201, epoch: 100: 20%|██ | 202/1000 [01:19<05:12, 2.55it/s] # PTI :step: 201, epoch: 100: 20%|██ | 203/1000 [01:19<05:11, 2.56it/s] # PTI :step: 202, epoch: 101: 20%|██ | 203/1000 [01:19<05:11, 2.56it/s] # PTI :step: 202, epoch: 101: 20%|██ | 204/1000 [01:19<05:12, 2.54it/s] # PTI :step: 203, epoch: 101: 20%|██ | 204/1000 [01:19<05:12, 2.54it/s] # PTI :step: 203, epoch: 101: 20%|██ | 205/1000 [01:20<05:08, 2.58it/s] # PTI :step: 204, epoch: 102: 20%|██ | 205/1000 [01:20<05:08, 2.58it/s] # PTI :step: 204, epoch: 102: 21%|██ | 206/1000 [01:20<05:13, 2.53it/s] # PTI :step: 205, epoch: 102: 21%|██ | 206/1000 [01:20<05:13, 2.53it/s] # PTI :step: 205, epoch: 102: 21%|██ | 207/1000 [01:21<05:09, 2.56it/s] # PTI :step: 206, epoch: 103: 21%|██ | 207/1000 [01:21<05:09, 2.56it/s] # PTI :step: 206, epoch: 103: 21%|██ | 208/1000 [01:21<05:11, 2.54it/s] # PTI :step: 207, epoch: 103: 21%|██ | 208/1000 [01:21<05:11, 2.54it/s] # PTI :step: 207, epoch: 103: 21%|██ | 209/1000 [01:21<05:07, 2.58it/s] # PTI :step: 208, epoch: 104: 21%|██ | 209/1000 [01:21<05:07, 2.58it/s] # PTI :step: 208, epoch: 104: 21%|██ | 210/1000 [01:22<05:08, 2.56it/s] # PTI :step: 209, epoch: 104: 21%|██ | 210/1000 [01:22<05:08, 2.56it/s] # PTI :step: 209, epoch: 104: 21%|██ | 211/1000 [01:22<05:06, 2.57it/s] # PTI :step: 210, epoch: 105: 21%|██ | 211/1000 [01:22<05:06, 2.57it/s] # PTI :step: 210, epoch: 105: 21%|██ | 212/1000 [01:23<05:09, 2.55it/s] # PTI :step: 211, epoch: 105: 21%|██ | 212/1000 [01:23<05:09, 2.55it/s] # PTI :step: 211, epoch: 105: 21%|██▏ | 213/1000 [01:23<05:06, 2.57it/s] # PTI :step: 212, epoch: 106: 21%|██▏ | 213/1000 [01:23<05:06, 2.57it/s] # PTI :step: 212, epoch: 106: 21%|██▏ | 214/1000 [01:23<05:09, 2.54it/s] # PTI :step: 213, epoch: 106: 21%|██▏ | 214/1000 [01:23<05:09, 2.54it/s] # PTI :step: 213, epoch: 106: 22%|██▏ | 215/1000 [01:24<05:05, 2.57it/s] # PTI :step: 214, epoch: 107: 22%|██▏ | 215/1000 [01:24<05:05, 2.57it/s] # PTI :step: 214, epoch: 107: 22%|██▏ | 216/1000 [01:24<05:07, 2.55it/s] # PTI :step: 215, epoch: 107: 22%|██▏ | 216/1000 [01:24<05:07, 2.55it/s] # PTI :step: 215, epoch: 107: 22%|██▏ | 217/1000 [01:25<05:03, 2.58it/s] # PTI :step: 216, epoch: 108: 22%|██▏ | 217/1000 [01:25<05:03, 2.58it/s] # PTI :step: 216, epoch: 108: 22%|██▏ | 218/1000 [01:25<05:06, 2.55it/s] # PTI :step: 217, epoch: 108: 22%|██▏ | 218/1000 [01:25<05:06, 2.55it/s] # PTI :step: 217, epoch: 108: 22%|██▏ | 219/1000 [01:25<05:08, 2.53it/s] # PTI :step: 218, epoch: 109: 22%|██▏ | 219/1000 [01:25<05:08, 2.53it/s] # PTI :step: 218, epoch: 109: 22%|██▏ | 220/1000 [01:26<05:09, 2.52it/s] # PTI :step: 219, epoch: 109: 22%|██▏ | 220/1000 [01:26<05:09, 2.52it/s] # PTI :step: 219, epoch: 109: 22%|██▏ | 221/1000 [01:26<05:07, 2.53it/s] # PTI :step: 220, epoch: 110: 22%|██▏ | 221/1000 [01:26<05:07, 2.53it/s] # PTI :step: 220, epoch: 110: 22%|██▏ | 222/1000 [01:27<05:08, 2.52it/s] # PTI :step: 221, epoch: 110: 22%|██▏ | 222/1000 [01:27<05:08, 2.52it/s] # PTI :step: 221, epoch: 110: 22%|██▏ | 223/1000 [01:27<05:04, 2.55it/s] # PTI :step: 222, epoch: 111: 22%|██▏ | 223/1000 [01:27<05:04, 2.55it/s] # PTI :step: 222, epoch: 111: 22%|██▏ | 224/1000 [01:27<05:06, 2.53it/s] # PTI :step: 223, epoch: 111: 22%|██▏ | 224/1000 [01:27<05:06, 2.53it/s] # PTI :step: 223, epoch: 111: 22%|██▎ | 225/1000 [01:28<05:04, 2.55it/s] # PTI :step: 224, epoch: 112: 22%|██▎ | 225/1000 [01:28<05:04, 2.55it/s] # PTI :step: 224, epoch: 112: 23%|██▎ | 226/1000 [01:28<05:06, 2.53it/s] # PTI :step: 225, epoch: 112: 23%|██▎ | 226/1000 [01:28<05:06, 2.53it/s] # PTI :step: 225, epoch: 112: 23%|██▎ | 227/1000 [01:29<05:01, 2.56it/s] # PTI :step: 226, epoch: 113: 23%|██▎ | 227/1000 [01:29<05:01, 2.56it/s] # PTI :step: 226, epoch: 113: 23%|██▎ | 228/1000 [01:29<05:03, 2.54it/s] # PTI :step: 227, epoch: 113: 23%|██▎ | 228/1000 [01:29<05:03, 2.54it/s] # PTI :step: 227, epoch: 113: 23%|██▎ | 229/1000 [01:29<05:00, 2.56it/s] # PTI :step: 228, epoch: 114: 23%|██▎ | 229/1000 [01:29<05:00, 2.56it/s] # PTI :step: 228, epoch: 114: 23%|██▎ | 230/1000 [01:30<05:02, 2.54it/s] # PTI :step: 229, epoch: 114: 23%|██▎ | 230/1000 [01:30<05:02, 2.54it/s] # PTI :step: 229, epoch: 114: 23%|██▎ | 231/1000 [01:30<05:02, 2.54it/s] # PTI :step: 230, epoch: 115: 23%|██▎ | 231/1000 [01:30<05:02, 2.54it/s] # PTI :step: 230, epoch: 115: 23%|██▎ | 232/1000 [01:30<05:05, 2.51it/s] # PTI :step: 231, epoch: 115: 23%|██▎ | 232/1000 [01:30<05:05, 2.51it/s] # PTI :step: 231, epoch: 115: 23%|██▎ | 233/1000 [01:31<05:02, 2.54it/s] # PTI :step: 232, epoch: 116: 23%|██▎ | 233/1000 [01:31<05:02, 2.54it/s] # PTI :step: 232, epoch: 116: 23%|██▎ | 234/1000 [01:31<05:03, 2.52it/s] # PTI :step: 233, epoch: 116: 23%|██▎ | 234/1000 [01:31<05:03, 2.52it/s] # PTI :step: 233, epoch: 116: 24%|██▎ | 235/1000 [01:32<04:59, 2.56it/s] # PTI :step: 234, epoch: 117: 24%|██▎ | 235/1000 [01:32<04:59, 2.56it/s] # PTI :step: 234, epoch: 117: 24%|██▎ | 236/1000 [01:32<05:00, 2.54it/s] # PTI :step: 235, epoch: 117: 24%|██▎ | 236/1000 [01:32<05:00, 2.54it/s] # PTI :step: 235, epoch: 117: 24%|██▎ | 237/1000 [01:32<04:56, 2.57it/s] # PTI :step: 236, epoch: 118: 24%|██▎ | 237/1000 [01:32<04:56, 2.57it/s] # PTI :step: 236, epoch: 118: 24%|██▍ | 238/1000 [01:33<04:58, 2.55it/s] # PTI :step: 237, epoch: 118: 24%|██▍ | 238/1000 [01:33<04:58, 2.55it/s] # PTI :step: 237, epoch: 118: 24%|██▍ | 239/1000 [01:33<04:56, 2.57it/s] # PTI :step: 238, epoch: 119: 24%|██▍ | 239/1000 [01:33<04:56, 2.57it/s] # PTI :step: 238, epoch: 119: 24%|██▍ | 240/1000 [01:34<04:58, 2.55it/s] # PTI :step: 239, epoch: 119: 24%|██▍ | 240/1000 [01:34<04:58, 2.55it/s] # PTI :step: 239, epoch: 119: 24%|██▍ | 241/1000 [01:34<04:55, 2.57it/s] # PTI :step: 240, epoch: 120: 24%|██▍ | 241/1000 [01:34<04:55, 2.57it/s] # PTI :step: 240, epoch: 120: 24%|██▍ | 242/1000 [01:34<04:56, 2.55it/s] # PTI :step: 241, epoch: 120: 24%|██▍ | 242/1000 [01:34<04:56, 2.55it/s] # PTI :step: 241, epoch: 120: 24%|██▍ | 243/1000 [01:35<04:53, 2.58it/s] # PTI :step: 242, epoch: 121: 24%|██▍ | 243/1000 [01:35<04:53, 2.58it/s] # PTI :step: 242, epoch: 121: 24%|██▍ | 244/1000 [01:35<04:56, 2.55it/s] # PTI :step: 243, epoch: 121: 24%|██▍ | 244/1000 [01:35<04:56, 2.55it/s] # PTI :step: 243, epoch: 121: 24%|██▍ | 245/1000 [01:36<04:53, 2.57it/s] # PTI :step: 244, epoch: 122: 24%|██▍ | 245/1000 [01:36<04:53, 2.57it/s] # PTI :step: 244, epoch: 122: 25%|██▍ | 246/1000 [01:36<04:55, 2.55it/s] # PTI :step: 245, epoch: 122: 25%|██▍ | 246/1000 [01:36<04:55, 2.55it/s] # PTI :step: 245, epoch: 122: 25%|██▍ | 247/1000 [01:36<04:52, 2.57it/s] # PTI :step: 246, epoch: 123: 25%|██▍ | 247/1000 [01:36<04:52, 2.57it/s] # PTI :step: 246, epoch: 123: 25%|██▍ | 248/1000 [01:37<04:54, 2.55it/s] # PTI :step: 247, epoch: 123: 25%|██▍ | 248/1000 [01:37<04:54, 2.55it/s] # PTI :step: 247, epoch: 123: 25%|██▍ | 249/1000 [01:37<04:52, 2.57it/s] # PTI :step: 248, epoch: 124: 25%|██▍ | 249/1000 [01:37<04:52, 2.57it/s] # PTI :step: 248, epoch: 124: 25%|██▌ | 250/1000 [01:38<04:53, 2.55it/s] # PTI :step: 249, epoch: 124: 25%|██▌ | 250/1000 [01:38<04:53, 2.55it/s] # PTI :step: 249, epoch: 124: 25%|██▌ | 251/1000 [01:38<04:51, 2.57it/s] # PTI :step: 250, epoch: 125: 25%|██▌ | 251/1000 [01:38<04:51, 2.57it/s] # PTI :step: 250, epoch: 125: 25%|██▌ | 252/1000 [01:38<04:53, 2.55it/s] # PTI :step: 251, epoch: 125: 25%|██▌ | 252/1000 [01:38<04:53, 2.55it/s] # PTI :step: 251, epoch: 125: 25%|██▌ | 253/1000 [01:39<04:50, 2.58it/s] # PTI :step: 252, epoch: 126: 25%|██▌ | 253/1000 [01:39<04:50, 2.58it/s] # PTI :step: 252, epoch: 126: 25%|██▌ | 254/1000 [01:39<04:52, 2.55it/s] # PTI :step: 253, epoch: 126: 25%|██▌ | 254/1000 [01:39<04:52, 2.55it/s] # PTI :step: 253, epoch: 126: 26%|██▌ | 255/1000 [01:39<04:49, 2.58it/s] # PTI :step: 254, epoch: 127: 26%|██▌ | 255/1000 [01:39<04:49, 2.58it/s] # PTI :step: 254, epoch: 127: 26%|██▌ | 256/1000 [01:40<04:51, 2.55it/s] # PTI :step: 255, epoch: 127: 26%|██▌ | 256/1000 [01:40<04:51, 2.55it/s] # PTI :step: 255, epoch: 127: 26%|██▌ | 257/1000 [01:40<04:49, 2.57it/s] # PTI :step: 256, epoch: 128: 26%|██▌ | 257/1000 [01:40<04:49, 2.57it/s] # PTI :step: 256, epoch: 128: 26%|██▌ | 258/1000 [01:41<04:51, 2.54it/s] # PTI :step: 257, epoch: 128: 26%|██▌ | 258/1000 [01:41<04:51, 2.54it/s] # PTI :step: 257, epoch: 128: 26%|██▌ | 259/1000 [01:41<04:51, 2.54it/s] # PTI :step: 258, epoch: 129: 26%|██▌ | 259/1000 [01:41<04:51, 2.54it/s] # PTI :step: 258, epoch: 129: 26%|██▌ | 260/1000 [01:41<04:52, 2.53it/s] # PTI :step: 259, epoch: 129: 26%|██▌ | 260/1000 [01:41<04:52, 2.53it/s] # PTI :step: 259, epoch: 129: 26%|██▌ | 261/1000 [01:42<04:48, 2.57it/s] # PTI :step: 260, epoch: 130: 26%|██▌ | 261/1000 [01:42<04:48, 2.57it/s] # PTI :step: 260, epoch: 130: 26%|██▌ | 262/1000 [01:42<04:50, 2.54it/s] # PTI :step: 261, epoch: 130: 26%|██▌ | 262/1000 [01:42<04:50, 2.54it/s] # PTI :step: 261, epoch: 130: 26%|██▋ | 263/1000 [01:43<04:47, 2.57it/s] # PTI :step: 262, epoch: 131: 26%|██▋ | 263/1000 [01:43<04:47, 2.57it/s] # PTI :step: 262, epoch: 131: 26%|██▋ | 264/1000 [01:43<04:49, 2.54it/s] # PTI :step: 263, epoch: 131: 26%|██▋ | 264/1000 [01:43<04:49, 2.54it/s] # PTI :step: 263, epoch: 131: 26%|██▋ | 265/1000 [01:43<04:45, 2.57it/s] # PTI :step: 264, epoch: 132: 26%|██▋ | 265/1000 [01:43<04:45, 2.57it/s] # PTI :step: 264, epoch: 132: 27%|██▋ | 266/1000 [01:44<04:47, 2.55it/s] # PTI :step: 265, epoch: 132: 27%|██▋ | 266/1000 [01:44<04:47, 2.55it/s] # PTI :step: 265, epoch: 132: 27%|██▋ | 267/1000 [01:44<04:45, 2.57it/s] # PTI :step: 266, epoch: 133: 27%|██▋ | 267/1000 [01:44<04:45, 2.57it/s] # PTI :step: 266, epoch: 133: 27%|██▋ | 268/1000 [01:45<04:46, 2.55it/s] # PTI :step: 267, epoch: 133: 27%|██▋ | 268/1000 [01:45<04:46, 2.55it/s] # PTI :step: 267, epoch: 133: 27%|██▋ | 269/1000 [01:45<04:43, 2.58it/s] # PTI :step: 268, epoch: 134: 27%|██▋ | 269/1000 [01:45<04:43, 2.58it/s] # PTI :step: 268, epoch: 134: 27%|██▋ | 270/1000 [01:45<04:47, 2.54it/s] # PTI :step: 269, epoch: 134: 27%|██▋ | 270/1000 [01:45<04:47, 2.54it/s] # PTI :step: 269, epoch: 134: 27%|██▋ | 271/1000 [01:46<04:43, 2.57it/s] # PTI :step: 270, epoch: 135: 27%|██▋ | 271/1000 [01:46<04:43, 2.57it/s] # PTI :step: 270, epoch: 135: 27%|██▋ | 272/1000 [01:46<04:46, 2.54it/s] # PTI :step: 271, epoch: 135: 27%|██▋ | 272/1000 [01:46<04:46, 2.54it/s] # PTI :step: 271, epoch: 135: 27%|██▋ | 273/1000 [01:47<04:43, 2.57it/s] # PTI :step: 272, epoch: 136: 27%|██▋ | 273/1000 [01:47<04:43, 2.57it/s] # PTI :step: 272, epoch: 136: 27%|██▋ | 274/1000 [01:47<04:44, 2.55it/s] # PTI :step: 273, epoch: 136: 27%|██▋ | 274/1000 [01:47<04:44, 2.55it/s] # PTI :step: 273, epoch: 136: 28%|██▊ | 275/1000 [01:47<04:43, 2.55it/s] # PTI :step: 274, epoch: 137: 28%|██▊ | 275/1000 [01:47<04:43, 2.55it/s] # PTI :step: 274, epoch: 137: 28%|██▊ | 276/1000 [01:48<04:45, 2.53it/s] # PTI :step: 275, epoch: 137: 28%|██▊ | 276/1000 [01:48<04:45, 2.53it/s] # PTI :step: 275, epoch: 137: 28%|██▊ | 277/1000 [01:48<04:42, 2.56it/s] # PTI :step: 276, epoch: 138: 28%|██▊ | 277/1000 [01:48<04:42, 2.56it/s] # PTI :step: 276, epoch: 138: 28%|██▊ | 278/1000 [01:48<04:43, 2.54it/s] # PTI :step: 277, epoch: 138: 28%|██▊ | 278/1000 [01:48<04:43, 2.54it/s] # PTI :step: 277, epoch: 138: 28%|██▊ | 279/1000 [01:49<04:40, 2.57it/s] # PTI :step: 278, epoch: 139: 28%|██▊ | 279/1000 [01:49<04:40, 2.57it/s] # PTI :step: 278, epoch: 139: 28%|██▊ | 280/1000 [01:49<04:42, 2.55it/s] # PTI :step: 279, epoch: 139: 28%|██▊ | 280/1000 [01:49<04:42, 2.55it/s] # PTI :step: 279, epoch: 139: 28%|██▊ | 281/1000 [01:50<04:39, 2.57it/s] # PTI :step: 280, epoch: 140: 28%|██▊ | 281/1000 [01:50<04:39, 2.57it/s] # PTI :step: 280, epoch: 140: 28%|██▊ | 282/1000 [01:50<04:41, 2.55it/s] # PTI :step: 281, epoch: 140: 28%|██▊ | 282/1000 [01:50<04:41, 2.55it/s] # PTI :step: 281, epoch: 140: 28%|██▊ | 283/1000 [01:50<04:38, 2.57it/s] # PTI :step: 282, epoch: 141: 28%|██▊ | 283/1000 [01:50<04:38, 2.57it/s] # PTI :step: 282, epoch: 141: 28%|██▊ | 284/1000 [01:51<04:40, 2.55it/s] # PTI :step: 283, epoch: 141: 28%|██▊ | 284/1000 [01:51<04:40, 2.55it/s] # PTI :step: 283, epoch: 141: 28%|██▊ | 285/1000 [01:51<04:38, 2.57it/s] # PTI :step: 284, epoch: 142: 28%|██▊ | 285/1000 [01:51<04:38, 2.57it/s] # PTI :step: 284, epoch: 142: 29%|██▊ | 286/1000 [01:52<04:39, 2.55it/s] # PTI :step: 285, epoch: 142: 29%|██▊ | 286/1000 [01:52<04:39, 2.55it/s] # PTI :step: 285, epoch: 142: 29%|██▊ | 287/1000 [01:52<04:37, 2.57it/s] # PTI :step: 286, epoch: 143: 29%|██▊ | 287/1000 [01:52<04:37, 2.57it/s] # PTI :step: 286, epoch: 143: 29%|██▉ | 288/1000 [01:52<04:38, 2.55it/s] # PTI :step: 287, epoch: 143: 29%|██▉ | 288/1000 [01:52<04:38, 2.55it/s] # PTI :step: 287, epoch: 143: 29%|██▉ | 289/1000 [01:53<04:35, 2.58it/s] # PTI :step: 288, epoch: 144: 29%|██▉ | 289/1000 [01:53<04:35, 2.58it/s] # PTI :step: 288, epoch: 144: 29%|██▉ | 290/1000 [01:53<04:38, 2.55it/s] # PTI :step: 289, epoch: 144: 29%|██▉ | 290/1000 [01:53<04:38, 2.55it/s] # PTI :step: 289, epoch: 144: 29%|██▉ | 291/1000 [01:54<04:35, 2.57it/s] # PTI :step: 290, epoch: 145: 29%|██▉ | 291/1000 [01:54<04:35, 2.57it/s] # PTI :step: 290, epoch: 145: 29%|██▉ | 292/1000 [01:54<04:37, 2.55it/s] # PTI :step: 291, epoch: 145: 29%|██▉ | 292/1000 [01:54<04:37, 2.55it/s] # PTI :step: 291, epoch: 145: 29%|██▉ | 293/1000 [01:54<04:37, 2.55it/s] # PTI :step: 292, epoch: 146: 29%|██▉ | 293/1000 [01:54<04:37, 2.55it/s] # PTI :step: 292, epoch: 146: 29%|██▉ | 294/1000 [01:55<04:38, 2.53it/s] # PTI :step: 293, epoch: 146: 29%|██▉ | 294/1000 [01:55<04:38, 2.53it/s] # PTI :step: 293, epoch: 146: 30%|██▉ | 295/1000 [01:55<04:37, 2.54it/s] # PTI :step: 294, epoch: 147: 30%|██▉ | 295/1000 [01:55<04:37, 2.54it/s] # PTI :step: 294, epoch: 147: 30%|██▉ | 296/1000 [01:56<04:39, 2.52it/s] # PTI :step: 295, epoch: 147: 30%|██▉ | 296/1000 [01:56<04:39, 2.52it/s] # PTI :step: 295, epoch: 147: 30%|██▉ | 297/1000 [01:56<05:01, 2.33it/s] # PTI :step: 296, epoch: 148: 30%|██▉ | 297/1000 [01:56<05:01, 2.33it/s] # PTI :step: 296, epoch: 148: 30%|██▉ | 298/1000 [01:56<04:55, 2.38it/s] # PTI :step: 297, epoch: 148: 30%|██▉ | 298/1000 [01:56<04:55, 2.38it/s] # PTI :step: 297, epoch: 148: 30%|██▉ | 299/1000 [01:57<04:45, 2.45it/s] # PTI :step: 298, epoch: 149: 30%|██▉ | 299/1000 [01:57<04:45, 2.45it/s] # PTI :step: 298, epoch: 149: 30%|███ | 300/1000 [01:57<04:44, 2.46it/s] # PTI :step: 299, epoch: 149: 30%|███ | 300/1000 [01:57<04:44, 2.46it/s] # PTI :step: 299, epoch: 149: 30%|███ | 301/1000 [01:58<04:37, 2.51it/s] # PTI :step: 300, epoch: 150: 30%|███ | 301/1000 [01:58<04:37, 2.51it/s] # PTI :step: 300, epoch: 150: 30%|███ | 302/1000 [01:58<04:38, 2.51it/s] # PTI :step: 301, epoch: 150: 30%|███ | 302/1000 [01:58<04:38, 2.51it/s] # PTI :step: 301, epoch: 150: 30%|███ | 303/1000 [01:58<04:33, 2.54it/s] # PTI :step: 302, epoch: 151: 30%|███ | 303/1000 [01:58<04:33, 2.54it/s] # PTI :step: 302, epoch: 151: 30%|███ | 304/1000 [01:59<04:34, 2.53it/s] # PTI :step: 303, epoch: 151: 30%|███ | 304/1000 [01:59<04:34, 2.53it/s] # PTI :step: 303, epoch: 151: 30%|███ | 305/1000 [01:59<04:31, 2.56it/s] # PTI :step: 304, epoch: 152: 30%|███ | 305/1000 [01:59<04:31, 2.56it/s] # PTI :step: 304, epoch: 152: 31%|███ | 306/1000 [02:00<04:33, 2.54it/s] # PTI :step: 305, epoch: 152: 31%|███ | 306/1000 [02:00<04:33, 2.54it/s] # PTI :step: 305, epoch: 152: 31%|███ | 307/1000 [02:00<04:30, 2.56it/s] # PTI :step: 306, epoch: 153: 31%|███ | 307/1000 [02:00<04:30, 2.56it/s] # PTI :step: 306, epoch: 153: 31%|███ | 308/1000 [02:00<04:31, 2.55it/s] # PTI :step: 307, epoch: 153: 31%|███ | 308/1000 [02:00<04:31, 2.55it/s] # PTI :step: 307, epoch: 153: 31%|███ | 309/1000 [02:01<04:30, 2.56it/s] # PTI :step: 308, epoch: 154: 31%|███ | 309/1000 [02:01<04:30, 2.56it/s] # PTI :step: 308, epoch: 154: 31%|███ | 310/1000 [02:01<04:31, 2.54it/s] # PTI :step: 309, epoch: 154: 31%|███ | 310/1000 [02:01<04:31, 2.54it/s] # PTI :step: 309, epoch: 154: 31%|███ | 311/1000 [02:01<04:28, 2.57it/s] # PTI :step: 310, epoch: 155: 31%|███ | 311/1000 [02:01<04:28, 2.57it/s] # PTI :step: 310, epoch: 155: 31%|███ | 312/1000 [02:02<04:31, 2.54it/s] # PTI :step: 311, epoch: 155: 31%|███ | 312/1000 [02:02<04:31, 2.54it/s] # PTI :step: 311, epoch: 155: 31%|███▏ | 313/1000 [02:02<04:28, 2.56it/s] # PTI :step: 312, epoch: 156: 31%|███▏ | 313/1000 [02:02<04:28, 2.56it/s] # PTI :step: 312, epoch: 156: 31%|███▏ | 314/1000 [02:03<04:30, 2.54it/s] # PTI :step: 313, epoch: 156: 31%|███▏ | 314/1000 [02:03<04:30, 2.54it/s] # PTI :step: 313, epoch: 156: 32%|███▏ | 315/1000 [02:03<04:27, 2.56it/s] # PTI :step: 314, epoch: 157: 32%|███▏ | 315/1000 [02:03<04:27, 2.56it/s] # PTI :step: 314, epoch: 157: 32%|███▏ | 316/1000 [02:03<04:28, 2.54it/s] # PTI :step: 315, epoch: 157: 32%|███▏ | 316/1000 [02:03<04:28, 2.54it/s] # PTI :step: 315, epoch: 157: 32%|███▏ | 317/1000 [02:04<04:25, 2.57it/s] # PTI :step: 316, epoch: 158: 32%|███▏ | 317/1000 [02:04<04:25, 2.57it/s] # PTI :step: 316, epoch: 158: 32%|███▏ | 318/1000 [02:04<04:27, 2.55it/s] # PTI :step: 317, epoch: 158: 32%|███▏ | 318/1000 [02:04<04:27, 2.55it/s] # PTI :step: 317, epoch: 158: 32%|███▏ | 319/1000 [02:05<04:24, 2.57it/s] # PTI :step: 318, epoch: 159: 32%|███▏ | 319/1000 [02:05<04:24, 2.57it/s] # PTI :step: 318, epoch: 159: 32%|███▏ | 320/1000 [02:05<04:26, 2.55it/s] # PTI :step: 319, epoch: 159: 32%|███▏ | 320/1000 [02:05<04:26, 2.55it/s] # PTI :step: 319, epoch: 159: 32%|███▏ | 321/1000 [02:05<04:24, 2.57it/s] # PTI :step: 320, epoch: 160: 32%|███▏ | 321/1000 [02:05<04:24, 2.57it/s] # PTI :step: 320, epoch: 160: 32%|███▏ | 322/1000 [02:06<04:26, 2.55it/s] # PTI :step: 321, epoch: 160: 32%|███▏ | 322/1000 [02:06<04:26, 2.55it/s] # PTI :step: 321, epoch: 160: 32%|███▏ | 323/1000 [02:06<04:23, 2.57it/s] # PTI :step: 322, epoch: 161: 32%|███▏ | 323/1000 [02:06<04:23, 2.57it/s] # PTI :step: 322, epoch: 161: 32%|███▏ | 324/1000 [02:07<04:25, 2.55it/s] # PTI :step: 323, epoch: 161: 32%|███▏ | 324/1000 [02:07<04:25, 2.55it/s] # PTI :step: 323, epoch: 161: 32%|███▎ | 325/1000 [02:07<04:22, 2.58it/s] # PTI :step: 324, epoch: 162: 32%|███▎ | 325/1000 [02:07<04:22, 2.58it/s] # PTI :step: 324, epoch: 162: 33%|███▎ | 326/1000 [02:07<04:23, 2.56it/s] # PTI :step: 325, epoch: 162: 33%|███▎ | 326/1000 [02:07<04:23, 2.56it/s] # PTI :step: 325, epoch: 162: 33%|███▎ | 327/1000 [02:08<04:20, 2.58it/s] # PTI :step: 326, epoch: 163: 33%|███▎ | 327/1000 [02:08<04:20, 2.58it/s] # PTI :step: 326, epoch: 163: 33%|███▎ | 328/1000 [02:08<04:22, 2.56it/s] # PTI :step: 327, epoch: 163: 33%|███▎ | 328/1000 [02:08<04:22, 2.56it/s] # PTI :step: 327, epoch: 163: 33%|███▎ | 329/1000 [02:09<04:20, 2.58it/s] # PTI :step: 328, epoch: 164: 33%|███▎ | 329/1000 [02:09<04:20, 2.58it/s] # PTI :step: 328, epoch: 164: 33%|███▎ | 330/1000 [02:09<04:22, 2.55it/s] # PTI :step: 329, epoch: 164: 33%|███▎ | 330/1000 [02:09<04:22, 2.55it/s] # PTI :step: 329, epoch: 164: 33%|███▎ | 331/1000 [02:09<04:20, 2.57it/s] # PTI :step: 330, epoch: 165: 33%|███▎ | 331/1000 [02:09<04:20, 2.57it/s] # PTI :step: 330, epoch: 165: 33%|███▎ | 332/1000 [02:10<04:23, 2.53it/s] # PTI :step: 331, epoch: 165: 33%|███▎ | 332/1000 [02:10<04:23, 2.53it/s] # PTI :step: 331, epoch: 165: 33%|███▎ | 333/1000 [02:10<04:20, 2.56it/s] # PTI :step: 332, epoch: 166: 33%|███▎ | 333/1000 [02:10<04:20, 2.56it/s] # PTI :step: 332, epoch: 166: 33%|███▎ | 334/1000 [02:10<04:22, 2.54it/s] # PTI :step: 333, epoch: 166: 33%|███▎ | 334/1000 [02:10<04:22, 2.54it/s] # PTI :step: 333, epoch: 166: 34%|███▎ | 335/1000 [02:11<04:18, 2.57it/s] # PTI :step: 334, epoch: 167: 34%|███▎ | 335/1000 [02:11<04:18, 2.57it/s] # PTI :step: 334, epoch: 167: 34%|███▎ | 336/1000 [02:11<04:20, 2.55it/s] # PTI :step: 335, epoch: 167: 34%|███▎ | 336/1000 [02:11<04:20, 2.55it/s] # PTI :step: 335, epoch: 167: 34%|███▎ | 337/1000 [02:12<04:19, 2.55it/s] # PTI :step: 336, epoch: 168: 34%|███▎ | 337/1000 [02:12<04:19, 2.55it/s] # PTI :step: 336, epoch: 168: 34%|███▍ | 338/1000 [02:12<04:20, 2.54it/s] # PTI :step: 337, epoch: 168: 34%|███▍ | 338/1000 [02:12<04:20, 2.54it/s] # PTI :step: 337, epoch: 168: 34%|███▍ | 339/1000 [02:12<04:17, 2.57it/s] # PTI :step: 338, epoch: 169: 34%|███▍ | 339/1000 [02:12<04:17, 2.57it/s] # PTI :step: 338, epoch: 169: 34%|███▍ | 340/1000 [02:13<04:19, 2.55it/s] # PTI :step: 339, epoch: 169: 34%|███▍ | 340/1000 [02:13<04:19, 2.55it/s] # PTI :step: 339, epoch: 169: 34%|███▍ | 341/1000 [02:13<04:16, 2.57it/s] # PTI :step: 340, epoch: 170: 34%|███▍ | 341/1000 [02:13<04:16, 2.57it/s] # PTI :step: 340, epoch: 170: 34%|███▍ | 342/1000 [02:14<04:18, 2.55it/s] # PTI :step: 341, epoch: 170: 34%|███▍ | 342/1000 [02:14<04:18, 2.55it/s] # PTI :step: 341, epoch: 170: 34%|███▍ | 343/1000 [02:14<04:15, 2.57it/s] # PTI :step: 342, epoch: 171: 34%|███▍ | 343/1000 [02:14<04:15, 2.57it/s] # PTI :step: 342, epoch: 171: 34%|███▍ | 344/1000 [02:14<04:17, 2.55it/s] # PTI :step: 343, epoch: 171: 34%|███▍ | 344/1000 [02:14<04:17, 2.55it/s] # PTI :step: 343, epoch: 171: 34%|███▍ | 345/1000 [02:15<04:14, 2.58it/s] # PTI :step: 344, epoch: 172: 34%|███▍ | 345/1000 [02:15<04:14, 2.58it/s] # PTI :step: 344, epoch: 172: 35%|███▍ | 346/1000 [02:15<04:16, 2.55it/s] # PTI :step: 345, epoch: 172: 35%|███▍ | 346/1000 [02:15<04:16, 2.55it/s] # PTI :step: 345, epoch: 172: 35%|███▍ | 347/1000 [02:16<04:13, 2.58it/s] # PTI :step: 346, epoch: 173: 35%|███▍ | 347/1000 [02:16<04:13, 2.58it/s] # PTI :step: 346, epoch: 173: 35%|███▍ | 348/1000 [02:16<04:15, 2.55it/s] # PTI :step: 347, epoch: 173: 35%|███▍ | 348/1000 [02:16<04:15, 2.55it/s] # PTI :step: 347, epoch: 173: 35%|███▍ | 349/1000 [02:16<04:13, 2.57it/s] # PTI :step: 348, epoch: 174: 35%|███▍ | 349/1000 [02:16<04:13, 2.57it/s] # PTI :step: 348, epoch: 174: 35%|███▌ | 350/1000 [02:17<04:15, 2.55it/s] # PTI :step: 349, epoch: 174: 35%|███▌ | 350/1000 [02:17<04:15, 2.55it/s] # PTI :step: 349, epoch: 174: 35%|███▌ | 351/1000 [02:17<04:12, 2.57it/s] # PTI :step: 350, epoch: 175: 35%|███▌ | 351/1000 [02:17<04:12, 2.57it/s] # PTI :step: 350, epoch: 175: 35%|███▌ | 352/1000 [02:18<04:14, 2.55it/s] # PTI :step: 351, epoch: 175: 35%|███▌ | 352/1000 [02:18<04:14, 2.55it/s] # PTI :step: 351, epoch: 175: 35%|███▌ | 353/1000 [02:18<04:11, 2.57it/s] # PTI :step: 352, epoch: 176: 35%|███▌ | 353/1000 [02:18<04:11, 2.57it/s] # PTI :step: 352, epoch: 176: 35%|███▌ | 354/1000 [02:18<04:13, 2.55it/s] # PTI :step: 353, epoch: 176: 35%|███▌ | 354/1000 [02:18<04:13, 2.55it/s] # PTI :step: 353, epoch: 176: 36%|███▌ | 355/1000 [02:19<04:12, 2.55it/s] # PTI :step: 354, epoch: 177: 36%|███▌ | 355/1000 [02:19<04:12, 2.55it/s] # PTI :step: 354, epoch: 177: 36%|███▌ | 356/1000 [02:19<04:13, 2.54it/s] # PTI :step: 355, epoch: 177: 36%|███▌ | 356/1000 [02:19<04:13, 2.54it/s] # PTI :step: 355, epoch: 177: 36%|███▌ | 357/1000 [02:19<04:10, 2.56it/s] # PTI :step: 356, epoch: 178: 36%|███▌ | 357/1000 [02:19<04:10, 2.56it/s] # PTI :step: 356, epoch: 178: 36%|███▌ | 358/1000 [02:20<04:12, 2.54it/s] # PTI :step: 357, epoch: 178: 36%|███▌ | 358/1000 [02:20<04:12, 2.54it/s] # PTI :step: 357, epoch: 178: 36%|███▌ | 359/1000 [02:20<04:09, 2.57it/s] # PTI :step: 358, epoch: 179: 36%|███▌ | 359/1000 [02:20<04:09, 2.57it/s] # PTI :step: 358, epoch: 179: 36%|███▌ | 360/1000 [02:21<04:11, 2.55it/s] # PTI :step: 359, epoch: 179: 36%|███▌ | 360/1000 [02:21<04:11, 2.55it/s] # PTI :step: 359, epoch: 179: 36%|███▌ | 361/1000 [02:21<04:09, 2.56it/s] # PTI :step: 360, epoch: 180: 36%|███▌ | 361/1000 [02:21<04:09, 2.56it/s] # PTI :step: 360, epoch: 180: 36%|███▌ | 362/1000 [02:21<04:10, 2.54it/s] # PTI :step: 361, epoch: 180: 36%|███▌ | 362/1000 [02:21<04:10, 2.54it/s] # PTI :step: 361, epoch: 180: 36%|███▋ | 363/1000 [02:22<04:07, 2.57it/s] # PTI :step: 362, epoch: 181: 36%|███▋ | 363/1000 [02:22<04:07, 2.57it/s] # PTI :step: 362, epoch: 181: 36%|███▋ | 364/1000 [02:22<04:09, 2.55it/s] # PTI :step: 363, epoch: 181: 36%|███▋ | 364/1000 [02:22<04:09, 2.55it/s] # PTI :step: 363, epoch: 181: 36%|███▋ | 365/1000 [02:23<04:06, 2.58it/s] # PTI :step: 364, epoch: 182: 36%|███▋ | 365/1000 [02:23<04:06, 2.58it/s] # PTI :step: 364, epoch: 182: 37%|███▋ | 366/1000 [02:23<04:08, 2.55it/s] # PTI :step: 365, epoch: 182: 37%|███▋ | 366/1000 [02:23<04:08, 2.55it/s] # PTI :step: 365, epoch: 182: 37%|███▋ | 367/1000 [02:23<04:09, 2.54it/s] # PTI :step: 366, epoch: 183: 37%|███▋ | 367/1000 [02:23<04:09, 2.54it/s] # PTI :step: 366, epoch: 183: 37%|███▋ | 368/1000 [02:24<04:10, 2.53it/s] # PTI :step: 367, epoch: 183: 37%|███▋ | 368/1000 [02:24<04:10, 2.53it/s] # PTI :step: 367, epoch: 183: 37%|███▋ | 369/1000 [02:24<04:06, 2.56it/s] # PTI :step: 368, epoch: 184: 37%|███▋ | 369/1000 [02:24<04:06, 2.56it/s] # PTI :step: 368, epoch: 184: 37%|███▋ | 370/1000 [02:25<04:07, 2.54it/s] # PTI :step: 369, epoch: 184: 37%|███▋ | 370/1000 [02:25<04:07, 2.54it/s] # PTI :step: 369, epoch: 184: 37%|███▋ | 371/1000 [02:25<04:07, 2.55it/s] # PTI :step: 370, epoch: 185: 37%|███▋ | 371/1000 [02:25<04:07, 2.55it/s] # PTI :step: 370, epoch: 185: 37%|███▋ | 372/1000 [02:25<04:08, 2.53it/s] # PTI :step: 371, epoch: 185: 37%|███▋ | 372/1000 [02:25<04:08, 2.53it/s] # PTI :step: 371, epoch: 185: 37%|███▋ | 373/1000 [02:26<04:04, 2.56it/s] # PTI :step: 372, epoch: 186: 37%|███▋ | 373/1000 [02:26<04:04, 2.56it/s] # PTI :step: 372, epoch: 186: 37%|███▋ | 374/1000 [02:26<04:06, 2.54it/s] # PTI :step: 373, epoch: 186: 37%|███▋ | 374/1000 [02:26<04:06, 2.54it/s] # PTI :step: 373, epoch: 186: 38%|███▊ | 375/1000 [02:27<04:03, 2.57it/s] # PTI :step: 374, epoch: 187: 38%|███▊ | 375/1000 [02:27<04:03, 2.57it/s] # PTI :step: 374, epoch: 187: 38%|███▊ | 376/1000 [02:27<04:05, 2.55it/s] # PTI :step: 375, epoch: 187: 38%|███▊ | 376/1000 [02:27<04:05, 2.55it/s] # PTI :step: 375, epoch: 187: 38%|███▊ | 377/1000 [02:27<04:02, 2.57it/s] # PTI :step: 376, epoch: 188: 38%|███▊ | 377/1000 [02:27<04:02, 2.57it/s] # PTI :step: 376, epoch: 188: 38%|███▊ | 378/1000 [02:28<04:03, 2.55it/s] # PTI :step: 377, epoch: 188: 38%|███▊ | 378/1000 [02:28<04:03, 2.55it/s] # PTI :step: 377, epoch: 188: 38%|███▊ | 379/1000 [02:28<04:01, 2.57it/s] # PTI :step: 378, epoch: 189: 38%|███▊ | 379/1000 [02:28<04:01, 2.57it/s] # PTI :step: 378, epoch: 189: 38%|███▊ | 380/1000 [02:28<04:03, 2.55it/s] # PTI :step: 379, epoch: 189: 38%|███▊ | 380/1000 [02:28<04:03, 2.55it/s] # PTI :step: 379, epoch: 189: 38%|███▊ | 381/1000 [02:29<03:59, 2.58it/s] # PTI :step: 380, epoch: 190: 38%|███▊ | 381/1000 [02:29<03:59, 2.58it/s] # PTI :step: 380, epoch: 190: 38%|███▊ | 382/1000 [02:29<04:02, 2.55it/s] # PTI :step: 381, epoch: 190: 38%|███▊ | 382/1000 [02:29<04:02, 2.55it/s] # PTI :step: 381, epoch: 190: 38%|███▊ | 383/1000 [02:30<03:59, 2.57it/s] # PTI :step: 382, epoch: 191: 38%|███▊ | 383/1000 [02:30<03:59, 2.57it/s] # PTI :step: 382, epoch: 191: 38%|███▊ | 384/1000 [02:30<04:01, 2.55it/s] # PTI :step: 383, epoch: 191: 38%|███▊ | 384/1000 [02:30<04:01, 2.55it/s] # PTI :step: 383, epoch: 191: 38%|███▊ | 385/1000 [02:30<03:58, 2.57it/s] # PTI :step: 384, epoch: 192: 38%|███▊ | 385/1000 [02:30<03:58, 2.57it/s] # PTI :step: 384, epoch: 192: 39%|███▊ | 386/1000 [02:31<04:00, 2.55it/s] # PTI :step: 385, epoch: 192: 39%|███▊ | 386/1000 [02:31<04:00, 2.55it/s] # PTI :step: 385, epoch: 192: 39%|███▊ | 387/1000 [02:31<03:58, 2.57it/s] # PTI :step: 386, epoch: 193: 39%|███▊ | 387/1000 [02:31<03:58, 2.57it/s] # PTI :step: 386, epoch: 193: 39%|███▉ | 388/1000 [02:32<03:59, 2.55it/s] # PTI :step: 387, epoch: 193: 39%|███▉ | 388/1000 [02:32<03:59, 2.55it/s] # PTI :step: 387, epoch: 193: 39%|███▉ | 389/1000 [02:32<03:58, 2.56it/s] # PTI :step: 388, epoch: 194: 39%|███▉ | 389/1000 [02:32<03:58, 2.56it/s] # PTI :step: 388, epoch: 194: 39%|███▉ | 390/1000 [02:32<03:59, 2.54it/s] # PTI :step: 389, epoch: 194: 39%|███▉ | 390/1000 [02:32<03:59, 2.54it/s] # PTI :step: 389, epoch: 194: 39%|███▉ | 391/1000 [02:33<03:57, 2.56it/s] # PTI :step: 390, epoch: 195: 39%|███▉ | 391/1000 [02:33<03:57, 2.56it/s] # PTI :step: 390, epoch: 195: 39%|███▉ | 392/1000 [02:33<03:59, 2.54it/s] # PTI :step: 391, epoch: 195: 39%|███▉ | 392/1000 [02:33<03:59, 2.54it/s] # PTI :step: 391, epoch: 195: 39%|███▉ | 393/1000 [02:34<03:56, 2.57it/s] # PTI :step: 392, epoch: 196: 39%|███▉ | 393/1000 [02:34<03:56, 2.57it/s] # PTI :step: 392, epoch: 196: 39%|███▉ | 394/1000 [02:34<03:57, 2.55it/s] # PTI :step: 393, epoch: 196: 39%|███▉ | 394/1000 [02:34<03:57, 2.55it/s] # PTI :step: 393, epoch: 196: 40%|███▉ | 395/1000 [02:34<03:55, 2.57it/s] # PTI :step: 394, epoch: 197: 40%|███▉ | 395/1000 [02:34<03:55, 2.57it/s] # PTI :step: 394, epoch: 197: 40%|███▉ | 396/1000 [02:35<03:56, 2.55it/s] # PTI :step: 395, epoch: 197: 40%|███▉ | 396/1000 [02:35<03:56, 2.55it/s] # PTI :step: 395, epoch: 197: 40%|███▉ | 397/1000 [02:35<03:55, 2.56it/s] # PTI :step: 396, epoch: 198: 40%|███▉ | 397/1000 [02:35<03:55, 2.56it/s] # PTI :step: 396, epoch: 198: 40%|███▉ | 398/1000 [02:36<03:57, 2.54it/s] # PTI :step: 397, epoch: 198: 40%|███▉ | 398/1000 [02:36<03:57, 2.54it/s] # PTI :step: 397, epoch: 198: 40%|███▉ | 399/1000 [02:36<03:54, 2.56it/s] # PTI :step: 398, epoch: 199: 40%|███▉ | 399/1000 [02:36<03:54, 2.56it/s] # PTI :step: 398, epoch: 199: 40%|████ | 400/1000 [02:36<04:17, 2.33it/s] # PTI :step: 399, epoch: 199: 40%|████ | 400/1000 [02:36<04:17, 2.33it/s] # PTI :step: 399, epoch: 199: 40%|████ | 401/1000 [02:37<04:08, 2.41it/s] # PTI :step: 400, epoch: 200: 40%|████ | 401/1000 [02:37<04:08, 2.41it/s] # PTI :step: 400, epoch: 200: 40%|████ | 402/1000 [02:37<04:05, 2.43it/s] # PTI :step: 401, epoch: 200: 40%|████ | 402/1000 [02:37<04:05, 2.43it/s] # PTI :step: 401, epoch: 200: 40%|████ | 403/1000 [02:38<03:59, 2.49it/s] # PTI :step: 402, epoch: 201: 40%|████ | 403/1000 [02:38<03:59, 2.49it/s] # PTI :step: 402, epoch: 201: 40%|████ | 404/1000 [02:38<03:59, 2.49it/s] # PTI :step: 403, epoch: 201: 40%|████ | 404/1000 [02:38<03:59, 2.49it/s] # PTI :step: 403, epoch: 201: 40%|████ | 405/1000 [02:38<03:54, 2.53it/s] # PTI :step: 404, epoch: 202: 40%|████ | 405/1000 [02:38<03:54, 2.53it/s] # PTI :step: 404, epoch: 202: 41%|████ | 406/1000 [02:39<03:55, 2.52it/s] # PTI :step: 405, epoch: 202: 41%|████ | 406/1000 [02:39<03:55, 2.52it/s] # PTI :step: 405, epoch: 202: 41%|████ | 407/1000 [02:39<03:52, 2.55it/s] # PTI :step: 406, epoch: 203: 41%|████ | 407/1000 [02:39<03:52, 2.55it/s] # PTI :step: 406, epoch: 203: 41%|████ | 408/1000 [02:40<03:54, 2.53it/s] # PTI :step: 407, epoch: 203: 41%|████ | 408/1000 [02:40<03:54, 2.53it/s] # PTI :step: 407, epoch: 203: 41%|████ | 409/1000 [02:40<03:51, 2.55it/s] # PTI :step: 408, epoch: 204: 41%|████ | 409/1000 [02:40<03:51, 2.55it/s] # PTI :step: 408, epoch: 204: 41%|████ | 410/1000 [02:40<03:52, 2.53it/s] # PTI :step: 409, epoch: 204: 41%|████ | 410/1000 [02:40<03:52, 2.53it/s] # PTI :step: 409, epoch: 204: 41%|████ | 411/1000 [02:41<03:49, 2.57it/s] # PTI :step: 410, epoch: 205: 41%|████ | 411/1000 [02:41<03:49, 2.57it/s] # PTI :step: 410, epoch: 205: 41%|████ | 412/1000 [02:41<03:51, 2.54it/s] # PTI :step: 411, epoch: 205: 41%|████ | 412/1000 [02:41<03:51, 2.54it/s] # PTI :step: 411, epoch: 205: 41%|████▏ | 413/1000 [02:42<03:48, 2.57it/s] # PTI :step: 412, epoch: 206: 41%|████▏ | 413/1000 [02:42<03:48, 2.57it/s] # PTI :step: 412, epoch: 206: 41%|████▏ | 414/1000 [02:42<03:50, 2.55it/s] # PTI :step: 413, epoch: 206: 41%|████▏ | 414/1000 [02:42<03:50, 2.55it/s] # PTI :step: 413, epoch: 206: 42%|████▏ | 415/1000 [02:42<03:49, 2.55it/s] # PTI :step: 414, epoch: 207: 42%|████▏ | 415/1000 [02:42<03:49, 2.55it/s] # PTI :step: 414, epoch: 207: 42%|████▏ | 416/1000 [02:43<03:50, 2.54it/s] # PTI :step: 415, epoch: 207: 42%|████▏ | 416/1000 [02:43<03:50, 2.54it/s] # PTI :step: 415, epoch: 207: 42%|████▏ | 417/1000 [02:43<03:49, 2.54it/s] # PTI :step: 416, epoch: 208: 42%|████▏ | 417/1000 [02:43<03:49, 2.54it/s] # PTI :step: 416, epoch: 208: 42%|████▏ | 418/1000 [02:44<03:51, 2.51it/s] # PTI :step: 417, epoch: 208: 42%|████▏ | 418/1000 [02:44<03:51, 2.51it/s] # PTI :step: 417, epoch: 208: 42%|████▏ | 419/1000 [02:44<03:47, 2.55it/s] # PTI :step: 418, epoch: 209: 42%|████▏ | 419/1000 [02:44<03:47, 2.55it/s] # PTI :step: 418, epoch: 209: 42%|████▏ | 420/1000 [02:44<03:49, 2.53it/s] # PTI :step: 419, epoch: 209: 42%|████▏ | 420/1000 [02:44<03:49, 2.53it/s] # PTI :step: 419, epoch: 209: 42%|████▏ | 421/1000 [02:45<03:49, 2.52it/s] # PTI :step: 420, epoch: 210: 42%|████▏ | 421/1000 [02:45<03:49, 2.52it/s] # PTI :step: 420, epoch: 210: 42%|████▏ | 422/1000 [02:45<03:50, 2.51it/s] # PTI :step: 421, epoch: 210: 42%|████▏ | 422/1000 [02:45<03:50, 2.51it/s] # PTI :step: 421, epoch: 210: 42%|████▏ | 423/1000 [02:45<03:47, 2.54it/s] # PTI :step: 422, epoch: 211: 42%|████▏ | 423/1000 [02:45<03:47, 2.54it/s] # PTI :step: 422, epoch: 211: 42%|████▏ | 424/1000 [02:46<03:47, 2.53it/s] # PTI :step: 423, epoch: 211: 42%|████▏ | 424/1000 [02:46<03:47, 2.53it/s] # PTI :step: 423, epoch: 211: 42%|████▎ | 425/1000 [02:46<03:44, 2.56it/s] # PTI :step: 424, epoch: 212: 42%|████▎ | 425/1000 [02:46<03:44, 2.56it/s] # PTI :step: 424, epoch: 212: 43%|████▎ | 426/1000 [02:47<03:47, 2.52it/s] # PTI :step: 425, epoch: 212: 43%|████▎ | 426/1000 [02:47<03:47, 2.52it/s] # PTI :step: 425, epoch: 212: 43%|████▎ | 427/1000 [02:47<03:46, 2.53it/s] # PTI :step: 426, epoch: 213: 43%|████▎ | 427/1000 [02:47<03:46, 2.53it/s] # PTI :step: 426, epoch: 213: 43%|████▎ | 428/1000 [02:47<03:46, 2.52it/s] # PTI :step: 427, epoch: 213: 43%|████▎ | 428/1000 [02:47<03:46, 2.52it/s] # PTI :step: 427, epoch: 213: 43%|████▎ | 429/1000 [02:48<03:43, 2.56it/s] # PTI :step: 428, epoch: 214: 43%|████▎ | 429/1000 [02:48<03:43, 2.56it/s] # PTI :step: 428, epoch: 214: 43%|████▎ | 430/1000 [02:48<03:44, 2.54it/s] # PTI :step: 429, epoch: 214: 43%|████▎ | 430/1000 [02:48<03:44, 2.54it/s] # PTI :step: 429, epoch: 214: 43%|████▎ | 431/1000 [02:49<03:41, 2.57it/s] # PTI :step: 430, epoch: 215: 43%|████▎ | 431/1000 [02:49<03:41, 2.57it/s] # PTI :step: 430, epoch: 215: 43%|████▎ | 432/1000 [02:49<03:43, 2.54it/s] # PTI :step: 431, epoch: 215: 43%|████▎ | 432/1000 [02:49<03:43, 2.54it/s] # PTI :step: 431, epoch: 215: 43%|████▎ | 433/1000 [02:49<03:40, 2.57it/s] # PTI :step: 432, epoch: 216: 43%|████▎ | 433/1000 [02:49<03:40, 2.57it/s] # PTI :step: 432, epoch: 216: 43%|████▎ | 434/1000 [02:50<03:41, 2.55it/s] # PTI :step: 433, epoch: 216: 43%|████▎ | 434/1000 [02:50<03:41, 2.55it/s] # PTI :step: 433, epoch: 216: 44%|████▎ | 435/1000 [02:50<03:39, 2.57it/s] # PTI :step: 434, epoch: 217: 44%|████▎ | 435/1000 [02:50<03:39, 2.57it/s] # PTI :step: 434, epoch: 217: 44%|████▎ | 436/1000 [02:51<03:41, 2.55it/s] # PTI :step: 435, epoch: 217: 44%|████▎ | 436/1000 [02:51<03:41, 2.55it/s] # PTI :step: 435, epoch: 217: 44%|████▎ | 437/1000 [02:51<03:38, 2.57it/s] # PTI :step: 436, epoch: 218: 44%|████▎ | 437/1000 [02:51<03:38, 2.57it/s] # PTI :step: 436, epoch: 218: 44%|████▍ | 438/1000 [02:51<03:40, 2.55it/s] # PTI :step: 437, epoch: 218: 44%|████▍ | 438/1000 [02:51<03:40, 2.55it/s] # PTI :step: 437, epoch: 218: 44%|████▍ | 439/1000 [02:52<03:37, 2.58it/s] # PTI :step: 438, epoch: 219: 44%|████▍ | 439/1000 [02:52<03:37, 2.58it/s] # PTI :step: 438, epoch: 219: 44%|████▍ | 440/1000 [02:52<03:39, 2.56it/s] # PTI :step: 439, epoch: 219: 44%|████▍ | 440/1000 [02:52<03:39, 2.56it/s] # PTI :step: 439, epoch: 219: 44%|████▍ | 441/1000 [02:53<03:36, 2.58it/s] # PTI :step: 440, epoch: 220: 44%|████▍ | 441/1000 [02:53<03:36, 2.58it/s] # PTI :step: 440, epoch: 220: 44%|████▍ | 442/1000 [02:53<03:38, 2.56it/s] # PTI :step: 441, epoch: 220: 44%|████▍ | 442/1000 [02:53<03:38, 2.56it/s] # PTI :step: 441, epoch: 220: 44%|████▍ | 443/1000 [02:53<03:36, 2.58it/s] # PTI :step: 442, epoch: 221: 44%|████▍ | 443/1000 [02:53<03:36, 2.58it/s] # PTI :step: 442, epoch: 221: 44%|████▍ | 444/1000 [02:54<03:37, 2.55it/s] # PTI :step: 443, epoch: 221: 44%|████▍ | 444/1000 [02:54<03:37, 2.55it/s] # PTI :step: 443, epoch: 221: 44%|████▍ | 445/1000 [02:54<03:35, 2.57it/s] # PTI :step: 444, epoch: 222: 44%|████▍ | 445/1000 [02:54<03:35, 2.57it/s] # PTI :step: 444, epoch: 222: 45%|████▍ | 446/1000 [02:54<03:37, 2.55it/s] # PTI :step: 445, epoch: 222: 45%|████▍ | 446/1000 [02:54<03:37, 2.55it/s] # PTI :step: 445, epoch: 222: 45%|████▍ | 447/1000 [02:55<03:34, 2.58it/s] # PTI :step: 446, epoch: 223: 45%|████▍ | 447/1000 [02:55<03:34, 2.58it/s] # PTI :step: 446, epoch: 223: 45%|████▍ | 448/1000 [02:55<03:37, 2.54it/s] # PTI :step: 447, epoch: 223: 45%|████▍ | 448/1000 [02:55<03:37, 2.54it/s] # PTI :step: 447, epoch: 223: 45%|████▍ | 449/1000 [02:56<03:34, 2.56it/s] # PTI :step: 448, epoch: 224: 45%|████▍ | 449/1000 [02:56<03:34, 2.56it/s] # PTI :step: 448, epoch: 224: 45%|████▌ | 450/1000 [02:56<03:36, 2.54it/s] # PTI :step: 449, epoch: 224: 45%|████▌ | 450/1000 [02:56<03:36, 2.54it/s] # PTI :step: 449, epoch: 224: 45%|████▌ | 451/1000 [02:56<03:34, 2.56it/s] # PTI :step: 450, epoch: 225: 45%|████▌ | 451/1000 [02:56<03:34, 2.56it/s] # PTI :step: 450, epoch: 225: 45%|████▌ | 452/1000 [02:57<03:35, 2.55it/s] # PTI :step: 451, epoch: 225: 45%|████▌ | 452/1000 [02:57<03:35, 2.55it/s] # PTI :step: 451, epoch: 225: 45%|████▌ | 453/1000 [02:57<03:33, 2.56it/s] # PTI :step: 452, epoch: 226: 45%|████▌ | 453/1000 [02:57<03:33, 2.56it/s] # PTI :step: 452, epoch: 226: 45%|████▌ | 454/1000 [02:58<03:34, 2.54it/s] # PTI :step: 453, epoch: 226: 45%|████▌ | 454/1000 [02:58<03:34, 2.54it/s] # PTI :step: 453, epoch: 226: 46%|████▌ | 455/1000 [02:58<03:32, 2.56it/s] # PTI :step: 454, epoch: 227: 46%|████▌ | 455/1000 [02:58<03:32, 2.56it/s] # PTI :step: 454, epoch: 227: 46%|████▌ | 456/1000 [02:58<03:33, 2.55it/s] # PTI :step: 455, epoch: 227: 46%|████▌ | 456/1000 [02:58<03:33, 2.55it/s] # PTI :step: 455, epoch: 227: 46%|████▌ | 457/1000 [02:59<03:30, 2.57it/s] # PTI :step: 456, epoch: 228: 46%|████▌ | 457/1000 [02:59<03:30, 2.57it/s] # PTI :step: 456, epoch: 228: 46%|████▌ | 458/1000 [02:59<03:32, 2.55it/s] # PTI :step: 457, epoch: 228: 46%|████▌ | 458/1000 [02:59<03:32, 2.55it/s] # PTI :step: 457, epoch: 228: 46%|████▌ | 459/1000 [03:00<03:30, 2.58it/s] # PTI :step: 458, epoch: 229: 46%|████▌ | 459/1000 [03:00<03:30, 2.58it/s] # PTI :step: 458, epoch: 229: 46%|████▌ | 460/1000 [03:00<03:31, 2.55it/s] # PTI :step: 459, epoch: 229: 46%|████▌ | 460/1000 [03:00<03:31, 2.55it/s] # PTI :step: 459, epoch: 229: 46%|████▌ | 461/1000 [03:00<03:29, 2.58it/s] # PTI :step: 460, epoch: 230: 46%|████▌ | 461/1000 [03:00<03:29, 2.58it/s] # PTI :step: 460, epoch: 230: 46%|████▌ | 462/1000 [03:01<03:30, 2.55it/s] # PTI :step: 461, epoch: 230: 46%|████▌ | 462/1000 [03:01<03:30, 2.55it/s] # PTI :step: 461, epoch: 230: 46%|████▋ | 463/1000 [03:01<03:29, 2.57it/s] # PTI :step: 462, epoch: 231: 46%|████▋ | 463/1000 [03:01<03:29, 2.57it/s] # PTI :step: 462, epoch: 231: 46%|████▋ | 464/1000 [03:02<03:30, 2.55it/s] # PTI :step: 463, epoch: 231: 46%|████▋ | 464/1000 [03:02<03:30, 2.55it/s] # PTI :step: 463, epoch: 231: 46%|████▋ | 465/1000 [03:02<03:27, 2.57it/s] # PTI :step: 464, epoch: 232: 46%|████▋ | 465/1000 [03:02<03:27, 2.57it/s] # PTI :step: 464, epoch: 232: 47%|████▋ | 466/1000 [03:02<03:29, 2.55it/s] # PTI :step: 465, epoch: 232: 47%|████▋ | 466/1000 [03:02<03:29, 2.55it/s] # PTI :step: 465, epoch: 232: 47%|████▋ | 467/1000 [03:03<03:28, 2.56it/s] # PTI :step: 466, epoch: 233: 47%|████▋ | 467/1000 [03:03<03:28, 2.56it/s] # PTI :step: 466, epoch: 233: 47%|████▋ | 468/1000 [03:03<03:29, 2.53it/s] # PTI :step: 467, epoch: 233: 47%|████▋ | 468/1000 [03:03<03:29, 2.53it/s] # PTI :step: 467, epoch: 233: 47%|████▋ | 469/1000 [03:03<03:27, 2.56it/s] # PTI :step: 468, epoch: 234: 47%|████▋ | 469/1000 [03:03<03:27, 2.56it/s] # PTI :step: 468, epoch: 234: 47%|████▋ | 470/1000 [03:04<03:28, 2.55it/s] # PTI :step: 469, epoch: 234: 47%|████▋ | 470/1000 [03:04<03:28, 2.55it/s] # PTI :step: 469, epoch: 234: 47%|████▋ | 471/1000 [03:04<03:45, 2.34it/s] # PTI :step: 470, epoch: 235: 47%|████▋ | 471/1000 [03:04<03:45, 2.34it/s] # PTI :step: 470, epoch: 235: 47%|████▋ | 472/1000 [03:05<03:41, 2.39it/s] # PTI :step: 471, epoch: 235: 47%|████▋ | 472/1000 [03:05<03:41, 2.39it/s] # PTI :step: 471, epoch: 235: 47%|████▋ | 473/1000 [03:05<03:35, 2.45it/s] # PTI :step: 472, epoch: 236: 47%|████▋ | 473/1000 [03:05<03:35, 2.45it/s] # PTI :step: 472, epoch: 236: 47%|████▋ | 474/1000 [03:06<03:34, 2.46it/s] # PTI :step: 473, epoch: 236: 47%|████▋ | 474/1000 [03:06<03:34, 2.46it/s] # PTI :step: 473, epoch: 236: 48%|████▊ | 475/1000 [03:06<03:30, 2.49it/s] # PTI :step: 474, epoch: 237: 48%|████▊ | 475/1000 [03:06<03:30, 2.49it/s] # PTI :step: 474, epoch: 237: 48%|████▊ | 476/1000 [03:06<03:29, 2.50it/s] # PTI :step: 475, epoch: 237: 48%|████▊ | 476/1000 [03:06<03:29, 2.50it/s] # PTI :step: 475, epoch: 237: 48%|████▊ | 477/1000 [03:07<03:25, 2.55it/s] # PTI :step: 476, epoch: 238: 48%|████▊ | 477/1000 [03:07<03:25, 2.55it/s] # PTI :step: 476, epoch: 238: 48%|████▊ | 478/1000 [03:07<03:26, 2.53it/s] # PTI :step: 477, epoch: 238: 48%|████▊ | 478/1000 [03:07<03:26, 2.53it/s] # PTI :step: 477, epoch: 238: 48%|████▊ | 479/1000 [03:07<03:23, 2.56it/s] # PTI :step: 478, epoch: 239: 48%|████▊ | 479/1000 [03:07<03:23, 2.56it/s] # PTI :step: 478, epoch: 239: 48%|████▊ | 480/1000 [03:08<03:25, 2.53it/s] # PTI :step: 479, epoch: 239: 48%|████▊ | 480/1000 [03:08<03:25, 2.53it/s] # PTI :step: 479, epoch: 239: 48%|████▊ | 481/1000 [03:08<03:23, 2.55it/s] # PTI :step: 480, epoch: 240: 48%|████▊ | 481/1000 [03:08<03:23, 2.55it/s] # PTI :step: 480, epoch: 240: 48%|████▊ | 482/1000 [03:09<03:24, 2.54it/s] # PTI :step: 481, epoch: 240: 48%|████▊ | 482/1000 [03:09<03:24, 2.54it/s] # PTI :step: 481, epoch: 240: 48%|████▊ | 483/1000 [03:09<03:21, 2.57it/s] # PTI :step: 482, epoch: 241: 48%|████▊ | 483/1000 [03:09<03:21, 2.57it/s] # PTI :step: 482, epoch: 241: 48%|████▊ | 484/1000 [03:09<03:22, 2.55it/s] # PTI :step: 483, epoch: 241: 48%|████▊ | 484/1000 [03:09<03:22, 2.55it/s] # PTI :step: 483, epoch: 241: 48%|████▊ | 485/1000 [03:10<03:19, 2.58it/s] # PTI :step: 484, epoch: 242: 48%|████▊ | 485/1000 [03:10<03:19, 2.58it/s] # PTI :step: 484, epoch: 242: 49%|████▊ | 486/1000 [03:10<03:23, 2.53it/s] # PTI :step: 485, epoch: 242: 49%|████▊ | 486/1000 [03:10<03:23, 2.53it/s] # PTI :step: 485, epoch: 242: 49%|████▊ | 487/1000 [03:11<03:20, 2.56it/s] # PTI :step: 486, epoch: 243: 49%|████▊ | 487/1000 [03:11<03:20, 2.56it/s] # PTI :step: 486, epoch: 243: 49%|████▉ | 488/1000 [03:11<03:20, 2.55it/s] # PTI :step: 487, epoch: 243: 49%|████▉ | 488/1000 [03:11<03:20, 2.55it/s] # PTI :step: 487, epoch: 243: 49%|████▉ | 489/1000 [03:11<03:17, 2.58it/s] # PTI :step: 488, epoch: 244: 49%|████▉ | 489/1000 [03:11<03:17, 2.58it/s] # PTI :step: 488, epoch: 244: 49%|████▉ | 490/1000 [03:12<03:18, 2.56it/s] # PTI :step: 489, epoch: 244: 49%|████▉ | 490/1000 [03:12<03:18, 2.56it/s] # PTI :step: 489, epoch: 244: 49%|████▉ | 491/1000 [03:12<03:17, 2.57it/s] # PTI :step: 490, epoch: 245: 49%|████▉ | 491/1000 [03:12<03:17, 2.57it/s] # PTI :step: 490, epoch: 245: 49%|████▉ | 492/1000 [03:13<03:19, 2.55it/s] # PTI :step: 491, epoch: 245: 49%|████▉ | 492/1000 [03:13<03:19, 2.55it/s] # PTI :step: 491, epoch: 245: 49%|████▉ | 493/1000 [03:13<03:16, 2.58it/s] # PTI :step: 492, epoch: 246: 49%|████▉ | 493/1000 [03:13<03:16, 2.58it/s] # PTI :step: 492, epoch: 246: 49%|████▉ | 494/1000 [03:13<03:17, 2.56it/s] # PTI :step: 493, epoch: 246: 49%|████▉ | 494/1000 [03:13<03:17, 2.56it/s] # PTI :step: 493, epoch: 246: 50%|████▉ | 495/1000 [03:14<03:15, 2.59it/s] # PTI :step: 494, epoch: 247: 50%|████▉ | 495/1000 [03:14<03:15, 2.59it/s] # PTI :step: 494, epoch: 247: 50%|████▉ | 496/1000 [03:14<03:16, 2.56it/s] # PTI :step: 495, epoch: 247: 50%|████▉ | 496/1000 [03:14<03:16, 2.56it/s] # PTI :step: 495, epoch: 247: 50%|████▉ | 497/1000 [03:15<03:14, 2.59it/s] # PTI :step: 496, epoch: 248: 50%|████▉ | 497/1000 [03:15<03:14, 2.59it/s] # PTI :step: 496, epoch: 248: 50%|████▉ | 498/1000 [03:15<03:16, 2.55it/s] # PTI :step: 497, epoch: 248: 50%|████▉ | 498/1000 [03:15<03:16, 2.55it/s] # PTI :step: 497, epoch: 248: 50%|████▉ | 499/1000 [03:15<03:16, 2.54it/s] # PTI :step: 498, epoch: 249: 50%|████▉ | 499/1000 [03:15<03:16, 2.54it/s] # PTI :step: 498, epoch: 249: 50%|█████ | 500/1000 [03:16<03:17, 2.53it/s] # PTI : Pivot halfway # PTI :step: 499, epoch: 249: 50%|█████ | 500/1000 [03:16<03:17, 2.53it/s] # PTI :step: 499, epoch: 249: 50%|█████ | 501/1000 [03:16<03:15, 2.56it/s] # PTI :step: 500, epoch: 250: 50%|█████ | 501/1000 [03:16<03:15, 2.56it/s] # PTI :step: 500, epoch: 250: 50%|█████ | 502/1000 [03:17<03:23, 2.45it/s] # PTI :step: 501, epoch: 250: 50%|█████ | 502/1000 [03:17<03:23, 2.45it/s] # PTI :step: 501, epoch: 250: 50%|█████ | 503/1000 [03:17<03:18, 2.50it/s] # PTI :step: 502, epoch: 251: 50%|█████ | 503/1000 [03:17<03:18, 2.50it/s] # PTI :step: 502, epoch: 251: 50%|█████ | 504/1000 [03:17<03:17, 2.51it/s] # PTI :step: 503, epoch: 251: 50%|█████ | 504/1000 [03:17<03:17, 2.51it/s] # PTI :step: 503, epoch: 251: 50%|█████ | 505/1000 [03:18<03:14, 2.55it/s] # PTI :step: 504, epoch: 252: 50%|█████ | 505/1000 [03:18<03:14, 2.55it/s] # PTI :step: 504, epoch: 252: 51%|█████ | 506/1000 [03:18<03:14, 2.54it/s] # PTI :step: 505, epoch: 252: 51%|█████ | 506/1000 [03:18<03:14, 2.54it/s] # PTI :step: 505, epoch: 252: 51%|█████ | 507/1000 [03:18<03:10, 2.58it/s] # PTI :step: 506, epoch: 253: 51%|█████ | 507/1000 [03:18<03:10, 2.58it/s] # PTI :step: 506, epoch: 253: 51%|█████ | 508/1000 [03:19<03:11, 2.57it/s] # PTI :step: 507, epoch: 253: 51%|█████ | 508/1000 [03:19<03:11, 2.57it/s] # PTI :step: 507, epoch: 253: 51%|█████ | 509/1000 [03:19<03:09, 2.59it/s] # PTI :step: 508, epoch: 254: 51%|█████ | 509/1000 [03:19<03:09, 2.59it/s] # PTI :step: 508, epoch: 254: 51%|█████ | 510/1000 [03:20<03:10, 2.58it/s] # PTI :step: 509, epoch: 254: 51%|█████ | 510/1000 [03:20<03:10, 2.58it/s] # PTI :step: 509, epoch: 254: 51%|█████ | 511/1000 [03:20<03:09, 2.58it/s] # PTI :step: 510, epoch: 255: 51%|█████ | 511/1000 [03:20<03:09, 2.58it/s] # PTI :step: 510, epoch: 255: 51%|█████ | 512/1000 [03:20<03:10, 2.56it/s] # PTI :step: 511, epoch: 255: 51%|█████ | 512/1000 [03:20<03:10, 2.56it/s] # PTI :step: 511, epoch: 255: 51%|█████▏ | 513/1000 [03:21<03:08, 2.59it/s] # PTI :step: 512, epoch: 256: 51%|█████▏ | 513/1000 [03:21<03:08, 2.59it/s] # PTI :step: 512, epoch: 256: 51%|█████▏ | 514/1000 [03:21<03:10, 2.55it/s] # PTI :step: 513, epoch: 256: 51%|█████▏ | 514/1000 [03:21<03:10, 2.55it/s] # PTI :step: 513, epoch: 256: 52%|█████▏ | 515/1000 [03:22<03:08, 2.58it/s] # PTI :step: 514, epoch: 257: 52%|█████▏ | 515/1000 [03:22<03:08, 2.58it/s] # PTI :step: 514, epoch: 257: 52%|█████▏ | 516/1000 [03:22<03:08, 2.56it/s] # PTI :step: 515, epoch: 257: 52%|█████▏ | 516/1000 [03:22<03:08, 2.56it/s] # PTI :step: 515, epoch: 257: 52%|█████▏ | 517/1000 [03:22<03:06, 2.59it/s] # PTI :step: 516, epoch: 258: 52%|█████▏ | 517/1000 [03:22<03:06, 2.59it/s] # PTI :step: 516, epoch: 258: 52%|█████▏ | 518/1000 [03:23<03:06, 2.58it/s] # PTI :step: 517, epoch: 258: 52%|█████▏ | 518/1000 [03:23<03:06, 2.58it/s] # PTI :step: 517, epoch: 258: 52%|█████▏ | 519/1000 [03:23<03:06, 2.58it/s] # PTI :step: 518, epoch: 259: 52%|█████▏ | 519/1000 [03:23<03:06, 2.58it/s] # PTI :step: 518, epoch: 259: 52%|█████▏ | 520/1000 [03:24<03:07, 2.57it/s] # PTI :step: 519, epoch: 259: 52%|█████▏ | 520/1000 [03:24<03:07, 2.57it/s] # PTI :step: 519, epoch: 259: 52%|█████▏ | 521/1000 [03:24<03:04, 2.60it/s] # PTI :step: 520, epoch: 260: 52%|█████▏ | 521/1000 [03:24<03:04, 2.60it/s] # PTI :step: 520, epoch: 260: 52%|█████▏ | 522/1000 [03:24<03:07, 2.55it/s] # PTI :step: 521, epoch: 260: 52%|█████▏ | 522/1000 [03:24<03:07, 2.55it/s] # PTI :step: 521, epoch: 260: 52%|█████▏ | 523/1000 [03:25<03:04, 2.59it/s] # PTI :step: 522, epoch: 261: 52%|█████▏ | 523/1000 [03:25<03:04, 2.59it/s] # PTI :step: 522, epoch: 261: 52%|█████▏ | 524/1000 [03:25<03:04, 2.57it/s] # PTI :step: 523, epoch: 261: 52%|█████▏ | 524/1000 [03:25<03:04, 2.57it/s] # PTI :step: 523, epoch: 261: 52%|█████▎ | 525/1000 [03:25<03:02, 2.61it/s] # PTI :step: 524, epoch: 262: 52%|█████▎ | 525/1000 [03:25<03:02, 2.61it/s] # PTI :step: 524, epoch: 262: 53%|█████▎ | 526/1000 [03:26<03:03, 2.59it/s] # PTI :step: 525, epoch: 262: 53%|█████▎ | 526/1000 [03:26<03:03, 2.59it/s] # PTI :step: 525, epoch: 262: 53%|█████▎ | 527/1000 [03:26<03:02, 2.58it/s] # PTI :step: 526, epoch: 263: 53%|█████▎ | 527/1000 [03:26<03:02, 2.58it/s] # PTI :step: 526, epoch: 263: 53%|█████▎ | 528/1000 [03:27<03:03, 2.57it/s] # PTI :step: 527, epoch: 263: 53%|█████▎ | 528/1000 [03:27<03:03, 2.57it/s] # PTI :step: 527, epoch: 263: 53%|█████▎ | 529/1000 [03:27<03:01, 2.60it/s] # PTI :step: 528, epoch: 264: 53%|█████▎ | 529/1000 [03:27<03:01, 2.60it/s] # PTI :step: 528, epoch: 264: 53%|█████▎ | 530/1000 [03:27<03:01, 2.58it/s] # PTI :step: 529, epoch: 264: 53%|█████▎ | 530/1000 [03:27<03:01, 2.58it/s] # PTI :step: 529, epoch: 264: 53%|█████▎ | 531/1000 [03:28<02:59, 2.62it/s] # PTI :step: 530, epoch: 265: 53%|█████▎ | 531/1000 [03:28<02:59, 2.62it/s] # PTI :step: 530, epoch: 265: 53%|█████▎ | 532/1000 [03:28<03:01, 2.57it/s] # PTI :step: 531, epoch: 265: 53%|█████▎ | 532/1000 [03:28<03:01, 2.57it/s] # PTI :step: 531, epoch: 265: 53%|█████▎ | 533/1000 [03:29<02:59, 2.61it/s] # PTI :step: 532, epoch: 266: 53%|█████▎ | 533/1000 [03:29<02:59, 2.61it/s] # PTI :step: 532, epoch: 266: 53%|█████▎ | 534/1000 [03:29<03:00, 2.59it/s] # PTI :step: 533, epoch: 266: 53%|█████▎ | 534/1000 [03:29<03:00, 2.59it/s] # PTI :step: 533, epoch: 266: 54%|█████▎ | 535/1000 [03:29<02:59, 2.59it/s] # PTI :step: 534, epoch: 267: 54%|█████▎ | 535/1000 [03:29<02:59, 2.59it/s] # PTI :step: 534, epoch: 267: 54%|█████▎ | 536/1000 [03:30<02:59, 2.58it/s] # PTI :step: 535, epoch: 267: 54%|█████▎ | 536/1000 [03:30<02:59, 2.58it/s] # PTI :step: 535, epoch: 267: 54%|█████▎ | 537/1000 [03:30<02:58, 2.60it/s] # PTI :step: 536, epoch: 268: 54%|█████▎ | 537/1000 [03:30<02:58, 2.60it/s] # PTI :step: 536, epoch: 268: 54%|█████▍ | 538/1000 [03:30<02:59, 2.58it/s] # PTI :step: 537, epoch: 268: 54%|█████▍ | 538/1000 [03:30<02:59, 2.58it/s] # PTI :step: 537, epoch: 268: 54%|█████▍ | 539/1000 [03:31<02:56, 2.61it/s] # PTI :step: 538, epoch: 269: 54%|█████▍ | 539/1000 [03:31<02:56, 2.61it/s] # PTI :step: 538, epoch: 269: 54%|█████▍ | 540/1000 [03:31<02:59, 2.56it/s] # PTI :step: 539, epoch: 269: 54%|█████▍ | 540/1000 [03:31<02:59, 2.56it/s] # PTI :step: 539, epoch: 269: 54%|█████▍ | 541/1000 [03:32<02:56, 2.60it/s] # PTI :step: 540, epoch: 270: 54%|█████▍ | 541/1000 [03:32<02:56, 2.60it/s] # PTI :step: 540, epoch: 270: 54%|█████▍ | 542/1000 [03:32<02:57, 2.58it/s] # PTI :step: 541, epoch: 270: 54%|█████▍ | 542/1000 [03:32<02:57, 2.58it/s] # PTI :step: 541, epoch: 270: 54%|█████▍ | 543/1000 [03:32<02:55, 2.60it/s] # PTI :step: 542, epoch: 271: 54%|█████▍ | 543/1000 [03:32<02:55, 2.60it/s] # PTI :step: 542, epoch: 271: 54%|█████▍ | 544/1000 [03:33<02:56, 2.58it/s] # PTI :step: 543, epoch: 271: 54%|█████▍ | 544/1000 [03:33<02:56, 2.58it/s] # PTI :step: 543, epoch: 271: 55%|█████▍ | 545/1000 [03:33<02:55, 2.59it/s] # PTI :step: 544, epoch: 272: 55%|█████▍ | 545/1000 [03:33<02:55, 2.59it/s] # PTI :step: 544, epoch: 272: 55%|█████▍ | 546/1000 [03:34<02:56, 2.58it/s] # PTI :step: 545, epoch: 272: 55%|█████▍ | 546/1000 [03:34<02:56, 2.58it/s] # PTI :step: 545, epoch: 272: 55%|█████▍ | 547/1000 [03:34<02:54, 2.60it/s] # PTI :step: 546, epoch: 273: 55%|█████▍ | 547/1000 [03:34<02:54, 2.60it/s] # PTI :step: 546, epoch: 273: 55%|█████▍ | 548/1000 [03:34<02:55, 2.58it/s] # PTI :step: 547, epoch: 273: 55%|█████▍ | 548/1000 [03:34<02:55, 2.58it/s] # PTI :step: 547, epoch: 273: 55%|█████▍ | 549/1000 [03:35<02:52, 2.61it/s] # PTI :step: 548, epoch: 274: 55%|█████▍ | 549/1000 [03:35<02:52, 2.61it/s] # PTI :step: 548, epoch: 274: 55%|█████▌ | 550/1000 [03:35<02:54, 2.58it/s] # PTI :step: 549, epoch: 274: 55%|█████▌ | 550/1000 [03:35<02:54, 2.58it/s] # PTI :step: 549, epoch: 274: 55%|█████▌ | 551/1000 [03:35<02:52, 2.61it/s] # PTI :step: 550, epoch: 275: 55%|█████▌ | 551/1000 [03:35<02:52, 2.61it/s] # PTI :step: 550, epoch: 275: 55%|█████▌ | 552/1000 [03:36<02:52, 2.59it/s] # PTI :step: 551, epoch: 275: 55%|█████▌ | 552/1000 [03:36<02:52, 2.59it/s] # PTI :step: 551, epoch: 275: 55%|█████▌ | 553/1000 [03:36<02:53, 2.58it/s] # PTI :step: 552, epoch: 276: 55%|█████▌ | 553/1000 [03:36<02:53, 2.58it/s] # PTI :step: 552, epoch: 276: 55%|█████▌ | 554/1000 [03:37<02:54, 2.56it/s] # PTI :step: 553, epoch: 276: 55%|█████▌ | 554/1000 [03:37<02:54, 2.56it/s] # PTI :step: 553, epoch: 276: 56%|█████▌ | 555/1000 [03:37<02:52, 2.57it/s] # PTI :step: 554, epoch: 277: 56%|█████▌ | 555/1000 [03:37<02:52, 2.57it/s] # PTI :step: 554, epoch: 277: 56%|█████▌ | 556/1000 [03:37<02:52, 2.57it/s] # PTI :step: 555, epoch: 277: 56%|█████▌ | 556/1000 [03:37<02:52, 2.57it/s] # PTI :step: 555, epoch: 277: 56%|█████▌ | 557/1000 [03:38<02:50, 2.60it/s] # PTI :step: 556, epoch: 278: 56%|█████▌ | 557/1000 [03:38<02:50, 2.60it/s] # PTI :step: 556, epoch: 278: 56%|█████▌ | 558/1000 [03:38<02:52, 2.56it/s] # PTI :step: 557, epoch: 278: 56%|█████▌ | 558/1000 [03:38<02:52, 2.56it/s] # PTI :step: 557, epoch: 278: 56%|█████▌ | 559/1000 [03:39<02:49, 2.60it/s] # PTI :step: 558, epoch: 279: 56%|█████▌ | 559/1000 [03:39<02:49, 2.60it/s] # PTI :step: 558, epoch: 279: 56%|█████▌ | 560/1000 [03:39<02:50, 2.58it/s] # PTI :step: 559, epoch: 279: 56%|█████▌ | 560/1000 [03:39<02:50, 2.58it/s] # PTI :step: 559, epoch: 279: 56%|█████▌ | 561/1000 [03:39<02:48, 2.61it/s] # PTI :step: 560, epoch: 280: 56%|█████▌ | 561/1000 [03:39<02:48, 2.61it/s] # PTI :step: 560, epoch: 280: 56%|█████▌ | 562/1000 [03:40<02:49, 2.59it/s] # PTI :step: 561, epoch: 280: 56%|█████▌ | 562/1000 [03:40<02:49, 2.59it/s] # PTI :step: 561, epoch: 280: 56%|█████▋ | 563/1000 [03:40<02:48, 2.59it/s] # PTI :step: 562, epoch: 281: 56%|█████▋ | 563/1000 [03:40<02:48, 2.59it/s] # PTI :step: 562, epoch: 281: 56%|█████▋ | 564/1000 [03:41<02:49, 2.57it/s] # PTI :step: 563, epoch: 281: 56%|█████▋ | 564/1000 [03:41<02:49, 2.57it/s] # PTI :step: 563, epoch: 281: 56%|█████▋ | 565/1000 [03:41<02:47, 2.59it/s] # PTI :step: 564, epoch: 282: 56%|█████▋ | 565/1000 [03:41<02:47, 2.59it/s] # PTI :step: 564, epoch: 282: 57%|█████▋ | 566/1000 [03:41<02:49, 2.55it/s] # PTI :step: 565, epoch: 282: 57%|█████▋ | 566/1000 [03:41<02:49, 2.55it/s] # PTI :step: 565, epoch: 282: 57%|█████▋ | 567/1000 [03:42<02:47, 2.59it/s] # PTI :step: 566, epoch: 283: 57%|█████▋ | 567/1000 [03:42<02:47, 2.59it/s] # PTI :step: 566, epoch: 283: 57%|█████▋ | 568/1000 [03:42<02:47, 2.57it/s] # PTI :step: 567, epoch: 283: 57%|█████▋ | 568/1000 [03:42<02:47, 2.57it/s] # PTI :step: 567, epoch: 283: 57%|█████▋ | 569/1000 [03:42<02:45, 2.60it/s] # PTI :step: 568, epoch: 284: 57%|█████▋ | 569/1000 [03:42<02:45, 2.60it/s] # PTI :step: 568, epoch: 284: 57%|█████▋ | 570/1000 [03:43<02:46, 2.58it/s] # PTI :step: 569, epoch: 284: 57%|█████▋ | 570/1000 [03:43<02:46, 2.58it/s] # PTI :step: 569, epoch: 284: 57%|█████▋ | 571/1000 [03:43<02:46, 2.58it/s] # PTI :step: 570, epoch: 285: 57%|█████▋ | 571/1000 [03:43<02:46, 2.58it/s] # PTI :step: 570, epoch: 285: 57%|█████▋ | 572/1000 [03:44<02:47, 2.56it/s] # PTI :step: 571, epoch: 285: 57%|█████▋ | 572/1000 [03:44<02:47, 2.56it/s] # PTI :step: 571, epoch: 285: 57%|█████▋ | 573/1000 [03:44<02:45, 2.57it/s] # PTI :step: 572, epoch: 286: 57%|█████▋ | 573/1000 [03:44<02:45, 2.57it/s] # PTI :step: 572, epoch: 286: 57%|█████▋ | 574/1000 [03:44<02:46, 2.55it/s] # PTI :step: 573, epoch: 286: 57%|█████▋ | 574/1000 [03:44<02:46, 2.55it/s] # PTI :step: 573, epoch: 286: 57%|█████▊ | 575/1000 [03:45<02:44, 2.59it/s] # PTI :step: 574, epoch: 287: 57%|█████▊ | 575/1000 [03:45<02:44, 2.59it/s] # PTI :step: 574, epoch: 287: 58%|█████▊ | 576/1000 [03:45<02:46, 2.55it/s] # PTI :step: 575, epoch: 287: 58%|█████▊ | 576/1000 [03:45<02:46, 2.55it/s] # PTI :step: 575, epoch: 287: 58%|█████▊ | 577/1000 [03:46<02:43, 2.59it/s] # PTI :step: 576, epoch: 288: 58%|█████▊ | 577/1000 [03:46<02:43, 2.59it/s] # PTI :step: 576, epoch: 288: 58%|█████▊ | 578/1000 [03:46<02:57, 2.38it/s] # PTI :step: 577, epoch: 288: 58%|█████▊ | 578/1000 [03:46<02:57, 2.38it/s] # PTI :step: 577, epoch: 288: 58%|█████▊ | 579/1000 [03:46<02:52, 2.44it/s] # PTI :step: 578, epoch: 289: 58%|█████▊ | 579/1000 [03:46<02:52, 2.44it/s] # PTI :step: 578, epoch: 289: 58%|█████▊ | 580/1000 [03:47<02:49, 2.47it/s] # PTI :step: 579, epoch: 289: 58%|█████▊ | 580/1000 [03:47<02:49, 2.47it/s] # PTI :step: 579, epoch: 289: 58%|█████▊ | 581/1000 [03:47<02:46, 2.52it/s] # PTI :step: 580, epoch: 290: 58%|█████▊ | 581/1000 [03:47<02:46, 2.52it/s] # PTI :step: 580, epoch: 290: 58%|█████▊ | 582/1000 [03:48<02:45, 2.53it/s] # PTI :step: 581, epoch: 290: 58%|█████▊ | 582/1000 [03:48<02:45, 2.53it/s] # PTI :step: 581, epoch: 290: 58%|█████▊ | 583/1000 [03:48<02:42, 2.57it/s] # PTI :step: 582, epoch: 291: 58%|█████▊ | 583/1000 [03:48<02:42, 2.57it/s] # PTI :step: 582, epoch: 291: 58%|█████▊ | 584/1000 [03:48<02:42, 2.56it/s] # PTI :step: 583, epoch: 291: 58%|█████▊ | 584/1000 [03:48<02:42, 2.56it/s] # PTI :step: 583, epoch: 291: 58%|█████▊ | 585/1000 [03:49<02:39, 2.60it/s] # PTI :step: 584, epoch: 292: 58%|█████▊ | 585/1000 [03:49<02:39, 2.60it/s] # PTI :step: 584, epoch: 292: 59%|█████▊ | 586/1000 [03:49<02:40, 2.58it/s] # PTI :step: 585, epoch: 292: 59%|█████▊ | 586/1000 [03:49<02:40, 2.58it/s] # PTI :step: 585, epoch: 292: 59%|█████▊ | 587/1000 [03:50<02:39, 2.59it/s] # PTI :step: 586, epoch: 293: 59%|█████▊ | 587/1000 [03:50<02:39, 2.59it/s] # PTI :step: 586, epoch: 293: 59%|█████▉ | 588/1000 [03:50<02:40, 2.57it/s] # PTI :step: 587, epoch: 293: 59%|█████▉ | 588/1000 [03:50<02:40, 2.57it/s] # PTI :step: 587, epoch: 293: 59%|█████▉ | 589/1000 [03:50<02:39, 2.58it/s] # PTI :step: 588, epoch: 294: 59%|█████▉ | 589/1000 [03:50<02:39, 2.58it/s] # PTI :step: 588, epoch: 294: 59%|█████▉ | 590/1000 [03:51<02:39, 2.57it/s] # PTI :step: 589, epoch: 294: 59%|█████▉ | 590/1000 [03:51<02:39, 2.57it/s] # PTI :step: 589, epoch: 294: 59%|█████▉ | 591/1000 [03:51<02:39, 2.56it/s] # PTI :step: 590, epoch: 295: 59%|█████▉ | 591/1000 [03:51<02:39, 2.56it/s] # PTI :step: 590, epoch: 295: 59%|█████▉ | 592/1000 [03:51<02:39, 2.55it/s] # PTI :step: 591, epoch: 295: 59%|█████▉ | 592/1000 [03:51<02:39, 2.55it/s] # PTI :step: 591, epoch: 295: 59%|█████▉ | 593/1000 [03:52<02:37, 2.59it/s] # PTI :step: 592, epoch: 296: 59%|█████▉ | 593/1000 [03:52<02:37, 2.59it/s] # PTI :step: 592, epoch: 296: 59%|█████▉ | 594/1000 [03:52<02:39, 2.54it/s] # PTI :step: 593, epoch: 296: 59%|█████▉ | 594/1000 [03:52<02:39, 2.54it/s] # PTI :step: 593, epoch: 296: 60%|█████▉ | 595/1000 [03:53<02:36, 2.59it/s] # PTI :step: 594, epoch: 297: 60%|█████▉ | 595/1000 [03:53<02:36, 2.59it/s] # PTI :step: 594, epoch: 297: 60%|█████▉ | 596/1000 [03:53<02:36, 2.57it/s] # PTI :step: 595, epoch: 297: 60%|█████▉ | 596/1000 [03:53<02:36, 2.57it/s] # PTI :step: 595, epoch: 297: 60%|█████▉ | 597/1000 [03:53<02:34, 2.61it/s] # PTI :step: 596, epoch: 298: 60%|█████▉ | 597/1000 [03:53<02:34, 2.61it/s] # PTI :step: 596, epoch: 298: 60%|█████▉ | 598/1000 [03:54<02:35, 2.59it/s] # PTI :step: 597, epoch: 298: 60%|█████▉ | 598/1000 [03:54<02:35, 2.59it/s] # PTI :step: 597, epoch: 298: 60%|█████▉ | 599/1000 [03:54<02:35, 2.58it/s] # PTI :step: 598, epoch: 299: 60%|█████▉ | 599/1000 [03:54<02:35, 2.58it/s] # PTI :step: 598, epoch: 299: 60%|██████ | 600/1000 [03:55<02:35, 2.57it/s] # PTI :step: 599, epoch: 299: 60%|██████ | 600/1000 [03:55<02:35, 2.57it/s] # PTI :step: 599, epoch: 299: 60%|██████ | 601/1000 [03:55<02:33, 2.60it/s] # PTI :step: 600, epoch: 300: 60%|██████ | 601/1000 [03:55<02:33, 2.60it/s] # PTI :step: 600, epoch: 300: 60%|██████ | 602/1000 [03:55<02:35, 2.56it/s] # PTI :step: 601, epoch: 300: 60%|██████ | 602/1000 [03:55<02:35, 2.56it/s] # PTI :step: 601, epoch: 300: 60%|██████ | 603/1000 [03:56<02:32, 2.60it/s] # PTI :step: 602, epoch: 301: 60%|██████ | 603/1000 [03:56<02:32, 2.60it/s] # PTI :step: 602, epoch: 301: 60%|██████ | 604/1000 [03:56<02:34, 2.56it/s] # PTI :step: 603, epoch: 301: 60%|██████ | 604/1000 [03:56<02:34, 2.56it/s] # PTI :step: 603, epoch: 301: 60%|██████ | 605/1000 [03:57<02:32, 2.60it/s] # PTI :step: 604, epoch: 302: 60%|██████ | 605/1000 [03:57<02:32, 2.60it/s] # PTI :step: 604, epoch: 302: 61%|██████ | 606/1000 [03:57<02:32, 2.58it/s] # PTI :step: 605, epoch: 302: 61%|██████ | 606/1000 [03:57<02:32, 2.58it/s] # PTI :step: 605, epoch: 302: 61%|██████ | 607/1000 [03:57<02:31, 2.59it/s] # PTI :step: 606, epoch: 303: 61%|██████ | 607/1000 [03:57<02:31, 2.59it/s] # PTI :step: 606, epoch: 303: 61%|██████ | 608/1000 [03:58<02:32, 2.58it/s] # PTI :step: 607, epoch: 303: 61%|██████ | 608/1000 [03:58<02:32, 2.58it/s] # PTI :step: 607, epoch: 303: 61%|██████ | 609/1000 [03:58<02:29, 2.61it/s] # PTI :step: 608, epoch: 304: 61%|██████ | 609/1000 [03:58<02:29, 2.61it/s] # PTI :step: 608, epoch: 304: 61%|██████ | 610/1000 [03:58<02:30, 2.59it/s] # PTI :step: 609, epoch: 304: 61%|██████ | 610/1000 [03:58<02:30, 2.59it/s] # PTI :step: 609, epoch: 304: 61%|██████ | 611/1000 [03:59<02:29, 2.61it/s] # PTI :step: 610, epoch: 305: 61%|██████ | 611/1000 [03:59<02:29, 2.61it/s] # PTI :step: 610, epoch: 305: 61%|██████ | 612/1000 [03:59<02:31, 2.56it/s] # PTI :step: 611, epoch: 305: 61%|██████ | 612/1000 [03:59<02:31, 2.56it/s] # PTI :step: 611, epoch: 305: 61%|██████▏ | 613/1000 [04:00<02:30, 2.58it/s] # PTI :step: 612, epoch: 306: 61%|██████▏ | 613/1000 [04:00<02:30, 2.58it/s] # PTI :step: 612, epoch: 306: 61%|██████▏ | 614/1000 [04:00<02:30, 2.57it/s] # PTI :step: 613, epoch: 306: 61%|██████▏ | 614/1000 [04:00<02:30, 2.57it/s] # PTI :step: 613, epoch: 306: 62%|██████▏ | 615/1000 [04:00<02:29, 2.58it/s] # PTI :step: 614, epoch: 307: 62%|██████▏ | 615/1000 [04:00<02:29, 2.58it/s] # PTI :step: 614, epoch: 307: 62%|██████▏ | 616/1000 [04:01<02:29, 2.57it/s] # PTI :step: 615, epoch: 307: 62%|██████▏ | 616/1000 [04:01<02:29, 2.57it/s] # PTI :step: 615, epoch: 307: 62%|██████▏ | 617/1000 [04:01<02:29, 2.57it/s] # PTI :step: 616, epoch: 308: 62%|██████▏ | 617/1000 [04:01<02:29, 2.57it/s] # PTI :step: 616, epoch: 308: 62%|██████▏ | 618/1000 [04:02<02:29, 2.56it/s] # PTI :step: 617, epoch: 308: 62%|██████▏ | 618/1000 [04:02<02:29, 2.56it/s] # PTI :step: 617, epoch: 308: 62%|██████▏ | 619/1000 [04:02<02:27, 2.59it/s] # PTI :step: 618, epoch: 309: 62%|██████▏ | 619/1000 [04:02<02:27, 2.59it/s] # PTI :step: 618, epoch: 309: 62%|██████▏ | 620/1000 [04:02<02:29, 2.55it/s] # PTI :step: 619, epoch: 309: 62%|██████▏ | 620/1000 [04:02<02:29, 2.55it/s] # PTI :step: 619, epoch: 309: 62%|██████▏ | 621/1000 [04:03<02:27, 2.58it/s] # PTI :step: 620, epoch: 310: 62%|██████▏ | 621/1000 [04:03<02:27, 2.58it/s] # PTI :step: 620, epoch: 310: 62%|██████▏ | 622/1000 [04:03<02:29, 2.53it/s] # PTI :step: 621, epoch: 310: 62%|██████▏ | 622/1000 [04:03<02:29, 2.53it/s] # PTI :step: 621, epoch: 310: 62%|██████▏ | 623/1000 [04:04<02:28, 2.54it/s] # PTI :step: 622, epoch: 311: 62%|██████▏ | 623/1000 [04:04<02:28, 2.54it/s] # PTI :step: 622, epoch: 311: 62%|██████▏ | 624/1000 [04:04<02:29, 2.52it/s] # PTI :step: 623, epoch: 311: 62%|██████▏ | 624/1000 [04:04<02:29, 2.52it/s] # PTI :step: 623, epoch: 311: 62%|██████▎ | 625/1000 [04:04<02:29, 2.51it/s] # PTI :step: 624, epoch: 312: 62%|██████▎ | 625/1000 [04:04<02:29, 2.51it/s] # PTI :step: 624, epoch: 312: 63%|██████▎ | 626/1000 [04:05<02:29, 2.50it/s] # PTI :step: 625, epoch: 312: 63%|██████▎ | 626/1000 [04:05<02:29, 2.50it/s] # PTI :step: 625, epoch: 312: 63%|██████▎ | 627/1000 [04:05<02:30, 2.48it/s] # PTI :step: 626, epoch: 313: 63%|██████▎ | 627/1000 [04:05<02:30, 2.48it/s] # PTI :step: 626, epoch: 313: 63%|██████▎ | 628/1000 [04:06<02:29, 2.49it/s] # PTI :step: 627, epoch: 313: 63%|██████▎ | 628/1000 [04:06<02:29, 2.49it/s] # PTI :step: 627, epoch: 313: 63%|██████▎ | 629/1000 [04:06<02:27, 2.52it/s] # PTI :step: 628, epoch: 314: 63%|██████▎ | 629/1000 [04:06<02:27, 2.52it/s] # PTI :step: 628, epoch: 314: 63%|██████▎ | 630/1000 [04:06<02:27, 2.51it/s] # PTI :step: 629, epoch: 314: 63%|██████▎ | 630/1000 [04:06<02:27, 2.51it/s] # PTI :step: 629, epoch: 314: 63%|██████▎ | 631/1000 [04:07<02:25, 2.53it/s] # PTI :step: 630, epoch: 315: 63%|██████▎ | 631/1000 [04:07<02:25, 2.53it/s] # PTI :step: 630, epoch: 315: 63%|██████▎ | 632/1000 [04:07<02:26, 2.52it/s] # PTI :step: 631, epoch: 315: 63%|██████▎ | 632/1000 [04:07<02:26, 2.52it/s] # PTI :step: 631, epoch: 315: 63%|██████▎ | 633/1000 [04:08<02:23, 2.55it/s] # PTI :step: 632, epoch: 316: 63%|██████▎ | 633/1000 [04:08<02:23, 2.55it/s] # PTI :step: 632, epoch: 316: 63%|██████▎ | 634/1000 [04:08<02:24, 2.54it/s] # PTI :step: 633, epoch: 316: 63%|██████▎ | 634/1000 [04:08<02:24, 2.54it/s] # PTI :step: 633, epoch: 316: 64%|██████▎ | 635/1000 [04:08<02:21, 2.58it/s] # PTI :step: 634, epoch: 317: 64%|██████▎ | 635/1000 [04:08<02:21, 2.58it/s] # PTI :step: 634, epoch: 317: 64%|██████▎ | 636/1000 [04:09<02:21, 2.57it/s] # PTI :step: 635, epoch: 317: 64%|██████▎ | 636/1000 [04:09<02:21, 2.57it/s] # PTI :step: 635, epoch: 317: 64%|██████▎ | 637/1000 [04:09<02:20, 2.59it/s] # PTI :step: 636, epoch: 318: 64%|██████▎ | 637/1000 [04:09<02:20, 2.59it/s] # PTI :step: 636, epoch: 318: 64%|██████▍ | 638/1000 [04:09<02:20, 2.58it/s] # PTI :step: 637, epoch: 318: 64%|██████▍ | 638/1000 [04:09<02:20, 2.58it/s] # PTI :step: 637, epoch: 318: 64%|██████▍ | 639/1000 [04:10<02:18, 2.61it/s] # PTI :step: 638, epoch: 319: 64%|██████▍ | 639/1000 [04:10<02:18, 2.61it/s] # PTI :step: 638, epoch: 319: 64%|██████▍ | 640/1000 [04:10<02:19, 2.58it/s] # PTI :step: 639, epoch: 319: 64%|██████▍ | 640/1000 [04:10<02:19, 2.58it/s] # PTI :step: 639, epoch: 319: 64%|██████▍ | 641/1000 [04:11<02:18, 2.59it/s] # PTI :step: 640, epoch: 320: 64%|██████▍ | 641/1000 [04:11<02:18, 2.59it/s] # PTI :step: 640, epoch: 320: 64%|██████▍ | 642/1000 [04:11<02:19, 2.57it/s] # PTI :step: 641, epoch: 320: 64%|██████▍ | 642/1000 [04:11<02:19, 2.57it/s] # PTI :step: 641, epoch: 320: 64%|██████▍ | 643/1000 [04:11<02:18, 2.58it/s] # PTI :step: 642, epoch: 321: 64%|██████▍ | 643/1000 [04:11<02:18, 2.58it/s] # PTI :step: 642, epoch: 321: 64%|██████▍ | 644/1000 [04:12<02:19, 2.56it/s] # PTI :step: 643, epoch: 321: 64%|██████▍ | 644/1000 [04:12<02:19, 2.56it/s] # PTI :step: 643, epoch: 321: 64%|██████▍ | 645/1000 [04:12<02:17, 2.58it/s] # PTI :step: 644, epoch: 322: 64%|██████▍ | 645/1000 [04:12<02:17, 2.58it/s] # PTI :step: 644, epoch: 322: 65%|██████▍ | 646/1000 [04:13<02:17, 2.57it/s] # PTI :step: 645, epoch: 322: 65%|██████▍ | 646/1000 [04:13<02:17, 2.57it/s] # PTI :step: 645, epoch: 322: 65%|██████▍ | 647/1000 [04:13<02:15, 2.60it/s] # PTI :step: 646, epoch: 323: 65%|██████▍ | 647/1000 [04:13<02:15, 2.60it/s] # PTI :step: 646, epoch: 323: 65%|██████▍ | 648/1000 [04:13<02:16, 2.58it/s] # PTI :step: 647, epoch: 323: 65%|██████▍ | 648/1000 [04:13<02:16, 2.58it/s] # PTI :step: 647, epoch: 323: 65%|██████▍ | 649/1000 [04:14<02:14, 2.61it/s] # PTI :step: 648, epoch: 324: 65%|██████▍ | 649/1000 [04:14<02:14, 2.61it/s] # PTI :step: 648, epoch: 324: 65%|██████▌ | 650/1000 [04:14<02:15, 2.59it/s] # PTI :step: 649, epoch: 324: 65%|██████▌ | 650/1000 [04:14<02:15, 2.59it/s] # PTI :step: 649, epoch: 324: 65%|██████▌ | 651/1000 [04:14<02:13, 2.61it/s] # PTI :step: 650, epoch: 325: 65%|██████▌ | 651/1000 [04:14<02:13, 2.61it/s] # PTI :step: 650, epoch: 325: 65%|██████▌ | 652/1000 [04:15<02:14, 2.58it/s] # PTI :step: 651, epoch: 325: 65%|██████▌ | 652/1000 [04:15<02:14, 2.58it/s] # PTI :step: 651, epoch: 325: 65%|██████▌ | 653/1000 [04:15<02:15, 2.56it/s] # PTI :step: 652, epoch: 326: 65%|██████▌ | 653/1000 [04:15<02:15, 2.56it/s] # PTI :step: 652, epoch: 326: 65%|██████▌ | 654/1000 [04:16<02:15, 2.55it/s] # PTI :step: 653, epoch: 326: 65%|██████▌ | 654/1000 [04:16<02:15, 2.55it/s] # PTI :step: 653, epoch: 326: 66%|██████▌ | 655/1000 [04:16<02:13, 2.58it/s] # PTI :step: 654, epoch: 327: 66%|██████▌ | 655/1000 [04:16<02:13, 2.58it/s] # PTI :step: 654, epoch: 327: 66%|██████▌ | 656/1000 [04:16<02:14, 2.56it/s] # PTI :step: 655, epoch: 327: 66%|██████▌ | 656/1000 [04:16<02:14, 2.56it/s] # PTI :step: 655, epoch: 327: 66%|██████▌ | 657/1000 [04:17<02:12, 2.60it/s] # PTI :step: 656, epoch: 328: 66%|██████▌ | 657/1000 [04:17<02:12, 2.60it/s] # PTI :step: 656, epoch: 328: 66%|██████▌ | 658/1000 [04:17<02:13, 2.55it/s] # PTI :step: 657, epoch: 328: 66%|██████▌ | 658/1000 [04:17<02:13, 2.55it/s] # PTI :step: 657, epoch: 328: 66%|██████▌ | 659/1000 [04:18<02:14, 2.54it/s] # PTI :step: 658, epoch: 329: 66%|██████▌ | 659/1000 [04:18<02:14, 2.54it/s] # PTI :step: 658, epoch: 329: 66%|██████▌ | 660/1000 [04:18<02:14, 2.53it/s] # PTI :step: 659, epoch: 329: 66%|██████▌ | 660/1000 [04:18<02:14, 2.53it/s] # PTI :step: 659, epoch: 329: 66%|██████▌ | 661/1000 [04:18<02:11, 2.57it/s] # PTI :step: 660, epoch: 330: 66%|██████▌ | 661/1000 [04:18<02:11, 2.57it/s] # PTI :step: 660, epoch: 330: 66%|██████▌ | 662/1000 [04:19<02:12, 2.56it/s] # PTI :step: 661, epoch: 330: 66%|██████▌ | 662/1000 [04:19<02:12, 2.56it/s] # PTI :step: 661, epoch: 330: 66%|██████▋ | 663/1000 [04:19<02:11, 2.57it/s] # PTI :step: 662, epoch: 331: 66%|██████▋ | 663/1000 [04:19<02:11, 2.57it/s] # PTI :step: 662, epoch: 331: 66%|██████▋ | 664/1000 [04:20<02:11, 2.56it/s] # PTI :step: 663, epoch: 331: 66%|██████▋ | 664/1000 [04:20<02:11, 2.56it/s] # PTI :step: 663, epoch: 331: 66%|██████▋ | 665/1000 [04:20<02:10, 2.57it/s] # PTI :step: 664, epoch: 332: 66%|██████▋ | 665/1000 [04:20<02:10, 2.57it/s] # PTI :step: 664, epoch: 332: 67%|██████▋ | 666/1000 [04:20<02:10, 2.56it/s] # PTI :step: 665, epoch: 332: 67%|██████▋ | 666/1000 [04:20<02:10, 2.56it/s] # PTI :step: 665, epoch: 332: 67%|██████▋ | 667/1000 [04:21<02:08, 2.60it/s] # PTI :step: 666, epoch: 333: 67%|██████▋ | 667/1000 [04:21<02:08, 2.60it/s] # PTI :step: 666, epoch: 333: 67%|██████▋ | 668/1000 [04:21<02:08, 2.58it/s] # PTI :step: 667, epoch: 333: 67%|██████▋ | 668/1000 [04:21<02:08, 2.58it/s] # PTI :step: 667, epoch: 333: 67%|██████▋ | 669/1000 [04:21<02:06, 2.62it/s] # PTI :step: 668, epoch: 334: 67%|██████▋ | 669/1000 [04:21<02:06, 2.62it/s] # PTI :step: 668, epoch: 334: 67%|██████▋ | 670/1000 [04:22<02:06, 2.60it/s] # PTI :step: 669, epoch: 334: 67%|██████▋ | 670/1000 [04:22<02:06, 2.60it/s] # PTI :step: 669, epoch: 334: 67%|██████▋ | 671/1000 [04:22<02:05, 2.62it/s] # PTI :step: 670, epoch: 335: 67%|██████▋ | 671/1000 [04:22<02:05, 2.62it/s] # PTI :step: 670, epoch: 335: 67%|██████▋ | 672/1000 [04:23<02:06, 2.60it/s] # PTI :step: 671, epoch: 335: 67%|██████▋ | 672/1000 [04:23<02:06, 2.60it/s] # PTI :step: 671, epoch: 335: 67%|██████▋ | 673/1000 [04:23<02:05, 2.60it/s] # PTI :step: 672, epoch: 336: 67%|██████▋ | 673/1000 [04:23<02:05, 2.60it/s] # PTI :step: 672, epoch: 336: 67%|██████▋ | 674/1000 [04:23<02:05, 2.59it/s] # PTI :step: 673, epoch: 336: 67%|██████▋ | 674/1000 [04:23<02:05, 2.59it/s] # PTI :step: 673, epoch: 336: 68%|██████▊ | 675/1000 [04:24<02:04, 2.62it/s] # PTI :step: 674, epoch: 337: 68%|██████▊ | 675/1000 [04:24<02:04, 2.62it/s] # PTI :step: 674, epoch: 337: 68%|██████▊ | 676/1000 [04:24<02:04, 2.59it/s] # PTI :step: 675, epoch: 337: 68%|██████▊ | 676/1000 [04:24<02:04, 2.59it/s] # PTI :step: 675, epoch: 337: 68%|██████▊ | 677/1000 [04:25<02:03, 2.62it/s] # PTI :step: 676, epoch: 338: 68%|██████▊ | 677/1000 [04:25<02:03, 2.62it/s] # PTI :step: 676, epoch: 338: 68%|██████▊ | 678/1000 [04:25<02:04, 2.60it/s] # PTI :step: 677, epoch: 338: 68%|██████▊ | 678/1000 [04:25<02:04, 2.60it/s] # PTI :step: 677, epoch: 338: 68%|██████▊ | 679/1000 [04:25<02:05, 2.55it/s] # PTI :step: 678, epoch: 339: 68%|██████▊ | 679/1000 [04:25<02:05, 2.55it/s] # PTI :step: 678, epoch: 339: 68%|██████▊ | 680/1000 [04:26<02:05, 2.54it/s] # PTI :step: 679, epoch: 339: 68%|██████▊ | 680/1000 [04:26<02:05, 2.54it/s] # PTI :step: 679, epoch: 339: 68%|██████▊ | 681/1000 [04:26<02:04, 2.57it/s] # PTI :step: 680, epoch: 340: 68%|██████▊ | 681/1000 [04:26<02:04, 2.57it/s] # PTI :step: 680, epoch: 340: 68%|██████▊ | 682/1000 [04:26<02:04, 2.56it/s] # PTI :step: 681, epoch: 340: 68%|██████▊ | 682/1000 [04:26<02:04, 2.56it/s] # PTI :step: 681, epoch: 340: 68%|██████▊ | 683/1000 [04:27<02:15, 2.35it/s] # PTI :step: 682, epoch: 341: 68%|██████▊ | 683/1000 [04:27<02:15, 2.35it/s] # PTI :step: 682, epoch: 341: 68%|██████▊ | 684/1000 [04:27<02:11, 2.40it/s] # PTI :step: 683, epoch: 341: 68%|██████▊ | 684/1000 [04:27<02:11, 2.40it/s] # PTI :step: 683, epoch: 341: 68%|██████▊ | 685/1000 [04:28<02:07, 2.46it/s] # PTI :step: 684, epoch: 342: 68%|██████▊ | 685/1000 [04:28<02:07, 2.46it/s] # PTI :step: 684, epoch: 342: 69%|██████▊ | 686/1000 [04:28<02:06, 2.49it/s] # PTI :step: 685, epoch: 342: 69%|██████▊ | 686/1000 [04:28<02:06, 2.49it/s] # PTI :step: 685, epoch: 342: 69%|██████▊ | 687/1000 [04:29<02:02, 2.55it/s] # PTI :step: 686, epoch: 343: 69%|██████▊ | 687/1000 [04:29<02:02, 2.55it/s] # PTI :step: 686, epoch: 343: 69%|██████▉ | 688/1000 [04:29<02:03, 2.53it/s] # PTI :step: 687, epoch: 343: 69%|██████▉ | 688/1000 [04:29<02:03, 2.53it/s] # PTI :step: 687, epoch: 343: 69%|██████▉ | 689/1000 [04:29<02:00, 2.57it/s] # PTI :step: 688, epoch: 344: 69%|██████▉ | 689/1000 [04:29<02:00, 2.57it/s] # PTI :step: 688, epoch: 344: 69%|██████▉ | 690/1000 [04:30<02:00, 2.56it/s] # PTI :step: 689, epoch: 344: 69%|██████▉ | 690/1000 [04:30<02:00, 2.56it/s] # PTI :step: 689, epoch: 344: 69%|██████▉ | 691/1000 [04:30<01:59, 2.59it/s] # PTI :step: 690, epoch: 345: 69%|██████▉ | 691/1000 [04:30<01:59, 2.59it/s] # PTI :step: 690, epoch: 345: 69%|██████▉ | 692/1000 [04:30<01:59, 2.58it/s] # PTI :step: 691, epoch: 345: 69%|██████▉ | 692/1000 [04:30<01:59, 2.58it/s] # PTI :step: 691, epoch: 345: 69%|██████▉ | 693/1000 [04:31<01:57, 2.61it/s] # PTI :step: 692, epoch: 346: 69%|██████▉ | 693/1000 [04:31<01:57, 2.61it/s] # PTI :step: 692, epoch: 346: 69%|██████▉ | 694/1000 [04:31<01:59, 2.56it/s] # PTI :step: 693, epoch: 346: 69%|██████▉ | 694/1000 [04:31<01:59, 2.56it/s] # PTI :step: 693, epoch: 346: 70%|██████▉ | 695/1000 [04:32<01:57, 2.59it/s] # PTI :step: 694, epoch: 347: 70%|██████▉ | 695/1000 [04:32<01:57, 2.59it/s] # PTI :step: 694, epoch: 347: 70%|██████▉ | 696/1000 [04:32<01:58, 2.57it/s] # PTI :step: 695, epoch: 347: 70%|██████▉ | 696/1000 [04:32<01:58, 2.57it/s] # PTI :step: 695, epoch: 347: 70%|██████▉ | 697/1000 [04:32<01:56, 2.60it/s] # PTI :step: 696, epoch: 348: 70%|██████▉ | 697/1000 [04:32<01:56, 2.60it/s] # PTI :step: 696, epoch: 348: 70%|██████▉ | 698/1000 [04:33<01:56, 2.59it/s] # PTI :step: 697, epoch: 348: 70%|██████▉ | 698/1000 [04:33<01:56, 2.59it/s] # PTI :step: 697, epoch: 348: 70%|██████▉ | 699/1000 [04:33<01:56, 2.59it/s] # PTI :step: 698, epoch: 349: 70%|██████▉ | 699/1000 [04:33<01:56, 2.59it/s] # PTI :step: 698, epoch: 349: 70%|███████ | 700/1000 [04:34<01:56, 2.58it/s] # PTI :step: 699, epoch: 349: 70%|███████ | 700/1000 [04:34<01:56, 2.58it/s] # PTI :step: 699, epoch: 349: 70%|███████ | 701/1000 [04:34<01:54, 2.60it/s] # PTI :step: 700, epoch: 350: 70%|███████ | 701/1000 [04:34<01:54, 2.60it/s] # PTI :step: 700, epoch: 350: 70%|███████ | 702/1000 [04:34<01:55, 2.59it/s] # PTI :step: 701, epoch: 350: 70%|███████ | 702/1000 [04:34<01:55, 2.59it/s] # PTI :step: 701, epoch: 350: 70%|███████ | 703/1000 [04:35<01:53, 2.62it/s] # PTI :step: 702, epoch: 351: 70%|███████ | 703/1000 [04:35<01:53, 2.62it/s] # PTI :step: 702, epoch: 351: 70%|███████ | 704/1000 [04:35<01:54, 2.58it/s] # PTI :step: 703, epoch: 351: 70%|███████ | 704/1000 [04:35<01:54, 2.58it/s] # PTI :step: 703, epoch: 351: 70%|███████ | 705/1000 [04:35<01:53, 2.60it/s] # PTI :step: 704, epoch: 352: 70%|███████ | 705/1000 [04:35<01:53, 2.60it/s] # PTI :step: 704, epoch: 352: 71%|███████ | 706/1000 [04:36<01:54, 2.57it/s] # PTI :step: 705, epoch: 352: 71%|███████ | 706/1000 [04:36<01:54, 2.57it/s] # PTI :step: 705, epoch: 352: 71%|███████ | 707/1000 [04:36<01:53, 2.58it/s] # PTI :step: 706, epoch: 353: 71%|███████ | 707/1000 [04:36<01:53, 2.58it/s] # PTI :step: 706, epoch: 353: 71%|███████ | 708/1000 [04:37<01:53, 2.57it/s] # PTI :step: 707, epoch: 353: 71%|███████ | 708/1000 [04:37<01:53, 2.57it/s] # PTI :step: 707, epoch: 353: 71%|███████ | 709/1000 [04:37<01:52, 2.59it/s] # PTI :step: 708, epoch: 354: 71%|███████ | 709/1000 [04:37<01:52, 2.59it/s] # PTI :step: 708, epoch: 354: 71%|███████ | 710/1000 [04:37<01:52, 2.58it/s] # PTI :step: 709, epoch: 354: 71%|███████ | 710/1000 [04:37<01:52, 2.58it/s] # PTI :step: 709, epoch: 354: 71%|███████ | 711/1000 [04:38<01:51, 2.60it/s] # PTI :step: 710, epoch: 355: 71%|███████ | 711/1000 [04:38<01:51, 2.60it/s] # PTI :step: 710, epoch: 355: 71%|███████ | 712/1000 [04:38<01:51, 2.58it/s] # PTI :step: 711, epoch: 355: 71%|███████ | 712/1000 [04:38<01:51, 2.58it/s] # PTI :step: 711, epoch: 355: 71%|███████▏ | 713/1000 [04:39<01:50, 2.60it/s] # PTI :step: 712, epoch: 356: 71%|███████▏ | 713/1000 [04:39<01:50, 2.60it/s] # PTI :step: 712, epoch: 356: 71%|███████▏ | 714/1000 [04:39<01:50, 2.58it/s] # PTI :step: 713, epoch: 356: 71%|███████▏ | 714/1000 [04:39<01:50, 2.58it/s] # PTI :step: 713, epoch: 356: 72%|███████▏ | 715/1000 [04:39<01:49, 2.60it/s] # PTI :step: 714, epoch: 357: 72%|███████▏ | 715/1000 [04:39<01:49, 2.60it/s] # PTI :step: 714, epoch: 357: 72%|███████▏ | 716/1000 [04:40<01:49, 2.59it/s] # PTI :step: 715, epoch: 357: 72%|███████▏ | 716/1000 [04:40<01:49, 2.59it/s] # PTI :step: 715, epoch: 357: 72%|███████▏ | 717/1000 [04:40<01:49, 2.59it/s] # PTI :step: 716, epoch: 358: 72%|███████▏ | 717/1000 [04:40<01:49, 2.59it/s] # PTI :step: 716, epoch: 358: 72%|███████▏ | 718/1000 [04:41<01:49, 2.58it/s] # PTI :step: 717, epoch: 358: 72%|███████▏ | 718/1000 [04:41<01:49, 2.58it/s] # PTI :step: 717, epoch: 358: 72%|███████▏ | 719/1000 [04:41<01:48, 2.58it/s] # PTI :step: 718, epoch: 359: 72%|███████▏ | 719/1000 [04:41<01:48, 2.58it/s] # PTI :step: 718, epoch: 359: 72%|███████▏ | 720/1000 [04:41<01:49, 2.56it/s] # PTI :step: 719, epoch: 359: 72%|███████▏ | 720/1000 [04:41<01:49, 2.56it/s] # PTI :step: 719, epoch: 359: 72%|███████▏ | 721/1000 [04:42<01:47, 2.59it/s] # PTI :step: 720, epoch: 360: 72%|███████▏ | 721/1000 [04:42<01:47, 2.59it/s] # PTI :step: 720, epoch: 360: 72%|███████▏ | 722/1000 [04:42<01:47, 2.58it/s] # PTI :step: 721, epoch: 360: 72%|███████▏ | 722/1000 [04:42<01:47, 2.58it/s] # PTI :step: 721, epoch: 360: 72%|███████▏ | 723/1000 [04:42<01:46, 2.60it/s] # PTI :step: 722, epoch: 361: 72%|███████▏ | 723/1000 [04:42<01:46, 2.60it/s] # PTI :step: 722, epoch: 361: 72%|███████▏ | 724/1000 [04:43<01:46, 2.58it/s] # PTI :step: 723, epoch: 361: 72%|███████▏ | 724/1000 [04:43<01:46, 2.58it/s] # PTI :step: 723, epoch: 361: 72%|███████▎ | 725/1000 [04:43<01:45, 2.61it/s] # PTI :step: 724, epoch: 362: 72%|███████▎ | 725/1000 [04:43<01:45, 2.61it/s] # PTI :step: 724, epoch: 362: 73%|███████▎ | 726/1000 [04:44<01:45, 2.59it/s] # PTI :step: 725, epoch: 362: 73%|███████▎ | 726/1000 [04:44<01:45, 2.59it/s] # PTI :step: 725, epoch: 362: 73%|███████▎ | 727/1000 [04:44<01:44, 2.60it/s] # PTI :step: 726, epoch: 363: 73%|███████▎ | 727/1000 [04:44<01:44, 2.60it/s] # PTI :step: 726, epoch: 363: 73%|███████▎ | 728/1000 [04:44<01:45, 2.58it/s] # PTI :step: 727, epoch: 363: 73%|███████▎ | 728/1000 [04:44<01:45, 2.58it/s] # PTI :step: 727, epoch: 363: 73%|███████▎ | 729/1000 [04:45<01:44, 2.61it/s] # PTI :step: 728, epoch: 364: 73%|███████▎ | 729/1000 [04:45<01:44, 2.61it/s] # PTI :step: 728, epoch: 364: 73%|███████▎ | 730/1000 [04:45<01:44, 2.58it/s] # PTI :step: 729, epoch: 364: 73%|███████▎ | 730/1000 [04:45<01:44, 2.58it/s] # PTI :step: 729, epoch: 364: 73%|███████▎ | 731/1000 [04:46<01:43, 2.61it/s] # PTI :step: 730, epoch: 365: 73%|███████▎ | 731/1000 [04:46<01:43, 2.61it/s] # PTI :step: 730, epoch: 365: 73%|███████▎ | 732/1000 [04:46<01:43, 2.59it/s] # PTI :step: 731, epoch: 365: 73%|███████▎ | 732/1000 [04:46<01:43, 2.59it/s] # PTI :step: 731, epoch: 365: 73%|███████▎ | 733/1000 [04:46<01:42, 2.62it/s] # PTI :step: 732, epoch: 366: 73%|███████▎ | 733/1000 [04:46<01:42, 2.62it/s] # PTI :step: 732, epoch: 366: 73%|███████▎ | 734/1000 [04:47<01:42, 2.60it/s] # PTI :step: 733, epoch: 366: 73%|███████▎ | 734/1000 [04:47<01:42, 2.60it/s] # PTI :step: 733, epoch: 366: 74%|███████▎ | 735/1000 [04:47<01:41, 2.60it/s] # PTI :step: 734, epoch: 367: 74%|███████▎ | 735/1000 [04:47<01:41, 2.60it/s] # PTI :step: 734, epoch: 367: 74%|███████▎ | 736/1000 [04:47<01:42, 2.59it/s] # PTI :step: 735, epoch: 367: 74%|███████▎ | 736/1000 [04:47<01:42, 2.59it/s] # PTI :step: 735, epoch: 367: 74%|███████▎ | 737/1000 [04:48<01:40, 2.61it/s] # PTI :step: 736, epoch: 368: 74%|███████▎ | 737/1000 [04:48<01:40, 2.61it/s] # PTI :step: 736, epoch: 368: 74%|███████▍ | 738/1000 [04:48<01:42, 2.57it/s] # PTI :step: 737, epoch: 368: 74%|███████▍ | 738/1000 [04:48<01:42, 2.57it/s] # PTI :step: 737, epoch: 368: 74%|███████▍ | 739/1000 [04:49<01:41, 2.57it/s] # PTI :step: 738, epoch: 369: 74%|███████▍ | 739/1000 [04:49<01:41, 2.57it/s] # PTI :step: 738, epoch: 369: 74%|███████▍ | 740/1000 [04:49<01:41, 2.56it/s] # PTI :step: 739, epoch: 369: 74%|███████▍ | 740/1000 [04:49<01:41, 2.56it/s] # PTI :step: 739, epoch: 369: 74%|███████▍ | 741/1000 [04:49<01:39, 2.59it/s] # PTI :step: 740, epoch: 370: 74%|███████▍ | 741/1000 [04:49<01:39, 2.59it/s] # PTI :step: 740, epoch: 370: 74%|███████▍ | 742/1000 [04:50<01:40, 2.57it/s] # PTI :step: 741, epoch: 370: 74%|███████▍ | 742/1000 [04:50<01:40, 2.57it/s] # PTI :step: 741, epoch: 370: 74%|███████▍ | 743/1000 [04:50<01:39, 2.58it/s] # PTI :step: 742, epoch: 371: 74%|███████▍ | 743/1000 [04:50<01:39, 2.58it/s] # PTI :step: 742, epoch: 371: 74%|███████▍ | 744/1000 [04:51<01:39, 2.57it/s] # PTI :step: 743, epoch: 371: 74%|███████▍ | 744/1000 [04:51<01:39, 2.57it/s] # PTI :step: 743, epoch: 371: 74%|███████▍ | 745/1000 [04:51<01:38, 2.60it/s] # PTI :step: 744, epoch: 372: 74%|███████▍ | 745/1000 [04:51<01:38, 2.60it/s] # PTI :step: 744, epoch: 372: 75%|███████▍ | 746/1000 [04:51<01:38, 2.58it/s] # PTI :step: 745, epoch: 372: 75%|███████▍ | 746/1000 [04:51<01:38, 2.58it/s] # PTI :step: 745, epoch: 372: 75%|███████▍ | 747/1000 [04:52<01:37, 2.59it/s] # PTI :step: 746, epoch: 373: 75%|███████▍ | 747/1000 [04:52<01:37, 2.59it/s] # PTI :step: 746, epoch: 373: 75%|███████▍ | 748/1000 [04:52<01:38, 2.56it/s] # PTI :step: 747, epoch: 373: 75%|███████▍ | 748/1000 [04:52<01:38, 2.56it/s] # PTI :step: 747, epoch: 373: 75%|███████▍ | 749/1000 [04:53<01:36, 2.59it/s] # PTI :step: 748, epoch: 374: 75%|███████▍ | 749/1000 [04:53<01:36, 2.59it/s] # PTI :step: 748, epoch: 374: 75%|███████▌ | 750/1000 [04:53<01:37, 2.57it/s] # PTI :step: 749, epoch: 374: 75%|███████▌ | 750/1000 [04:53<01:37, 2.57it/s] # PTI :step: 749, epoch: 374: 75%|███████▌ | 751/1000 [04:53<01:35, 2.61it/s] # PTI :step: 750, epoch: 375: 75%|███████▌ | 751/1000 [04:53<01:35, 2.61it/s] # PTI :step: 750, epoch: 375: 75%|███████▌ | 752/1000 [04:54<01:35, 2.59it/s] # PTI :step: 751, epoch: 375: 75%|███████▌ | 752/1000 [04:54<01:35, 2.59it/s] # PTI :step: 751, epoch: 375: 75%|███████▌ | 753/1000 [04:54<01:34, 2.61it/s] # PTI :step: 752, epoch: 376: 75%|███████▌ | 753/1000 [04:54<01:34, 2.61it/s] # PTI :step: 752, epoch: 376: 75%|███████▌ | 754/1000 [04:54<01:34, 2.59it/s] # PTI :step: 753, epoch: 376: 75%|███████▌ | 754/1000 [04:54<01:34, 2.59it/s] # PTI :step: 753, epoch: 376: 76%|███████▌ | 755/1000 [04:55<01:41, 2.41it/s] # PTI :step: 754, epoch: 377: 76%|███████▌ | 755/1000 [04:55<01:41, 2.41it/s] # PTI :step: 754, epoch: 377: 76%|███████▌ | 756/1000 [04:55<01:40, 2.44it/s] # PTI :step: 755, epoch: 377: 76%|███████▌ | 756/1000 [04:55<01:40, 2.44it/s] # PTI :step: 755, epoch: 377: 76%|███████▌ | 757/1000 [04:56<01:36, 2.51it/s] # PTI :step: 756, epoch: 378: 76%|███████▌ | 757/1000 [04:56<01:36, 2.51it/s] # PTI :step: 756, epoch: 378: 76%|███████▌ | 758/1000 [04:56<01:36, 2.52it/s] # PTI :step: 757, epoch: 378: 76%|███████▌ | 758/1000 [04:56<01:36, 2.52it/s] # PTI :step: 757, epoch: 378: 76%|███████▌ | 759/1000 [04:56<01:33, 2.57it/s] # PTI :step: 758, epoch: 379: 76%|███████▌ | 759/1000 [04:56<01:33, 2.57it/s] # PTI :step: 758, epoch: 379: 76%|███████▌ | 760/1000 [04:57<01:33, 2.56it/s] # PTI :step: 759, epoch: 379: 76%|███████▌ | 760/1000 [04:57<01:33, 2.56it/s] # PTI :step: 759, epoch: 379: 76%|███████▌ | 761/1000 [04:57<01:33, 2.56it/s] # PTI :step: 760, epoch: 380: 76%|███████▌ | 761/1000 [04:57<01:33, 2.56it/s] # PTI :step: 760, epoch: 380: 76%|███████▌ | 762/1000 [04:58<01:33, 2.56it/s] # PTI :step: 761, epoch: 380: 76%|███████▌ | 762/1000 [04:58<01:33, 2.56it/s] # PTI :step: 761, epoch: 380: 76%|███████▋ | 763/1000 [04:58<01:31, 2.59it/s] # PTI :step: 762, epoch: 381: 76%|███████▋ | 763/1000 [04:58<01:31, 2.59it/s] # PTI :step: 762, epoch: 381: 76%|███████▋ | 764/1000 [04:58<01:31, 2.58it/s] # PTI :step: 763, epoch: 381: 76%|███████▋ | 764/1000 [04:58<01:31, 2.58it/s] # PTI :step: 763, epoch: 381: 76%|███████▋ | 765/1000 [04:59<01:29, 2.61it/s] # PTI :step: 764, epoch: 382: 76%|███████▋ | 765/1000 [04:59<01:29, 2.61it/s] # PTI :step: 764, epoch: 382: 77%|███████▋ | 766/1000 [04:59<01:31, 2.57it/s] # PTI :step: 765, epoch: 382: 77%|███████▋ | 766/1000 [04:59<01:31, 2.57it/s] # PTI :step: 765, epoch: 382: 77%|███████▋ | 767/1000 [05:00<01:29, 2.60it/s] # PTI :step: 766, epoch: 383: 77%|███████▋ | 767/1000 [05:00<01:29, 2.60it/s] # PTI :step: 766, epoch: 383: 77%|███████▋ | 768/1000 [05:00<01:29, 2.58it/s] # PTI :step: 767, epoch: 383: 77%|███████▋ | 768/1000 [05:00<01:29, 2.58it/s] # PTI :step: 767, epoch: 383: 77%|███████▋ | 769/1000 [05:00<01:28, 2.60it/s] # PTI :step: 768, epoch: 384: 77%|███████▋ | 769/1000 [05:00<01:28, 2.60it/s] # PTI :step: 768, epoch: 384: 77%|███████▋ | 770/1000 [05:01<01:29, 2.57it/s] # PTI :step: 769, epoch: 384: 77%|███████▋ | 770/1000 [05:01<01:29, 2.57it/s] # PTI :step: 769, epoch: 384: 77%|███████▋ | 771/1000 [05:01<01:29, 2.57it/s] # PTI :step: 770, epoch: 385: 77%|███████▋ | 771/1000 [05:01<01:29, 2.57it/s] # PTI :step: 770, epoch: 385: 77%|███████▋ | 772/1000 [05:01<01:28, 2.57it/s] # PTI :step: 771, epoch: 385: 77%|███████▋ | 772/1000 [05:01<01:28, 2.57it/s] # PTI :step: 771, epoch: 385: 77%|███████▋ | 773/1000 [05:02<01:27, 2.60it/s] # PTI :step: 772, epoch: 386: 77%|███████▋ | 773/1000 [05:02<01:27, 2.60it/s] # PTI :step: 772, epoch: 386: 77%|███████▋ | 774/1000 [05:02<01:28, 2.56it/s] # PTI :step: 773, epoch: 386: 77%|███████▋ | 774/1000 [05:02<01:28, 2.56it/s] # PTI :step: 773, epoch: 386: 78%|███████▊ | 775/1000 [05:03<01:27, 2.58it/s] # PTI :step: 774, epoch: 387: 78%|███████▊ | 775/1000 [05:03<01:27, 2.58it/s] # PTI :step: 774, epoch: 387: 78%|███████▊ | 776/1000 [05:03<01:27, 2.57it/s] # PTI :step: 775, epoch: 387: 78%|███████▊ | 776/1000 [05:03<01:27, 2.57it/s] # PTI :step: 775, epoch: 387: 78%|███████▊ | 777/1000 [05:03<01:25, 2.60it/s] # PTI :step: 776, epoch: 388: 78%|███████▊ | 777/1000 [05:03<01:25, 2.60it/s] # PTI :step: 776, epoch: 388: 78%|███████▊ | 778/1000 [05:04<01:26, 2.58it/s] # PTI :step: 777, epoch: 388: 78%|███████▊ | 778/1000 [05:04<01:26, 2.58it/s] # PTI :step: 777, epoch: 388: 78%|███████▊ | 779/1000 [05:04<01:25, 2.58it/s] # PTI :step: 778, epoch: 389: 78%|███████▊ | 779/1000 [05:04<01:25, 2.58it/s] # PTI :step: 778, epoch: 389: 78%|███████▊ | 780/1000 [05:05<01:25, 2.57it/s] # PTI :step: 779, epoch: 389: 78%|███████▊ | 780/1000 [05:05<01:25, 2.57it/s] # PTI :step: 779, epoch: 389: 78%|███████▊ | 781/1000 [05:05<01:24, 2.60it/s] # PTI :step: 780, epoch: 390: 78%|███████▊ | 781/1000 [05:05<01:24, 2.60it/s] # PTI :step: 780, epoch: 390: 78%|███████▊ | 782/1000 [05:05<01:24, 2.58it/s] # PTI :step: 781, epoch: 390: 78%|███████▊ | 782/1000 [05:05<01:24, 2.58it/s] # PTI :step: 781, epoch: 390: 78%|███████▊ | 783/1000 [05:06<01:22, 2.61it/s] # PTI :step: 782, epoch: 391: 78%|███████▊ | 783/1000 [05:06<01:22, 2.61it/s] # PTI :step: 782, epoch: 391: 78%|███████▊ | 784/1000 [05:06<01:23, 2.59it/s] # PTI :step: 783, epoch: 391: 78%|███████▊ | 784/1000 [05:06<01:23, 2.59it/s] # PTI :step: 783, epoch: 391: 78%|███████▊ | 785/1000 [05:07<01:22, 2.61it/s] # PTI :step: 784, epoch: 392: 78%|███████▊ | 785/1000 [05:07<01:22, 2.61it/s] # PTI :step: 784, epoch: 392: 79%|███████▊ | 786/1000 [05:07<01:23, 2.57it/s] # PTI :step: 785, epoch: 392: 79%|███████▊ | 786/1000 [05:07<01:23, 2.57it/s] # PTI :step: 785, epoch: 392: 79%|███████▊ | 787/1000 [05:07<01:22, 2.57it/s] # PTI :step: 786, epoch: 393: 79%|███████▊ | 787/1000 [05:07<01:22, 2.57it/s] # PTI :step: 786, epoch: 393: 79%|███████▉ | 788/1000 [05:08<01:23, 2.55it/s] # PTI :step: 787, epoch: 393: 79%|███████▉ | 788/1000 [05:08<01:23, 2.55it/s] # PTI :step: 787, epoch: 393: 79%|███████▉ | 789/1000 [05:08<01:22, 2.56it/s] # PTI :step: 788, epoch: 394: 79%|███████▉ | 789/1000 [05:08<01:22, 2.56it/s] # PTI :step: 788, epoch: 394: 79%|███████▉ | 790/1000 [05:08<01:22, 2.56it/s] # PTI :step: 789, epoch: 394: 79%|███████▉ | 790/1000 [05:08<01:22, 2.56it/s] # PTI :step: 789, epoch: 394: 79%|███████▉ | 791/1000 [05:09<01:20, 2.59it/s] # PTI :step: 790, epoch: 395: 79%|███████▉ | 791/1000 [05:09<01:20, 2.59it/s] # PTI :step: 790, epoch: 395: 79%|███████▉ | 792/1000 [05:09<01:20, 2.57it/s] # PTI :step: 791, epoch: 395: 79%|███████▉ | 792/1000 [05:09<01:20, 2.57it/s] # PTI :step: 791, epoch: 395: 79%|███████▉ | 793/1000 [05:10<01:19, 2.61it/s] # PTI :step: 792, epoch: 396: 79%|███████▉ | 793/1000 [05:10<01:19, 2.61it/s] # PTI :step: 792, epoch: 396: 79%|███████▉ | 794/1000 [05:10<01:19, 2.59it/s] # PTI :step: 793, epoch: 396: 79%|███████▉ | 794/1000 [05:10<01:19, 2.59it/s] # PTI :step: 793, epoch: 396: 80%|███████▉ | 795/1000 [05:10<01:18, 2.61it/s] # PTI :step: 794, epoch: 397: 80%|███████▉ | 795/1000 [05:10<01:18, 2.61it/s] # PTI :step: 794, epoch: 397: 80%|███████▉ | 796/1000 [05:11<01:18, 2.59it/s] # PTI :step: 795, epoch: 397: 80%|███████▉ | 796/1000 [05:11<01:18, 2.59it/s] # PTI :step: 795, epoch: 397: 80%|███████▉ | 797/1000 [05:11<01:18, 2.59it/s] # PTI :step: 796, epoch: 398: 80%|███████▉ | 797/1000 [05:11<01:18, 2.59it/s] # PTI :step: 796, epoch: 398: 80%|███████▉ | 798/1000 [05:12<01:18, 2.58it/s] # PTI :step: 797, epoch: 398: 80%|███████▉ | 798/1000 [05:12<01:18, 2.58it/s] # PTI :step: 797, epoch: 398: 80%|███████▉ | 799/1000 [05:12<01:17, 2.60it/s] # PTI :step: 798, epoch: 399: 80%|███████▉ | 799/1000 [05:12<01:17, 2.60it/s] # PTI :step: 798, epoch: 399: 80%|████████ | 800/1000 [05:12<01:17, 2.58it/s] # PTI :step: 799, epoch: 399: 80%|████████ | 800/1000 [05:12<01:17, 2.58it/s] # PTI :step: 799, epoch: 399: 80%|████████ | 801/1000 [05:13<01:16, 2.61it/s] # PTI :step: 800, epoch: 400: 80%|████████ | 801/1000 [05:13<01:16, 2.61it/s] # PTI :step: 800, epoch: 400: 80%|████████ | 802/1000 [05:13<01:16, 2.59it/s] # PTI :step: 801, epoch: 400: 80%|████████ | 802/1000 [05:13<01:16, 2.59it/s] # PTI :step: 801, epoch: 400: 80%|████████ | 803/1000 [05:13<01:15, 2.62it/s] # PTI :step: 802, epoch: 401: 80%|████████ | 803/1000 [05:13<01:15, 2.62it/s] # PTI :step: 802, epoch: 401: 80%|████████ | 804/1000 [05:14<01:15, 2.60it/s] # PTI :step: 803, epoch: 401: 80%|████████ | 804/1000 [05:14<01:15, 2.60it/s] # PTI :step: 803, epoch: 401: 80%|████████ | 805/1000 [05:14<01:14, 2.62it/s] # PTI :step: 804, epoch: 402: 80%|████████ | 805/1000 [05:14<01:14, 2.62it/s] # PTI :step: 804, epoch: 402: 81%|████████ | 806/1000 [05:15<01:14, 2.60it/s] # PTI :step: 805, epoch: 402: 81%|████████ | 806/1000 [05:15<01:14, 2.60it/s] # PTI :step: 805, epoch: 402: 81%|████████ | 807/1000 [05:15<01:13, 2.62it/s] # PTI :step: 806, epoch: 403: 81%|████████ | 807/1000 [05:15<01:13, 2.62it/s] # PTI :step: 806, epoch: 403: 81%|████████ | 808/1000 [05:15<01:14, 2.59it/s] # PTI :step: 807, epoch: 403: 81%|████████ | 808/1000 [05:15<01:14, 2.59it/s] # PTI :step: 807, epoch: 403: 81%|████████ | 809/1000 [05:16<01:13, 2.61it/s] # PTI :step: 808, epoch: 404: 81%|████████ | 809/1000 [05:16<01:13, 2.61it/s] # PTI :step: 808, epoch: 404: 81%|████████ | 810/1000 [05:16<01:19, 2.39it/s] # PTI :step: 809, epoch: 404: 81%|████████ | 810/1000 [05:16<01:19, 2.39it/s] # PTI :step: 809, epoch: 404: 81%|████████ | 811/1000 [05:17<01:16, 2.47it/s] # PTI :step: 810, epoch: 405: 81%|████████ | 811/1000 [05:17<01:16, 2.47it/s] # PTI :step: 810, epoch: 405: 81%|████████ | 812/1000 [05:17<01:15, 2.49it/s] # PTI :step: 811, epoch: 405: 81%|████████ | 812/1000 [05:17<01:15, 2.49it/s] # PTI :step: 811, epoch: 405: 81%|████████▏ | 813/1000 [05:17<01:13, 2.54it/s] # PTI :step: 812, epoch: 406: 81%|████████▏ | 813/1000 [05:17<01:13, 2.54it/s] # PTI :step: 812, epoch: 406: 81%|████████▏ | 814/1000 [05:18<01:13, 2.54it/s] # PTI :step: 813, epoch: 406: 81%|████████▏ | 814/1000 [05:18<01:13, 2.54it/s] # PTI :step: 813, epoch: 406: 82%|████████▏ | 815/1000 [05:18<01:12, 2.55it/s] # PTI :step: 814, epoch: 407: 82%|████████▏ | 815/1000 [05:18<01:12, 2.55it/s] # PTI :step: 814, epoch: 407: 82%|████████▏ | 816/1000 [05:19<01:12, 2.52it/s] # PTI :step: 815, epoch: 407: 82%|████████▏ | 816/1000 [05:19<01:12, 2.52it/s] # PTI :step: 815, epoch: 407: 82%|████████▏ | 817/1000 [05:19<01:11, 2.56it/s] # PTI :step: 816, epoch: 408: 82%|████████▏ | 817/1000 [05:19<01:11, 2.56it/s] # PTI :step: 816, epoch: 408: 82%|████████▏ | 818/1000 [05:19<01:11, 2.56it/s] # PTI :step: 817, epoch: 408: 82%|████████▏ | 818/1000 [05:19<01:11, 2.56it/s] # PTI :step: 817, epoch: 408: 82%|████████▏ | 819/1000 [05:20<01:09, 2.59it/s] # PTI :step: 818, epoch: 409: 82%|████████▏ | 819/1000 [05:20<01:09, 2.59it/s] # PTI :step: 818, epoch: 409: 82%|████████▏ | 820/1000 [05:20<01:10, 2.57it/s] # PTI :step: 819, epoch: 409: 82%|████████▏ | 820/1000 [05:20<01:10, 2.57it/s] # PTI :step: 819, epoch: 409: 82%|████████▏ | 821/1000 [05:21<01:08, 2.60it/s] # PTI :step: 820, epoch: 410: 82%|████████▏ | 821/1000 [05:21<01:08, 2.60it/s] # PTI :step: 820, epoch: 410: 82%|████████▏ | 822/1000 [05:21<01:09, 2.57it/s] # PTI :step: 821, epoch: 410: 82%|████████▏ | 822/1000 [05:21<01:09, 2.57it/s] # PTI :step: 821, epoch: 410: 82%|████████▏ | 823/1000 [05:21<01:08, 2.60it/s] # PTI :step: 822, epoch: 411: 82%|████████▏ | 823/1000 [05:21<01:08, 2.60it/s] # PTI :step: 822, epoch: 411: 82%|████████▏ | 824/1000 [05:22<01:08, 2.58it/s] # PTI :step: 823, epoch: 411: 82%|████████▏ | 824/1000 [05:22<01:08, 2.58it/s] # PTI :step: 823, epoch: 411: 82%|████████▎ | 825/1000 [05:22<01:07, 2.61it/s] # PTI :step: 824, epoch: 412: 82%|████████▎ | 825/1000 [05:22<01:07, 2.61it/s] # PTI :step: 824, epoch: 412: 83%|████████▎ | 826/1000 [05:22<01:07, 2.59it/s] # PTI :step: 825, epoch: 412: 83%|████████▎ | 826/1000 [05:22<01:07, 2.59it/s] # PTI :step: 825, epoch: 412: 83%|████████▎ | 827/1000 [05:23<01:06, 2.62it/s] # PTI :step: 826, epoch: 413: 83%|████████▎ | 827/1000 [05:23<01:06, 2.62it/s] # PTI :step: 826, epoch: 413: 83%|████████▎ | 828/1000 [05:23<01:06, 2.59it/s] # PTI :step: 827, epoch: 413: 83%|████████▎ | 828/1000 [05:23<01:06, 2.59it/s] # PTI :step: 827, epoch: 413: 83%|████████▎ | 829/1000 [05:24<01:05, 2.62it/s] # PTI :step: 828, epoch: 414: 83%|████████▎ | 829/1000 [05:24<01:05, 2.62it/s] # PTI :step: 828, epoch: 414: 83%|████████▎ | 830/1000 [05:24<01:05, 2.60it/s] # PTI :step: 829, epoch: 414: 83%|████████▎ | 830/1000 [05:24<01:05, 2.60it/s] # PTI :step: 829, epoch: 414: 83%|████████▎ | 831/1000 [05:24<01:04, 2.62it/s] # PTI :step: 830, epoch: 415: 83%|████████▎ | 831/1000 [05:24<01:04, 2.62it/s] # PTI :step: 830, epoch: 415: 83%|████████▎ | 832/1000 [05:25<01:04, 2.60it/s] # PTI :step: 831, epoch: 415: 83%|████████▎ | 832/1000 [05:25<01:04, 2.60it/s] # PTI :step: 831, epoch: 415: 83%|████████▎ | 833/1000 [05:25<01:04, 2.60it/s] # PTI :step: 832, epoch: 416: 83%|████████▎ | 833/1000 [05:25<01:04, 2.60it/s] # PTI :step: 832, epoch: 416: 83%|████████▎ | 834/1000 [05:26<01:04, 2.59it/s] # PTI :step: 833, epoch: 416: 83%|████████▎ | 834/1000 [05:26<01:04, 2.59it/s] # PTI :step: 833, epoch: 416: 84%|████████▎ | 835/1000 [05:26<01:03, 2.61it/s] # PTI :step: 834, epoch: 417: 84%|████████▎ | 835/1000 [05:26<01:03, 2.61it/s] # PTI :step: 834, epoch: 417: 84%|████████▎ | 836/1000 [05:26<01:03, 2.59it/s] # PTI :step: 835, epoch: 417: 84%|████████▎ | 836/1000 [05:26<01:03, 2.59it/s] # PTI :step: 835, epoch: 417: 84%|████████▎ | 837/1000 [05:27<01:02, 2.62it/s] # PTI :step: 836, epoch: 418: 84%|████████▎ | 837/1000 [05:27<01:02, 2.62it/s] # PTI :step: 836, epoch: 418: 84%|████████▍ | 838/1000 [05:27<01:02, 2.59it/s] # PTI :step: 837, epoch: 418: 84%|████████▍ | 838/1000 [05:27<01:02, 2.59it/s] # PTI :step: 837, epoch: 418: 84%|████████▍ | 839/1000 [05:27<01:01, 2.62it/s] # PTI :step: 838, epoch: 419: 84%|████████▍ | 839/1000 [05:27<01:01, 2.62it/s] # PTI :step: 838, epoch: 419: 84%|████████▍ | 840/1000 [05:28<01:01, 2.60it/s] # PTI :step: 839, epoch: 419: 84%|████████▍ | 840/1000 [05:28<01:01, 2.60it/s] # PTI :step: 839, epoch: 419: 84%|████████▍ | 841/1000 [05:28<01:00, 2.61it/s] # PTI :step: 840, epoch: 420: 84%|████████▍ | 841/1000 [05:28<01:00, 2.61it/s] # PTI :step: 840, epoch: 420: 84%|████████▍ | 842/1000 [05:29<01:01, 2.59it/s] # PTI :step: 841, epoch: 420: 84%|████████▍ | 842/1000 [05:29<01:01, 2.59it/s] # PTI :step: 841, epoch: 420: 84%|████████▍ | 843/1000 [05:29<01:00, 2.60it/s] # PTI :step: 842, epoch: 421: 84%|████████▍ | 843/1000 [05:29<01:00, 2.60it/s] # PTI :step: 842, epoch: 421: 84%|████████▍ | 844/1000 [05:29<01:00, 2.58it/s] # PTI :step: 843, epoch: 421: 84%|████████▍ | 844/1000 [05:29<01:00, 2.58it/s] # PTI :step: 843, epoch: 421: 84%|████████▍ | 845/1000 [05:30<00:59, 2.60it/s] # PTI :step: 844, epoch: 422: 84%|████████▍ | 845/1000 [05:30<00:59, 2.60it/s] # PTI :step: 844, epoch: 422: 85%|████████▍ | 846/1000 [05:30<00:59, 2.58it/s] # PTI :step: 845, epoch: 422: 85%|████████▍ | 846/1000 [05:30<00:59, 2.58it/s] # PTI :step: 845, epoch: 422: 85%|████████▍ | 847/1000 [05:31<00:58, 2.61it/s] # PTI :step: 846, epoch: 423: 85%|████████▍ | 847/1000 [05:31<00:58, 2.61it/s] # PTI :step: 846, epoch: 423: 85%|████████▍ | 848/1000 [05:31<00:58, 2.59it/s] # PTI :step: 847, epoch: 423: 85%|████████▍ | 848/1000 [05:31<00:58, 2.59it/s] # PTI :step: 847, epoch: 423: 85%|████████▍ | 849/1000 [05:31<00:58, 2.58it/s] # PTI :step: 848, epoch: 424: 85%|████████▍ | 849/1000 [05:31<00:58, 2.58it/s] # PTI :step: 848, epoch: 424: 85%|████████▌ | 850/1000 [05:32<00:58, 2.55it/s] # PTI :step: 849, epoch: 424: 85%|████████▌ | 850/1000 [05:32<00:58, 2.55it/s] # PTI :step: 849, epoch: 424: 85%|████████▌ | 851/1000 [05:32<00:57, 2.58it/s] # PTI :step: 850, epoch: 425: 85%|████████▌ | 851/1000 [05:32<00:57, 2.58it/s] # PTI :step: 850, epoch: 425: 85%|████████▌ | 852/1000 [05:32<00:57, 2.57it/s] # PTI :step: 851, epoch: 425: 85%|████████▌ | 852/1000 [05:32<00:57, 2.57it/s] # PTI :step: 851, epoch: 425: 85%|████████▌ | 853/1000 [05:33<00:56, 2.60it/s] # PTI :step: 852, epoch: 426: 85%|████████▌ | 853/1000 [05:33<00:56, 2.60it/s] # PTI :step: 852, epoch: 426: 85%|████████▌ | 854/1000 [05:33<00:56, 2.56it/s] # PTI :step: 853, epoch: 426: 85%|████████▌ | 854/1000 [05:33<00:56, 2.56it/s] # PTI :step: 853, epoch: 426: 86%|████████▌ | 855/1000 [05:34<00:55, 2.59it/s] # PTI :step: 854, epoch: 427: 86%|████████▌ | 855/1000 [05:34<00:55, 2.59it/s] # PTI :step: 854, epoch: 427: 86%|████████▌ | 856/1000 [05:34<00:55, 2.57it/s] # PTI :step: 855, epoch: 427: 86%|████████▌ | 856/1000 [05:34<00:55, 2.57it/s] # PTI :step: 855, epoch: 427: 86%|████████▌ | 857/1000 [05:34<00:55, 2.60it/s] # PTI :step: 856, epoch: 428: 86%|████████▌ | 857/1000 [05:34<00:55, 2.60it/s] # PTI :step: 856, epoch: 428: 86%|████████▌ | 858/1000 [05:35<00:54, 2.58it/s] # PTI :step: 857, epoch: 428: 86%|████████▌ | 858/1000 [05:35<00:54, 2.58it/s] # PTI :step: 857, epoch: 428: 86%|████████▌ | 859/1000 [05:35<00:54, 2.57it/s] # PTI :step: 858, epoch: 429: 86%|████████▌ | 859/1000 [05:35<00:54, 2.57it/s] # PTI :step: 858, epoch: 429: 86%|████████▌ | 860/1000 [05:36<00:54, 2.56it/s] # PTI :step: 859, epoch: 429: 86%|████████▌ | 860/1000 [05:36<00:54, 2.56it/s] # PTI :step: 859, epoch: 429: 86%|████████▌ | 861/1000 [05:36<00:53, 2.59it/s] # PTI :step: 860, epoch: 430: 86%|████████▌ | 861/1000 [05:36<00:53, 2.59it/s] # PTI :step: 860, epoch: 430: 86%|████████▌ | 862/1000 [05:36<00:53, 2.58it/s] # PTI :step: 861, epoch: 430: 86%|████████▌ | 862/1000 [05:36<00:53, 2.58it/s] # PTI :step: 861, epoch: 430: 86%|████████▋ | 863/1000 [05:37<00:52, 2.60it/s] # PTI :step: 862, epoch: 431: 86%|████████▋ | 863/1000 [05:37<00:52, 2.60it/s] # PTI :step: 862, epoch: 431: 86%|████████▋ | 864/1000 [05:37<00:52, 2.58it/s] # PTI :step: 863, epoch: 431: 86%|████████▋ | 864/1000 [05:37<00:52, 2.58it/s] # PTI :step: 863, epoch: 431: 86%|████████▋ | 865/1000 [05:37<00:51, 2.61it/s] # PTI :step: 864, epoch: 432: 86%|████████▋ | 865/1000 [05:37<00:51, 2.61it/s] # PTI :step: 864, epoch: 432: 87%|████████▋ | 866/1000 [05:38<00:51, 2.60it/s] # PTI :step: 865, epoch: 432: 87%|████████▋ | 866/1000 [05:38<00:51, 2.60it/s] # PTI :step: 865, epoch: 432: 87%|████████▋ | 867/1000 [05:38<00:50, 2.61it/s] # PTI :step: 866, epoch: 433: 87%|████████▋ | 867/1000 [05:38<00:50, 2.61it/s] # PTI :step: 866, epoch: 433: 87%|████████▋ | 868/1000 [05:39<00:51, 2.59it/s] # PTI :step: 867, epoch: 433: 87%|████████▋ | 868/1000 [05:39<00:51, 2.59it/s] # PTI :step: 867, epoch: 433: 87%|████████▋ | 869/1000 [05:39<00:50, 2.58it/s] # PTI :step: 868, epoch: 434: 87%|████████▋ | 869/1000 [05:39<00:50, 2.58it/s] # PTI :step: 868, epoch: 434: 87%|████████▋ | 870/1000 [05:39<00:50, 2.57it/s] # PTI :step: 869, epoch: 434: 87%|████████▋ | 870/1000 [05:39<00:50, 2.57it/s] # PTI :step: 869, epoch: 434: 87%|████████▋ | 871/1000 [05:40<00:49, 2.60it/s] # PTI :step: 870, epoch: 435: 87%|████████▋ | 871/1000 [05:40<00:49, 2.60it/s] # PTI :step: 870, epoch: 435: 87%|████████▋ | 872/1000 [05:40<00:49, 2.58it/s] # PTI :step: 871, epoch: 435: 87%|████████▋ | 872/1000 [05:40<00:49, 2.58it/s] # PTI :step: 871, epoch: 435: 87%|████████▋ | 873/1000 [05:41<00:48, 2.61it/s] # PTI :step: 872, epoch: 436: 87%|████████▋ | 873/1000 [05:41<00:48, 2.61it/s] # PTI :step: 872, epoch: 436: 87%|████████▋ | 874/1000 [05:41<00:48, 2.58it/s] # PTI :step: 873, epoch: 436: 87%|████████▋ | 874/1000 [05:41<00:48, 2.58it/s] # PTI :step: 873, epoch: 436: 88%|████████▊ | 875/1000 [05:41<00:48, 2.58it/s] # PTI :step: 874, epoch: 437: 88%|████████▊ | 875/1000 [05:41<00:48, 2.58it/s] # PTI :step: 874, epoch: 437: 88%|████████▊ | 876/1000 [05:42<00:48, 2.56it/s] # PTI :step: 875, epoch: 437: 88%|████████▊ | 876/1000 [05:42<00:48, 2.56it/s] # PTI :step: 875, epoch: 437: 88%|████████▊ | 877/1000 [05:42<00:47, 2.58it/s] # PTI :step: 876, epoch: 438: 88%|████████▊ | 877/1000 [05:42<00:47, 2.58it/s] # PTI :step: 876, epoch: 438: 88%|████████▊ | 878/1000 [05:43<00:47, 2.57it/s] # PTI :step: 877, epoch: 438: 88%|████████▊ | 878/1000 [05:43<00:47, 2.57it/s] # PTI :step: 877, epoch: 438: 88%|████████▊ | 879/1000 [05:43<00:46, 2.60it/s] # PTI :step: 878, epoch: 439: 88%|████████▊ | 879/1000 [05:43<00:46, 2.60it/s] # PTI :step: 878, epoch: 439: 88%|████████▊ | 880/1000 [05:43<00:46, 2.58it/s] # PTI :step: 879, epoch: 439: 88%|████████▊ | 880/1000 [05:43<00:46, 2.58it/s] # PTI :step: 879, epoch: 439: 88%|████████▊ | 881/1000 [05:44<00:45, 2.60it/s] # PTI :step: 880, epoch: 440: 88%|████████▊ | 881/1000 [05:44<00:45, 2.60it/s] # PTI :step: 880, epoch: 440: 88%|████████▊ | 882/1000 [05:44<00:45, 2.58it/s] # PTI :step: 881, epoch: 440: 88%|████████▊ | 882/1000 [05:44<00:45, 2.58it/s] # PTI :step: 881, epoch: 440: 88%|████████▊ | 883/1000 [05:44<00:44, 2.60it/s] # PTI :step: 882, epoch: 441: 88%|████████▊ | 883/1000 [05:44<00:44, 2.60it/s] # PTI :step: 882, epoch: 441: 88%|████████▊ | 884/1000 [05:45<00:44, 2.58it/s] # PTI :step: 883, epoch: 441: 88%|████████▊ | 884/1000 [05:45<00:44, 2.58it/s] # PTI :step: 883, epoch: 441: 88%|████████▊ | 885/1000 [05:45<00:44, 2.59it/s] # PTI :step: 884, epoch: 442: 88%|████████▊ | 885/1000 [05:45<00:44, 2.59it/s] # PTI :step: 884, epoch: 442: 89%|████████▊ | 886/1000 [05:46<00:44, 2.58it/s] # PTI :step: 885, epoch: 442: 89%|████████▊ | 886/1000 [05:46<00:44, 2.58it/s] # PTI :step: 885, epoch: 442: 89%|████████▊ | 887/1000 [05:46<00:43, 2.59it/s] # PTI :step: 886, epoch: 443: 89%|████████▊ | 887/1000 [05:46<00:43, 2.59it/s] # PTI :step: 886, epoch: 443: 89%|████████▉ | 888/1000 [05:46<00:43, 2.58it/s] # PTI :step: 887, epoch: 443: 89%|████████▉ | 888/1000 [05:46<00:43, 2.58it/s] # PTI :step: 887, epoch: 443: 89%|████████▉ | 889/1000 [05:47<00:42, 2.60it/s] # PTI :step: 888, epoch: 444: 89%|████████▉ | 889/1000 [05:47<00:42, 2.60it/s] # PTI :step: 888, epoch: 444: 89%|████████▉ | 890/1000 [05:47<00:42, 2.58it/s] # PTI :step: 889, epoch: 444: 89%|████████▉ | 890/1000 [05:47<00:42, 2.58it/s] # PTI :step: 889, epoch: 444: 89%|████████▉ | 891/1000 [05:48<00:41, 2.61it/s] # PTI :step: 890, epoch: 445: 89%|████████▉ | 891/1000 [05:48<00:41, 2.61it/s] # PTI :step: 890, epoch: 445: 89%|████████▉ | 892/1000 [05:48<00:41, 2.58it/s] # PTI :step: 891, epoch: 445: 89%|████████▉ | 892/1000 [05:48<00:41, 2.58it/s] # PTI :step: 891, epoch: 445: 89%|████████▉ | 893/1000 [05:48<00:41, 2.61it/s] # PTI :step: 892, epoch: 446: 89%|████████▉ | 893/1000 [05:48<00:41, 2.61it/s] # PTI :step: 892, epoch: 446: 89%|████████▉ | 894/1000 [05:49<00:40, 2.59it/s] # PTI :step: 893, epoch: 446: 89%|████████▉ | 894/1000 [05:49<00:40, 2.59it/s] # PTI :step: 893, epoch: 446: 90%|████████▉ | 895/1000 [05:49<00:40, 2.58it/s] # PTI :step: 894, epoch: 447: 90%|████████▉ | 895/1000 [05:49<00:40, 2.58it/s] # PTI :step: 894, epoch: 447: 90%|████████▉ | 896/1000 [05:49<00:40, 2.57it/s] # PTI :step: 895, epoch: 447: 90%|████████▉ | 896/1000 [05:49<00:40, 2.57it/s] # PTI :step: 895, epoch: 447: 90%|████████▉ | 897/1000 [05:50<00:39, 2.60it/s] # PTI :step: 896, epoch: 448: 90%|████████▉ | 897/1000 [05:50<00:39, 2.60it/s] # PTI :step: 896, epoch: 448: 90%|████████▉ | 898/1000 [05:50<00:39, 2.56it/s] # PTI :step: 897, epoch: 448: 90%|████████▉ | 898/1000 [05:50<00:39, 2.56it/s] # PTI :step: 897, epoch: 448: 90%|████████▉ | 899/1000 [05:51<00:39, 2.56it/s] # PTI :step: 898, epoch: 449: 90%|████████▉ | 899/1000 [05:51<00:39, 2.56it/s] # PTI :step: 898, epoch: 449: 90%|█████████ | 900/1000 [05:51<00:39, 2.53it/s] # PTI :step: 899, epoch: 449: 90%|█████████ | 900/1000 [05:51<00:39, 2.53it/s] # PTI :step: 899, epoch: 449: 90%|█████████ | 901/1000 [05:51<00:38, 2.56it/s] # PTI :step: 900, epoch: 450: 90%|█████████ | 901/1000 [05:51<00:38, 2.56it/s] # PTI :step: 900, epoch: 450: 90%|█████████ | 902/1000 [05:52<00:38, 2.53it/s] # PTI :step: 901, epoch: 450: 90%|█████████ | 902/1000 [05:52<00:38, 2.53it/s] # PTI :step: 901, epoch: 450: 90%|█████████ | 903/1000 [05:52<00:37, 2.57it/s] # PTI :step: 902, epoch: 451: 90%|█████████ | 903/1000 [05:52<00:37, 2.57it/s] # PTI :step: 902, epoch: 451: 90%|█████████ | 904/1000 [05:53<00:37, 2.56it/s] # PTI :step: 903, epoch: 451: 90%|█████████ | 904/1000 [05:53<00:37, 2.56it/s] # PTI :step: 903, epoch: 451: 90%|█████████ | 905/1000 [05:53<00:36, 2.58it/s] # PTI :step: 904, epoch: 452: 90%|█████████ | 905/1000 [05:53<00:36, 2.58it/s] # PTI :step: 904, epoch: 452: 91%|█████████ | 906/1000 [05:53<00:36, 2.57it/s] # PTI :step: 905, epoch: 452: 91%|█████████ | 906/1000 [05:53<00:36, 2.57it/s] # PTI :step: 905, epoch: 452: 91%|█████████ | 907/1000 [05:54<00:35, 2.59it/s] # PTI :step: 906, epoch: 453: 91%|█████████ | 907/1000 [05:54<00:35, 2.59it/s] # PTI :step: 906, epoch: 453: 91%|█████████ | 908/1000 [05:54<00:35, 2.57it/s] # PTI :step: 907, epoch: 453: 91%|█████████ | 908/1000 [05:54<00:35, 2.57it/s] # PTI :step: 907, epoch: 453: 91%|█████████ | 909/1000 [05:55<00:35, 2.57it/s] # PTI :step: 908, epoch: 454: 91%|█████████ | 909/1000 [05:55<00:35, 2.57it/s] # PTI :step: 908, epoch: 454: 91%|█████████ | 910/1000 [05:55<00:35, 2.56it/s] # PTI :step: 909, epoch: 454: 91%|█████████ | 910/1000 [05:55<00:35, 2.56it/s] # PTI :step: 909, epoch: 454: 91%|█████████ | 911/1000 [05:55<00:34, 2.59it/s] # PTI :step: 910, epoch: 455: 91%|█████████ | 911/1000 [05:55<00:34, 2.59it/s] # PTI :step: 910, epoch: 455: 91%|█████████ | 912/1000 [05:56<00:34, 2.58it/s] # PTI :step: 911, epoch: 455: 91%|█████████ | 912/1000 [05:56<00:34, 2.58it/s] # PTI :step: 911, epoch: 455: 91%|█████████▏| 913/1000 [05:56<00:34, 2.55it/s] # PTI :step: 912, epoch: 456: 91%|█████████▏| 913/1000 [05:56<00:34, 2.55it/s] # PTI :step: 912, epoch: 456: 91%|█████████▏| 914/1000 [05:57<00:33, 2.55it/s] # PTI :step: 913, epoch: 456: 91%|█████████▏| 914/1000 [05:57<00:33, 2.55it/s] # PTI :step: 913, epoch: 456: 92%|█████████▏| 915/1000 [05:57<00:33, 2.57it/s] # PTI :step: 914, epoch: 457: 92%|█████████▏| 915/1000 [05:57<00:33, 2.57it/s] # PTI :step: 914, epoch: 457: 92%|█████████▏| 916/1000 [05:57<00:32, 2.56it/s] # PTI :step: 915, epoch: 457: 92%|█████████▏| 916/1000 [05:57<00:32, 2.56it/s] # PTI :step: 915, epoch: 457: 92%|█████████▏| 917/1000 [05:58<00:32, 2.59it/s] # PTI :step: 916, epoch: 458: 92%|█████████▏| 917/1000 [05:58<00:32, 2.59it/s] # PTI :step: 916, epoch: 458: 92%|█████████▏| 918/1000 [05:58<00:31, 2.58it/s] # PTI :step: 917, epoch: 458: 92%|█████████▏| 918/1000 [05:58<00:31, 2.58it/s] # PTI :step: 917, epoch: 458: 92%|█████████▏| 919/1000 [05:58<00:31, 2.61it/s] # PTI :step: 918, epoch: 459: 92%|█████████▏| 919/1000 [05:58<00:31, 2.61it/s] # PTI :step: 918, epoch: 459: 92%|█████████▏| 920/1000 [05:59<00:30, 2.59it/s] # PTI :step: 919, epoch: 459: 92%|█████████▏| 920/1000 [05:59<00:30, 2.59it/s] # PTI :step: 919, epoch: 459: 92%|█████████▏| 921/1000 [05:59<00:30, 2.58it/s] # PTI :step: 920, epoch: 460: 92%|█████████▏| 921/1000 [05:59<00:30, 2.58it/s] # PTI :step: 920, epoch: 460: 92%|█████████▏| 922/1000 [06:00<00:30, 2.57it/s] # PTI :step: 921, epoch: 460: 92%|█████████▏| 922/1000 [06:00<00:30, 2.57it/s] # PTI :step: 921, epoch: 460: 92%|█████████▏| 923/1000 [06:00<00:29, 2.59it/s] # PTI :step: 922, epoch: 461: 92%|█████████▏| 923/1000 [06:00<00:29, 2.59it/s] # PTI :step: 922, epoch: 461: 92%|█████████▏| 924/1000 [06:00<00:29, 2.55it/s] # PTI :step: 923, epoch: 461: 92%|█████████▏| 924/1000 [06:00<00:29, 2.55it/s] # PTI :step: 923, epoch: 461: 92%|█████████▎| 925/1000 [06:01<00:29, 2.59it/s] # PTI :step: 924, epoch: 462: 92%|█████████▎| 925/1000 [06:01<00:29, 2.59it/s] # PTI :step: 924, epoch: 462: 93%|█████████▎| 926/1000 [06:01<00:28, 2.57it/s] # PTI :step: 925, epoch: 462: 93%|█████████▎| 926/1000 [06:01<00:28, 2.57it/s] # PTI :step: 925, epoch: 462: 93%|█████████▎| 927/1000 [06:02<00:28, 2.60it/s] # PTI :step: 926, epoch: 463: 93%|█████████▎| 927/1000 [06:02<00:28, 2.60it/s] # PTI :step: 926, epoch: 463: 93%|█████████▎| 928/1000 [06:02<00:28, 2.56it/s] # PTI :step: 927, epoch: 463: 93%|█████████▎| 928/1000 [06:02<00:28, 2.56it/s] # PTI :step: 927, epoch: 463: 93%|█████████▎| 929/1000 [06:02<00:27, 2.59it/s] # PTI :step: 928, epoch: 464: 93%|█████████▎| 929/1000 [06:02<00:27, 2.59it/s] # PTI :step: 928, epoch: 464: 93%|█████████▎| 930/1000 [06:03<00:27, 2.58it/s] # PTI :step: 929, epoch: 464: 93%|█████████▎| 930/1000 [06:03<00:27, 2.58it/s] # PTI :step: 929, epoch: 464: 93%|█████████▎| 931/1000 [06:03<00:26, 2.58it/s] # PTI :step: 930, epoch: 465: 93%|█████████▎| 931/1000 [06:03<00:26, 2.58it/s] # PTI :step: 930, epoch: 465: 93%|█████████▎| 932/1000 [06:03<00:26, 2.57it/s] # PTI :step: 931, epoch: 465: 93%|█████████▎| 932/1000 [06:03<00:26, 2.57it/s] # PTI :step: 931, epoch: 465: 93%|█████████▎| 933/1000 [06:04<00:25, 2.60it/s] # PTI :step: 932, epoch: 466: 93%|█████████▎| 933/1000 [06:04<00:25, 2.60it/s] # PTI :step: 932, epoch: 466: 93%|█████████▎| 934/1000 [06:04<00:25, 2.59it/s] # PTI :step: 933, epoch: 466: 93%|█████████▎| 934/1000 [06:04<00:25, 2.59it/s] # PTI :step: 933, epoch: 466: 94%|█████████▎| 935/1000 [06:05<00:24, 2.61it/s] # PTI :step: 934, epoch: 467: 94%|█████████▎| 935/1000 [06:05<00:24, 2.61it/s] # PTI :step: 934, epoch: 467: 94%|█████████▎| 936/1000 [06:05<00:25, 2.56it/s] # PTI :step: 935, epoch: 467: 94%|█████████▎| 936/1000 [06:05<00:25, 2.56it/s] # PTI :step: 935, epoch: 467: 94%|█████████▎| 937/1000 [06:05<00:24, 2.58it/s] # PTI :step: 936, epoch: 468: 94%|█████████▎| 937/1000 [06:05<00:24, 2.58it/s] # PTI :step: 936, epoch: 468: 94%|█████████▍| 938/1000 [06:06<00:24, 2.56it/s] # PTI :step: 937, epoch: 468: 94%|█████████▍| 938/1000 [06:06<00:24, 2.56it/s] # PTI :step: 937, epoch: 468: 94%|█████████▍| 939/1000 [06:06<00:23, 2.57it/s] # PTI :step: 938, epoch: 469: 94%|█████████▍| 939/1000 [06:06<00:23, 2.57it/s] # PTI :step: 938, epoch: 469: 94%|█████████▍| 940/1000 [06:07<00:23, 2.56it/s] # PTI :step: 939, epoch: 469: 94%|█████████▍| 940/1000 [06:07<00:23, 2.56it/s] # PTI :step: 939, epoch: 469: 94%|█████████▍| 941/1000 [06:07<00:22, 2.59it/s] # PTI :step: 940, epoch: 470: 94%|█████████▍| 941/1000 [06:07<00:22, 2.59it/s] # PTI :step: 940, epoch: 470: 94%|█████████▍| 942/1000 [06:07<00:22, 2.57it/s] # PTI :step: 941, epoch: 470: 94%|█████████▍| 942/1000 [06:07<00:22, 2.57it/s] # PTI :step: 941, epoch: 470: 94%|█████████▍| 943/1000 [06:08<00:21, 2.60it/s] # PTI :step: 942, epoch: 471: 94%|█████████▍| 943/1000 [06:08<00:21, 2.60it/s] # PTI :step: 942, epoch: 471: 94%|█████████▍| 944/1000 [06:08<00:21, 2.58it/s] # PTI :step: 943, epoch: 471: 94%|█████████▍| 944/1000 [06:08<00:21, 2.58it/s] # PTI :step: 943, epoch: 471: 94%|█████████▍| 945/1000 [06:08<00:21, 2.60it/s] # PTI :step: 944, epoch: 472: 94%|█████████▍| 945/1000 [06:08<00:21, 2.60it/s] # PTI :step: 944, epoch: 472: 95%|█████████▍| 946/1000 [06:09<00:21, 2.57it/s] # PTI :step: 945, epoch: 472: 95%|█████████▍| 946/1000 [06:09<00:21, 2.57it/s] # PTI :step: 945, epoch: 472: 95%|█████████▍| 947/1000 [06:09<00:20, 2.60it/s] # PTI :step: 946, epoch: 473: 95%|█████████▍| 947/1000 [06:09<00:20, 2.60it/s] # PTI :step: 946, epoch: 473: 95%|█████████▍| 948/1000 [06:10<00:20, 2.57it/s] # PTI :step: 947, epoch: 473: 95%|█████████▍| 948/1000 [06:10<00:20, 2.57it/s] # PTI :step: 947, epoch: 473: 95%|█████████▍| 949/1000 [06:10<00:19, 2.57it/s] # PTI :step: 948, epoch: 474: 95%|█████████▍| 949/1000 [06:10<00:19, 2.57it/s] # PTI :step: 948, epoch: 474: 95%|█████████▌| 950/1000 [06:10<00:19, 2.56it/s] # PTI :step: 949, epoch: 474: 95%|█████████▌| 950/1000 [06:10<00:19, 2.56it/s] # PTI :step: 949, epoch: 474: 95%|█████████▌| 951/1000 [06:11<00:18, 2.60it/s] # PTI :step: 950, epoch: 475: 95%|█████████▌| 951/1000 [06:11<00:18, 2.60it/s] # PTI :step: 950, epoch: 475: 95%|█████████▌| 952/1000 [06:11<00:18, 2.56it/s] # PTI :step: 951, epoch: 475: 95%|█████████▌| 952/1000 [06:11<00:18, 2.56it/s] # PTI :step: 951, epoch: 475: 95%|█████████▌| 953/1000 [06:12<00:18, 2.60it/s] # PTI :step: 952, epoch: 476: 95%|█████████▌| 953/1000 [06:12<00:18, 2.60it/s] # PTI :step: 952, epoch: 476: 95%|█████████▌| 954/1000 [06:12<00:17, 2.58it/s] # PTI :step: 953, epoch: 476: 95%|█████████▌| 954/1000 [06:12<00:17, 2.58it/s] # PTI :step: 953, epoch: 476: 96%|█████████▌| 955/1000 [06:12<00:17, 2.60it/s] # PTI :step: 954, epoch: 477: 96%|█████████▌| 955/1000 [06:12<00:17, 2.60it/s] # PTI :step: 954, epoch: 477: 96%|█████████▌| 956/1000 [06:13<00:17, 2.58it/s] # PTI :step: 955, epoch: 477: 96%|█████████▌| 956/1000 [06:13<00:17, 2.58it/s] # PTI :step: 955, epoch: 477: 96%|█████████▌| 957/1000 [06:13<00:16, 2.55it/s] # PTI :step: 956, epoch: 478: 96%|█████████▌| 957/1000 [06:13<00:16, 2.55it/s] # PTI :step: 956, epoch: 478: 96%|█████████▌| 958/1000 [06:14<00:16, 2.54it/s] # PTI :step: 957, epoch: 478: 96%|█████████▌| 958/1000 [06:14<00:16, 2.54it/s] # PTI :step: 957, epoch: 478: 96%|█████████▌| 959/1000 [06:14<00:15, 2.56it/s] # PTI :step: 958, epoch: 479: 96%|█████████▌| 959/1000 [06:14<00:15, 2.56it/s] # PTI :step: 958, epoch: 479: 96%|█████████▌| 960/1000 [06:14<00:15, 2.56it/s] # PTI :step: 959, epoch: 479: 96%|█████████▌| 960/1000 [06:14<00:15, 2.56it/s] # PTI :step: 959, epoch: 479: 96%|█████████▌| 961/1000 [06:15<00:15, 2.59it/s] # PTI :step: 960, epoch: 480: 96%|█████████▌| 961/1000 [06:15<00:15, 2.59it/s] # PTI :step: 960, epoch: 480: 96%|█████████▌| 962/1000 [06:15<00:14, 2.57it/s] # PTI :step: 961, epoch: 480: 96%|█████████▌| 962/1000 [06:15<00:14, 2.57it/s] # PTI :step: 961, epoch: 480: 96%|█████████▋| 963/1000 [06:15<00:14, 2.57it/s] # PTI :step: 962, epoch: 481: 96%|█████████▋| 963/1000 [06:15<00:14, 2.57it/s] # PTI :step: 962, epoch: 481: 96%|█████████▋| 964/1000 [06:16<00:14, 2.56it/s] # PTI :step: 963, epoch: 481: 96%|█████████▋| 964/1000 [06:16<00:14, 2.56it/s] # PTI :step: 963, epoch: 481: 96%|█████████▋| 965/1000 [06:16<00:13, 2.59it/s] # PTI :step: 964, epoch: 482: 96%|█████████▋| 965/1000 [06:16<00:13, 2.59it/s] # PTI :step: 964, epoch: 482: 97%|█████████▋| 966/1000 [06:17<00:13, 2.57it/s] # PTI :step: 965, epoch: 482: 97%|█████████▋| 966/1000 [06:17<00:13, 2.57it/s] # PTI :step: 965, epoch: 482: 97%|█████████▋| 967/1000 [06:17<00:12, 2.60it/s] # PTI :step: 966, epoch: 483: 97%|█████████▋| 967/1000 [06:17<00:12, 2.60it/s] # PTI :step: 966, epoch: 483: 97%|█████████▋| 968/1000 [06:17<00:12, 2.58it/s] # PTI :step: 967, epoch: 483: 97%|█████████▋| 968/1000 [06:17<00:12, 2.58it/s] # PTI :step: 967, epoch: 483: 97%|█████████▋| 969/1000 [06:18<00:11, 2.61it/s] # PTI :step: 968, epoch: 484: 97%|█████████▋| 969/1000 [06:18<00:11, 2.61it/s] # PTI :step: 968, epoch: 484: 97%|█████████▋| 970/1000 [06:18<00:11, 2.58it/s] # PTI :step: 969, epoch: 484: 97%|█████████▋| 970/1000 [06:18<00:11, 2.58it/s] # PTI :step: 969, epoch: 484: 97%|█████████▋| 971/1000 [06:19<00:11, 2.61it/s] # PTI :step: 970, epoch: 485: 97%|█████████▋| 971/1000 [06:19<00:11, 2.61it/s] # PTI :step: 970, epoch: 485: 97%|█████████▋| 972/1000 [06:19<00:10, 2.59it/s] # PTI :step: 971, epoch: 485: 97%|█████████▋| 972/1000 [06:19<00:10, 2.59it/s] # PTI :step: 971, epoch: 485: 97%|█████████▋| 973/1000 [06:19<00:10, 2.61it/s] # PTI :step: 972, epoch: 486: 97%|█████████▋| 973/1000 [06:19<00:10, 2.61it/s] # PTI :step: 972, epoch: 486: 97%|█████████▋| 974/1000 [06:20<00:10, 2.58it/s] # PTI :step: 973, epoch: 486: 97%|█████████▋| 974/1000 [06:20<00:10, 2.58it/s] # PTI :step: 973, epoch: 486: 98%|█████████▊| 975/1000 [06:20<00:09, 2.60it/s] # PTI :step: 974, epoch: 487: 98%|█████████▊| 975/1000 [06:20<00:09, 2.60it/s] # PTI :step: 974, epoch: 487: 98%|█████████▊| 976/1000 [06:21<00:09, 2.58it/s] # PTI :step: 975, epoch: 487: 98%|█████████▊| 976/1000 [06:21<00:09, 2.58it/s] # PTI :step: 975, epoch: 487: 98%|█████████▊| 977/1000 [06:21<00:08, 2.59it/s] # PTI :step: 976, epoch: 488: 98%|█████████▊| 977/1000 [06:21<00:08, 2.59it/s] # PTI :step: 976, epoch: 488: 98%|█████████▊| 978/1000 [06:21<00:08, 2.57it/s] # PTI :step: 977, epoch: 488: 98%|█████████▊| 978/1000 [06:21<00:08, 2.57it/s] # PTI :step: 977, epoch: 488: 98%|█████████▊| 979/1000 [06:22<00:08, 2.60it/s] # PTI :step: 978, epoch: 489: 98%|█████████▊| 979/1000 [06:22<00:08, 2.60it/s] # PTI :step: 978, epoch: 489: 98%|█████████▊| 980/1000 [06:22<00:07, 2.57it/s] # PTI :step: 979, epoch: 489: 98%|█████████▊| 980/1000 [06:22<00:07, 2.57it/s] # PTI :step: 979, epoch: 489: 98%|█████████▊| 981/1000 [06:22<00:07, 2.58it/s] # PTI :step: 980, epoch: 490: 98%|█████████▊| 981/1000 [06:22<00:07, 2.58it/s] # PTI :step: 980, epoch: 490: 98%|█████████▊| 982/1000 [06:23<00:07, 2.56it/s] # PTI :step: 981, epoch: 490: 98%|█████████▊| 982/1000 [06:23<00:07, 2.56it/s] # PTI :step: 981, epoch: 490: 98%|█████████▊| 983/1000 [06:23<00:06, 2.59it/s] # PTI :step: 982, epoch: 491: 98%|█████████▊| 983/1000 [06:23<00:06, 2.59it/s] # PTI :step: 982, epoch: 491: 98%|█████████▊| 984/1000 [06:24<00:06, 2.57it/s] # PTI :step: 983, epoch: 491: 98%|█████████▊| 984/1000 [06:24<00:06, 2.57it/s] # PTI :step: 983, epoch: 491: 98%|█████████▊| 985/1000 [06:24<00:05, 2.60it/s] # PTI :step: 984, epoch: 492: 98%|█████████▊| 985/1000 [06:24<00:05, 2.60it/s] # PTI :step: 984, epoch: 492: 99%|█████████▊| 986/1000 [06:24<00:05, 2.58it/s] # PTI :step: 985, epoch: 492: 99%|█████████▊| 986/1000 [06:24<00:05, 2.58it/s] # PTI :step: 985, epoch: 492: 99%|█████████▊| 987/1000 [06:25<00:05, 2.60it/s] # PTI :step: 986, epoch: 493: 99%|█████████▊| 987/1000 [06:25<00:05, 2.60it/s] # PTI :step: 986, epoch: 493: 99%|█████████▉| 988/1000 [06:25<00:04, 2.58it/s] # PTI :step: 987, epoch: 493: 99%|█████████▉| 988/1000 [06:25<00:04, 2.58it/s] # PTI :step: 987, epoch: 493: 99%|█████████▉| 989/1000 [06:26<00:04, 2.60it/s] # PTI :step: 988, epoch: 494: 99%|█████████▉| 989/1000 [06:26<00:04, 2.60it/s] # PTI :step: 988, epoch: 494: 99%|█████████▉| 990/1000 [06:26<00:03, 2.58it/s] # PTI :step: 989, epoch: 494: 99%|█████████▉| 990/1000 [06:26<00:03, 2.58it/s] # PTI :step: 989, epoch: 494: 99%|█████████▉| 991/1000 [06:26<00:03, 2.61it/s] # PTI :step: 990, epoch: 495: 99%|█████████▉| 991/1000 [06:26<00:03, 2.61it/s] # PTI :step: 990, epoch: 495: 99%|█████████▉| 992/1000 [06:27<00:03, 2.58it/s] # PTI :step: 991, epoch: 495: 99%|█████████▉| 992/1000 [06:27<00:03, 2.58it/s] # PTI :step: 991, epoch: 495: 99%|█████████▉| 993/1000 [06:27<00:02, 2.60it/s] # PTI :step: 992, epoch: 496: 99%|█████████▉| 993/1000 [06:27<00:02, 2.60it/s] # PTI :step: 992, epoch: 496: 99%|█████████▉| 994/1000 [06:27<00:02, 2.58it/s] # PTI :step: 993, epoch: 496: 99%|█████████▉| 994/1000 [06:27<00:02, 2.58it/s] # PTI :step: 993, epoch: 496: 100%|█████████▉| 995/1000 [06:28<00:01, 2.60it/s] # PTI :step: 994, epoch: 497: 100%|█████████▉| 995/1000 [06:28<00:01, 2.60it/s] # PTI :step: 994, epoch: 497: 100%|█████████▉| 996/1000 [06:28<00:01, 2.57it/s] # PTI :step: 995, epoch: 497: 100%|█████████▉| 996/1000 [06:28<00:01, 2.57it/s] # PTI :step: 995, epoch: 497: 100%|█████████▉| 997/1000 [06:29<00:01, 2.60it/s] # PTI :step: 996, epoch: 498: 100%|█████████▉| 997/1000 [06:29<00:01, 2.60it/s] # PTI :step: 996, epoch: 498: 100%|█████████▉| 998/1000 [06:29<00:00, 2.58it/s] # PTI :step: 997, epoch: 498: 100%|█████████▉| 998/1000 [06:29<00:00, 2.58it/s] # PTI :step: 997, epoch: 498: 100%|█████████▉| 999/1000 [06:29<00:00, 2.58it/s] # PTI :step: 998, epoch: 499: 100%|█████████▉| 999/1000 [06:29<00:00, 2.58it/s] # PTI :step: 998, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00, 2.57it/s] Saving final model for return # PTI :step: 999, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00, 2.57it/s] # PTI :step: 999, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00, 2.56it/s] training_out/lora.safetensors training_out/embeddings.pti training_out/special_params.json
Version Details
- Version ID
2ea90da29b19984472a0bbad4ecb39abe4b91fa0d6a5e8dc59988022149dee55- Version Created
- August 24, 2023