Upload folder using huggingface_hub

README.md

@@ -0,0 +1,202 @@
+---
+base_model: microsoft/Phi-3.5-mini-instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

adapter_config.json

@@ -0,0 +1,29 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "microsoft/Phi-3.5-mini-instruct",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 64,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "o_proj",
+    "qkv_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bfe5d67cebe0d17de991d013f378b0b47348a323a0d9d431c97103deb29fa4cc
+size 695383552

checkpoint-1000/README.md

@@ -0,0 +1,202 @@
+---
+base_model: microsoft/Phi-3.5-mini-instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-1000/adapter_config.json

@@ -0,0 +1,29 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "microsoft/Phi-3.5-mini-instruct",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 64,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "o_proj",
+    "qkv_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-1000/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28e61424a488503272dbcddb3ee9b3bcbddaa52a0ba38023fd57f984a553e17b
+size 695383552

checkpoint-1000/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:428885b8e3e3b36602d101402757798766a32bd8014bcdd132a154dd8991da96
+size 604089722

checkpoint-1000/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:efa5bddc471c8ac0b6e5ea7f477e79471cb71d974e5c26424dc0cff21418231d
+size 14244

checkpoint-1000/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f239cab3977550af51dae77533320c0c157e084a6c2f322886a7cd5c5c058151
+size 1064

checkpoint-1000/special_tokens_map.json

@@ -0,0 +1,28 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": "<|im_start|>",
+  "eos_token": "<|im_end|>",
+  "pad_token": "<|im_end|>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-1000/tokenizer_config.json

@@ -0,0 +1,151 @@
+{
+  "add_bos_token": false,
+  "add_eos_token": false,
+  "add_prefix_space": null,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": false
+    },
+    "32000": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32001": {
+      "content": "<|assistant|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32002": {
+      "content": "<|placeholder1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32003": {
+      "content": "<|placeholder2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32004": {
+      "content": "<|placeholder3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32005": {
+      "content": "<|placeholder4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32006": {
+      "content": "<|system|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "<|end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "<|placeholder5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "<|placeholder6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "<|user|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32011": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32012": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "bos_token": "<|im_start|>",
+  "chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "legacy": false,
+  "model_max_length": 131072,
+  "pad_token": "<|im_end|>",
+  "padding_side": "right",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}

checkpoint-1000/trainer_state.json

@@ -0,0 +1,342 @@
+{
+  "best_metric": 0.46247440576553345,
+  "best_model_checkpoint": "Phi-3.5-mini-instruct_text_to_sql_lora\\checkpoint-1000",
+  "epoch": 1.4903129657228018,
+  "eval_steps": 50,
+  "global_step": 1000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.07451564828614009,
+      "grad_norm": 0.09373754262924194,
+      "learning_rate": 0.0002,
+      "loss": 0.9134,
+      "step": 50
+    },
+    {
+      "epoch": 0.07451564828614009,
+      "eval_loss": 0.5543281435966492,
+      "eval_runtime": 19.9013,
+      "eval_samples_per_second": 6.231,
+      "eval_steps_per_second": 0.804,
+      "step": 50
+    },
+    {
+      "epoch": 0.14903129657228018,
+      "grad_norm": 0.04845063388347626,
+      "learning_rate": 0.0001996800092633612,
+      "loss": 0.5243,
+      "step": 100
+    },
+    {
+      "epoch": 0.14903129657228018,
+      "eval_loss": 0.5150236487388611,
+      "eval_runtime": 19.8752,
+      "eval_samples_per_second": 6.239,
+      "eval_steps_per_second": 0.805,
+      "step": 100
+    },
+    {
+      "epoch": 0.22354694485842028,
+      "grad_norm": 0.06224009767174721,
+      "learning_rate": 0.00019872208493487546,
+      "loss": 0.5046,
+      "step": 150
+    },
+    {
+      "epoch": 0.22354694485842028,
+      "eval_loss": 0.504132091999054,
+      "eval_runtime": 19.8753,
+      "eval_samples_per_second": 6.239,
+      "eval_steps_per_second": 0.805,
+      "step": 150
+    },
+    {
+      "epoch": 0.29806259314456035,
+      "grad_norm": 0.053420498967170715,
+      "learning_rate": 0.0001971323575527731,
+      "loss": 0.4989,
+      "step": 200
+    },
+    {
+      "epoch": 0.29806259314456035,
+      "eval_loss": 0.49748167395591736,
+      "eval_runtime": 19.873,
+      "eval_samples_per_second": 6.24,
+      "eval_steps_per_second": 0.805,
+      "step": 200
+    },
+    {
+      "epoch": 0.37257824143070045,
+      "grad_norm": 0.04381432756781578,
+      "learning_rate": 0.0001949210010777752,
+      "loss": 0.4873,
+      "step": 250
+    },
+    {
+      "epoch": 0.37257824143070045,
+      "eval_loss": 0.4926624298095703,
+      "eval_runtime": 19.9753,
+      "eval_samples_per_second": 6.208,
+      "eval_steps_per_second": 0.801,
+      "step": 250
+    },
+    {
+      "epoch": 0.44709388971684055,
+      "grad_norm": 0.05697334185242653,
+      "learning_rate": 0.00019210216778162994,
+      "loss": 0.4854,
+      "step": 300
+    },
+    {
+      "epoch": 0.44709388971684055,
+      "eval_loss": 0.48829007148742676,
+      "eval_runtime": 19.8877,
+      "eval_samples_per_second": 6.235,
+      "eval_steps_per_second": 0.805,
+      "step": 300
+    },
+    {
+      "epoch": 0.5216095380029806,
+      "grad_norm": 0.07128433138132095,
+      "learning_rate": 0.0001886938976751951,
+      "loss": 0.4788,
+      "step": 350
+    },
+    {
+      "epoch": 0.5216095380029806,
+      "eval_loss": 0.48432213068008423,
+      "eval_runtime": 19.8588,
+      "eval_samples_per_second": 6.244,
+      "eval_steps_per_second": 0.806,
+      "step": 350
+    },
+    {
+      "epoch": 0.5961251862891207,
+      "grad_norm": 0.049252185970544815,
+      "learning_rate": 0.00018471800305571129,
+      "loss": 0.4811,
+      "step": 400
+    },
+    {
+      "epoch": 0.5961251862891207,
+      "eval_loss": 0.4807914197444916,
+      "eval_runtime": 19.8677,
+      "eval_samples_per_second": 6.241,
+      "eval_steps_per_second": 0.805,
+      "step": 400
+    },
+    {
+      "epoch": 0.6706408345752608,
+      "grad_norm": 0.05810828506946564,
+      "learning_rate": 0.00018019992891214008,
+      "loss": 0.4796,
+      "step": 450
+    },
+    {
+      "epoch": 0.6706408345752608,
+      "eval_loss": 0.478938490152359,
+      "eval_runtime": 19.8654,
+      "eval_samples_per_second": 6.242,
+      "eval_steps_per_second": 0.805,
+      "step": 450
+    },
+    {
+      "epoch": 0.7451564828614009,
+      "grad_norm": 0.06429937481880188,
+      "learning_rate": 0.00017516859008194938,
+      "loss": 0.4738,
+      "step": 500
+    },
+    {
+      "epoch": 0.7451564828614009,
+      "eval_loss": 0.47758275270462036,
+      "eval_runtime": 19.8891,
+      "eval_samples_per_second": 6.235,
+      "eval_steps_per_second": 0.804,
+      "step": 500
+    },
+    {
+      "epoch": 0.819672131147541,
+      "grad_norm": 0.057866841554641724,
+      "learning_rate": 0.00016965618620151017,
+      "loss": 0.4693,
+      "step": 550
+    },
+    {
+      "epoch": 0.819672131147541,
+      "eval_loss": 0.47498929500579834,
+      "eval_runtime": 19.8807,
+      "eval_samples_per_second": 6.237,
+      "eval_steps_per_second": 0.805,
+      "step": 550
+    },
+    {
+      "epoch": 0.8941877794336811,
+      "grad_norm": 0.07081956416368484,
+      "learning_rate": 0.00016369799563438958,
+      "loss": 0.4696,
+      "step": 600
+    },
+    {
+      "epoch": 0.8941877794336811,
+      "eval_loss": 0.4721943736076355,
+      "eval_runtime": 19.8698,
+      "eval_samples_per_second": 6.241,
+      "eval_steps_per_second": 0.805,
+      "step": 600
+    },
+    {
+      "epoch": 0.9687034277198212,
+      "grad_norm": 0.04943346604704857,
+      "learning_rate": 0.00015733214969635968,
+      "loss": 0.4682,
+      "step": 650
+    },
+    {
+      "epoch": 0.9687034277198212,
+      "eval_loss": 0.4704548120498657,
+      "eval_runtime": 21.0797,
+      "eval_samples_per_second": 5.882,
+      "eval_steps_per_second": 0.759,
+      "step": 650
+    },
+    {
+      "epoch": 1.0432190760059612,
+      "grad_norm": 0.04892728850245476,
+      "learning_rate": 0.00015059938862204127,
+      "loss": 0.4607,
+      "step": 700
+    },
+    {
+      "epoch": 1.0432190760059612,
+      "eval_loss": 0.4692542850971222,
+      "eval_runtime": 21.0437,
+      "eval_samples_per_second": 5.893,
+      "eval_steps_per_second": 0.76,
+      "step": 700
+    },
+    {
+      "epoch": 1.1177347242921014,
+      "grad_norm": 0.05664736032485962,
+      "learning_rate": 0.00014354280083495006,
+      "loss": 0.4535,
+      "step": 750
+    },
+    {
+      "epoch": 1.1177347242921014,
+      "eval_loss": 0.4676324725151062,
+      "eval_runtime": 22.3216,
+      "eval_samples_per_second": 5.555,
+      "eval_steps_per_second": 0.717,
+      "step": 750
+    },
+    {
+      "epoch": 1.1922503725782414,
+      "grad_norm": 0.04623207449913025,
+      "learning_rate": 0.000136207547189569,
+      "loss": 0.4538,
+      "step": 800
+    },
+    {
+      "epoch": 1.1922503725782414,
+      "eval_loss": 0.4663061201572418,
+      "eval_runtime": 19.8619,
+      "eval_samples_per_second": 6.243,
+      "eval_steps_per_second": 0.806,
+      "step": 800
+    },
+    {
+      "epoch": 1.2667660208643814,
+      "grad_norm": 0.05065590888261795,
+      "learning_rate": 0.00012864057195024643,
+      "loss": 0.4508,
+      "step": 850
+    },
+    {
+      "epoch": 1.2667660208643814,
+      "eval_loss": 0.4653000235557556,
+      "eval_runtime": 20.4016,
+      "eval_samples_per_second": 6.078,
+      "eval_steps_per_second": 0.784,
+      "step": 850
+    },
+    {
+      "epoch": 1.3412816691505216,
+      "grad_norm": 0.050148364156484604,
+      "learning_rate": 0.00012089030235660155,
+      "loss": 0.449,
+      "step": 900
+    },
+    {
+      "epoch": 1.3412816691505216,
+      "eval_loss": 0.4636177122592926,
+      "eval_runtime": 20.3024,
+      "eval_samples_per_second": 6.108,
+      "eval_steps_per_second": 0.788,
+      "step": 900
+    },
+    {
+      "epoch": 1.4157973174366618,
+      "grad_norm": 0.05486341193318367,
+      "learning_rate": 0.00011300633869816275,
+      "loss": 0.4493,
+      "step": 950
+    },
+    {
+      "epoch": 1.4157973174366618,
+      "eval_loss": 0.4632996618747711,
+      "eval_runtime": 20.384,
+      "eval_samples_per_second": 6.083,
+      "eval_steps_per_second": 0.785,
+      "step": 950
+    },
+    {
+      "epoch": 1.4903129657228018,
+      "grad_norm": 0.05443250760436058,
+      "learning_rate": 0.00010503913688170396,
+      "loss": 0.4512,
+      "step": 1000
+    },
+    {
+      "epoch": 1.4903129657228018,
+      "eval_loss": 0.46247440576553345,
+      "eval_runtime": 20.3518,
+      "eval_samples_per_second": 6.093,
+      "eval_steps_per_second": 0.786,
+      "step": 1000
+    }
+  ],
+  "logging_steps": 50,
+  "max_steps": 2013,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 3,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "EarlyStoppingCallback": {
+      "args": {
+        "early_stopping_patience": 3,
+        "early_stopping_threshold": 0.0
+      },
+      "attributes": {
+        "early_stopping_patience_counter": 0
+      }
+    },
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 3.733040336763617e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-1000/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb271c4925692ee63ef50cf05761726fa11d266c78d2f904cbd3b49754d4ecae
+size 5496

checkpoint-1500/README.md

@@ -0,0 +1,202 @@
+---
+base_model: microsoft/Phi-3.5-mini-instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-1500/adapter_config.json

@@ -0,0 +1,29 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "microsoft/Phi-3.5-mini-instruct",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 64,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "o_proj",
+    "qkv_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-1500/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c799895a11edca4e37408df737ad04f9150c5540850d1615f9054f3b9c59bd2
+size 695383552

checkpoint-1500/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59531d53aee5442b0afe5e19905367f18de1c7a9603da53470872be91d3fd7c3
+size 604089722

checkpoint-1500/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f2440383e59bbbea8bb80ae66635dfe69ecf8c9ff8c017548c2337c9d5f0cd5
+size 14244

checkpoint-1500/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:64b8be4b9a11f6efe9c86bd69cc8238e2dc9edb844aceec84e7b89f574abf8b6
+size 1064

checkpoint-1500/special_tokens_map.json

@@ -0,0 +1,28 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": "<|im_start|>",
+  "eos_token": "<|im_end|>",
+  "pad_token": "<|im_end|>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-1500/tokenizer_config.json

@@ -0,0 +1,151 @@
+{
+  "add_bos_token": false,
+  "add_eos_token": false,
+  "add_prefix_space": null,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": false
+    },
+    "32000": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32001": {
+      "content": "<|assistant|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32002": {
+      "content": "<|placeholder1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32003": {
+      "content": "<|placeholder2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32004": {
+      "content": "<|placeholder3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32005": {
+      "content": "<|placeholder4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32006": {
+      "content": "<|system|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "<|end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "<|placeholder5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "<|placeholder6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "<|user|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32011": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32012": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "bos_token": "<|im_start|>",
+  "chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "legacy": false,
+  "model_max_length": 131072,
+  "pad_token": "<|im_end|>",
+  "padding_side": "right",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}

checkpoint-1500/trainer_state.json

@@ -0,0 +1,492 @@
+{
+  "best_metric": 0.4551125168800354,
+  "best_model_checkpoint": "Phi-3.5-mini-instruct_text_to_sql_lora\\checkpoint-1500",
+  "epoch": 2.235469448584203,
+  "eval_steps": 50,
+  "global_step": 1500,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.07451564828614009,
+      "grad_norm": 0.09373754262924194,
+      "learning_rate": 0.0002,
+      "loss": 0.9134,
+      "step": 50
+    },
+    {
+      "epoch": 0.07451564828614009,
+      "eval_loss": 0.5543281435966492,
+      "eval_runtime": 19.9013,
+      "eval_samples_per_second": 6.231,
+      "eval_steps_per_second": 0.804,
+      "step": 50
+    },
+    {
+      "epoch": 0.14903129657228018,
+      "grad_norm": 0.04845063388347626,
+      "learning_rate": 0.0001996800092633612,
+      "loss": 0.5243,
+      "step": 100
+    },
+    {
+      "epoch": 0.14903129657228018,
+      "eval_loss": 0.5150236487388611,
+      "eval_runtime": 19.8752,
+      "eval_samples_per_second": 6.239,
+      "eval_steps_per_second": 0.805,
+      "step": 100
+    },
+    {
+      "epoch": 0.22354694485842028,
+      "grad_norm": 0.06224009767174721,
+      "learning_rate": 0.00019872208493487546,
+      "loss": 0.5046,
+      "step": 150
+    },
+    {
+      "epoch": 0.22354694485842028,
+      "eval_loss": 0.504132091999054,
+      "eval_runtime": 19.8753,
+      "eval_samples_per_second": 6.239,
+      "eval_steps_per_second": 0.805,
+      "step": 150
+    },
+    {
+      "epoch": 0.29806259314456035,
+      "grad_norm": 0.053420498967170715,
+      "learning_rate": 0.0001971323575527731,
+      "loss": 0.4989,
+      "step": 200
+    },
+    {
+      "epoch": 0.29806259314456035,
+      "eval_loss": 0.49748167395591736,
+      "eval_runtime": 19.873,
+      "eval_samples_per_second": 6.24,
+      "eval_steps_per_second": 0.805,
+      "step": 200
+    },
+    {
+      "epoch": 0.37257824143070045,
+      "grad_norm": 0.04381432756781578,
+      "learning_rate": 0.0001949210010777752,
+      "loss": 0.4873,
+      "step": 250
+    },
+    {
+      "epoch": 0.37257824143070045,
+      "eval_loss": 0.4926624298095703,
+      "eval_runtime": 19.9753,
+      "eval_samples_per_second": 6.208,
+      "eval_steps_per_second": 0.801,
+      "step": 250
+    },
+    {
+      "epoch": 0.44709388971684055,
+      "grad_norm": 0.05697334185242653,
+      "learning_rate": 0.00019210216778162994,
+      "loss": 0.4854,
+      "step": 300
+    },
+    {
+      "epoch": 0.44709388971684055,
+      "eval_loss": 0.48829007148742676,
+      "eval_runtime": 19.8877,
+      "eval_samples_per_second": 6.235,
+      "eval_steps_per_second": 0.805,
+      "step": 300
+    },
+    {
+      "epoch": 0.5216095380029806,
+      "grad_norm": 0.07128433138132095,
+      "learning_rate": 0.0001886938976751951,
+      "loss": 0.4788,
+      "step": 350
+    },
+    {
+      "epoch": 0.5216095380029806,
+      "eval_loss": 0.48432213068008423,
+      "eval_runtime": 19.8588,
+      "eval_samples_per_second": 6.244,
+      "eval_steps_per_second": 0.806,
+      "step": 350
+    },
+    {
+      "epoch": 0.5961251862891207,
+      "grad_norm": 0.049252185970544815,
+      "learning_rate": 0.00018471800305571129,
+      "loss": 0.4811,
+      "step": 400
+    },
+    {
+      "epoch": 0.5961251862891207,
+      "eval_loss": 0.4807914197444916,
+      "eval_runtime": 19.8677,
+      "eval_samples_per_second": 6.241,
+      "eval_steps_per_second": 0.805,
+      "step": 400
+    },
+    {
+      "epoch": 0.6706408345752608,
+      "grad_norm": 0.05810828506946564,
+      "learning_rate": 0.00018019992891214008,
+      "loss": 0.4796,
+      "step": 450
+    },
+    {
+      "epoch": 0.6706408345752608,
+      "eval_loss": 0.478938490152359,
+      "eval_runtime": 19.8654,
+      "eval_samples_per_second": 6.242,
+      "eval_steps_per_second": 0.805,
+      "step": 450
+    },
+    {
+      "epoch": 0.7451564828614009,
+      "grad_norm": 0.06429937481880188,
+      "learning_rate": 0.00017516859008194938,
+      "loss": 0.4738,
+      "step": 500
+    },
+    {
+      "epoch": 0.7451564828614009,
+      "eval_loss": 0.47758275270462036,
+      "eval_runtime": 19.8891,
+      "eval_samples_per_second": 6.235,
+      "eval_steps_per_second": 0.804,
+      "step": 500
+    },
+    {
+      "epoch": 0.819672131147541,
+      "grad_norm": 0.057866841554641724,
+      "learning_rate": 0.00016965618620151017,
+      "loss": 0.4693,
+      "step": 550
+    },
+    {
+      "epoch": 0.819672131147541,
+      "eval_loss": 0.47498929500579834,
+      "eval_runtime": 19.8807,
+      "eval_samples_per_second": 6.237,
+      "eval_steps_per_second": 0.805,
+      "step": 550
+    },
+    {
+      "epoch": 0.8941877794336811,
+      "grad_norm": 0.07081956416368484,
+      "learning_rate": 0.00016369799563438958,
+      "loss": 0.4696,
+      "step": 600
+    },
+    {
+      "epoch": 0.8941877794336811,
+      "eval_loss": 0.4721943736076355,
+      "eval_runtime": 19.8698,
+      "eval_samples_per_second": 6.241,
+      "eval_steps_per_second": 0.805,
+      "step": 600
+    },
+    {
+      "epoch": 0.9687034277198212,
+      "grad_norm": 0.04943346604704857,
+      "learning_rate": 0.00015733214969635968,
+      "loss": 0.4682,
+      "step": 650
+    },
+    {
+      "epoch": 0.9687034277198212,
+      "eval_loss": 0.4704548120498657,
+      "eval_runtime": 21.0797,
+      "eval_samples_per_second": 5.882,
+      "eval_steps_per_second": 0.759,
+      "step": 650
+    },
+    {
+      "epoch": 1.0432190760059612,
+      "grad_norm": 0.04892728850245476,
+      "learning_rate": 0.00015059938862204127,
+      "loss": 0.4607,
+      "step": 700
+    },
+    {
+      "epoch": 1.0432190760059612,
+      "eval_loss": 0.4692542850971222,
+      "eval_runtime": 21.0437,
+      "eval_samples_per_second": 5.893,
+      "eval_steps_per_second": 0.76,
+      "step": 700
+    },
+    {
+      "epoch": 1.1177347242921014,
+      "grad_norm": 0.05664736032485962,
+      "learning_rate": 0.00014354280083495006,
+      "loss": 0.4535,
+      "step": 750
+    },
+    {
+      "epoch": 1.1177347242921014,
+      "eval_loss": 0.4676324725151062,
+      "eval_runtime": 22.3216,
+      "eval_samples_per_second": 5.555,
+      "eval_steps_per_second": 0.717,
+      "step": 750
+    },
+    {
+      "epoch": 1.1922503725782414,
+      "grad_norm": 0.04623207449913025,
+      "learning_rate": 0.000136207547189569,
+      "loss": 0.4538,
+      "step": 800
+    },
+    {
+      "epoch": 1.1922503725782414,
+      "eval_loss": 0.4663061201572418,
+      "eval_runtime": 19.8619,
+      "eval_samples_per_second": 6.243,
+      "eval_steps_per_second": 0.806,
+      "step": 800
+    },
+    {
+      "epoch": 1.2667660208643814,
+      "grad_norm": 0.05065590888261795,
+      "learning_rate": 0.00012864057195024643,
+      "loss": 0.4508,
+      "step": 850
+    },
+    {
+      "epoch": 1.2667660208643814,
+      "eval_loss": 0.4653000235557556,
+      "eval_runtime": 20.4016,
+      "eval_samples_per_second": 6.078,
+      "eval_steps_per_second": 0.784,
+      "step": 850
+    },
+    {
+      "epoch": 1.3412816691505216,
+      "grad_norm": 0.050148364156484604,
+      "learning_rate": 0.00012089030235660155,
+      "loss": 0.449,
+      "step": 900
+    },
+    {
+      "epoch": 1.3412816691505216,
+      "eval_loss": 0.4636177122592926,
+      "eval_runtime": 20.3024,
+      "eval_samples_per_second": 6.108,
+      "eval_steps_per_second": 0.788,
+      "step": 900
+    },
+    {
+      "epoch": 1.4157973174366618,
+      "grad_norm": 0.05486341193318367,
+      "learning_rate": 0.00011300633869816275,
+      "loss": 0.4493,
+      "step": 950
+    },
+    {
+      "epoch": 1.4157973174366618,
+      "eval_loss": 0.4632996618747711,
+      "eval_runtime": 20.384,
+      "eval_samples_per_second": 6.083,
+      "eval_steps_per_second": 0.785,
+      "step": 950
+    },
+    {
+      "epoch": 1.4903129657228018,
+      "grad_norm": 0.05443250760436058,
+      "learning_rate": 0.00010503913688170396,
+      "loss": 0.4512,
+      "step": 1000
+    },
+    {
+      "epoch": 1.4903129657228018,
+      "eval_loss": 0.46247440576553345,
+      "eval_runtime": 20.3518,
+      "eval_samples_per_second": 6.093,
+      "eval_steps_per_second": 0.786,
+      "step": 1000
+    },
+    {
+      "epoch": 1.5648286140089418,
+      "grad_norm": 0.050281789153814316,
+      "learning_rate": 9.703968552278915e-05,
+      "loss": 0.4517,
+      "step": 1050
+    },
+    {
+      "epoch": 1.5648286140089418,
+      "eval_loss": 0.46042901277542114,
+      "eval_runtime": 19.9596,
+      "eval_samples_per_second": 6.213,
+      "eval_steps_per_second": 0.802,
+      "step": 1050
+    },
+    {
+      "epoch": 1.639344262295082,
+      "grad_norm": 0.05282198637723923,
+      "learning_rate": 8.905917962807927e-05,
+      "loss": 0.4478,
+      "step": 1100
+    },
+    {
+      "epoch": 1.639344262295082,
+      "eval_loss": 0.4593241810798645,
+      "eval_runtime": 19.9271,
+      "eval_samples_per_second": 6.223,
+      "eval_steps_per_second": 0.803,
+      "step": 1100
+    },
+    {
+      "epoch": 1.713859910581222,
+      "grad_norm": 0.05663960054516792,
+      "learning_rate": 8.114869295677425e-05,
+      "loss": 0.4483,
+      "step": 1150
+    },
+    {
+      "epoch": 1.713859910581222,
+      "eval_loss": 0.4582765996456146,
+      "eval_runtime": 19.9072,
+      "eval_samples_per_second": 6.229,
+      "eval_steps_per_second": 0.804,
+      "step": 1150
+    },
+    {
+      "epoch": 1.788375558867362,
+      "grad_norm": 0.05754128098487854,
+      "learning_rate": 7.335885115801656e-05,
+      "loss": 0.4479,
+      "step": 1200
+    },
+    {
+      "epoch": 1.788375558867362,
+      "eval_loss": 0.4579518735408783,
+      "eval_runtime": 19.883,
+      "eval_samples_per_second": 6.236,
+      "eval_steps_per_second": 0.805,
+      "step": 1200
+    },
+    {
+      "epoch": 1.8628912071535022,
+      "grad_norm": 0.05780432000756264,
+      "learning_rate": 6.573950777611587e-05,
+      "loss": 0.4476,
+      "step": 1250
+    },
+    {
+      "epoch": 1.8628912071535022,
+      "eval_loss": 0.456869512796402,
+      "eval_runtime": 19.9094,
+      "eval_samples_per_second": 6.228,
+      "eval_steps_per_second": 0.804,
+      "step": 1250
+    },
+    {
+      "epoch": 1.9374068554396424,
+      "grad_norm": 0.05665415897965431,
+      "learning_rate": 5.833942519710177e-05,
+      "loss": 0.4454,
+      "step": 1300
+    },
+    {
+      "epoch": 1.9374068554396424,
+      "eval_loss": 0.45577672123908997,
+      "eval_runtime": 19.9333,
+      "eval_samples_per_second": 6.221,
+      "eval_steps_per_second": 0.803,
+      "step": 1300
+    },
+    {
+      "epoch": 2.0119225037257826,
+      "grad_norm": 0.057158373296260834,
+      "learning_rate": 5.1205962578487155e-05,
+      "loss": 0.4435,
+      "step": 1350
+    },
+    {
+      "epoch": 2.0119225037257826,
+      "eval_loss": 0.45555853843688965,
+      "eval_runtime": 19.9237,
+      "eval_samples_per_second": 6.224,
+      "eval_steps_per_second": 0.803,
+      "step": 1350
+    },
+    {
+      "epoch": 2.0864381520119224,
+      "grad_norm": 0.05942057818174362,
+      "learning_rate": 4.4384772759434425e-05,
+      "loss": 0.4339,
+      "step": 1400
+    },
+    {
+      "epoch": 2.0864381520119224,
+      "eval_loss": 0.4557653069496155,
+      "eval_runtime": 19.9268,
+      "eval_samples_per_second": 6.223,
+      "eval_steps_per_second": 0.803,
+      "step": 1400
+    },
+    {
+      "epoch": 2.1609538002980626,
+      "grad_norm": 0.05777844041585922,
+      "learning_rate": 3.7919510091042566e-05,
+      "loss": 0.4322,
+      "step": 1450
+    },
+    {
+      "epoch": 2.1609538002980626,
+      "eval_loss": 0.45560821890830994,
+      "eval_runtime": 19.9533,
+      "eval_samples_per_second": 6.215,
+      "eval_steps_per_second": 0.802,
+      "step": 1450
+    },
+    {
+      "epoch": 2.235469448584203,
+      "grad_norm": 0.05342744290828705,
+      "learning_rate": 3.185155105658798e-05,
+      "loss": 0.4295,
+      "step": 1500
+    },
+    {
+      "epoch": 2.235469448584203,
+      "eval_loss": 0.4551125168800354,
+      "eval_runtime": 19.9502,
+      "eval_samples_per_second": 6.215,
+      "eval_steps_per_second": 0.802,
+      "step": 1500
+    }
+  ],
+  "logging_steps": 50,
+  "max_steps": 2013,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 3,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "EarlyStoppingCallback": {
+      "args": {
+        "early_stopping_patience": 3,
+        "early_stopping_threshold": 0.0
+      },
+      "attributes": {
+        "early_stopping_patience_counter": 0
+      }
+    },
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 5.5993271609563546e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-1500/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb271c4925692ee63ef50cf05761726fa11d266c78d2f904cbd3b49754d4ecae
+size 5496

checkpoint-2000/README.md

@@ -0,0 +1,202 @@
+---
+base_model: microsoft/Phi-3.5-mini-instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-2000/adapter_config.json

@@ -0,0 +1,29 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "microsoft/Phi-3.5-mini-instruct",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 64,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "o_proj",
+    "qkv_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-2000/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bfe5d67cebe0d17de991d013f378b0b47348a323a0d9d431c97103deb29fa4cc
+size 695383552

checkpoint-2000/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17d030b232f424a15e06aa4b5366d8499d0fe9b33913f8112733a14a63404291
+size 604089722

checkpoint-2000/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a2dc9fa23a14381951f28f3e10caff357d3c6eafe7b1567874753d2ff7b18a1
+size 14244

checkpoint-2000/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b606b7072d6735cf89a7f009a62b050762f6ff828130da49f78ca563d025ae62
+size 1064

checkpoint-2000/special_tokens_map.json

@@ -0,0 +1,28 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": "<|im_start|>",
+  "eos_token": "<|im_end|>",
+  "pad_token": "<|im_end|>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-2000/tokenizer_config.json

@@ -0,0 +1,151 @@
+{
+  "add_bos_token": false,
+  "add_eos_token": false,
+  "add_prefix_space": null,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": false
+    },
+    "32000": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32001": {
+      "content": "<|assistant|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32002": {
+      "content": "<|placeholder1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32003": {
+      "content": "<|placeholder2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32004": {
+      "content": "<|placeholder3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32005": {
+      "content": "<|placeholder4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32006": {
+      "content": "<|system|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "<|end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "<|placeholder5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "<|placeholder6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "<|user|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32011": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32012": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "bos_token": "<|im_start|>",
+  "chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "legacy": false,
+  "model_max_length": 131072,
+  "pad_token": "<|im_end|>",
+  "padding_side": "right",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}

checkpoint-2000/trainer_state.json

@@ -0,0 +1,642 @@
+{
+  "best_metric": 0.4530116021633148,
+  "best_model_checkpoint": "Phi-3.5-mini-instruct_text_to_sql_lora\\checkpoint-2000",
+  "epoch": 2.9806259314456036,
+  "eval_steps": 50,
+  "global_step": 2000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.07451564828614009,
+      "grad_norm": 0.09373754262924194,
+      "learning_rate": 0.0002,
+      "loss": 0.9134,
+      "step": 50
+    },
+    {
+      "epoch": 0.07451564828614009,
+      "eval_loss": 0.5543281435966492,
+      "eval_runtime": 19.9013,
+      "eval_samples_per_second": 6.231,
+      "eval_steps_per_second": 0.804,
+      "step": 50
+    },
+    {
+      "epoch": 0.14903129657228018,
+      "grad_norm": 0.04845063388347626,
+      "learning_rate": 0.0001996800092633612,
+      "loss": 0.5243,
+      "step": 100
+    },
+    {
+      "epoch": 0.14903129657228018,
+      "eval_loss": 0.5150236487388611,
+      "eval_runtime": 19.8752,
+      "eval_samples_per_second": 6.239,
+      "eval_steps_per_second": 0.805,
+      "step": 100
+    },
+    {
+      "epoch": 0.22354694485842028,
+      "grad_norm": 0.06224009767174721,
+      "learning_rate": 0.00019872208493487546,
+      "loss": 0.5046,
+      "step": 150
+    },
+    {
+      "epoch": 0.22354694485842028,
+      "eval_loss": 0.504132091999054,
+      "eval_runtime": 19.8753,
+      "eval_samples_per_second": 6.239,
+      "eval_steps_per_second": 0.805,
+      "step": 150
+    },
+    {
+      "epoch": 0.29806259314456035,
+      "grad_norm": 0.053420498967170715,
+      "learning_rate": 0.0001971323575527731,
+      "loss": 0.4989,
+      "step": 200
+    },
+    {
+      "epoch": 0.29806259314456035,
+      "eval_loss": 0.49748167395591736,
+      "eval_runtime": 19.873,
+      "eval_samples_per_second": 6.24,
+      "eval_steps_per_second": 0.805,
+      "step": 200
+    },
+    {
+      "epoch": 0.37257824143070045,
+      "grad_norm": 0.04381432756781578,
+      "learning_rate": 0.0001949210010777752,
+      "loss": 0.4873,
+      "step": 250
+    },
+    {
+      "epoch": 0.37257824143070045,
+      "eval_loss": 0.4926624298095703,
+      "eval_runtime": 19.9753,
+      "eval_samples_per_second": 6.208,
+      "eval_steps_per_second": 0.801,
+      "step": 250
+    },
+    {
+      "epoch": 0.44709388971684055,
+      "grad_norm": 0.05697334185242653,
+      "learning_rate": 0.00019210216778162994,
+      "loss": 0.4854,
+      "step": 300
+    },
+    {
+      "epoch": 0.44709388971684055,
+      "eval_loss": 0.48829007148742676,
+      "eval_runtime": 19.8877,
+      "eval_samples_per_second": 6.235,
+      "eval_steps_per_second": 0.805,
+      "step": 300
+    },
+    {
+      "epoch": 0.5216095380029806,
+      "grad_norm": 0.07128433138132095,
+      "learning_rate": 0.0001886938976751951,
+      "loss": 0.4788,
+      "step": 350
+    },
+    {
+      "epoch": 0.5216095380029806,
+      "eval_loss": 0.48432213068008423,
+      "eval_runtime": 19.8588,
+      "eval_samples_per_second": 6.244,
+      "eval_steps_per_second": 0.806,
+      "step": 350
+    },
+    {
+      "epoch": 0.5961251862891207,
+      "grad_norm": 0.049252185970544815,
+      "learning_rate": 0.00018471800305571129,
+      "loss": 0.4811,
+      "step": 400
+    },
+    {
+      "epoch": 0.5961251862891207,
+      "eval_loss": 0.4807914197444916,
+      "eval_runtime": 19.8677,
+      "eval_samples_per_second": 6.241,
+      "eval_steps_per_second": 0.805,
+      "step": 400
+    },
+    {
+      "epoch": 0.6706408345752608,
+      "grad_norm": 0.05810828506946564,
+      "learning_rate": 0.00018019992891214008,
+      "loss": 0.4796,
+      "step": 450
+    },
+    {
+      "epoch": 0.6706408345752608,
+      "eval_loss": 0.478938490152359,
+      "eval_runtime": 19.8654,
+      "eval_samples_per_second": 6.242,
+      "eval_steps_per_second": 0.805,
+      "step": 450
+    },
+    {
+      "epoch": 0.7451564828614009,
+      "grad_norm": 0.06429937481880188,
+      "learning_rate": 0.00017516859008194938,
+      "loss": 0.4738,
+      "step": 500
+    },
+    {
+      "epoch": 0.7451564828614009,
+      "eval_loss": 0.47758275270462036,
+      "eval_runtime": 19.8891,
+      "eval_samples_per_second": 6.235,
+      "eval_steps_per_second": 0.804,
+      "step": 500
+    },
+    {
+      "epoch": 0.819672131147541,
+      "grad_norm": 0.057866841554641724,
+      "learning_rate": 0.00016965618620151017,
+      "loss": 0.4693,
+      "step": 550
+    },
+    {
+      "epoch": 0.819672131147541,
+      "eval_loss": 0.47498929500579834,
+      "eval_runtime": 19.8807,
+      "eval_samples_per_second": 6.237,
+      "eval_steps_per_second": 0.805,
+      "step": 550
+    },
+    {
+      "epoch": 0.8941877794336811,
+      "grad_norm": 0.07081956416368484,
+      "learning_rate": 0.00016369799563438958,
+      "loss": 0.4696,
+      "step": 600
+    },
+    {
+      "epoch": 0.8941877794336811,
+      "eval_loss": 0.4721943736076355,
+      "eval_runtime": 19.8698,
+      "eval_samples_per_second": 6.241,
+      "eval_steps_per_second": 0.805,
+      "step": 600
+    },
+    {
+      "epoch": 0.9687034277198212,
+      "grad_norm": 0.04943346604704857,
+      "learning_rate": 0.00015733214969635968,
+      "loss": 0.4682,
+      "step": 650
+    },
+    {
+      "epoch": 0.9687034277198212,
+      "eval_loss": 0.4704548120498657,
+      "eval_runtime": 21.0797,
+      "eval_samples_per_second": 5.882,
+      "eval_steps_per_second": 0.759,
+      "step": 650
+    },
+    {
+      "epoch": 1.0432190760059612,
+      "grad_norm": 0.04892728850245476,
+      "learning_rate": 0.00015059938862204127,
+      "loss": 0.4607,
+      "step": 700
+    },
+    {
+      "epoch": 1.0432190760059612,
+      "eval_loss": 0.4692542850971222,
+      "eval_runtime": 21.0437,
+      "eval_samples_per_second": 5.893,
+      "eval_steps_per_second": 0.76,
+      "step": 700
+    },
+    {
+      "epoch": 1.1177347242921014,
+      "grad_norm": 0.05664736032485962,
+      "learning_rate": 0.00014354280083495006,
+      "loss": 0.4535,
+      "step": 750
+    },
+    {
+      "epoch": 1.1177347242921014,
+      "eval_loss": 0.4676324725151062,
+      "eval_runtime": 22.3216,
+      "eval_samples_per_second": 5.555,
+      "eval_steps_per_second": 0.717,
+      "step": 750
+    },
+    {
+      "epoch": 1.1922503725782414,
+      "grad_norm": 0.04623207449913025,
+      "learning_rate": 0.000136207547189569,
+      "loss": 0.4538,
+      "step": 800
+    },
+    {
+      "epoch": 1.1922503725782414,
+      "eval_loss": 0.4663061201572418,
+      "eval_runtime": 19.8619,
+      "eval_samples_per_second": 6.243,
+      "eval_steps_per_second": 0.806,
+      "step": 800
+    },
+    {
+      "epoch": 1.2667660208643814,
+      "grad_norm": 0.05065590888261795,
+      "learning_rate": 0.00012864057195024643,
+      "loss": 0.4508,
+      "step": 850
+    },
+    {
+      "epoch": 1.2667660208643814,
+      "eval_loss": 0.4653000235557556,
+      "eval_runtime": 20.4016,
+      "eval_samples_per_second": 6.078,
+      "eval_steps_per_second": 0.784,
+      "step": 850
+    },
+    {
+      "epoch": 1.3412816691505216,
+      "grad_norm": 0.050148364156484604,
+      "learning_rate": 0.00012089030235660155,
+      "loss": 0.449,
+      "step": 900
+    },
+    {
+      "epoch": 1.3412816691505216,
+      "eval_loss": 0.4636177122592926,
+      "eval_runtime": 20.3024,
+      "eval_samples_per_second": 6.108,
+      "eval_steps_per_second": 0.788,
+      "step": 900
+    },
+    {
+      "epoch": 1.4157973174366618,
+      "grad_norm": 0.05486341193318367,
+      "learning_rate": 0.00011300633869816275,
+      "loss": 0.4493,
+      "step": 950
+    },
+    {
+      "epoch": 1.4157973174366618,
+      "eval_loss": 0.4632996618747711,
+      "eval_runtime": 20.384,
+      "eval_samples_per_second": 6.083,
+      "eval_steps_per_second": 0.785,
+      "step": 950
+    },
+    {
+      "epoch": 1.4903129657228018,
+      "grad_norm": 0.05443250760436058,
+      "learning_rate": 0.00010503913688170396,
+      "loss": 0.4512,
+      "step": 1000
+    },
+    {
+      "epoch": 1.4903129657228018,
+      "eval_loss": 0.46247440576553345,
+      "eval_runtime": 20.3518,
+      "eval_samples_per_second": 6.093,
+      "eval_steps_per_second": 0.786,
+      "step": 1000
+    },
+    {
+      "epoch": 1.5648286140089418,
+      "grad_norm": 0.050281789153814316,
+      "learning_rate": 9.703968552278915e-05,
+      "loss": 0.4517,
+      "step": 1050
+    },
+    {
+      "epoch": 1.5648286140089418,
+      "eval_loss": 0.46042901277542114,
+      "eval_runtime": 19.9596,
+      "eval_samples_per_second": 6.213,
+      "eval_steps_per_second": 0.802,
+      "step": 1050
+    },
+    {
+      "epoch": 1.639344262295082,
+      "grad_norm": 0.05282198637723923,
+      "learning_rate": 8.905917962807927e-05,
+      "loss": 0.4478,
+      "step": 1100
+    },
+    {
+      "epoch": 1.639344262295082,
+      "eval_loss": 0.4593241810798645,
+      "eval_runtime": 19.9271,
+      "eval_samples_per_second": 6.223,
+      "eval_steps_per_second": 0.803,
+      "step": 1100
+    },
+    {
+      "epoch": 1.713859910581222,
+      "grad_norm": 0.05663960054516792,
+      "learning_rate": 8.114869295677425e-05,
+      "loss": 0.4483,
+      "step": 1150
+    },
+    {
+      "epoch": 1.713859910581222,
+      "eval_loss": 0.4582765996456146,
+      "eval_runtime": 19.9072,
+      "eval_samples_per_second": 6.229,
+      "eval_steps_per_second": 0.804,
+      "step": 1150
+    },
+    {
+      "epoch": 1.788375558867362,
+      "grad_norm": 0.05754128098487854,
+      "learning_rate": 7.335885115801656e-05,
+      "loss": 0.4479,
+      "step": 1200
+    },
+    {
+      "epoch": 1.788375558867362,
+      "eval_loss": 0.4579518735408783,
+      "eval_runtime": 19.883,
+      "eval_samples_per_second": 6.236,
+      "eval_steps_per_second": 0.805,
+      "step": 1200
+    },
+    {
+      "epoch": 1.8628912071535022,
+      "grad_norm": 0.05780432000756264,
+      "learning_rate": 6.573950777611587e-05,
+      "loss": 0.4476,
+      "step": 1250
+    },
+    {
+      "epoch": 1.8628912071535022,
+      "eval_loss": 0.456869512796402,
+      "eval_runtime": 19.9094,
+      "eval_samples_per_second": 6.228,
+      "eval_steps_per_second": 0.804,
+      "step": 1250
+    },
+    {
+      "epoch": 1.9374068554396424,
+      "grad_norm": 0.05665415897965431,
+      "learning_rate": 5.833942519710177e-05,
+      "loss": 0.4454,
+      "step": 1300
+    },
+    {
+      "epoch": 1.9374068554396424,
+      "eval_loss": 0.45577672123908997,
+      "eval_runtime": 19.9333,
+      "eval_samples_per_second": 6.221,
+      "eval_steps_per_second": 0.803,
+      "step": 1300
+    },
+    {
+      "epoch": 2.0119225037257826,
+      "grad_norm": 0.057158373296260834,
+      "learning_rate": 5.1205962578487155e-05,
+      "loss": 0.4435,
+      "step": 1350
+    },
+    {
+      "epoch": 2.0119225037257826,
+      "eval_loss": 0.45555853843688965,
+      "eval_runtime": 19.9237,
+      "eval_samples_per_second": 6.224,
+      "eval_steps_per_second": 0.803,
+      "step": 1350
+    },
+    {
+      "epoch": 2.0864381520119224,
+      "grad_norm": 0.05942057818174362,
+      "learning_rate": 4.4384772759434425e-05,
+      "loss": 0.4339,
+      "step": 1400
+    },
+    {
+      "epoch": 2.0864381520119224,
+      "eval_loss": 0.4557653069496155,
+      "eval_runtime": 19.9268,
+      "eval_samples_per_second": 6.223,
+      "eval_steps_per_second": 0.803,
+      "step": 1400
+    },
+    {
+      "epoch": 2.1609538002980626,
+      "grad_norm": 0.05777844041585922,
+      "learning_rate": 3.7919510091042566e-05,
+      "loss": 0.4322,
+      "step": 1450
+    },
+    {
+      "epoch": 2.1609538002980626,
+      "eval_loss": 0.45560821890830994,
+      "eval_runtime": 19.9533,
+      "eval_samples_per_second": 6.215,
+      "eval_steps_per_second": 0.802,
+      "step": 1450
+    },
+    {
+      "epoch": 2.235469448584203,
+      "grad_norm": 0.05342744290828705,
+      "learning_rate": 3.185155105658798e-05,
+      "loss": 0.4295,
+      "step": 1500
+    },
+    {
+      "epoch": 2.235469448584203,
+      "eval_loss": 0.4551125168800354,
+      "eval_runtime": 19.9502,
+      "eval_samples_per_second": 6.215,
+      "eval_steps_per_second": 0.802,
+      "step": 1500
+    },
+    {
+      "epoch": 2.3099850968703426,
+      "grad_norm": 0.05730094388127327,
+      "learning_rate": 2.6219729469697318e-05,
+      "loss": 0.4363,
+      "step": 1550
+    },
+    {
+      "epoch": 2.3099850968703426,
+      "eval_loss": 0.45447057485580444,
+      "eval_runtime": 19.938,
+      "eval_samples_per_second": 6.219,
+      "eval_steps_per_second": 0.802,
+      "step": 1550
+    },
+    {
+      "epoch": 2.384500745156483,
+      "grad_norm": 0.05646738409996033,
+      "learning_rate": 2.1060087945134677e-05,
+      "loss": 0.4298,
+      "step": 1600
+    },
+    {
+      "epoch": 2.384500745156483,
+      "eval_loss": 0.4543200731277466,
+      "eval_runtime": 19.9365,
+      "eval_samples_per_second": 6.22,
+      "eval_steps_per_second": 0.803,
+      "step": 1600
+    },
+    {
+      "epoch": 2.459016393442623,
+      "grad_norm": 0.0644339844584465,
+      "learning_rate": 1.640564723274486e-05,
+      "loss": 0.4308,
+      "step": 1650
+    },
+    {
+      "epoch": 2.459016393442623,
+      "eval_loss": 0.4538328945636749,
+      "eval_runtime": 19.9162,
+      "eval_samples_per_second": 6.226,
+      "eval_steps_per_second": 0.803,
+      "step": 1650
+    },
+    {
+      "epoch": 2.533532041728763,
+      "grad_norm": 0.05787523835897446,
+      "learning_rate": 1.2286194890771819e-05,
+      "loss": 0.4363,
+      "step": 1700
+    },
+    {
+      "epoch": 2.533532041728763,
+      "eval_loss": 0.45351502299308777,
+      "eval_runtime": 19.9092,
+      "eval_samples_per_second": 6.228,
+      "eval_steps_per_second": 0.804,
+      "step": 1700
+    },
+    {
+      "epoch": 2.608047690014903,
+      "grad_norm": 0.05828353762626648,
+      "learning_rate": 8.728094651004648e-06,
+      "loss": 0.4291,
+      "step": 1750
+    },
+    {
+      "epoch": 2.608047690014903,
+      "eval_loss": 0.4533880949020386,
+      "eval_runtime": 19.9085,
+      "eval_samples_per_second": 6.229,
+      "eval_steps_per_second": 0.804,
+      "step": 1750
+    },
+    {
+      "epoch": 2.682563338301043,
+      "grad_norm": 0.05924544110894203,
+      "learning_rate": 5.7541176957785605e-06,
+      "loss": 0.4286,
+      "step": 1800
+    },
+    {
+      "epoch": 2.682563338301043,
+      "eval_loss": 0.45319971442222595,
+      "eval_runtime": 19.9089,
+      "eval_samples_per_second": 6.228,
+      "eval_steps_per_second": 0.804,
+      "step": 1800
+    },
+    {
+      "epoch": 2.7570789865871834,
+      "grad_norm": 0.0565376915037632,
+      "learning_rate": 3.3832969266265112e-06,
+      "loss": 0.4259,
+      "step": 1850
+    },
+    {
+      "epoch": 2.7570789865871834,
+      "eval_loss": 0.45311444997787476,
+      "eval_runtime": 19.9241,
+      "eval_samples_per_second": 6.224,
+      "eval_steps_per_second": 0.803,
+      "step": 1850
+    },
+    {
+      "epoch": 2.8315946348733236,
+      "grad_norm": 0.05949319526553154,
+      "learning_rate": 1.6308051572357152e-06,
+      "loss": 0.4313,
+      "step": 1900
+    },
+    {
+      "epoch": 2.8315946348733236,
+      "eval_loss": 0.45298200845718384,
+      "eval_runtime": 19.9172,
+      "eval_samples_per_second": 6.226,
+      "eval_steps_per_second": 0.803,
+      "step": 1900
+    },
+    {
+      "epoch": 2.9061102831594634,
+      "grad_norm": 0.059121884405612946,
+      "learning_rate": 5.078580102509834e-07,
+      "loss": 0.4298,
+      "step": 1950
+    },
+    {
+      "epoch": 2.9061102831594634,
+      "eval_loss": 0.45297005772590637,
+      "eval_runtime": 19.9314,
+      "eval_samples_per_second": 6.221,
+      "eval_steps_per_second": 0.803,
+      "step": 1950
+    },
+    {
+      "epoch": 2.9806259314456036,
+      "grad_norm": 0.055241379886865616,
+      "learning_rate": 2.164213936770576e-08,
+      "loss": 0.4298,
+      "step": 2000
+    },
+    {
+      "epoch": 2.9806259314456036,
+      "eval_loss": 0.4530116021633148,
+      "eval_runtime": 19.9318,
+      "eval_samples_per_second": 6.221,
+      "eval_steps_per_second": 0.803,
+      "step": 2000
+    }
+  ],
+  "logging_steps": 50,
+  "max_steps": 2013,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 3,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "EarlyStoppingCallback": {
+      "args": {
+        "early_stopping_patience": 3,
+        "early_stopping_threshold": 0.0
+      },
+      "attributes": {
+        "early_stopping_patience_counter": 0
+      }
+    },
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 7.466080673527235e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-2000/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb271c4925692ee63ef50cf05761726fa11d266c78d2f904cbd3b49754d4ecae
+size 5496

checkpoint-2013/README.md

@@ -0,0 +1,202 @@
+---
+base_model: microsoft/Phi-3.5-mini-instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-2013/adapter_config.json

@@ -0,0 +1,29 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "microsoft/Phi-3.5-mini-instruct",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 64,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "o_proj",
+    "qkv_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-2013/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3075fcd44dc7217321dae7019a17ec0617b8d8b07efeb87421525a25b851f42a
+size 695383552

checkpoint-2013/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d01273733a10c45a23e59460914a7bc09cd067397117a0afd27e9e1d8d36c177
+size 604089722

checkpoint-2013/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b840222158dd5cd2d7104da4aa2a9bf0903ff1671c0eb9d3f596b0bcc162fd2
+size 14244

checkpoint-2013/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a454c9b3f6121f7efbfdd8d1c962a1e2e6d47501ab60156b3fbbf82701fda2c5
+size 1064

checkpoint-2013/special_tokens_map.json

@@ -0,0 +1,28 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": "<|im_start|>",
+  "eos_token": "<|im_end|>",
+  "pad_token": "<|im_end|>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-2013/tokenizer_config.json

@@ -0,0 +1,151 @@
+{
+  "add_bos_token": false,
+  "add_eos_token": false,
+  "add_prefix_space": null,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": false
+    },
+    "32000": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32001": {
+      "content": "<|assistant|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32002": {
+      "content": "<|placeholder1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32003": {
+      "content": "<|placeholder2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32004": {
+      "content": "<|placeholder3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32005": {
+      "content": "<|placeholder4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32006": {
+      "content": "<|system|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "<|end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "<|placeholder5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "<|placeholder6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "<|user|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32011": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32012": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "bos_token": "<|im_start|>",
+  "chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "legacy": false,
+  "model_max_length": 131072,
+  "pad_token": "<|im_end|>",
+  "padding_side": "right",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}

checkpoint-2013/trainer_state.json

@@ -0,0 +1,642 @@
+{
+  "best_metric": 0.4530116021633148,
+  "best_model_checkpoint": "Phi-3.5-mini-instruct_text_to_sql_lora\\checkpoint-2000",
+  "epoch": 3.0,
+  "eval_steps": 50,
+  "global_step": 2013,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.07451564828614009,
+      "grad_norm": 0.09373754262924194,
+      "learning_rate": 0.0002,
+      "loss": 0.9134,
+      "step": 50
+    },
+    {
+      "epoch": 0.07451564828614009,
+      "eval_loss": 0.5543281435966492,
+      "eval_runtime": 19.9013,
+      "eval_samples_per_second": 6.231,
+      "eval_steps_per_second": 0.804,
+      "step": 50
+    },
+    {
+      "epoch": 0.14903129657228018,
+      "grad_norm": 0.04845063388347626,
+      "learning_rate": 0.0001996800092633612,
+      "loss": 0.5243,
+      "step": 100
+    },
+    {
+      "epoch": 0.14903129657228018,
+      "eval_loss": 0.5150236487388611,
+      "eval_runtime": 19.8752,
+      "eval_samples_per_second": 6.239,
+      "eval_steps_per_second": 0.805,
+      "step": 100
+    },
+    {
+      "epoch": 0.22354694485842028,
+      "grad_norm": 0.06224009767174721,
+      "learning_rate": 0.00019872208493487546,
+      "loss": 0.5046,
+      "step": 150
+    },
+    {
+      "epoch": 0.22354694485842028,
+      "eval_loss": 0.504132091999054,
+      "eval_runtime": 19.8753,
+      "eval_samples_per_second": 6.239,
+      "eval_steps_per_second": 0.805,
+      "step": 150
+    },
+    {
+      "epoch": 0.29806259314456035,
+      "grad_norm": 0.053420498967170715,
+      "learning_rate": 0.0001971323575527731,
+      "loss": 0.4989,
+      "step": 200
+    },
+    {
+      "epoch": 0.29806259314456035,
+      "eval_loss": 0.49748167395591736,
+      "eval_runtime": 19.873,
+      "eval_samples_per_second": 6.24,
+      "eval_steps_per_second": 0.805,
+      "step": 200
+    },
+    {
+      "epoch": 0.37257824143070045,
+      "grad_norm": 0.04381432756781578,
+      "learning_rate": 0.0001949210010777752,
+      "loss": 0.4873,
+      "step": 250
+    },
+    {
+      "epoch": 0.37257824143070045,
+      "eval_loss": 0.4926624298095703,
+      "eval_runtime": 19.9753,
+      "eval_samples_per_second": 6.208,
+      "eval_steps_per_second": 0.801,
+      "step": 250
+    },
+    {
+      "epoch": 0.44709388971684055,
+      "grad_norm": 0.05697334185242653,
+      "learning_rate": 0.00019210216778162994,
+      "loss": 0.4854,
+      "step": 300
+    },
+    {
+      "epoch": 0.44709388971684055,
+      "eval_loss": 0.48829007148742676,
+      "eval_runtime": 19.8877,
+      "eval_samples_per_second": 6.235,
+      "eval_steps_per_second": 0.805,
+      "step": 300
+    },
+    {
+      "epoch": 0.5216095380029806,
+      "grad_norm": 0.07128433138132095,
+      "learning_rate": 0.0001886938976751951,
+      "loss": 0.4788,
+      "step": 350
+    },
+    {
+      "epoch": 0.5216095380029806,
+      "eval_loss": 0.48432213068008423,
+      "eval_runtime": 19.8588,
+      "eval_samples_per_second": 6.244,
+      "eval_steps_per_second": 0.806,
+      "step": 350
+    },
+    {
+      "epoch": 0.5961251862891207,
+      "grad_norm": 0.049252185970544815,
+      "learning_rate": 0.00018471800305571129,
+      "loss": 0.4811,
+      "step": 400
+    },
+    {
+      "epoch": 0.5961251862891207,
+      "eval_loss": 0.4807914197444916,
+      "eval_runtime": 19.8677,
+      "eval_samples_per_second": 6.241,
+      "eval_steps_per_second": 0.805,
+      "step": 400
+    },
+    {
+      "epoch": 0.6706408345752608,
+      "grad_norm": 0.05810828506946564,
+      "learning_rate": 0.00018019992891214008,
+      "loss": 0.4796,
+      "step": 450
+    },
+    {
+      "epoch": 0.6706408345752608,
+      "eval_loss": 0.478938490152359,
+      "eval_runtime": 19.8654,
+      "eval_samples_per_second": 6.242,
+      "eval_steps_per_second": 0.805,
+      "step": 450
+    },
+    {
+      "epoch": 0.7451564828614009,
+      "grad_norm": 0.06429937481880188,
+      "learning_rate": 0.00017516859008194938,
+      "loss": 0.4738,
+      "step": 500
+    },
+    {
+      "epoch": 0.7451564828614009,
+      "eval_loss": 0.47758275270462036,
+      "eval_runtime": 19.8891,
+      "eval_samples_per_second": 6.235,
+      "eval_steps_per_second": 0.804,
+      "step": 500
+    },
+    {
+      "epoch": 0.819672131147541,
+      "grad_norm": 0.057866841554641724,
+      "learning_rate": 0.00016965618620151017,
+      "loss": 0.4693,
+      "step": 550
+    },
+    {
+      "epoch": 0.819672131147541,
+      "eval_loss": 0.47498929500579834,
+      "eval_runtime": 19.8807,
+      "eval_samples_per_second": 6.237,
+      "eval_steps_per_second": 0.805,
+      "step": 550
+    },
+    {
+      "epoch": 0.8941877794336811,
+      "grad_norm": 0.07081956416368484,
+      "learning_rate": 0.00016369799563438958,
+      "loss": 0.4696,
+      "step": 600
+    },
+    {
+      "epoch": 0.8941877794336811,
+      "eval_loss": 0.4721943736076355,
+      "eval_runtime": 19.8698,
+      "eval_samples_per_second": 6.241,
+      "eval_steps_per_second": 0.805,
+      "step": 600
+    },
+    {
+      "epoch": 0.9687034277198212,
+      "grad_norm": 0.04943346604704857,
+      "learning_rate": 0.00015733214969635968,
+      "loss": 0.4682,
+      "step": 650
+    },
+    {
+      "epoch": 0.9687034277198212,
+      "eval_loss": 0.4704548120498657,
+      "eval_runtime": 21.0797,
+      "eval_samples_per_second": 5.882,
+      "eval_steps_per_second": 0.759,
+      "step": 650
+    },
+    {
+      "epoch": 1.0432190760059612,
+      "grad_norm": 0.04892728850245476,
+      "learning_rate": 0.00015059938862204127,
+      "loss": 0.4607,
+      "step": 700
+    },
+    {
+      "epoch": 1.0432190760059612,
+      "eval_loss": 0.4692542850971222,
+      "eval_runtime": 21.0437,
+      "eval_samples_per_second": 5.893,
+      "eval_steps_per_second": 0.76,
+      "step": 700
+    },
+    {
+      "epoch": 1.1177347242921014,
+      "grad_norm": 0.05664736032485962,
+      "learning_rate": 0.00014354280083495006,
+      "loss": 0.4535,
+      "step": 750
+    },
+    {
+      "epoch": 1.1177347242921014,
+      "eval_loss": 0.4676324725151062,
+      "eval_runtime": 22.3216,
+      "eval_samples_per_second": 5.555,
+      "eval_steps_per_second": 0.717,
+      "step": 750
+    },
+    {
+      "epoch": 1.1922503725782414,
+      "grad_norm": 0.04623207449913025,
+      "learning_rate": 0.000136207547189569,
+      "loss": 0.4538,
+      "step": 800
+    },
+    {
+      "epoch": 1.1922503725782414,
+      "eval_loss": 0.4663061201572418,
+      "eval_runtime": 19.8619,
+      "eval_samples_per_second": 6.243,
+      "eval_steps_per_second": 0.806,
+      "step": 800
+    },
+    {
+      "epoch": 1.2667660208643814,
+      "grad_norm": 0.05065590888261795,
+      "learning_rate": 0.00012864057195024643,
+      "loss": 0.4508,
+      "step": 850
+    },
+    {
+      "epoch": 1.2667660208643814,
+      "eval_loss": 0.4653000235557556,
+      "eval_runtime": 20.4016,
+      "eval_samples_per_second": 6.078,
+      "eval_steps_per_second": 0.784,
+      "step": 850
+    },
+    {
+      "epoch": 1.3412816691505216,
+      "grad_norm": 0.050148364156484604,
+      "learning_rate": 0.00012089030235660155,
+      "loss": 0.449,
+      "step": 900
+    },
+    {
+      "epoch": 1.3412816691505216,
+      "eval_loss": 0.4636177122592926,
+      "eval_runtime": 20.3024,
+      "eval_samples_per_second": 6.108,
+      "eval_steps_per_second": 0.788,
+      "step": 900
+    },
+    {
+      "epoch": 1.4157973174366618,
+      "grad_norm": 0.05486341193318367,
+      "learning_rate": 0.00011300633869816275,
+      "loss": 0.4493,
+      "step": 950
+    },
+    {
+      "epoch": 1.4157973174366618,
+      "eval_loss": 0.4632996618747711,
+      "eval_runtime": 20.384,
+      "eval_samples_per_second": 6.083,
+      "eval_steps_per_second": 0.785,
+      "step": 950
+    },
+    {
+      "epoch": 1.4903129657228018,
+      "grad_norm": 0.05443250760436058,
+      "learning_rate": 0.00010503913688170396,
+      "loss": 0.4512,
+      "step": 1000
+    },
+    {
+      "epoch": 1.4903129657228018,
+      "eval_loss": 0.46247440576553345,
+      "eval_runtime": 20.3518,
+      "eval_samples_per_second": 6.093,
+      "eval_steps_per_second": 0.786,
+      "step": 1000
+    },
+    {
+      "epoch": 1.5648286140089418,
+      "grad_norm": 0.050281789153814316,
+      "learning_rate": 9.703968552278915e-05,
+      "loss": 0.4517,
+      "step": 1050
+    },
+    {
+      "epoch": 1.5648286140089418,
+      "eval_loss": 0.46042901277542114,
+      "eval_runtime": 19.9596,
+      "eval_samples_per_second": 6.213,
+      "eval_steps_per_second": 0.802,
+      "step": 1050
+    },
+    {
+      "epoch": 1.639344262295082,
+      "grad_norm": 0.05282198637723923,
+      "learning_rate": 8.905917962807927e-05,
+      "loss": 0.4478,
+      "step": 1100
+    },
+    {
+      "epoch": 1.639344262295082,
+      "eval_loss": 0.4593241810798645,
+      "eval_runtime": 19.9271,
+      "eval_samples_per_second": 6.223,
+      "eval_steps_per_second": 0.803,
+      "step": 1100
+    },
+    {
+      "epoch": 1.713859910581222,
+      "grad_norm": 0.05663960054516792,
+      "learning_rate": 8.114869295677425e-05,
+      "loss": 0.4483,
+      "step": 1150
+    },
+    {
+      "epoch": 1.713859910581222,
+      "eval_loss": 0.4582765996456146,
+      "eval_runtime": 19.9072,
+      "eval_samples_per_second": 6.229,
+      "eval_steps_per_second": 0.804,
+      "step": 1150
+    },
+    {
+      "epoch": 1.788375558867362,
+      "grad_norm": 0.05754128098487854,
+      "learning_rate": 7.335885115801656e-05,
+      "loss": 0.4479,
+      "step": 1200
+    },
+    {
+      "epoch": 1.788375558867362,
+      "eval_loss": 0.4579518735408783,
+      "eval_runtime": 19.883,
+      "eval_samples_per_second": 6.236,
+      "eval_steps_per_second": 0.805,
+      "step": 1200
+    },
+    {
+      "epoch": 1.8628912071535022,
+      "grad_norm": 0.05780432000756264,
+      "learning_rate": 6.573950777611587e-05,
+      "loss": 0.4476,
+      "step": 1250
+    },
+    {
+      "epoch": 1.8628912071535022,
+      "eval_loss": 0.456869512796402,
+      "eval_runtime": 19.9094,
+      "eval_samples_per_second": 6.228,
+      "eval_steps_per_second": 0.804,
+      "step": 1250
+    },
+    {
+      "epoch": 1.9374068554396424,
+      "grad_norm": 0.05665415897965431,
+      "learning_rate": 5.833942519710177e-05,
+      "loss": 0.4454,
+      "step": 1300
+    },
+    {
+      "epoch": 1.9374068554396424,
+      "eval_loss": 0.45577672123908997,
+      "eval_runtime": 19.9333,
+      "eval_samples_per_second": 6.221,
+      "eval_steps_per_second": 0.803,
+      "step": 1300
+    },
+    {
+      "epoch": 2.0119225037257826,
+      "grad_norm": 0.057158373296260834,
+      "learning_rate": 5.1205962578487155e-05,
+      "loss": 0.4435,
+      "step": 1350
+    },
+    {
+      "epoch": 2.0119225037257826,
+      "eval_loss": 0.45555853843688965,
+      "eval_runtime": 19.9237,
+      "eval_samples_per_second": 6.224,
+      "eval_steps_per_second": 0.803,
+      "step": 1350
+    },
+    {
+      "epoch": 2.0864381520119224,
+      "grad_norm": 0.05942057818174362,
+      "learning_rate": 4.4384772759434425e-05,
+      "loss": 0.4339,
+      "step": 1400
+    },
+    {
+      "epoch": 2.0864381520119224,
+      "eval_loss": 0.4557653069496155,
+      "eval_runtime": 19.9268,
+      "eval_samples_per_second": 6.223,
+      "eval_steps_per_second": 0.803,
+      "step": 1400
+    },
+    {
+      "epoch": 2.1609538002980626,
+      "grad_norm": 0.05777844041585922,
+      "learning_rate": 3.7919510091042566e-05,
+      "loss": 0.4322,
+      "step": 1450
+    },
+    {
+      "epoch": 2.1609538002980626,
+      "eval_loss": 0.45560821890830994,
+      "eval_runtime": 19.9533,
+      "eval_samples_per_second": 6.215,
+      "eval_steps_per_second": 0.802,
+      "step": 1450
+    },
+    {
+      "epoch": 2.235469448584203,
+      "grad_norm": 0.05342744290828705,
+      "learning_rate": 3.185155105658798e-05,
+      "loss": 0.4295,
+      "step": 1500
+    },
+    {
+      "epoch": 2.235469448584203,
+      "eval_loss": 0.4551125168800354,
+      "eval_runtime": 19.9502,
+      "eval_samples_per_second": 6.215,
+      "eval_steps_per_second": 0.802,
+      "step": 1500
+    },
+    {
+      "epoch": 2.3099850968703426,
+      "grad_norm": 0.05730094388127327,
+      "learning_rate": 2.6219729469697318e-05,
+      "loss": 0.4363,
+      "step": 1550
+    },
+    {
+      "epoch": 2.3099850968703426,
+      "eval_loss": 0.45447057485580444,
+      "eval_runtime": 19.938,
+      "eval_samples_per_second": 6.219,
+      "eval_steps_per_second": 0.802,
+      "step": 1550
+    },
+    {
+      "epoch": 2.384500745156483,
+      "grad_norm": 0.05646738409996033,
+      "learning_rate": 2.1060087945134677e-05,
+      "loss": 0.4298,
+      "step": 1600
+    },
+    {
+      "epoch": 2.384500745156483,
+      "eval_loss": 0.4543200731277466,
+      "eval_runtime": 19.9365,
+      "eval_samples_per_second": 6.22,
+      "eval_steps_per_second": 0.803,
+      "step": 1600
+    },
+    {
+      "epoch": 2.459016393442623,
+      "grad_norm": 0.0644339844584465,
+      "learning_rate": 1.640564723274486e-05,
+      "loss": 0.4308,
+      "step": 1650
+    },
+    {
+      "epoch": 2.459016393442623,
+      "eval_loss": 0.4538328945636749,
+      "eval_runtime": 19.9162,
+      "eval_samples_per_second": 6.226,
+      "eval_steps_per_second": 0.803,
+      "step": 1650
+    },
+    {
+      "epoch": 2.533532041728763,
+      "grad_norm": 0.05787523835897446,
+      "learning_rate": 1.2286194890771819e-05,
+      "loss": 0.4363,
+      "step": 1700
+    },
+    {
+      "epoch": 2.533532041728763,
+      "eval_loss": 0.45351502299308777,
+      "eval_runtime": 19.9092,
+      "eval_samples_per_second": 6.228,
+      "eval_steps_per_second": 0.804,
+      "step": 1700
+    },
+    {
+      "epoch": 2.608047690014903,
+      "grad_norm": 0.05828353762626648,
+      "learning_rate": 8.728094651004648e-06,
+      "loss": 0.4291,
+      "step": 1750
+    },
+    {
+      "epoch": 2.608047690014903,
+      "eval_loss": 0.4533880949020386,
+      "eval_runtime": 19.9085,
+      "eval_samples_per_second": 6.229,
+      "eval_steps_per_second": 0.804,
+      "step": 1750
+    },
+    {
+      "epoch": 2.682563338301043,
+      "grad_norm": 0.05924544110894203,
+      "learning_rate": 5.7541176957785605e-06,
+      "loss": 0.4286,
+      "step": 1800
+    },
+    {
+      "epoch": 2.682563338301043,
+      "eval_loss": 0.45319971442222595,
+      "eval_runtime": 19.9089,
+      "eval_samples_per_second": 6.228,
+      "eval_steps_per_second": 0.804,
+      "step": 1800
+    },
+    {
+      "epoch": 2.7570789865871834,
+      "grad_norm": 0.0565376915037632,
+      "learning_rate": 3.3832969266265112e-06,
+      "loss": 0.4259,
+      "step": 1850
+    },
+    {
+      "epoch": 2.7570789865871834,
+      "eval_loss": 0.45311444997787476,
+      "eval_runtime": 19.9241,
+      "eval_samples_per_second": 6.224,
+      "eval_steps_per_second": 0.803,
+      "step": 1850
+    },
+    {
+      "epoch": 2.8315946348733236,
+      "grad_norm": 0.05949319526553154,
+      "learning_rate": 1.6308051572357152e-06,
+      "loss": 0.4313,
+      "step": 1900
+    },
+    {
+      "epoch": 2.8315946348733236,
+      "eval_loss": 0.45298200845718384,
+      "eval_runtime": 19.9172,
+      "eval_samples_per_second": 6.226,
+      "eval_steps_per_second": 0.803,
+      "step": 1900
+    },
+    {
+      "epoch": 2.9061102831594634,
+      "grad_norm": 0.059121884405612946,
+      "learning_rate": 5.078580102509834e-07,
+      "loss": 0.4298,
+      "step": 1950
+    },
+    {
+      "epoch": 2.9061102831594634,
+      "eval_loss": 0.45297005772590637,
+      "eval_runtime": 19.9314,
+      "eval_samples_per_second": 6.221,
+      "eval_steps_per_second": 0.803,
+      "step": 1950
+    },
+    {
+      "epoch": 2.9806259314456036,
+      "grad_norm": 0.055241379886865616,
+      "learning_rate": 2.164213936770576e-08,
+      "loss": 0.4298,
+      "step": 2000
+    },
+    {
+      "epoch": 2.9806259314456036,
+      "eval_loss": 0.4530116021633148,
+      "eval_runtime": 19.9318,
+      "eval_samples_per_second": 6.221,
+      "eval_steps_per_second": 0.803,
+      "step": 2000
+    }
+  ],
+  "logging_steps": 50,
+  "max_steps": 2013,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 3,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "EarlyStoppingCallback": {
+      "args": {
+        "early_stopping_patience": 3,
+        "early_stopping_threshold": 0.0
+      },
+      "attributes": {
+        "early_stopping_patience_counter": 0
+      }
+    },
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 7.514149576475935e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-2013/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb271c4925692ee63ef50cf05761726fa11d266c78d2f904cbd3b49754d4ecae
+size 5496

checkpoint-500/README.md

@@ -0,0 +1,202 @@
+---
+base_model: microsoft/Phi-3.5-mini-instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-500/adapter_config.json

@@ -0,0 +1,29 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "microsoft/Phi-3.5-mini-instruct",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 64,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "o_proj",
+    "qkv_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-500/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c141ccb150f3545ead5fcc54a4ecfddacef13eb5f53fde1376cbd0fc824125b
+size 695383552