Model save

README.md

@@ -0,0 +1,58 @@
+---
+library_name: transformers
+tags:
+- llama-factory
+- generated_from_trainer
+model-index:
+- name: r2egym-stack-bugsseq
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# r2egym-stack-bugsseq
+
+This model was trained from scratch on the None dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 4e-05
+- train_batch_size: 1
+- eval_batch_size: 8
+- seed: 42
+- distributed_type: multi-GPU
+- num_devices: 8
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 16
+- total_eval_batch_size: 64
+- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.98) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: cosine
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 7.0
+
+### Training results
+
+
+
+### Framework versions
+
+- Transformers 4.56.1
+- Pytorch 2.9.1+cu128
+- Datasets 4.4.1
+- Tokenizers 0.22.1

generation_config.json

@@ -0,0 +1,12 @@
+{
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "pad_token_id": 151643,
+  "temperature": 0.6,
+  "top_k": 20,
+  "top_p": 0.95,
+  "transformers_version": "4.56.1"
+}

model-00001-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e5b360ed5e34a02e66df60d5e9c2273673464dbc7d0d6bf86467e8cbeee95636
+oid sha256:31d7ce73473660d79901025f8afb58e6252909995899a4d607955af9c0afdcf9
 size 4902257696

model-00002-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f92a1de97f13e0d9ad430f74143fae0f8cb01971c27c9165910ab313c9d806e4
+oid sha256:7f9175e27c1af8d893b036579d9beaa8971e48d7ad38220d6a669bcb736c523e
 size 4915960368

model-00003-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2089fd10e827d0b708ed83125beaac859cab9dc8160ce2efdc1824d29261321e
+oid sha256:cb6b019198d3353f336c51e484ac4b2f8d714ecbe0325ea355032c97df864095
 size 4983068496

model-00004-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bc493238756b0935f95d0ec97a528b48c7902f739501a012063f1b9cf04ee8ca
+oid sha256:5ba39cad6e81833e3cc72a24d357c4639cac89490aff1712206e4f7bf712abce
 size 1580230264

trainer_log.jsonl

@@ -1939,3 +1939,7 @@
 {"current_steps": 9595, "total_steps": 9625, "loss": 0.0629, "lr": 1.26410223527218e-09, "epoch": 6.979265187340851, "percentage": 99.69, "elapsed_time": "18:35:18", "remaining_time": "0:03:29"}
 {"current_steps": 9600, "total_steps": 9625, "loss": 0.0703, "lr": 8.89215172437119e-10, "epoch": 6.9829028737722805, "percentage": 99.74, "elapsed_time": "18:37:05", "remaining_time": "0:02:54"}
 {"current_steps": 9605, "total_steps": 9625, "loss": 0.0963, "lr": 5.800960077206874e-10, "epoch": 6.986540560203711, "percentage": 99.79, "elapsed_time": "18:40:47", "remaining_time": "0:02:20"}
+{"current_steps": 9610, "total_steps": 9625, "loss": 0.1259, "lr": 3.3674575767417283e-10, "epoch": 6.99017824663514, "percentage": 99.84, "elapsed_time": "18:43:04", "remaining_time": "0:01:45"}
+{"current_steps": 9615, "total_steps": 9625, "loss": 0.0713, "lr": 1.591652225663154e-10, "epoch": 6.9938159330665695, "percentage": 99.9, "elapsed_time": "18:44:50", "remaining_time": "0:01:10"}
+{"current_steps": 9620, "total_steps": 9625, "loss": 0.0655, "lr": 4.735498637442604e-11, "epoch": 6.997453619498, "percentage": 99.95, "elapsed_time": "18:46:26", "remaining_time": "0:00:35"}
+{"current_steps": 9624, "total_steps": 9625, "epoch": 7.0, "percentage": 99.99, "elapsed_time": "18:48:00", "remaining_time": "0:00:07"}