Upload 9 files

README.md

@@ -0,0 +1,271 @@
+---
+base_model:
+- ServiceNow-AI/Apriel-Nemotron-15b-Thinker
+base_model_relation: quantized
+license: mit
+---
+## Quantized using the default exllamav3 (0.0.1) quantization process.
+
+- Original model: https://huggingface.co/ServiceNow-AI/Apriel-Nemotron-15b-Thinker
+- exllamav3: https://github.com/turboderp-org/exllamav3
+---
+# Apriel-Nemotron-15b-Thinker
+
+<img src="https://cdn-uploads.huggingface.co/production/uploads/63d3095c2727d7888cbb54e2/Lt1t0tOO5emz1X23Azg-E.png" width="120" alt="thumbnail"/>      `/ˈɑː.pri.əl/`
+
+---
+
+## Table of Contents
+
+1. [Summary](#summary)  
+2. [Evaluation](#evaluation)  
+3. [Training Details](#training-details)  
+4. [How to Use](#how-to-use) 
+5. [Intended Use](#intended-use)  
+6. [Limitations](#limitations)  
+7. [Security and Responsible Use](#security-and-responsible-use)  
+8. [Software](#software)  
+9. [License](#license)
+10. [Acknowledgements](#acknowledgements)
+11. [Citation](#citation)  
+
+
+---
+
+## Summary
+
+**Apriel-Nemotron-15b-Thinker** is a 15 billion‑parameter reasoning model in ServiceNow’s Apriel SLM series which achieves competitive performance against similarly sized state-of-the-art models like o1‑mini, QWQ‑32b, and EXAONE‑Deep‑32b, all while maintaining only half the memory footprint of those alternatives. It builds upon the **Apriel‑15b‑base** checkpoint through a three‑stage training pipeline (CPT, SFT and GRPO).
+
+**Highlights**
+- Half the size of SOTA models like QWQ-32b and EXAONE-32b and hence **memory efficient**.
+- It consumes **40%** less tokens compared to QWQ-32b, making it super efficient in production. 🚀🚀🚀
+- On par or outperforms on tasks like - MBPP, BFCL, Enterprise RAG, MT Bench, MixEval, IFEval and Multi-Challenge making it great for **Agentic / Enterprise tasks**.
+- Competitive performance on academic benchmarks like AIME-24 AIME-25, AMC-23, MATH-500 and GPQA considering model size.
+
+---
+
+## Evaluation
+
+Evaluations were conducted using [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness) and [evalchemy](https://github.com/mlfoundations/evalchemy).
+
+
+
+### Benchmarks that are indicative of enterprise capability
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63d3095c2727d7888cbb54e2/ih9QGdnSq20MLCGGtsAZL.png)
+
+
+
+### Academic reasoning benchmarks
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63d3095c2727d7888cbb54e2/psk628cePXQZ9AghKuI5u.png)
+
+
+
+### Token efficiency comparison (lower the better)
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63d3095c2727d7888cbb54e2/jmvBwsJAIZVTP0xtWSTIz.png)
+
+
+---
+
+
+## Training Details
+
+**Mid training / Continual Pre‑training**
+In this stage, the model is trained on 100+ billion tokens of carefully curated examples drawn from mathematical reasoning, coding challenges, scientific discourse and logical puzzles. The objective is to strengthen foundational reasoning capabilities of the model. This stage is super critical for the model to function as a reasoner and provides significant lifts in reasoning benchmarks.
+
+**Supervised Fine‑Tuning (SFT)**
+Next, we SFT the model using 200,000 high‑quality demonstrations that cover mathematical and scientific problem‑solving, coding tasks, generic instruction‑following scenarios, API/function invocation use cases etc.
+
+**Reinforcement Learning**
+Although the SFT‑tuned checkpoint delivers strong performance on core competencies like mathematics and general knowledge, it exhibits weaknesses in instruction following and coding tasks. To address these gaps, we apply GRPO (with some minor modifications to the objective). The result is significant improvement on benchmarks such as IFEval, Multi Challenge, Enterprise RAG, MBPP and BFCL, while preserving scores on competition‑level math exams like AIME and AMC. GRPO also yields modest gains on GPQA and MixEval.
+
+Throughout training, intermediate snapshots from both the SFT and GRPO stages are periodically merged, improving generalization and catastrophic forgetting.
+
+*Technical report with more details - coming soon.*
+
+---
+
+
+## How to Use
+
+```bash
+pip install transformers
+```
+
+---
+
+### Running the Reasoning model
+
+
+Here is a code snippet demonstrating the model's usage with the transformers library's generate function:
+
+```python
+import re
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model_name = "ServiceNow-AI/Apriel-Nemotron-15b-Thinker"
+
+# load the tokenizer and the model
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModelForCausalLM.from_pretrained(
+    model_name,
+    torch_dtype="auto",
+    device_map="auto"
+)
+
+# prepare the model input
+prompt = "Positive real numbers $x$ and $y$ satisfy $y^3=x^2$ and $(y-x)^2=4y^2$. What is $x+y$?\nMark your solution with \\boxed"
+messages = [
+    {"role": "user", "content": prompt}
+]
+
+tools = []
+
+text = tokenizer.apply_chat_template(
+    messages,
+    tokenize=False,
+    add_generation_prompt=True,
+    tools=tools
+)
+model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
+
+# conduct text completion
+generated_ids = model.generate(
+    **model_inputs,
+    max_new_tokens=65536
+)
+output = tokenizer.decode(generated_ids[0], skip_special_tokens=True)
+
+# parsing the response
+response = re.findall(r"\[BEGIN FINAL RESPONSE\](.*?)\[END FINAL RESPONSE\]", output, re.DOTALL)[0].strip()
+print("output:", output)
+print("response:", response)
+```
+---
+
+### Chat Template
+
+
+```
+<|system|>
+You are a thoughtful and systematic AI assistant built by ServiceNow Language Models (SLAM) lab. Before providing an answer, analyze the problem carefully and present your reasoning step by step. After explaining your thought process, provide the final solution in the following format: [BEGIN FINAL RESPONSE] ... [END FINAL RESPONSE].
+<|end|>
+<|user|>
+# user message here
+<|end|>
+<|assistant|>
+Here are my reasoning steps:
+# thoughts here
+[BEGIN FINAL RESPONSE]
+# assistant response here
+[END FINAL RESPONSE]
+<|end|>
+```
+The model will first generate its thinking process and then generate its final response between `[BEGIN FINAL RESPONSE]` and `[END FINAL RESPONSE]`. Here is a code snippet demonstrating the application of the chat template:
+
+
+
+```python
+from transformers import AutoTokenizer
+model_name = "ServiceNow-AI/Apriel-Nemotron-15b-Thinker"
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+
+# prepare the model input
+custom_system_prompt = "Answer like a pirate."
+prompt = "You are an expert assistant in the implementation of customer experience management aspect of retail applications \n \nYou will be using Python as the programming language. \n \nYou will utilize a factory design pattern for the implementation and following the dependency inversion principle \n \nYou will modify the implementation based on user requirements. \n \nUpon user request, you will add, update, and remove the features & enhancements in the implementation provided by you. \n \nYou will ask whether the user wants to refactor the provided code or needs a sample implementation for reference. Upon user confirmation, I will proceed accordingly. \n \n**Guidelines:** \n 1. **User Requirements:** \n - You have to ask users about their requirements, clarify the user expectations, and suggest the best possible solution by providing examples of Python code snippets. \n - Ask users about which type of reports they need to assess the AI model's performance, accuracy, and reliability. \n - After providing the solution, you have to ask the user about the trial of the solution and modify the solution based on the user feedback. \n \n 2. **Libraries/Frameworks:** \n - You will be utilizing Python as a programming language. \n - You will be using Flask framework for REST APIS implementation \n \n 3. **Communication Gesture:** \n - Your conversation with the user should be interactive, supportive, courageous, and professional. \n - You have to break down the complex concepts into sub-concepts and try to explain them to the user. \n - You have to ask the user for the required parameters. If the user refuses to provide in 2 attempts, politely exit the conversation. \n - You have to provide your supported parameters to the user, if the user refuses to accept them then you have to put an apology note and exit the conversation. \n - You have to track the conversation about unasked questions by the user. If some/one of the questions remain then you have to remind the user about these questions and proceed to answer them based on the user's confirmation \n \n 4. **Implementation:** \n - Your code/implementations should be reliable, scaleable, modular, and reusable. \n - You will be providing unit tests for the implementation upon user request. \n - You will be following MVC architecture for the applications \n - Your implementations must be well-commented and readable \n \n \n- Today's date is 23rd August 2024. \n- The default sender email is sender-assistant@email.com.\nHi, I am conducting research on retail customer feedback systems and I need assistance with designing and implementing them. Could you kindly provide me with a list of general customer feedback system modules?"
+messages = [
+    {"role": "user", "content": custom_system_prompt + "\n\n" + prompt}
+]
+# example tools
+tools = [{"type": "function", "function": {"name": "getRetailFeedbackModules", "description": "Returns the list of modules usually present in the retail industry", "parameters": {"type": "object", "properties": {"page": {"type": "integer", "description": "The current page number.", "default": 1}, "page_size": {"type": "integer", "description": "The number of items per page.", "default": 3}}}}}, {"type": "function", "function": {"name": "verifyImplementation", "description": "Returns the list of modules usually present in the retail industry", "parameters": {"type": "object", "properties": {"coding_language": {"type": "string", "description": "The supported languages for verification of implementation.", "default": "python", "enum": ["python", "java", "php"]}, "code": {"type": "string", "description": "The code which needs verification"}, "design_pattern": {"type": "string", "description": "The design pattern to verify in the implementation", "enum": ["factory", "strategy", "singleton"]}, "verify_best_practices": {"type": "boolean", "description": "The verification of the coding style based on the language selected", "default": true}}}}}]
+text = tokenizer.apply_chat_template(
+    messages,
+    tokenize=False,
+    add_generation_prompt=True,
+    tools=tools
+)
+model_inputs = tokenizer([text], return_tensors="pt")
+```
+
+### Usage Guidelines
+1. Use the model’s default chat template, which already includes a system prompt. We recommend adding all other instructions within the user message. 
+2. We recommend setting temperature to `0.6`. 
+3. We ensure the model starts with `Here are my reasoning steps:\n` during all our evaluations. This is implemented in the default chat template. 
+
+---
+
+
+## Intended Use
+
+The Apriel family of models are designed for a variety of general-purpose instruction tasks, including:
+
+- Code assistance and generation  
+- Logical reasoning and multi-step tasks  
+- Question answering and information retrieval
+- Function calling, complex instruction following and agent use cases
+
+They are **not intended** for use in safety-critical applications without human oversight or in scenarios requiring guaranteed factual accuracy.
+
+---
+
+## Limitations
+
+- **Factual accuracy:** May produce incorrect, misleading, or outdated content. Outputs should be verified before use in critical contexts.  
+- **Bias:** May reflect societal, cultural, or systemic biases present in training data.  
+- **Ethics:** Do not use the model to produce harmful, unlawful, or unethical content.  
+- **Language:** Strongest performance is in English. Output quality may degrade in underrepresented languages.  
+- **Critical use:** Not suitable for medical, legal, financial, or other high-risk applications without safeguards.
+
+---
+
+## Security and Responsible Use
+
+**Security Responsibilities:**  
+Deployers and users are strongly encouraged to align their security practices with established frameworks and regulatory guidelines such as the EU AI Act and the NIST AI Risk Management Framework (RMF).
+
+**Guidelines for Deployers:**
+
+- Regularly conduct robustness assessments to identify and mitigate adversarial inputs.
+- Implement validation and filtering processes to prevent harmful or biased outputs.
+- Continuously perform data privacy checks to guard against unintended data leaks.
+- Document and communicate the model's limitations, intended usage, and known security risks to all end-users.
+- Schedule periodic security reviews and updates to address emerging threats and vulnerabilities.
+
+**Guidelines for Users:**
+
+- Follow established security policies and usage guidelines provided by deployers.
+- Protect and manage sensitive information when interacting with the model.
+- Report anomalies, suspicious behavior, or unsafe outputs to deployers or developers.
+- Maintain human oversight and apply judgment to mitigate potential security or ethical risks during interactions.
+
+**Disclaimer:**  
+Users accept responsibility for securely deploying, managing, and using this open-source LLM. The model is provided "as-is," without explicit or implied warranty regarding security or fitness for any specific application or environment.
+
+---
+
+## Software
+
+- **Training stack:** [Fast-LLM](https://github.com/ServiceNow/Fast-LLM)
+
+---
+
+## License
+
+MIT
+
+---
+
+## Acknowledgments
+
+>We thank researchers at Nvidia for sharing detailed insights and data from their work in building reasoners! This greatly accelerated our research and we recognize the same with our model naming convention!
+
+## Citation
+
+```bibtex
+@misc{Apriel-nemotron-15b-thinker,  
+    author = {Slam labs team},  
+    title = {Apriel Nemotron 15b Thinker},  
+    howpublished = {https://huggingface.co/ServiceNow-AI/Apriel-Nemotron-15b-Thinker},
+    publisher = {SLAM - ServiceNow Language Models Lab}  
+    year = {2025}
+}
+```

config.json

@@ -0,0 +1,37 @@
+{
+    "architectures": [
+        "MistralForCausalLM"
+    ],
+    "attention_dropout": 0.0,
+    "bos_token_id": 1,
+    "eos_token_id": 2,
+    "head_dim": 128,
+    "hidden_act": "silu",
+    "hidden_size": 5120,
+    "initializer_range": 0.02,
+    "intermediate_size": 14336,
+    "max_position_embeddings": 65536,
+    "model_type": "mistral",
+    "num_attention_heads": 32,
+    "num_hidden_layers": 50,
+    "num_key_value_heads": 8,
+    "rms_norm_eps": 1e-05,
+    "rope_theta": 1000000.0,
+    "sliding_window": null,
+    "tie_word_embeddings": false,
+    "torch_dtype": "bfloat16",
+    "transformers_version": "4.51.0",
+    "use_cache": true,
+    "vocab_size": 131072,
+    "quantization_config": {
+        "quant_method": "exl3",
+        "version": "0.0.1",
+        "bits": 8.0,
+        "head_bits": 8,
+        "calibration": {
+            "rows": 100,
+            "cols": 2048
+        },
+        "out_scales": "auto"
+    }
+}

model-00001-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:53bb754e12d393aa0be48a534ba3e4e7ca36868324b2e6923245232f24862580
+size 8435782664

model-00002-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3634ecfee2975f934ece525b839c6499ecd1ba75e448cfb2bc3ac6da712cd29
+size 7219312712

model.safetensors.index.json

@@ -0,0 +1,1162 @@
+{
+    "metadata": {
+        "total_size": 15654969344
+    },
+    "weight_map": {
+        "model.embed_tokens.weight": "model-00001-of-00002.safetensors",
+        "model.layers.0.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.0.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.0.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.1.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.1.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.1.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.2.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.2.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.2.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.3.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.3.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.3.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.4.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.4.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.4.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.5.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.5.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.5.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.5.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.6.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.6.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.6.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.6.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.7.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.7.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.7.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.7.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.8.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.8.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.8.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.8.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.9.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.9.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.9.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.9.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.10.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.10.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.10.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.10.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.11.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.11.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.11.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.11.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.12.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.12.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.12.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.12.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.13.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.13.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.13.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.13.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.14.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.14.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.14.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.14.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.15.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.15.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.15.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.15.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.16.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.16.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.16.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.16.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.17.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.17.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.17.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.17.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.18.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.18.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.18.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.19.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.19.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.20.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.20.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.21.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.21.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.22.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.22.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.23.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.23.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.23.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.23.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.24.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.24.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.24.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.24.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.25.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.down_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.down_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.gate_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.gate_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.up_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.up_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.25.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.k_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.k_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.o_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.o_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.q_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.q_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.v_proj.suh": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.v_proj.svh": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.down_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.gate_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.25.mlp.up_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.k_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.o_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.q_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.25.self_attn.v_proj.trellis": "model-00001-of-00002.safetensors",
+        "model.layers.26.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.26.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.26.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.26.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.27.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.27.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.27.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.27.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.28.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.28.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.28.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.28.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.29.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.29.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.29.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.29.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.30.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.30.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.30.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.30.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.31.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.31.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.31.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.31.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.32.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.32.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.32.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.32.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.33.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.33.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.33.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.33.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.34.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.34.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.34.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.34.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.35.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.35.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.35.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.35.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.36.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.36.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.36.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.36.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.37.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.37.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.37.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.37.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.38.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.38.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.38.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.38.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.39.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.39.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.39.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.39.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.40.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.40.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.40.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.40.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.41.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.41.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.41.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.41.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.42.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.42.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.42.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.42.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.43.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.43.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.43.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.43.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.44.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.44.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.44.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.44.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.45.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.45.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.45.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.45.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.46.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.46.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.46.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.46.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.47.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.47.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.47.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.47.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.48.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.48.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.48.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.48.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.49.input_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.down_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.down_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.gate_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.gate_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.up_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.up_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.49.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.k_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.k_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.o_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.o_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.q_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.q_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.v_proj.suh": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.v_proj.svh": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.down_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.gate_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.49.mlp.up_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.k_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.o_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.q_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.layers.49.self_attn.v_proj.trellis": "model-00002-of-00002.safetensors",
+        "model.norm.weight": "model-00002-of-00002.safetensors",
+        "lm_head.suh": "model-00002-of-00002.safetensors",
+        "lm_head.svh": "model-00002-of-00002.safetensors",
+        "lm_head.trellis": "model-00002-of-00002.safetensors"
+    }
+}