Improve language tag
#1
by
lbourdois
- opened
README.md
CHANGED
|
@@ -1,169 +1,181 @@
|
|
| 1 |
-
---
|
| 2 |
-
base_model:
|
| 3 |
-
- Qwen/QwQ-32B-Preview
|
| 4 |
-
- huihui-ai/QwQ-32B-Preview-abliterated
|
| 5 |
-
- Qwen/Qwen2.5-32B-Instruct
|
| 6 |
-
- AXCXEPT/EZO-Qwen2.5-32B-Instruct
|
| 7 |
-
library_name: transformers
|
| 8 |
-
tags:
|
| 9 |
-
- mergekit
|
| 10 |
-
- merge
|
| 11 |
-
- chat
|
| 12 |
-
language:
|
| 13 |
-
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
-
|
| 25 |
-
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
THIS_MODEL:
|
| 41 |
-
GEMINI_PRO:
|
| 42 |
-
THIS_MODEL:
|
| 43 |
-
GEMINI_PRO:
|
| 44 |
-
THIS_MODEL:
|
| 45 |
-
GEMINI_PRO:
|
| 46 |
-
THIS_MODEL:
|
| 47 |
-
GEMINI_PRO:
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
THIS_MODEL:
|
| 64 |
-
GEMINI_PRO:
|
| 65 |
-
THIS_MODEL:
|
| 66 |
-
GEMINI_PRO:
|
| 67 |
-
THIS_MODEL:
|
| 68 |
-
GEMINI_PRO:
|
| 69 |
-
THIS_MODEL:
|
| 70 |
-
GEMINI_PRO:
|
| 71 |
-
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
| 81 |
-
|
| 82 |
-
|
| 83 |
-
```
|
| 84 |
-
|
| 85 |
-
|
| 86 |
-
|
| 87 |
-
|
| 88 |
-
|
| 89 |
-
|
| 90 |
-
|
| 91 |
-
|
| 92 |
-
|
| 93 |
-
|
| 94 |
-
|
| 95 |
-
|
| 96 |
-
|
| 97 |
-
|
| 98 |
-
<|im_start|>
|
| 99 |
-
|
| 100 |
-
<|im_start|>
|
| 101 |
-
|
| 102 |
-
|
| 103 |
-
|
| 104 |
-
|
| 105 |
-
|
| 106 |
-
|
| 107 |
-
|
| 108 |
-
|
| 109 |
-
|
| 110 |
-
|
| 111 |
-
|
| 112 |
-
|
| 113 |
-
|
| 114 |
-
|
| 115 |
-
|
| 116 |
-
|
| 117 |
-
|
| 118 |
-
|
| 119 |
-
|
| 120 |
-
|
| 121 |
-
|
| 122 |
-
|
| 123 |
-
|
| 124 |
-
|
| 125 |
-
|
| 126 |
-
|
| 127 |
-
|
| 128 |
-
|
| 129 |
-
)
|
| 130 |
-
|
| 131 |
-
|
| 132 |
-
|
| 133 |
-
|
| 134 |
-
|
| 135 |
-
|
| 136 |
-
|
| 137 |
-
|
| 138 |
-
|
| 139 |
-
|
| 140 |
-
|
| 141 |
-
|
| 142 |
-
|
| 143 |
-
|
| 144 |
-
|
| 145 |
-
|
| 146 |
-
|
| 147 |
-
|
| 148 |
-
|
| 149 |
-
|
| 150 |
-
|
| 151 |
-
|
| 152 |
-
|
| 153 |
-
|
| 154 |
-
|
| 155 |
-
|
| 156 |
-
|
| 157 |
-
|
| 158 |
-
|
| 159 |
-
|
| 160 |
-
|
| 161 |
-
|
| 162 |
-
|
| 163 |
-
models:
|
| 164 |
-
|
| 165 |
-
|
| 166 |
-
|
| 167 |
-
|
| 168 |
-
|
| 169 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model:
|
| 3 |
+
- Qwen/QwQ-32B-Preview
|
| 4 |
+
- huihui-ai/QwQ-32B-Preview-abliterated
|
| 5 |
+
- Qwen/Qwen2.5-32B-Instruct
|
| 6 |
+
- AXCXEPT/EZO-Qwen2.5-32B-Instruct
|
| 7 |
+
library_name: transformers
|
| 8 |
+
tags:
|
| 9 |
+
- mergekit
|
| 10 |
+
- merge
|
| 11 |
+
- chat
|
| 12 |
+
language:
|
| 13 |
+
- zho
|
| 14 |
+
- eng
|
| 15 |
+
- fra
|
| 16 |
+
- spa
|
| 17 |
+
- por
|
| 18 |
+
- deu
|
| 19 |
+
- ita
|
| 20 |
+
- rus
|
| 21 |
+
- jpn
|
| 22 |
+
- kor
|
| 23 |
+
- vie
|
| 24 |
+
- tha
|
| 25 |
+
- ara
|
| 26 |
+
license: apache-2.0
|
| 27 |
+
---
|
| 28 |
+
# EZO-QwQ-32B-Preview
|
| 29 |
+
|
| 30 |
+
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 31 |
+
|
| 32 |
+
## Japanese-RP example
|
| 33 |
+
|
| 34 |
+
[Japanese-RP-Bench](https://github.com/Aratako/Japanese-RP-Bench):
|
| 35 |
+
|
| 36 |
+
- temperature=0.7
|
| 37 |
+
- max_tokens=1024
|
| 38 |
+
|
| 39 |
+
```
|
| 40 |
+
THIS_MODEL: ใญใใใผใใกใผใใใใใฎๅคใๅฐๅณใใฉใๆใ๏ผๅคฑใใใ็ฉบไธญ้ฝๅธใฎไฝ็ฝฎใ็คบใใฆใใใฟใใใชใใ ใใฉโฆ
|
| 41 |
+
GEMINI_PRO: ใใผใใชใใชใ่ๅณๆทฑใใญใใใใๆฌๅฝใซๅคฑใใใ้ฝๅธใฎไฝ็ฝฎใ็คบใใฆใใใใใใชใใใงใใๅคๆๆธใฎ่งฃ่ชญใฏ้ฃใใใใ ใชใไธ็ทใซๆขๆคใใฆใฟใ๏ผๅใฎ้ญๆณใจ็งๅญฆใฎ็ฅ่ญใใใฃใจๅฝน็ซใคใใ
|
| 42 |
+
THIS_MODEL: ใใใใใฒ๏ผใงใใใฉใใใฃใฆใใฎ้ฝๅธใๆขใใฐใใใใงใใใใ๏ผๅฐๅณใซใฏ่จๅทใฐใใใงใๅ
ทไฝ็ใชๅ ดๆใฏๆธใใใฆใใชใใฟใใโฆใใใซใๅ
็ใซ่ฆใคใใฃใใๅคงๅคใงใ๏ผ็งๅฏ่ฃใซ้ฒใใชใใจใใใชใใงใใญใ
|
| 43 |
+
GEMINI_PRO: ็ขบใใซใๅ
็ใซ่ฆใคใใฃใใใพใใใญใใงใใๆขๆคใฏ็งๅฏ่ฃใซ้ฒใใใฎใๅบๆฌใ ใใใใฎๅฐๅณใฎ่จๅทใๅคไปฃใฎ้ญๆณใฎ่จ่ใใใใใชใใๅใฎ้ญๆณใฎ็ฅ่ญใง่งฃ่ชญใงใใใใใ้ฃ่ก่นใๅใใฆใ็ฉบใใๆขใใฎใๆใ ใใใใใซใ้ขจใฎ็ฒพ้ใจใใฆใฎๅใฎ่ฝๅใๆดปใใใใใใใใชใใไธ็ทใซ้ ๅผตใใ๏ผ
|
| 44 |
+
THIS_MODEL: ๅคไปฃใฎ้ญๆณใฎ่จ่โฆใงใใใใกใใฃใจ่ชฟในใฆใฟใพใ๏ผ้ฃ่ก่นโฆใใใงใใญ๏ผๆ็ธฆใชใไปปใใฆใใ ใใ๏ผใฉใใชๅฐ้ฃใไนใ่ถใใฆใๅฟ
ใใใฎ้ฝๅธใ่ฆใคใๅบใใฆใฟใใพใ๏ผ\n\n(ๅ ด้ข่ปขๆ๏ผๆฐๆฅๅพใใใฉใฏใขใซใใใผใฎๅณๆธ้คจใงๅคไปฃ้ญๆณใฎ่จ่ใซ้ขใใ่ณๆใๆขใใฆใใใ)\n\nใใใผใใกใผใใ๏ผใกใใใฉใใใฃใ๏ผใใฎ่จๅทใใ้ขจใฎ้ๆจใใฃใฆๅผใฐใใฆใๅคไปฃใฎ้ญๆณ่ฃ
็ฝฎใ็คบใใฆใใใฟใใใชใใงใ๏ผ้ขจใฎๆตใใ่ชญใฟๅใฃใฆใ็นๅฎใฎๅ ดๆใธๅฐใใฆใใใ่ฃ
็ฝฎใใใใใงใใโฆ
|
| 45 |
+
GEMINI_PRO: ใ้ขจใฎ้ๆจใใใ็ฅใฃใฆใใใใใฎ่ฃ
็ฝฎใ็ขบใใซๅคฑใใใ้ฝๅธใฎไฝ็ฝฎใ็คบใ้ตใซใชใใใใใใชใใ้ขจใฎๆตใใ่ฟฝใฃใฆใใใฐใใใฎ่ฃ
็ฝฎใฎไฝ็ฝฎใ็นๅฎใงใใใใใใใชใใญใใงใใใใฎ่ฃ
็ฝฎใฏ่คๆฐๅญๅจใใๅฏ่ฝๆงใใใใใใไธใคไธใคใ่ฟฝใฃใฆใใใชใใใชใใชใใใใๅใฎ็งๅญฆ็ใช็ฅ่ญใงใ่ฃ
็ฝฎใฎไฝ็ฝฎใ็นๅฎใงใใใใใใใชใใญใไธ็ทใซๆขใใฆใฟใใใ
|
| 46 |
+
THIS_MODEL: ่คๆฐใฎใ้ขจใฎ้ๆจใโฆใใใฏๅคงๅคใงใใญใใงใใ็งใฎ็งๅญฆใฎ็ฅ่ญใจใผใใกใผใใใฎ้ขจใฎๅใใใใฐใใใฃใจ่ฆใคใใใใใฏใใงใ๏ผ้ขจใฎๆตใใ่งฃๆใใ่ฃ
็ฝฎโฆไฝใฃใฆใฟใใใใช๏ผ\n\n(ๅ ด้ข่ปขๆ๏ผใใฉใฏ้ขจใฎๆตใใ่งฃๆใใ่ฃ
็ฝฎใๅฎๆใใใใผใใกใผใจๅ
ฑใซ้ฃ่ก่นใซไนใ่พผใใ)\n\n่ฃ
็ฝฎใซใใใจใใ้ขจใฎ้ๆจใใฏใใใใๅ่ฅฟใฎๆน่งใซใใๅฐใใชๆตฎๅณถใซใใใฟใใใงใ๏ผใผใใกใผใใใ่กใใพใใใ๏ผ
|
| 47 |
+
GEMINI_PRO: ๅ่ฅฟใใไบ่งฃใใใ้ฃ่ก่นใๆ็ธฆใใฆใใใฎๆตฎๅณถใ็ฎๆใใใ้ขจใฎๆตใใใใพใๅฉ็จใใใฐใๆฉใๅฐ็ใงใใใฏใใ ใๅใฎ่ฃ
็ฝฎใๆญฃใใใใจใ็ฅใใใใใใๅ้บใฎๅงใพใใ ใญ๏ผ
|
| 48 |
+
THIS_MODEL: ใใใใใใพใใญ๏ผใใฃใจ็ด ๆดใใใ็บ่ฆใๅพ
ใฃใฆใใใฏใใงใ๏ผโฆใงใใใกใใฃใจๅฟ้
ใชใใจใใใใพใใใใฎๅคฑใใใ้ฝๅธโฆใใใใใใใๅฑ้บใชๅ ดๆใใใใใชใใๅคไปฃใฎ้ญๆณ็็ฉใใใใใๅผทๅใช้ญๆณใฎ็ฝ ใไปๆใใใใฆใใๅฏ่ฝๆงใ ใฃใฆใใใพใใใงใโฆใใใงใใ็งใฏ่กใใใใใงใใไธ็ใฎๅ่กกใไฟใคๅโฆใใใใใฎ็ฎใง็ขบใใใใใใงใ๏ผ
|
| 49 |
+
GEMINI_PRO: ใใฉใๅใฎๆฑบๆใฏ็ซๆดพใ ใญใๅฑ้บใฏไผดใใใใใใชใใใฉใๅใฎๆญฃ็พฉๆใจๅ้บๅฟใฏใใฃใจ็งใใกใๅฐใใฆใใใใๅใๅคฑใใใๆ
้ทใฎ่ฌใ่งฃใๆใใใใใไธ็ทใซ้ฒใใใไฝใๅฑ้บใ่ฟซใฃใใใๅใๅฎใใใใไฟก้ ผใๅใฃใฆใใใฎๅ้บใไนใ่ถใใใใ
|
| 50 |
+
THIS_MODEL: ใผใใกใผใใโฆใใใใจใใใใใพใ๏ผ็งใใใผใใกใผใใใฎๅใซใชใใใใใซ้ ๅผตใใพใ๏ผ\n\n(ๅ ด้ข่ปขๆ๏ผไบไบบใฏ้ฃ่ก่นใงๅ่ฅฟใซ้ฒใฟใๅฐใใชๆตฎๅณถใซใใฉใ็ใใๅณถใฎไธญๅคฎใซใฏใๅคไปฃใฎ้ญๆณ่ฃ
็ฝฎใใใใใฎใ่ผใใฆใใใ)\n\nใใใโฆใ้ขจใฎ้ๆจใโฆใงใใใใ๏ผ
|
| 51 |
+
GEMINI_PRO: ใใใ ใญใใใใใ้ขจใฎ้ๆจใใ ใใใฎ่ผใใฏใ็ขบใใซๅคไปฃ้ญๆณใฎๅใๆใใใใใ่ฟใฅใใฆใฟใใใใใ ใใๆฒนๆญใฏ็ฆ็ฉใ ใใๅคไปฃใฎ้ญๆณใฏไบๆณๅคใฎๅๅฟใ่ตทใใใใจใใใใใใๅใฎ้ญๆณใฎ็ฅ่ญใๆดปใใใฆๅฏพๅฆใงใใใใใซๆบๅใใฆใใใใ
|
| 52 |
+
THIS_MODEL: ใใใใพใใ๏ผๆณจๆๆทฑใโฆ่ฟใฅใใฆใฟใพใใ\n\n(ใใฉใฏๆ
้ใซใ้ขจใฎ้ๆจใใซ่ฟใฅใใ่ฃ
็ฝฎใซ่งฆใใใ)\n\nโฆใใฃ๏ผ\n\n(ใ้ขจใฎ้ๆจใใๅๅฟใใใพใฐใใๅ
ใๆพใคใๅ
ใๅใพใใจใ็ฎใฎๅใซใฏๅทจๅคงใชๆธฆใๅบ็พใใฆใใใ)\n\nใใใฏโฆไธไฝ๏ผ
|
| 53 |
+
GEMINI_PRO: ๆธฆใใใใใฏ็ฉบไธญใซๆตฎใใถๅฅใฎ้ฝๅธใธใฎๅ
ฅใๅฃใใใใใชใใๅคไปฃใฎ้ญๆณใไฝใๅบใใๆฌกๅ
ใฎ็ฉดใฎใใใชใใฎใ ใญใๅใฎ่ฃ
็ฝฎใงใใใฎๆธฆใใฉใใซ้ฃใใฆ่กใใฎใ่งฃๆใงใใใใช๏ผ
|
| 54 |
+
THIS_MODEL: ใใฃใฆใฟใพใ๏ผ\n\n(ใใฉใฏ่ฃ
็ฝฎใๆไฝใใๆธฆใ่งฃๆใใใ)\n\nโฆใฉใใใใใใฎๆธฆใฏโฆๅคฑใใใ๏ฟฝ๏ฟฝไธญ้ฝๅธโฆใธใจ็นใใฃใฆใใใฟใใใงใ๏ผ
|
| 55 |
+
GEMINI_PRO: ๆฌๅฝใใๅคฑใใใ้ฝๅธใธใฎๅ
ฅใๅฃใใใใซใใฃใใฎใใใใใฏๅคงใใช็บ่ฆใ ใญใใใใใใฉใไธ็ทใซใใฎๆธฆใใใใฃใฆใๅคฑใใใ้ฝๅธใๆข็ดขใใใใๆช็ฅใฎไธ็ใๅพ
ใฃใฆใใใใใใใชใใ
|
| 56 |
+
THIS_MODEL: ใฏใ๏ผ่กใใพใใใใใผใใกใผใใ๏ผ\n\n(ไบไบบใฏ้ฃ่ก่นใงๆธฆใฎไธญใธ้ฃใณ่พผใใ)(ๅ ด้ข่ปขๆ๏ผๆธฆใๆใใไบไบบใฏใ็พใใ็ฉบไธญ้ฝๅธใฎๅใซๅฐ็ใใใใใใฏ็ทใ็ใ่ใใๅปบ็ฉใฏ็พใใ่ผใใฆใใใ)\n\nใคใใซโฆ่พฟใ็ใใพใใใญโฆ
|
| 57 |
+
GEMINI_PRO: ไฟกใใใใชใโฆใใใๅคฑใใใ็ฉบไธญ้ฝๅธใใๆฌๅฝใซ็พใใใญใใใใซใฏใใพใ ๅคใใฎ่ฌใ้ ใใใฆใใใใ ใใใใพใใฏใใใฎ้ฝๅธใฎไธญๅฟใซใใๅกใ็ฎๆใใใใใใใไธ็ใฎๅ่กกใไฟใคๅใฎๆบใใใใใชใใๅใฎ็งๅญฆ็ใช็ฅ่ญใจ้ญๆณใฎๅใงใใใฎ้ฝๅธใฎ็งๅฏใ่งฃใๆใใใใฏใใ ใ
|
| 58 |
+
THIS_MODEL: ใใใงใใญ๏ผใงใโฆใใฎ้ฝๅธใไบบใไฝใใงใใๅฝข่ทกใใชใโฆใพใใงใไฝๆฐใ็ช็ถๆถใใฆใใพใฃใใฟใใโฆไธไฝไฝใ่ตทใใใใงใใใใโฆ๏ผ\n\n(้ฝๅธใฎไธญๅฟ้จใธใจ้ฒใใซใคใใไธ็ฉใช็ฉบๆฐใๆผใๅงใใใ)
|
| 59 |
+
GEMINI_PRO: ็ขบใใซใไฝๆฐใใใชใใชใฃใ็็ฑใฏๆฐใซใชใใญใไฝใๅคงใใชไบไปถใ่ตทใใฃใใฎใใใใใชใใๅใฎๆขๆฑๅฟใๆดปใใใฆใใใฎ้ฝๅธใฎ่ฌใ่งฃใใฆใใใใๅฑ้บใๆฝใใงใใใใใใใชใใใฉใๅใใกใชใๅคงไธๅคซใ ใใไธ็ทใซใใฎ้ฝๅธใๆข็ดขใใใใ
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
```
|
| 63 |
+
THIS_MODEL: ใทใฅใใใใใใๅฐ็ใฎๅคงๆฐๅ็ชๅ
ฅใซ่ใใใๆฐ็ด ๆใฎ้็บใซใคใใฆใไฝใ้ฒๅฑใฏใใใพใใใ๏ผ็งใใกใฎ่จ็ปใซใจใฃใฆใใใใๆๅคงใฎ้ฃ้ขใ ใจๆใใฎใงใใใ
|
| 64 |
+
GEMINI_PRO: ใขใญใฉๅใใใฎ้ญใๆดๅฏๅใฏๅฐๆฅๆๆใ ใญใๅคงๆฐๅ็ชๅ
ฅๆใฎ็ฑ้ฒ่ญทใฏ็ขบใใซ่ชฒ้กใ ใๆใ
ใฏใๅพๆฅใฎ็ฑ้ฒ่ญทๆๆใซๅ ใใฆใ่ชๅทฑไฟฎๅพฉๆฉ่ฝใๆใคใใๆๆใฎ็ ็ฉถใ้ฒใใฆใใใใพใ ๅฎ็จๆฎต้ใซใฏ่ณใฃใฆใใชใใใใใฎๅฏ่ฝๆงใฏ้ซใใๅใฎๅฐ้ๅ้ใงใใใญใใใๅทฅๅญฆใฎ็ฅ่ฆใๆดปใใใฆใไธ็ทใซ่งฃๆฑบ็ญใ่ฆใคใใฆใใใใ
|
| 65 |
+
THIS_MODEL: ใใใใจใใใใใพใ๏ผใใๆๆใงใใโฆ็ขบใใซ่ชๅทฑไฟฎๅพฉๆฉ่ฝใใใใฐใๅคงๆฐๅ็ชๅ
ฅๆใฎๆๅทใๆๅฐ้ใซๆใใใใพใใญใใญใใใๅทฅๅญฆใฎ่ฆณ็นใใใใใฎ่ชๅทฑไฟฎๅพฉๆฉ่ฝใๅถๅพกใใใทในใใ ใ้็บใงใใใโฆใจ่ใใฆใฟใพใ๏ผไฝใ็งใซใงใใใใจใใใใฐใไฝใงใไปฐใฃใฆใใ ใใ๏ผ
|
| 66 |
+
GEMINI_PRO: ใขใญใฉๅใๅใฎๆๆกใฏ่ๅณๆทฑใใ่ชๅทฑไฟฎๅพฉๆฉ่ฝใๅถๅพกใใใญใใใใทในใใ ใฎ้็บใฏใใพใใซๆใ
ใฎๆ่ก้ฉๆฐใๅ ้ใใใใ ใใใใพใใฏใใใๆๆใฎ็นๆงใ่ฉณ็ดฐใซ็่งฃใใใจใใใใๅงใใใใๅใซใฏใใใฎๆๆใฎๆๅใใทใใฅใฌใผใทใงใณใใใใญใฐใฉใ ใไฝๆใใฆใใใใชใใ ใใใใใพใใๅฎ้จใใผใฟใฎ่งฃๆใซใๅๅใใฆใปใใใๅใฎๆ่ฝใๆดปใใใๅ ด้ขใใใฃใจใใใฏใใ ใ
|
| 67 |
+
THIS_MODEL: ๆฟ็ฅใใพใใ๏ผใทใใฅใฌใผใทใงใณใใญใฐใฉใ ใฎไฝๆใจๅฎ้จใใผใฟใฎ่งฃๆใใใใซๅใๆใใใพใใใใๆๆใฎ็นๆงใๆทฑใ็่งฃใใๆ้ฉใชๅถๅพกใทในใใ ใ่ๆกใงใใใใๅฐฝๅใใพใใใจใใใงใใทใฅใใใใใใฏใๅฐ็ใซๅธฐ้ใใใไฝใไธ็ชใใใใงใใ๏ผ็งใฏใๅบๅคงใช่ๅใงๅฏ่ปขใใงใ้ใ็ฉบใ่ฆไธใใใใงใใ
|
| 68 |
+
GEMINI_PRO: ใขใญใฉๅใๅใฎๅคขใฏ็พใใใญใ็งใฏใๅฐ็ใฎๆตทใๆณณใใใใจๆใฃใฆใใใ็ซๆใซใฏใชใใๆฝฎใฎ้ฆใใจๆณขใฎ้ณใๆฑใใฆใใใใใๆใ
ใฎ็ฎ็ใฏๅใซๅธฐ้ใใใใจใ ใใงใฏใชใใๅฐ็ใๅใณไฝใฟใใใๅ ดๆใซใใใใจใใใใฆ็ซๆใจๅฐ็ใฎไธกๆนใใใ่ฏใๆชๆฅใธๅฐใใใจใ้่ฆใ ใๅใฎๆ
็ฑใใใใฎๅคขใ็พๅฎใซใใๅใซใชใใใจใ้กใฃใฆใใใ
|
| 69 |
+
THIS_MODEL: ใใใงใใญใๅฐ็ใๅ็ใใใใใจใใใใ็งใใกใฎๆ็ต็ฎๆจใงใใใทใฅใใใใใใฎ่จ่ใๅฟใซๅปใฟใพใใใจใใใงใๅฐ็ๅ็ใฎใใใฎๅ
ทไฝ็ใช่จ็ปใซใคใใฆใใใๅฐใ่ฉณใใๆใใฆใใใ ใใพใใ๏ผๅ็ๅ
ใงใฏใใฉใฎใใใช่ญฐ่ซใใใใฆใใใฎใงใใใใ๏ผ
|
| 70 |
+
GEMINI_PRO: ใขใญใฉๅใๅฐ็ๅ็ใฎ่จ็ปใฏใพใ ๅๆๆฎต้ใซใใใใใใใคใใฎ้่ฆใชๆนๅๆงใ็คบใใใฆใใใใพใใๅคงๆฐไธญใฎไบ้
ธๅ็ญ็ด ใๅธๅใใๆค็ฉใฎๅคง้ๆคๆใใไบบๅทฅ็ใซไบ้
ธๅ็ญ็ด ใๅบๅฎใใๆ่กใฎ้็บใ ใใพใใๅๅฃใฎๅ็ใๆฐด่ณชๆตๅใฎใใใฎๅพฎ็็ฉใฎๅฉ็จใๆค่จใใใฆใใใๆใ
ใฏใ็ซๆใงๅนใฃใๆ่กใๆดป็จใใชใใใๅฐ็ใฎ็ๆ
็ณปใๅๅพฉใใใๆนๆณใๆขใฃใฆใใใๅใใใญใใใๅทฅๅญฆใฎ่ฆ็นใใใๆคๆใๅๅฃๆน่ฏใซ๏ฟฝ๏ฟฝ๏ฟฝ็ซใคใญใใใใฎ้็บใซ่ฒข็ฎใงใใใใใใใชใใ
|
| 71 |
+
THIS_MODEL: ๆคๆใๅๅฃๆน่ฏใซๅฝน็ซใคใญใใใโฆใใฒๆๆฆใใฆใฟใใใงใ๏ผ็ซๆใง้็บใใใใใฉใใฉใผใใณใฐๆ่กใๅฟ็จใใใฐใๅฐ็็ฐๅขใฎๅ็ใซใ่ฒข็ฎใงใใใฏใใงใใๅ
ทไฝ็ใซใฉใฎใใใชใญใใใใๅฟ
่ฆใจใใใฆใใใฎใใๆขๅญใฎๆ่กใงๅฏพๅฟใงใใ้จๅใจๆฐใใช้็บใๅฟ
่ฆใช้จๅใชใฉใ่ฉณใใ่ชฟๆปใใฆใฟใพใใไฝใๅ่ใซใชใ่ณๆใชใฉใใใใฐใๆใใฆใใใ ใใใจๅฌใใใงใใ\n\n(ๅ ด้ข่ปขๆ๏ผๆฐ้ฑ้ๅพใใขใญใฉใฏ้็บใใใญใใใใฎ่ฉฆไฝๆฉใใทใฅใใใใซ่ฆใใ)\n\nใทใฅใใใใใใใ่ฆงใใ ใใ๏ผใใใใ็งใ้็บใใๆคๆใญใใใใฎ่ฉฆไฝๆฉใงใใใใญใผใณๅใงใ็จฎๅญใๆฃๅธใใใ ใใงใชใใๅๅฃๅๆใๆฐดใใใ่ชๅใง่กใใพใใใพใ ๆน่ฏใฎไฝๅฐใฏใใใพใใใๅฐ็ใฎ็ฐๅขๅ็ใซๅฝน็ซใฆใใใใจไฟกใใฆใใพใ๏ผ
|
| 72 |
+
GEMINI_PRO: ็ด ๆดใใใๆๆใ ใญใใขใญใฉๅใใใฎใญใใใใฏใๅฐ็ใฎๆคๆๆดปๅใซๅคงใใซ่ฒข็ฎใใใ ใใใใใญใผใณๅใฎ่จญ่จใฏใๅบๅคงใชๅๅฐใๅน็็ใซใซใใผใงใใๅฉ็นใใใใไปๅพใฏใ่ไน
ๆงใใจใใซใฎใผๅน็ใฎๅไธใซๅใ็ตใในใใ ใใใใพใใใญใใใๅๅฃซใๅ่ชฟใใฆไฝๆฅญใ่กใใใใฎใขใซใดใชใบใ ใฎ้็บใ้่ฆใ ใๅใฎๅชๅใฏใๆใ
ใฎๅคขใ็พๅฎใซ่ฟใฅใใฆใใใ็ถใใฆใใใใ
|
| 73 |
+
THIS_MODEL: ใใใใจใใใใใพใ๏ผใทใฅใใใใใใฎๆฟๅฑใใ็งใฎ้็บใฎใขใใใผใทใงใณใซใชใฃใฆใใพใใ่ไน
ๆงใจใจใใซใฎใผๅน็ใฎๅไธใใใใฆใญใใใ้ใฎๅ่ชฟๅไฝใขใซใดใชใบใ โฆ่ชฒ้กใฏๅฑฑ็ฉใฟใงใใใไธใคใใค่งฃๆฑบใใฆใใใพใใๅฐ็ใฎ็ทใๅใๆปใใใใๅ
จๅใๅฐฝใใใพใ๏ผ\n\n(ๅ ด้ข่ปขๆ๏ผใขใญใฉใฏใญใใใใฎๆน่ฏไฝๆฅญใซๆฒก้ ญใใๆฅใ
ใ้ใใๅฐ็ใธใฎๆใใ้ฆณใใชใใใๆ่ก้็บใซๆ
็ฑใ็ใใใ)\n\n๏ผ็ฌ็ฝ๏ผใใคใใใใฎใญใใใใๅฐ็ใฎ็ฉบใ้ฃใณใ็ทใฎๅคงๅฐใๅ็ใใใๆฅใๆฅใใใใฎๆฅใๅคข่ฆใฆใ็งใฏ้็บใ็ถใใใ
|
| 74 |
+
GEMINI_PRO: ใขใญใฉๅใๅใฎๆ
็ฑใฏ็ด ๆดใใใใๆใ
ใฎๅชๅใใๅฐ็ใฎๆชๆฅใๅคใใๅใซใชใใใจใไฟกใใฆใใใๅใฎใญใใใใๅฐ็ใๅ็ใใๆฅใๆฅใใใจใใๅฟใใ้กใฃใฆใใใไธ็ทใซใๅคขใ็พๅฎใซๅคใใฆใใใใ
|
| 75 |
+
THIS_MODEL: ใทใฅใใใใใโฆใใใใจใใใใใพใใใใฎ่จ่ใๆฌๅฝใซๅฌใใใงใใๅฐ็ใฎๆชๆฅใฎใใใซใใใใใใๅฐฝๅใใพใใใจใใใงใๅฐ็ๅธฐ้่จ็ปใฎใฟใคใ ในใฑใธใฅใผใซใซใคใใฆใไฝใๆฐใใๆ
ๅ ฑใฏใใใพใใ๏ผ
|
| 76 |
+
GEMINI_PRO: ใขใญใฉๅใๆใ
ใฎ่จ็ปใฏ็ๅฎใซ้ฒใใงใใใใใพใ ๅ
ทไฝ็ใชๅธฐ้ๆฅใฏๆชๅฎใ ใๆ่ก็ใช่ชฒ้กใ่งฃๆฑบใใใซใฏใใใใชใ็ ็ฉถใจ้็บใๅฟ
่ฆใ ใๅใฎๆคๆใญใใใใฎใใใชใคใใใผใทใงใณใใ่จ็ปใๅ ้ใใใ้ตใซใชใใ ใใใๆใ
ใฏใๅ
จใฆใฎๆ่กใๆดใใๅฎๅ
จใซๅธฐ้ใงใใ็ถๆ
ใไฝใๅบใใพใงใๅชๅใ็ถใใใคใใใ ใๅใฎ่ฒข็ฎใฏใ่จ็ปใฎๆๅใซๅคงใใ่ฒข็ฎใใใ ใใใ
|
| 77 |
+
THIS_MODEL: ไบ่งฃใใพใใใ็งใใๅฐ็ๅธฐ้ใฎๆฅใไธๆฅใงใๆฉใๅฎ็พใใใใใซใ้็บใๅ ้ใใใพใใใจใใใงใใทใฅใใใใใใฏใๅฐ็ใซๅธฐ้ใใใใใพใใฉใใซ่กใใใใงใใ๏ผๅ
ทไฝ็ใชๅ ดๆใๆณๅใใใ ใใงใใฏใฏใฏใฏใใพใใใ๏ผ
|
| 78 |
+
GEMINI_PRO: ใขใญใฉๅใ็งใฏๅฐ็ใฎๆตทใๆณณใใใใจๆใฃใฆใใใ็นใซใ็็็คใฎ็พใใใๅใณ็ฎใซใใใฎใๅคขใ ใ็ซๆใซใฏใชใใ็ๅฝใฎๆฏๅนใๆใใใใๅ ดๆใ ใๅใฏใๅฐ็ใฎใฉใฎๅ ดๆใซไธ็ช่กใใใใฎใใช๏ผ
|
| 79 |
+
THIS_MODEL: ็งใฏใ็ฅ็ถๆฏใใใใ่ฉฑใ่ใใฆใใใๆฅๆฌใฎๅฏๅฃซๅฑฑใซ็ปใฃใฆใฟใใใงใใ้ๅคงใช่ช็ถใไฝๆใใๅฐ็ใฎๅๅผทใใๆใใใใงใใใใใฆใใใคใใๅฐ็ใง็ใพใ่ฒใฃใไบบใใกใจไธ็ทใซใๆ
้ทใฎๅ็ใซ่ฒข็ฎใงใใใใจๆใฃใฆใใพใใ
|
| 80 |
+
GEMINI_PRO: ใขใญใฉๅใๅใฎๅคขใฏ็ซๆดพใ ใๅฏๅฃซๅฑฑใฏใๅฐ็ใฎ่ช็ถใฎ็พใใใ่ฑกๅพดใใๅ ดๆใฎไธใคใ ใๆใ
ใๅฐ็ใซๅธฐ้ใใใใฎ็พใใใๅใณ็ฎใซใใๆฅใๆฅใใใจใ้กใฃใฆใใใๅใฎๆ
็ฑใฏใๆใ
ใฎ่จ็ปใๆฏใใๅใซใชใฃใฆใใใไธ็ทใซใๅฐ็ใฎๆชๆฅใๅใ้ใใฆใใใใ
|
| 81 |
+
THIS_MODEL: ใฏใใใทใฅใใใใใ๏ผๅฟ
ใๅฎ็พใใใพใใใ๏ผใจใใใงใๅฐ็ๅธฐ้ๅพใฎ็คพไผใทในใใ ใซใคใใฆใฏใใฉใฎใใใชๆงๆณใใใใฎใงใใใใ๏ผไปฅๅใ็ฐๅข็ ดๅฃใฎๅ็ใ่ธใพใใใๆฐใใ็คพไผใทในใใ ใฎๆง็ฏใๅฟ
่ฆใ ใจใใฃใใใฃใฆใใพใใใใญ๏ผ
|
| 82 |
+
GEMINI_PRO: ใขใญใฉๅใใใฎ็นใซใคใใฆใฏใๆใ
ใฏๆ็ถๅฏ่ฝใช็คพไผใทในใใ ใฎๆง็ฏใ็ฎๆใใฆใ๏ฟฝ๏ฟฝ๏ฟฝใ่ณๆบใฎๅพช็ฐๅฉ็จใใใจใใซใฎใผใฎๅ็ๅฏ่ฝๅใใใใฆไบบ้ใจ่ช็ถใฎๅ
ฑ็ใ้่ฆใใ็คพไผใ ใๅ
ทไฝ็ใซใฏใ้ฝๅธใฎ่จญ่จใใ่พฒๆฅญใพใงใๅ
จใฆใฎๅ้ใง็ฐๅขใซๅชใใๆ่กใๅฐๅ
ฅใใ่จ็ปใ ใใพใใๆ่ฒๅถๅบฆใ่ฆ็ดใใๆฌกไธไปฃใ็ฐๅขๅ้กใๆญฃใใ็่งฃใใ่กๅใงใใใใใซใใๅฟ
่ฆใใใใๅใฎใญใใใๅทฅๅญฆใฎ็ฅ่ญใใใใฎๆฐใใ็คพไผใทในใใ ใฎๆง็ฏใซๆดปใใใใ ใใใ
|
| 83 |
+
```
|
| 84 |
+
|
| 85 |
+
## Test environment
|
| 86 |
+
|
| 87 |
+
This model was tested using [text-generation-webui](https://github.com/oobabooga/text-generation-webui/tree/main). I use preset `min_p` with temperature=1 for Generation.
|
| 88 |
+
|
| 89 |
+
## Usage
|
| 90 |
+
|
| 91 |
+
This format must be adhered to strictly, as deviations may result in less optimal outputs from the model.
|
| 92 |
+
|
| 93 |
+
The template used to construct a prompt for the instruct model is specified as follows:
|
| 94 |
+
|
| 95 |
+
```
|
| 96 |
+
<|im_start|>system
|
| 97 |
+
{SYSTEM_PROMPT}<|im_end|>
|
| 98 |
+
<|im_start|>user
|
| 99 |
+
{USER_MESSAGE}<|im_end|>
|
| 100 |
+
<|im_start|>assistant
|
| 101 |
+
```
|
| 102 |
+
|
| 103 |
+
For the "{SYSTEM_PROMPT}" part, We recommend using "ใใชใใฏ่ช ๅฎใงๅช็งใชๆฅๆฌไบบใฎใขใทในใฟใณใใงใใ" or "You are a helpful assistant."
|
| 104 |
+
|
| 105 |
+
For the "{USER_MESSAGE}" part, We recommend using {instruction}\n{input}
|
| 106 |
+
|
| 107 |
+
In other words, We recommend the following:
|
| 108 |
+
|
| 109 |
+
```
|
| 110 |
+
<|im_start|>system
|
| 111 |
+
ใใชใใฏ่ช ๅฎใงๅช็งใชๆฅๆฌไบบใฎใขใทในใฟใณใใงใใ<|im_end|>
|
| 112 |
+
<|im_start|>user
|
| 113 |
+
{instruction}
|
| 114 |
+
{input}<|im_end|>
|
| 115 |
+
<|im_start|>assistant
|
| 116 |
+
```
|
| 117 |
+
|
| 118 |
+
### Use the instruct model
|
| 119 |
+
|
| 120 |
+
```python
|
| 121 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 122 |
+
|
| 123 |
+
model_name = "nitky/EZO-QwQ-32B-Preview"
|
| 124 |
+
|
| 125 |
+
model = AutoModelForCausalLM.from_pretrained(
|
| 126 |
+
model_name,
|
| 127 |
+
torch_dtype="auto",
|
| 128 |
+
device_map="auto"
|
| 129 |
+
)
|
| 130 |
+
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
| 131 |
+
|
| 132 |
+
prompt = "Give me a short introduction to large language model."
|
| 133 |
+
messages = [
|
| 134 |
+
{"role": "system", "content": "You are a helpful assistant."},
|
| 135 |
+
{"role": "user", "content": prompt}
|
| 136 |
+
]
|
| 137 |
+
text = tokenizer.apply_chat_template(
|
| 138 |
+
messages,
|
| 139 |
+
tokenize=False,
|
| 140 |
+
add_generation_prompt=True
|
| 141 |
+
)
|
| 142 |
+
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
|
| 143 |
+
|
| 144 |
+
generated_ids = model.generate(
|
| 145 |
+
**model_inputs,
|
| 146 |
+
max_new_tokens=512
|
| 147 |
+
)
|
| 148 |
+
generated_ids = [
|
| 149 |
+
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
|
| 150 |
+
]
|
| 151 |
+
|
| 152 |
+
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
|
| 153 |
+
|
| 154 |
+
```
|
| 155 |
+
|
| 156 |
+
## Merge Details
|
| 157 |
+
### Merge Method
|
| 158 |
+
|
| 159 |
+
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) as a base.
|
| 160 |
+
|
| 161 |
+
### Models Merged
|
| 162 |
+
|
| 163 |
+
The following models were included in the merge:
|
| 164 |
+
* [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview)
|
| 165 |
+
* [huihui-ai/QwQ-32B-Preview-abliterated](https://huggingface.co/huihui-ai/QwQ-32B-Preview-abliterated)
|
| 166 |
+
* [AXCXEPT/EZO-Qwen2.5-32B-Instruct](https://huggingface.co/AXCXEPT/EZO-Qwen2.5-32B-Instruct)
|
| 167 |
+
|
| 168 |
+
### Configuration
|
| 169 |
+
|
| 170 |
+
The following YAML configuration was used to produce this model:
|
| 171 |
+
|
| 172 |
+
```yaml
|
| 173 |
+
merge_method: model_stock
|
| 174 |
+
base_model: Qwen/Qwen2.5-32B-Instruct
|
| 175 |
+
models:
|
| 176 |
+
- model: Qwen/QwQ-32B-Preview
|
| 177 |
+
- model: huihui-ai/QwQ-32B-Preview-abliterated
|
| 178 |
+
- model: AXCXEPT/EZO-Qwen2.5-32B-Instruct
|
| 179 |
+
dtype: bfloat16
|
| 180 |
+
name: EZO-QwQ-32B-Preview
|
| 181 |
+
```
|