Update README.md
Browse files
README.md
CHANGED
|
@@ -27,7 +27,7 @@ library_name: transformers
|
|
| 27 |
</div>
|
| 28 |
<h1 style="margin-top: 0rem;">🌙 Kimi K2 Usage Guidelines</h1>
|
| 29 |
</div>
|
| 30 |
-
It is recommended to have at least
|
| 31 |
|
| 32 |
Set the temperature to 0.6 recommended) to reduce repetition and incoherence.
|
| 33 |
|
|
|
|
| 27 |
</div>
|
| 28 |
<h1 style="margin-top: 0rem;">🌙 Kimi K2 Usage Guidelines</h1>
|
| 29 |
</div>
|
| 30 |
+
It is recommended to have at least 128GB unified RAM memory to run the small quants. Expect 5+ tokens/sec.
|
| 31 |
|
| 32 |
Set the temperature to 0.6 recommended) to reduce repetition and incoherence.
|
| 33 |
|