Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -20,9 +20,9 @@ hierarchical state-space module. This removes TinyLlama's RoPE positional limit
|
|
| 20 |
2K tokens, Hallamonic does not.
|
| 21 |
|
| 22 |
This is the final checkpoint (`Phase 2`, full fine-tune, step 5000) from the
|
| 23 |
-
**Harmonic** paper
|
| 24 |
-
for code
|
| 25 |
-
architecture is based on.
|
| 26 |
|
| 27 |
## Result
|
| 28 |
|
|
|
|
| 20 |
2K tokens, Hallamonic does not.
|
| 21 |
|
| 22 |
This is the final checkpoint (`Phase 2`, full fine-tune, step 5000) from the
|
| 23 |
+
**Harmonic** paper: [arxiv.org/abs/2606.24650](https://arxiv.org/abs/2606.24650).
|
| 24 |
+
See [Omibranch/Harmonic](https://github.com/Omibranch/Harmonic) for code and the
|
| 25 |
+
small-scale (7M-112M param) Harmonic results this architecture is based on.
|
| 26 |
|
| 27 |
## Result
|
| 28 |
|