Commit
·
90b5eb2
1
Parent(s):
086b093
Update README.md
Browse files
README.md
CHANGED
|
@@ -28,7 +28,7 @@ It is part of the **family of MosaicBERT-Base models** trained using ALiBi on di
|
|
| 28 |
* mosaic-bert-base-seqlen-1024
|
| 29 |
* [mosaic-bert-base-seqlen-2048](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-2048)
|
| 30 |
|
| 31 |
-
|
| 32 |
|
| 33 |
## Model Date
|
| 34 |
|
|
|
|
| 28 |
* mosaic-bert-base-seqlen-1024
|
| 29 |
* [mosaic-bert-base-seqlen-2048](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-2048)
|
| 30 |
|
| 31 |
+
The primary use case of these models is for research on efficient pretraining and finetuning for long context embeddings.
|
| 32 |
|
| 33 |
## Model Date
|
| 34 |
|