webXOS
webxos
AI & ML interests
3D Simulations and Multimodal Synthetics
Recent Activity
commented on
an
article
about 2 hours ago
🥃 Distilling Tiny Embeddings
upvoted
an
article
about 2 hours ago
🥃 Distilling Tiny Embeddings
reacted
to
davidmezzetti's
post
with 👍
about 2 hours ago
🥃 Distilling Tiny Embeddings. We're happy to build on the BERT Hash Series of models with this new set of fixed dimensional tiny embeddings models.
Ranging from 244K parameters to 970K and 50 dimensions to 128 dimensions these tiny models pack quite a punch.
Use cases include on-device semantic search, similarity comparisons, LLM chunking and Retrieval Augmented Generation (RAG). The advantage is that data never needs to leave the device while still having solid performance.
https://huggingface.co/blog/NeuML/bert-hash-embeddings
Organizations
None yet