Where do I find the context size of this model?
#4
by
opiiopip
- opened
Dear developers, thank you for this promising model!
I can't find the context size on the model card? In the text completion presets on the bottom, I see the number 16384, but on https://featherless.ai/models/FallenMerick/MN-Violet-Lotus-12B (for the same model), there is a tag on top named "Ctx length: 32768". I'm confused.
And on page https://nutstudio.imyfone.com/llm-tips/best-llm-for-roleplay/#2.1 , it says 131K tokens for your model. Is that value correct? That would be outstanding!