Hybrid LLMs, MoE, Mamba, multilingual NLP, biomedical reasoning, efficient pretraining