Article
Distillation in 2026 (so far): which frontier models use it and how
sergiopaniego
• • 3Sergio Paniego PRO
sergiopaniego
AI & ML interests
None yet
Recent Activity
upvoted an article about 14 hours ago
Native-speed vLLM transformers modeling backend updated a dataset about 15 hours ago
agents-course/final-certificates updated a dataset about 15 hours ago
agents-course/course-certificates-of-excellenceOrganizations
published an article about 16 hours ago
published an article 6 days ago
Article
A brief history of distillation in AI
sergiopaniego
• • 2 published an article 20 days ago
Article
Continuous batching for GRPO, now in TRL
sergiopaniego
• • 8 published an article 23 days ago
Article
I fine-tuned a model for free from one prompt, with TRL and the Google Colab CLI
sergiopaniego
• • 4 published an article 28 days ago
Article
Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP
- +3
ariG23498, ror, sergiopaniego, pcuenq, sayakpaul
• • 52 published an article about 1 month ago
Article
The Open Source Community is backing OpenEnv for Agentic RL
- +18
burtenshaw, spisakjo, lysandre, darktex, willcb, qjoy, pawalt, cwing-nv, danielhanchen, andrewzhou, thegovind, shimmyshimmer, Hamid-Nazeri, Sanyam, zkwentz, emre0, lewtun, sergiopaniego, banghua, unseenmars
• • 105 published an article about 1 month ago
Article
Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler
- +3
ariG23498, sayakpaul, sergiopaniego, ror, pcuenq
• • 136 published an article about 1 month ago
Article
Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL
- +6
aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, lvwerra, sergiopaniego
• • 42 published an article about 2 months ago
Article
Harness, Scaffold, and the AI Agent Terms Worth Getting Right
sergiopaniego, ariG23498
• • 129 published an article 3 months ago
Article
Welcome Gemma 4: Frontier multimodal intelligence on device
- +5
merve, pcuenq, sergiopaniego, burtenshaw, Steveeeeeeen, alvarobartt, SaylorTwift
• • 913 published an article 3 months ago
Article
TRL v1.0: Post-Training Library Built to Move with the Field
- +2
qgallouedec, stevhliu, pcuenq, sergiopaniego
• • 58 published an article 4 months ago
Article
Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries
- +7
aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, nouamanetazi, lvwerra, sergiopaniego
• • 169 published an article 4 months ago
Article
Bringing Autonomous Driving RL to OpenEnv and TRL
sergiopaniego
• • 22 published an article 4 months ago
Article
Mixture of Experts (MoEs) in Transformers
- +5
ariG23498, pcuenq, merve, IlyasMoutawwakil, ArthurZ, sergiopaniego, Molbap
• • 169 published an article 7 months ago
Article
Tokenization in Transformers v5: Simpler, Clearer, and More Modular
- +4
itazap, ariG23498, ArthurZ, sergiopaniego, merve, pcuenq
• • 125 published an article 10 months ago
Article
Smol2Operator: Post-Training GUI Agents for Computer Use
- +3
A-Mahla, merve, sergiopaniego, reach-vb, lewtun
• • 138 published an article 10 months ago
Article
Tricks from OpenAI gpt-oss YOU 🫵 can use with transformers
- +5
ariG23498, sergiopaniego, reach-vb, pcuenq, ArthurZ, SaylorTwift, cyrilvallez
• • 188 published an article 10 months ago
Article
Welcome EmbeddingGemma, Google's new efficient embedding model
- +4
tomaarsen, Xenova, alvarobartt, ariG23498, pcuenq, sergiopaniego
• • 275 published an article 11 months ago
Article
Vision Language Model Alignment in TRL ⚡️
- +3
sergiopaniego, merve, qgallouedec, kashif, ariG23498
• • 112 published an article about 1 year ago
Article
Efficient MultiModal Data Pipeline
- +3
ariG23498, lusxvr, andito, sergiopaniego, pcuenq
• • 72