Mixture-of-experts model

Knowledge graph concept · also referred to as mixture-of-experts, MoE, experts, MoE model, active parameters, MoE backbone, mixture of experts

Mentioned in

• DeepSeek V4.1 Flash is built for datacenters X thread · 2026-09-10
• Local AI will favor LPDDR and MoE X thread · 2026-08-10
• Write-up of Reiner Pope's Lecture: How GPT, Claude, and Gemini Are Actually Trained and Served post · 2026-07-14
• Popularity rankings for open models X thread · 2026-06-20

Related concepts

• Model size 3
• Inference throughput 2
• KV cache 2
• Local model deployment 2
• Memory bandwidth 2
• Memory capacity 2
• Speculative decoding 2
• AI benchmark 1