#moe

EMO: How Constraining Expert Selection to Document-Level Pools Causes Semantic Modularity to Emerge During MoE Pretraining

The Architecture of Intelligence: LLMs, 2024 → 2026

The Inference Machine: KV Cache, Attention, and How Modern LLMs Stay Fast

Reading the Label: A Field Guide to Local LLM Formats, Quantization, and Variants