Memory bandwidth Knowledge graph concept · also referred to as memory BW, HBM, memory bytes/s, sustained memory bandwidth, bandwidth Mentioned in Upper Bounds for Local Model Throughput X thread · 2026-07-17 Write-up of Reiner Pope's Lecture: How GPT, Claude, and Gemini Are Actually Trained and Served post · 2026-07-14 Theoretical Upper Bounds for LLM Performance post · 2026-07-14 Related concepts KV cache 3 LLM inference 3 Inference batching 2 Memory capacity 2 Model quantization 2 Roofline model 2 Speculative decoding 2 AI inference pricing 1