Token generation Knowledge graph concept · also referred to as 256 token blocks, random tokens, autoregressive generation, decoding, decode Mentioned in How diffusion language models generate text X thread · 2026-07-31 Related concepts Denoising 1 Diffusion language model 1 Inference batching 1 Inference throughput 1 LLM inference 1 Model quantization 1