学习大模型推理的加速技术:量化、投机采样与 PD 分离

Source evidence

What RADAR observed and classified to build this opportunity. It is what the source published, not a verification that the offer is still active.

• JuejinObserved: Sep 28, 2026Source reliability: 60%

  学习大模型推理的加速技术:量化、投机采样与 PD 分离. 在上一篇中,我们学习了推理的显存优化:PagedAttention 把 KV Cache 切成固定大小的块按需分配,前缀缓存让相同前缀的请求复用已算好的 KV 块。再往前看,KV Cache 本身是拿

  Open source