用于构建、评估和存储 vLLM 中 LLM 推理所需的预测性解码算法的统一库
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
