Recent Posts
一个完整的 vime + vLLM RL Training Step
colocate 模式下一次 GRPO 训练步的完整时序图、可调用接口表与参数表，以及按 55 个步骤代入数值、代码和源码位置的逐步讲解。
vLLM PD 分离：一次 MooncakeConnector 请求的完整时序
1P1D、RDMA 下一个请求从 Proxy 分发、P 侧 prefill、KV 推送到 D 侧 decode 的完整时序图、接口表与参数表，以及按 43 个步骤代入数值、代码和源码位置的讲解。
Parallelism Strategies in Distributed Computing
One map of DP, DDP, FSDP, ZeRO, TP, PP, CP, SP and EP across training and inference, what each costs, and which ones vLLM supports.
Open-Source RL Frameworks for LLMs: verl, OpenRLHF, TRL, NeMo RL, ROLL, slime, AReaL
A side-by-side comparison of the popular LLM RL training frameworks — verl, OpenRLHF, TRL, NeMo RL, ROLL, slime, AReaL — and a deep dive into verl's system design.