• PH.D. student at Sun Yat-sen university

• AI Infra, MLSys, Simulaters, GPU architecture

• Visit my personal web

News

• [2026/01/13] [LMSYS blog] EPD Disaggregation: Elastic Encoder Scaling for Vision-Language Models in SGLang
• [2025/06/27] [arXiv] [Code] gLLM is accepted by SC'25. Congratulations!
• [2025/05/28] [arXiv] [Code] EFIM is accepted by Euro-Par'25
• [2025/04/27] [arXiv] [Code] We have released gLLM, an efficient pipeline parallelism inference engine for LLM.

PRs for Project

vLLM

• [Bugfix][Multimodal] Fix Qwen3-Omni use_audio_in_video with mixed image/video inputs
• [Model] Support Unlimited OCR
• Fix the order of _free_encoder_inputs
• Remove unused EVS functions in qwen3_vl.py
• Support online use_audio_in_video
• [Bugfix] Fix benchmark_moe.py
• [Benchmark] Refactor sample_requests in benchmark_throughput
• [Bugfix] fix automatic prefix args and add log info
• [Minor Fix] Fix comments in benchmark_serving
• [Minor Fix] Remove unused code in benchmark_prefix_caching.py

SGLang

• Support PP for zmq_to_scheduler
• Add EPD disaggregation doc
• feat: support EPD disaggregation
• [VLM] Support PP for Qwen2.5-VL
• Add PP support for dots_vlm
• Fix port number overflow

xDiT

• Enable warm up for VAE
• Fix parallel vae

DistVAE

• Fix batch dimension

TVM

• [Doc] Fix minor error in "Expressions in Relay"
• [Doc] Fix minor error in doc (Add an operator to Relay)