中文
Agent infrastructure

sglang

sgl-project/sglang

High-performance serving framework for engineers deploying large language and multimodal models, providing optimized inference, scalable deployment, and production-oriented runtime features.

Topics

  • attention
  • blackwell
  • cuda
  • deepseek
  • diffusion
  • glm
  • gpt-oss
  • inference