中文
All projects

llm-compressor

vllm-project/llm-compressor

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Topics

  • compression
  • quantization