中文
Libraries & frameworks

ktransformers

kvcache-ai/ktransformers

A framework for heterogeneous CPU-GPU LLM inference and fine-tuning of giant MoE models.