中文
Agent infrastructure

exllamav3

turboderp-org/exllamav3

Optimized quantization and inference library for running large language models locally on consumer GPUs, supporting parallel execution, offloading, and open APIs.