Open-source inference engine for running LLMs, vision, audio, and image models locally on diverse hardware, exposing a unified API compatible with popular model-serving interfaces.