vllm-omni

A framework for efficient model inference with omni-modality models