中文
Agent infrastructure

vllm-omni

vllm-project/vllm-omni

Efficient inference-serving framework for omni-modal models, unifying text, image, audio, video, and action inputs under one serving architecture for developers deploying multimodal applications.

Topics

  • diffusion
  • inference
  • model-serving
  • pytorch
  • transformer
  • audio-generation
  • image-generation
  • multimodal