中文
Agent infrastructure

web-llm

mlc-ai/web-llm

High-performance browser-side LLM inference engine built on WebGPU and compatible with OpenAI APIs, distributed as npm packages for developers building web-based AI applications.

Topics

  • chatgpt
  • deep-learning
  • language-model
  • llm
  • tvm
  • webgpu
  • webml