TensorFold is a local LLM inference engine for Apple Silicon and NVIDIA GPUs. It loads checkpoints and serves models through an OpenAI- and Anthropic-compatible API without Python.
1894ai,ai-tools,llmTensorFold is a local LLM inference engine for Apple Silicon and NVIDIA GPUs. It loads checkpoints and serves models through an OpenAI- and Anthropic-compatible API without Python.