WhimRead needs JavaScript for on-site search.
Whim
Read
browse at whim
Discover
All tools
Picks
Surprise
About
Search
中文
Resources
llm-inference-engineering
amitshekhariitbhu/llm-inference-engineering
A step-by-step blog series teaching LLM inference engineering from KV cache to serving engines.
View on GitHub
Copy link
Topics
inference-optimization
llm
llm-engineering
llm-inference
llms
inference-engineering
large-language-models
Related projects
litgpt
13.8k
A developer framework with from-scratch implementations of 20+ LLMs plus proven recipes to pretrain, finetune, evaluate, and deploy them.
open-llms
12.9k
A list of open LLMs available for commercial use.
krasis
530
A local LLM runtime for running very large MoE models on consumer NVIDIA GPUs, with quantization caches and an OpenAI-compatible API.
ai-agent-book
58.3k
An open-source book on AI agent design and engineering, covering context, tools, memory, evaluation, training, and multi-agent collaboration with 109 hands-on experiments.
RAG_Techniques
30.3k
A hands-on collection of over 40 runnable notebooks teaching advanced retrieval-augmented generation techniques step by step.
llm-action
25.3k
A curated Chinese knowledge base sharing LLM training, fine-tuning, inference, and deployment tutorials with hands-on code.
515
inference-optimization,llm,llm-engineering
A step-by-step blog series teaching LLM inference engineering from KV cache to serving engines.
←
Previous
sammie-roto-2
Next
→
read-aware