← 返回发现
qwen38-27b-rtx3090
AI工具ai

qwen38-27b-rtx3090

syv-ai/qwen38-27b-rtx3090

Qwen3.8-27B on a single RTX 3090 with vLLM: ~1,000 tok/s at 64 concurrent (int8 tensor-core GEMMs, fp16 DeltaNet state), ~114 tok/s single-user at default sampling / ~124 greedy (MTP drafts, own-output draft vocab, calibrated int4 lm_head, split-KV verify attention), 150k-262k context; patches, requant scripts, benchmarks

3
Stars
15.01
热度评分
+0
7日增长
2天
趋势

📋 项目信息

分类AI工具
用途ai
发现日期2026-08-18