Recipes
1 Spark
5KAT-Coder V2.5-Dev NVFP4
Kwaipilot's agentic-coding KAT-Coder V2.5-Dev (35B MoE, ~3B active) in full NVFP4 on one DGX Spark, serving the full 262,144-token context at 82 tok/s single-stream decode — a 27% gain over the same config with no draft, from grafting Qwen3.6-35B-A3B's multi-token-prediction head into a checkpoint that shipped without one. Speculative decoding is verified, so the draft costs nothing in output quality, and the whole working set is 38 of 114 usable GiB.
Laguna-S 2.1 NVFP4
poolside's agentic-coding Laguna-S 2.1 (118B MoE, ~8B active) in NVFP4 on one DGX Spark, with the matching NVFP4 DFlash speculator — 42.9 tok/s single-stream (2.3x the no-draft baseline) at the full 262K context.
Qwen3.6 35B-A3B NVFP4 (Unsloth Fast)
Serve the full 262,144-token context of Qwen3.6 35B-A3B on ONE DGX Spark at 106 tok/s single-stream, using the checkpoint's own MTP head for speculative decode at k=3 — a 57% gain over the same config with no draft. Nothing needs patching and nothing is tight: the whole working set is 36 of 114 usable GiB.
Laguna-XS 2.1 NVFP4
Serve poolside's agentic-coding Laguna-XS 2.1 (33B MoE, ~3B active) on one DGX Spark with the NVFP4 experts and the checkpoint's own DFlash speculator: 132 tok/s single-stream on code — 3.17x the no-draft baseline — with the full 262K context still fitting 1.5x over. Needs vLLM 0.25.1 (the release where the Laguna DFlash draft landed) and one non-obvious tuning call: k=6, not k=1.
BTL-3 (Qwen3.6-27B) — BF16
badtheorylabs' BTL-3 agentic coder (a LoRA on Qwen3.6-27B, ~27B dense) in BF16 on one DGX Spark, with the base model's native MTP head driving speculative decode — 12.8 tok/s single-stream, 2.9x the no-draft baseline, at the full 262K context.
2 Sparks
5DeepSeek V4 Flash DSpark
Serve the 284B/13B DeepSeek V4 Flash DSpark checkpoint across two DGX Sparks at its full 1M-token context, with FP4 experts, an NVFP4 MLA KV cache, and DSpark speculative decoding holding decode speed flat out to 275K tokens.
2GLM-5.2 — 2-bit MoE
Run GLM-5.2 (753B MoE) across two DGX Sparks with vLLM-Moet's 2-bit expert kernels, expert-pruned planes, and NCCL-over-RoCE — ~15 tok/s single-stream, ~22 at 96K context with the fast build and its 4-bit speculator. Every number measured on real GB10 hardware.
2Hy3 NVFP4
Serve the full Hunyuan Hy3 (295B MoE, 21B active) across two DGX Sparks with NVFP4 expert planes, BF16 attention, and the checkpoint's native MTP head driving speculative decode — 19.5 tok/s single-stream at 160K context. Needs the marlin MoE backend on sm_121 and a one-line vLLM patch for the MTP head; both are covered below.
Laguna-S 2.1 FP8
poolside's agentic-coding Laguna-S 2.1 (118B MoE, ~8B active) in FP8 on two DGX Sparks (TP2), with a self-quantized W4A16 DFlash speculator — 60.9 tok/s single-stream (2.3x the no-draft baseline) at the full 262K context.
2Solar-Open2 250B NVFP4
Serve Upstage's Solar-Open2 (250B-class hybrid linear-attention MoE, 320 experts / top-8, ~8B active) in Nota's NVFP4 build across two DGX Sparks (TP2) — 10.2 tok/s single-stream decode, serving the full 1M native context (NoPE, no rope scaling), decode-bound by the BF16 attention the quant leaves untouched. Runs on a hand-written out-of-tree vLLM model plugin (no released engine implements the architecture).