benchmarks / qwen3-5-35b-a3b--dgx-spark-x1--vllm--bf16--p2048-o256-c1--2026-07-06
Qwen3.5 35B-A3B on NVIDIA DGX Spark
compare30.6tok/s
550msttft
3.7kprefill
vLLM 0.24.0BF16Jul 6, 2026
Run configuration
nodes
1
batch size
—
concurrency
1
context
10240
prompt / output
2041 / 256
weights Qwen/Qwen3.5-35B-A3B ↗
Metrics
decode tok/s
30.6
prefill tok/s
3.7k
ttft
550ms
total tok/s
28.8
inter-token
33ms
e2e latency
8.89s
req/s
0.112
peak memory
84 GB
avg power
29.1 W
energy/req
258.8 J
Reproduce
PATH="$HOME/venvs/vllm/bin:$PATH" VLLM_USE_DEEP_GEMM=0 vllm serve ~/models/hf/Qwen3.5-35B-A3B --served-model-name Qwen/Qwen3.5-35B-A3B --max-model-len 10240 --gpu-memory-utilization 0.62 --max-num-seqs 8 --limit-mm-per-prompt '{"image": 0, "video": 0}' --port 8000
python3 bench/harness.py bench/configs/qwen3-5-35b-a3b-bf16--vllm.json --rows-out data/benchmarks/qwen3-5-35b-a3b.jsonUnquantized baseline (original safetensors), vLLM on GB10