howtospark
models / Contrastive-LM/CLM-v0.1-8B
?

Contrastive-LM/CLM-v0.1-8B
Contrastive-LM/CLM-v0.1-8B
apache-2.0
Sparks
Spec decode
Optimize
Quantized from

Qwen/Qwen3-8B

Analyze the original repo for the full architecture picture.

Verdict

Couldn't read a parameter count — this may not be a standard safetensors transformer repo.

Make it fast

Once it fits: fewer bytes per token and fewer decode steps against 273 GB/s.

Add a speculative decoder

Decode is bandwidth-bound; a trained EAGLE-style draft multiplies tokens per weight-read.

EAGLEDraft-model speculative decodingMedusa heads
in the wild: vllm-Moet (kacper-daftcode)AngelSlim Eagle3 training (Tencent)

Make it yours

Change what the model does — adapt, edit, or steer it — independent of size.

Fine-tune it

LoRA/QLoRA adapts behavior on one Spark without touching the base weights.

Supervised fine-tuning (SFT)Low-rank factorizationPreference tuning (RLHF / DPO)

Edit or steer it

One-shot weight math — no gradients, no corpus.

AbliterationControl vectors / steeringModel merging (mergekit)
in the wild: huihui-ai abliterated models