models / owensong/Inflect-Micro-v2
Optimize
Verdict
Couldn't read a parameter count — this may not be a standard safetensors transformer repo.
Make it fast
Once it fits: fewer bytes per token and fewer decode steps against 273 GB/s.
Add a speculative decoder
Decode is bandwidth-bound; a trained EAGLE-style draft multiplies tokens per weight-read.
Make it yours
Change what the model does — adapt, edit, or steer it — independent of size.
Fine-tune it
LoRA/QLoRA adapts behavior on one Spark without touching the base weights.
Edit or steer it
One-shot weight math — no gradients, no corpus.