Our Story
Why we built Sparkient
Sparkient began with Peter Dobson's work on systems where speed and decision quality both mattered. Live LLM calls brought useful judgment, but also placed model latency, token usage, and a provider dependency inside every repeated request.
The same design gap kept appearing. Rules were fast but became brittle when meaning and context mattered. Live LLMs were flexible, but not every bounded choice justified a generative model call. The opportunity was a measured decision layer between those two paths.
The insight was simple: use the LLM as an offline teacher. Turn a clear policy into labelled examples, train a task-specific model, and test whether that model can handle the normal path. Four public domains measured 33–42ms average time per item in batched runs, with optional LLM escalation kept explicit for uncertain cloud decisions.
“We turned repeated AI judgement into a fast, measurable decision system.”
— Sparkient