Skip to content

Changelog

Where we are.

What is done and what comes next, as it stands. We add to this list; we don’t rewrite it.

What is done

Done

  1. DoneA working Inferstack gateway and CLI: session affinity, routing, cost ledger, failover, evals, metrics
  2. DoneAgents, tasks and background runs with per-agent budgets, in the gateway, the CLI and the Console
  3. DoneThe Inferstack Console, live in the browser, with Linux and Android builds from the same code
  4. DoneMeasured on a laptop: 87% less served cost on the second turn of a session
  5. DoneA market study of 8.56M public posts and issues on inference
  6. DoneA baseline on real agent logs: 88.5% of prompt tokens repeat
  7. DoneA shipped product: Clutch, a basketball recruiting platform

What comes next

Next

  1. NextGPU engines. The prototype runs on CPU with llama.cpp; vLLM and SGLang are next.
  2. NextThe model-switch handoff
  3. NextWindows and macOS builds of the Console, and a signed Android release
  4. NextPaying customers
  5. NextAn external benchmark. That’s what a pilot is for.