Why we moved our support desk to a local model
A founder’s account of the switch, with the numbers that mattered.
The problem
Our support desk ran on an API that got expensive as we grew.
What we did
We moved to a local 27B model on one office machine.
Latency went down and so did the bill.
What we would do again
- Measure before switching.
- Keep a cloud fallback.
Advertisement