A local model is good enough for most of my tooling
I moved commit messages, log triage, PR summaries, test naming and half a dozen other small jobs from a hosted API to an open-weight model running on my laptop. It was not about cost. It was about a category of task where a 30B model on a MacBook is indistinguishable from the frontier, and where I would rather the data never left the machine.
10 min readRead more →