A local model is good enough for most of my tooling
I moved commit messages, log triage, PR summaries, test naming and half a dozen other small jobs from a hosted API to an open-weight model on my laptop. Cost had nothing to do with it. For this kind of task a 30B model on a MacBook can't be told apart from the frontier, and I'd rather the data never left the machine.
llmlocal-modelsdeveloper-experience+1 more
10 min read12 min listen