Skip to content

#local-models

1 post on this topic, newest first. all tags →

A local model is good enough for most of my tooling

I moved commit messages, log triage, PR summaries, test naming and half a dozen other small jobs from a hosted API to an open-weight model on my laptop. Cost had nothing to do with it. For this kind of task a 30B model on a MacBook can't be told apart from the frontier, and I'd rather the data never left the machine.

llmlocal-modelsdeveloper-experience+1 more
10 min read12 min listen