https://www.fabswill.com/tags/local-llm/ Recent content in Local LLM on Fabian G. Williams Hugo -- gohugo.io en Sun, 02 Aug 2026 00:00:00 +0000 https://www.fabswill.com/blog/local-model-frontier-rematch-auto-replay-evals/ Sun, 02 Aug 2026 00:00:00 +0000 https://www.fabswill.com/blog/local-model-frontier-rematch-auto-replay-evals/ TL;DR My agents do real work on frontier models. Every dollar of that work is metered against my OpenAI and Anthropic bills. Meanwhile a perfectly capable local model, gpt-oss:20b, sits on a Mac Mini in my office costing me nothing. The obvious question: for which tasks could the free local model do the job just as well? Today I answered it with a system instead of a guess. I taught my eval framework to automatically replay every writing task on the local model right after the frontier model runs it, then grade both with the same judge and record the gap.