07 writing
notes from a self-hosted fleet.
Honest writeups from running real AI on my own budget silicon — local LLM inference on Intel Arc, autonomous agents with guardrails that hold, and a memory brain that remembers across every tool. Real numbers, no hype, $0 cloud.
latest 7 writeups, more on the way
The real cost of an outage nobody scoped for
Why the msp-tier3-toolkit scripts exist — the actual math on what an unscoped outage costs a small business, and why tier-3 runbooks pay for themselves the first time they're used.
read the writeup →
Guardrails that hold, not guardrails that annoy
What actually stops an autonomous agent from doing something dumb — money and outbound traffic clamped by default, and a standby box with no stake in the outcome.
read the writeup →
MoE beat dense on the same card, and here's the actual reason
A 30B mixture-of-experts model outproduces a 27B dense model by 9x on the same Arc B60 — the followup that explains why, down to what actually moves through VRAM per token.
read the writeup →
20 years of security ops, now pointed at AI agents
Why running an autonomous AI fleet safely is a security operations problem first and an AI problem second — and what two decades of the former actually buys you.
read the writeup →
What $0 cloud spend actually costs
The real math on running your own AI fleet vs. an API — a $500 card, a real electricity bill, and the crossover point where self-hosting wins.
read the writeup →
Building a shared memory brain for AI agents
A persistent, shared, self-correcting memory that every AI agent and tool reads from and writes to — so nothing gets re-explained twice. The design decisions that make it work: supersede-never-delete, write the mechanism not the answer, dedupe before you write, and automatic write-back. Past 130,000 memories, live.
read the writeup →
Running 30B LLMs on a $500 Intel Arc B60
Serious local inference doesn't need a 4090. Here's the exact stack — llama.cpp, Vulkan, IPEX-LLM — the driver and VRAM gotchas that actually bite, quantization tradeoffs, and the production finding: a 30B MoE at ~40 tok/s beats a dense 27B at 4.4 on the same card.
read the writeup →