Favorited Headless Everything For Personal AI by Matt Webb

I see this being adopted around me too. Not just CLI’s though, also more APIs, pulling in data sources from elsewhere. And most interestingly: I see adoption by people who did not program or treat their computer as their personal toolbox they can adapt before. Until generative AI lowered their barrier to entry. Going from 0 to using the command line (which coincidentally is what it was until 30 years ago anyway). Even without AI, CLI tools, like Automator on Mac did before, allow the creation of workflows around a piece of software. Matt mentions the Obsidian CLI, and I’ve been using that to manipulate Tasks in Obsidian without going to the Obsidian UI. For about a decade I’ve treated application UIs as just views on my data, with functionality geared towards the viewing, and interfaces as different queries on that data. Going headless means removing the viewer, and using the output of queries directly programmatically. Combined with how I see the arch of generative AI bending significantly towards deterministic code, I look forward to the type of things people come up with. Not their tools, but what they come up with. Because the path to scale of these things imo is not adopting or buying what someone else made, but adopting what someone else came up with conceptually and creating your own local version. Like we do socially too, contagion spreading through effective behaviour, and culturally, the contextual and local sum of all time greatest hits of our group behaviour. The invisible hand of networks rather than markets. It would be highly ironic if unethical corporate extractive AI not only creates the incentive but also actually paves the way for the masses to Walkaway.

It turns out that the best place for personal AIs to run is on a computer. […] ideally your computer. That way they can see the docs that you can see, and use the tools that you can use, and so what they want is not APIs (which connect webservers) but little apps they can use directly. CLI tools are the perfect little apps.

Matt Webb

Favorited I used AI. It worked. I hated it. by Michael Taggart

An excellent post by Michael Taggart on how it felt to him to make a much needed bit of code with the help of Claude Code. The results worked, but he hated how it made him feel. He explores those opposing outcomes without trying to resolve the tension. Much in here that I recognise from my own experiences, as well as what I see others do and how they talk about it. Towards the end he talks about ‘the real monster’ here, and I think that is the right frame: we have created a technology monster once more, and Smits’ monster theory (2003) is a tool to bring to bear again. Where will we adapt the monster to our tastes? Where will we shift our cultural understanding of ourselves and the world to make room for the monster? Once we’re done embracing it until the bubble bursts, or rejecting it outright no matter what.

I hated writing software this way. Forget the output for a moment; the process was excruciating. Most of my time was spent reading proposed code changes and pressing the 1 key to accept the changes, which I almost always did. I was basically Homer’s drinking bird.

Michael Taggart

Favorited Ollama Claude Code integration by Ollama
Favorited LM Studio Claude Code integration by LM Studio blog

Last Friday I participated in a workshop by Frank Meeuwsen on using Claude Code. I’ve been reluctant to use Claude Code for the basic reason that it uses cloud run models by default. This means that my inputs and any context I provide leave my machine to be gobbled up into the data foraging models. Nevertheless it was fun, I improved on my existing personal feed reader (a presentation layer on top of FreshRSS that allows me to write responses while I’m reading feeds).

However tempting it is to continue vibecoding with Claude Code and watching it work its way through my coding requests, that is not the way to go. After some online searching I found the above two pages, that explain how to point the program Claude Code to use the local end point of either Ollama or LMStudio. That’s more like it!

Now I need to figure out which LLMs that can be downloaded (or run on a VPS perhaps) are best suited to the type of tasks I want to set it. For coding, local agents, translation, and semantic work. There can be multiple models of course, as I can switch them up or run them sequentially (and in parallel if I deploy them on a VPS I think).

Open models can be used with Claude Code through Ollama’s Anthropic-compatible API

Ollama documentation

This means you can use your local models with Claude Code!

LM Studio blog