I mentioned wanting to automatically add related blogposts based on comparing embeddings. When Dries Buytaert blogged about it, I wanted to follow his example. However I want to use those embeddings not just on this site, but also in my notes that include a local blog archive. That way I can quickly find related postings or notes with what I am writing/thinking. Embeddings are a numerical vector representation of the contents of a blogpost. You then find related blogposts by comparing those numbers across postings. Two weeks ago I set up the blog archiving.

Today I used the local archive of blog posts to calculate the embeddings. I wanted to calculate the embeddings on my local machine. When I write a blogpost and it gets stored in my local archive that should trigger calculating the embedding. Which I can then re-use in my notes or on my site.

There are multiple models available for local use to calculate embeddings, and I wanted to test which one seems most effective.
I installed three models in Ollama locally, and ran my complete blog archive through them:

  1. Nomic-embed-text-v1.5, which took 5 minutes to get through my blog archive, a US model by Nomic
  2. bge-m3, which took 12.5 minutes, a Chinese model by BAAI, Beijing Academy for AI
  3. qwen3-embedding:0.6b, which took 25 minutes, a Chinese model by Alibaba Cloud

The processing time difference across all three models is a factor 5, but that is mostly only relevant this first time when I run the entire archive (or when I need to redo that). From now on, only newly written or edited existing postings will have to have their embeddings (re)calculated. The time used for a single posting is insignificant whichever model I use (the slowest model took about 0.4 seconds for a blogpost, the fastest about 0.1).

Using Nomic I noticed that it handles language as a dominant distinction, meaning a Dutch post will only ever have Dutch language related postings, and German postings only German language ones. While there are topics that will likely indeed stay within the context of a single language, many of my Dutch postings are talking about things I also write about in English a lot. So Nomic is off the list. The other two models were created with multi-linguality in mind.

To compare the remaining two, I looked at 25 or so postings, and compared the first 10 related postings both models gave me. I intend to only ever show at most 5 related postings, if any, but looking at the first 10 gives an opportunity to see what else the embeddings calculate as relevant. Bge-m3 was slightly better at showing indeed related postings in the top 5. Qwen3-embedding worked well enough in the top 5 too and was stronger further down the list, where Bge-m3 started showing more clearly unrelated postings further down. There the Qwen model would find relations to things mentioned in longer blogpostings that Bge missed but I see as relevant. So I can use either for showing the most likely related blogposts on my blog, with bge-m3 being the smaller and faster model to calculate embeddings.
On the other hand, in my notes when writing, the Qwen model would work better if looking at entire blogposts. However, I don’t intend to make comparisons there to full length blogposts, but to paragraphs in long blogposts. There are 264 blogposts longer than 800 words (their average is 1200 words. Thirteen over 2000 words, the longest 2850 words, often talk transcripts) Then the difference between the two models will dissolve again. For now I am going forward with Bge-m3.

A concern is there might be model drift, even if always nominally using the same model. This can only happen if I update the model locally, and then it is needed to check against known results whether there has been drift. I have the current embeddings, so occasionnally recalculating a few and compare as well as logging a few good results to see if they still hold would be enough. The remedy for such drift when it influences results too much is to recalculate all embeddings again. That, as shown above, can be done fairly quickly. Something to add to the maintenance note for this set-up.

The next stage is building a way of storing / pushing the embeddings to this blog and in my notes, and write the php script (based on what Dries created) that does the comparisons both on my site and across my notes.

Das Biblionetz ist eine einzigartige Website, die mehr Aufmerksamkeit verdient. Es beschreibt viele tausende Bücher, Artikel, Texte und Ausschnitte, und deren Verbindungen und Zusammenhänge auf Grund von Begriffe, Erwähnungen, Fragen und Aussagen.


Ein Beispiel wie Texte im Biblionetz untereinander verknüpft sind, und diese Vernetzung navigierbar macht

Bereits 1996 hat Beat Döbeli (blog) das Biblionetz angefangen. Seitdem wird jedes Sachbuch und Artikel das ihm interessiert darin aufgenommen. Wie bei allem was man über Jahre hinweg konsistent macht kommt etwas dabei ‘raus das durch das erreichte Volumen eine ganz andere Qualität bekommt.

Vor einigen Jahren bin ich über das Biblionetz gestolpert. Seitdem verwende ich es immer wenn ich eine Frage habe über deutschsprachige Bücher. Als Niederländer habe ich den leichtesten Zugang zu Sachbüchern auf Niederländisch und Englisch. Aber, wie bei Französisch und Spanisch, ist das deutsche Sprachgebiet groß genug um eine ganze andere Bücherwelt zu bieten die für andere Sprachgebiete unsichtbar bleibt. Döbeli hat zwar andere Interessen als ich, aber wir teilen auch Interessen, und das heißt das das Biblionetz sowohl genügend Bücher enthält die ich noch nicht kenne, als auch Bücher die ich bereits kenne. Durch die Verbindungen zwischen Bücher und Konzepte kann ich, startend mit was ich kenne navigieren und (wenigstens für mich) interessantes Neues finden.

Selbst mache ich seit ich schreiben kann Notizen, und seit 1991 auch digital. Mit der Zeit hat sich das zu einer persönlichen Wissensmanagement Methodik entwickelt. Personal Knowledge Management (PKM) ist deshalb auch ein Interesse von mir seit vielen Jahren. In 2024 wurde in Utrecht (NL) die erste Europäische PKM Konferenz organisiert. Um zu helfen Sprecher und Teilnehmer zu finden aus unterschiedlichen Europäischen Ländern habe ich mich beim Orga-Team gemeldet. Und dann auch Beat Döbeli eingeladen um sein Biblionetz zu zeigen und über seine Erfahrungen zu erzählen. Leider konnte er bis jetzt nicht, da die Konferenz immer zusammenfiel mit einer wichtigen Fachtagung für ihn. Im nächsten Jahr, 2027, wird es dann klappen. Wer an PKM interessiert ist sollte die Konferenz schon mal im Terminkalender vermerken (12. und 13. März 2027).

Darüber und mehr haben wir gesprochen als wir uns im Juni zum ersten Mal trafen, in Zürich. Wir sprachen über die Anfänge von Biblionetz und was es jetzt für ihn in seiner Arbeit als Professor an der Pedagogische Hochschule Schwyz bedeutet. 1996 war er als Informatiker an die Entwicklung des WWW interessiert, und betrachtete was er met Biblionetz anfing nicht direkt als Akademiker. Jetzt verwendet er das Biblionetz als ein akademisches Werkzeug, indem er zB. Studenten und Kollegen leicht mit Leselisten versehen kann. Bereits am Anfang war ihm klar das es mal eine Zeit geben könnte wo Computer das was er sich mit Biblionetz gebaut hat als persönliches Werkzeug, auch von sich aus machen könnten. Jetzt mit KI ist die Zeit vielleicht angebrochen.

Das Biblionetz ist über RSS zu folgen (wie natürlich auch Beat Döbeli’s Blog)

Dieser Blogartikel ist ein Beitrag an den Blogwochen 2026, im Thema ‘Mensch/Projekt der/das mehr Aufmerksamkeit verdient’.
Die Blogwochen, von Mitte September bis Mitte Dezember, sind dazu gedacht mehr deutschsprachige Blogger sichtbar zu machen, und neue interessante Blogs für den eigenen Feedreader zu finden. Ich nehme Teil weil ich mehr auf Deutsch schreiben möchte, und auch die Anzahl der deutschsprachigen Blogs die ich in meinem Feedreader folge vergrößern möchte.

Last March I made an export from my blog, so that I have all my blogposts since 2002 (some 3800 posts) in my notes locally. This makes it easier to find and link to my own blogposts while I am working, thinking, or writing in my notes. What I did not do in March was set up a way to keep syncing my blogposts to my notes from then on. Meaning I am now 6 months and 60 blogposts out of date.

Meanwhile Dries Buytaert wrote a month ago about how he used embeddings to list related postings with a blogpost based on their content, not their tags, keywords or categories.
This sounded immediately interesting and useful. What he describes is to run your site content through a model to create embeddings (a range of numbers as vectors representing your text), store the embeddings, and have a local script that when a posting is rendered calculates which embeddings match your posting closest. Related postings then is when their numerical vectors are closer than others. Only initially when you calculate embeddings for a posting is this dependent on a LLM, and afterwards it’s all regular calculations.

I thought creating those same embeddings may also be useful for semantic search within my blogposts for myself.
The plan therefore now is to

  • set up ongoing archiving of my blog and parsing them to my local notes
  • create embeddings using a model locally through ollama, e.g. with bge-m3, qwen3-embedding:0.6b, or nomic-embed-text
  • use those embeddings to calculate related postings for each existing posting, and forwards for new postings
  • use those same embeddings to allow finding related postings in my notes when writing something

The archiving is set up now, and updated once every day.

Next step is building and testing different ways of creating embeddings. The model to make those must be able to deal with and compare multiple languages, English, Dutch and German. I need to use the same model across all embedding of old and new posts, and when I want to compare with something I’m writing in my notes. This as different models create different representations of the same text and are not interchangeable. Also earlier this week in London the topic of model drift came up, that the same model, if you use it through an API from a vendor, will get tweaked and change over time. This results in slowly shifting embeddings.
With the team at Activate Intelligence we talked about how you’d need to pin down a model, and also log what a good result looks like when you start using it, so that you can detect drift over time. Using a local model (not an online model through an API) reduces drift, as things stay the same as long as I don’t update a model on my machine.
Solving drift means recreating all embeddings, which is the same effort as creating them now is. So, it’s not a barrier, but it is maintenance you need to stay on top of.

At PKM Summit this weekend one thing that stood out was that many have started creating their own tools, and were using vibecoding to create them.

While the term agency turned out to be unknown to almost all participants, that is of course what such tools create. The ability to do things, individually or as a group, in this case by creating your own tools to get there.
The power of finding new agency was felt and expressed by quite a few, and played a role in a good number of sessions too.

When I first encountered computers, in the early 1980s, creating your own stuff was the norm. It was almost the only option. Making the machine work for myself. Like software to keep my ham radio logs and print QSL cards.
These days I run a good many smaller and larger personal pieces of tooling on my laptop. Things like making it easy to search by date in my photos on Flickr, or posting to my website from my internal notes, or from within my feedreader.
Things that reduce friction, speed things up, reduce dependency on external systems.

Vibecoding, and especially the Claude Code style of vibe coding, is bringing people to create their own tools, who weren’t able to do so before. A pool of latent needs they can now tap into on their own.

Some I know are really now learning how a computer works under the hood through their vibe coding. Testing the limits of their machines, finding out how fast local stuff can be. Discovering the power of APIs, the utility of cron jobs, and learning how to run their own VPS or local servers.
Others are creating little tools that work the way they want. An app to present books from their collection in that one specific way just so. A mobile app for public transport built on your own existing commute patterns and nothing else. Apps pulling in data from several sources and presenting them in one interface that likely only makes sense to themselves.

Tools built by people realising they are pretty predictable to themselves, and that such highly localised and specifically contextualised predictability now lends itself to automation by the intended user themself.
Tools, in short, where, access to and control over data lies fully with the user, where applications are views on that data (and multiple apps use the same data), and interfaces queries on the data. Along the lines of Ruben Verborgh’s 2017 article “Paradigm Shifts for the Decentralised Web“ but then way more personal. The decoupling that is possible between data, applications and interfaces is even more powerful when you can do them all three for yourself. And then mash them up in any which way you want.

Vibecoding is allowing people to jump the barriers to entry to that. And judging by the stories they share, it feels like pole vaulting over them, not just clearing the barriers. That energy then propels them on to do more.

Over the past months I’ve also heard regularly how people are cancelling paid subscriptions to various online services, and switching to their personal tools that fit their use case much more precisely.

There are many ethical, political, and societal issues with much of the gen AI world, and how models come about, and how corporate vendors exploit and leverage their power.
Yet, where these things are not just consumed but used locally as a leg-up to a different level of self-reliance, it looks quite different. Something is brewing it feels like.
A shift, and I’d love to see more people explore and extend their own agency with such tools.

I attended the PKM Summit the past days in Utrecht. It was fun and inspiring. During the extended lunchbreak yesterday I went outside to enjoy a bit of sunshine and walk around town. Ending up in the Steven Sterk book shop I also browsed the shelves there a bit.

One title, From The Winter Archives, stood out to me. Being primed with thoughts of personal knowledge management and note making, I approached the title from that angle. The book, originally titled Fra vinterarkivene, is a 2015 novel by Norwegian writer Merethe Lindstrøm, and completely unconnected to such associations on PKM.

Five years ago Robin Sloan blogged about how newsletters should have seasons, and I blogged about it in response in more general terms, looking at seasons for any creative output. As were are moving from winter to spring, I was also reminded about the different tasks that come with the change of seasons around the house. Disconnecting the water tap before winter, removing some lights early spring, bringing back down the cushions for the garden benches.

Can my notes, can sections of my notes have seasons? There is always an ebb and flow in attention to certain topics and matters, which translate in the use, editing and creation of notes. That is maybe of a different frequency, a week or a few, a month, not a quarter year like a season. The thought of having a folder with notes named ‘the Winter archive’ crossed my mind, just because it sounded interesting, not because I have any notion about what it might actually contain.

Just a whimsical spring thought, riffing off a book title while my mind was simmering with notions about personal knowledge management.

I have been interested in personal knowledge management (pkm) for a very long time. I have been an avid notes maker ever since I learned to write. Digital tools from the late 1980s onwards have been extremely useful. And a source of nerdy fascination, I confess. I am certain personal knowledge management (pkm) is of tremendous value for anyone who wants to keep learning and make sense of the world around them.

On March 20 and 21 the European PKM Summit is taking place for the third time in Utrecht, Netherlands. I’ve helped a bit, like for earlier editions with suggesting speakers and workshop hosts for this event.

I am donating a ticket for a student in the Netherlands to attend this two day event. I did the same last year and the year before.

Are you a student at a university in the Netherlands (doing a bachelor’s or master’s) with a strong interest in personal knowledge management (pkm)? (note that it says interest, I don’t expect you to be highly sophisticated or experienced in it!)
Is your interest in pkm to strengthen your personal learning and deepen your interests, rather than increasing (perceived) productivity?
Would you like to go to the PKM Summit on 20 and 21 March in Utrecht, but as a student you cannot afford the 254 Euro ticket price?

Then I have one (1) conference ticket available! Let me know who you are and what fascinates you in pkm or attracts you to the event. If there are several people interested I will choose one. I will donate the ticket a month before the conference, by February 20th, so state your interest before then.

The single condition is that you attend the event on both days and participate actively in the sessions. If you have other ways to attend (by e.g. volunteering for the event staff) then that is preferable. This is specifically for someone who would otherwise not be able to go. I’d be happy to briefly meet you as well at the event, but if not that is perfectly fine too. It would be great however if you would share some of your impressions of the event afterwards online on the open web, especially if that is something you’d normally do anyway.

Interested? Email or DM me (in Dutch, German or English)! My contact details are in the right-hand sidebar.