In reply to Open Web Search project kicked off by Djoerd Hiemstra

I’m looking forward to following this project, Djoerd! It sounds sort-of IndieWeb like. Where e.g. MicroSub decouples feed fetching from feed reading and Micropub writing from posting, this project decouples index building from the search. Within IndieWeb that allows the creation of a variety of personal tools, to read and write the web. I’ve long been musing about personal search engines and personal agents and crawlers without putting anything into action. I’m curious to see if this project will actually deliver some of the things I dreamt of over time, by enabling personal tools for search.

A new EU project OpenWebSearch.eu … [in which] … the key idea is to separate index construction from the search engines themselves, where the most expensive step to create index shards can be carried out on large clusters while the search engine itself can be operated locally. …[including] an Open-Web-Search Engine Hub, [where anyone can] share their specifications of search engines and pre-computed, regularly updated search indices. … that would enable a new future of human-centric search without privacy concerns.

Djoerd Hiemstra

There has been quite a bit of response on my posting where I thought out loud about a search tool to help me find on-line traces of people I met face to face, so that I can follow up.

A large part of the comments seem to implicitly assume the creation of an on-line service where you type in the name of the person you are searching for, and that then comes up with the results from different sources.

Lilia Efimova voices her worry that it should not be too easy to combine all the traces of somebody on-line. There might be a very good reason after all to keep traces seperated. In Lilia’s case that would be the division between private and business life. Not that she thinks it should not be possible to combine those traces, but because it should take some effort to do so. I agree with that. That effort is the investment you make into forming a relationship, and when a relationship grows and deepens it becomes easier to track and interpret traces, as you start seeing what is there between the lines.

Therefore what I envision is not something like the internetaddressbook.com where the one being sought maintains a list of all public traces, nor is it any other one-stop-shop like tool.
I simply need a tool to help me search. I get tired of having to go through many different search screens for each tool and platform in which I want to find if someone has a profile there, filling in the same information each time.

I do not mind that it takes time to get to know somebody, I do not mind that traces might be deliberately hard to connect and that I need to invest in a relationship to see the whole picture. I do mind that the time I spend filling in search forms might be time spent on building those relationships.

So it is precisely as Barbara Kieslinger says in the comments, I still want to be the one searching and deciding myself.
I want a search aid that is completely dumb, unlike the internetaddressbook.com, and does not remember or register anything, nor shares or republishes search results. But a search tool I control that I can give what I already know and then looks where I point it to look. It’s just plain old search really, that can dig as deep as the current level of trust between me and the person the search revolves around allows.

As I do after each conference I am currently busy finding people on-line and adding them to my ‘social filter’ after BlogTalk Reloaded. Basically that means finding their on-line presences and adding them to my feedreader, and connecting to them in different environments such as Plazes, Skype, Flickr, OpenBC/Xing, LinkedIn, 43People etc. Weaving them into my social web so to speak.


Weaving a social web. Image by Pandiyan V, license CC BY NC

I don’t mind to spend the time to think of who I actually want to stay connected to. That after all is part of digesting the event I have visited and part of weaving new relationships. This can be time-consuming but that is not to be helped (except take better notes during an event). For instance today I have spent some time to find out who Marc Barrot is. He seemed familiar from a previous BlogTalk, seamed to know Paolo pretty well, and we had fun conversations. I have looked at his nametag a number of times, resolved to remember his name, but back home I drew a blank. Googling around a bit for him in combination with what I did know about him soon revealed his name.

What I do mind is how much time it actually takes to preserve a bit of context around having met somebody, by trying to find out if somebody is part of an environment where that context can be preserved. When I first started doing that it was fun as sort of a detective story, but nowadays I find it simply is too time consuming, and it really sounds like something a tool can do for me just as well.

Hence my question. Would there be a way to create a search agent that takes the name of a person you’ve met? Ideally you would provide such a search agent with your own account data of all the environments you are part of that you want to have searched. And then it comes back with a number of likely search results that might contain any or all of the following for instance:

Possible blogs of that person
Possible Flickr Feed, or 23 feed
Possible Skypename
Possible IM names
Profile in OpenBc.com
Profile in LinkedIn.com
Profile at 43people.com
Possible Plazes account
Possible del.icio.us account

So that I could have a look if it indeed is the person I am looking for, and then connect or subscribe. Connecting and subscribing would be manual again. Only I can send out personal messages, only I decide what to add to the feedreader.
Any suggestions, or a sudden inspiration to start coding?
Or any stories on how you do this yourself?