In recent days I saw two sudden drops in the number of sites which Technorati says link to me: from 157 to 111. The number of linking sites disappearing seems roughly in-line with new links (not necessarily new linking sites) being added at the front. The total number of links has dropped slightly, not much, and certainly not as dramatically as the number of linking sites.
This morning I took some time looking into it: Technorati seems to only take into account the first 199 links of the 267 links they report. Those 199 links indeed come from 111 sites. But older stuff is unreachable, and results in the already all too familiar Sorry, we couldn’t complete your search because we’re experiencing a high volume of requests right now. Please try again in a minute or add this search to your watchlist to track conversation. So I cannot reach stuff in Technorati that is older than 866 days or 29 months at the moment.
Every time a new page with new links appears at the front, a page of 20 old links is dumped so it seems. Those are mostly links from blog rolls from when I started blogging 3 years ago and that are still in place, so they hit my stats on how many sites are linking more than they hit the total number of links.
Now the number of links is not very relevant by itself, but that to me it looks as if Technorati is loosing data at the back door sucks.
Anybody else experiencing this?
[UPDATE] David Sifry is quick in pointing out in the comments that Technorati is NOT loosing data at the back door, and are working hard on improving their service. Certainly David’s respons time to my posting (90 minutes) is fast!
[UPDATE 2] The drop in sites linking to me as reported by Technorati is caused by a new way of evaluation. Instead of counting the total of all linking sites in the now almost 3 years of Technorati’s existence, they now look at the figures of the past 6 months. That favors dynamics in blogs more than seniority, which figures given the nature of blogs, doesn’t it?
We made some changes to how we report on Blogger influence or Authority metrics, you can see more here:
http://www.technorati.com/weblog/2005/09/50.html
Please let me know if there’s any way I or the team can be of better service to you.
BTW, we’re making a bunch of additional fixes in our URL search infrastructure over the coming weeks, which is designed to forever eliminate that dreaded “high volume of requests” screen.
Oh, and to answer your question directly, we are not dropping any data out the backdoor. 🙂
Dave
Thanks David!
For the quick reply. I updated my posting with your info.
best,
Ton