Going through the web logs of Bloglines, I noticed that Feedster is selectively crawling the site every half hour or so. Feedster is an RSS search engine. The interesting thing is that Feedster is only fetching one page, the list of new feeds added in the past 24 hours. My guess is that he’s written a parser for the page and is using it to find new feeds to crawl.
Smart move, from a business perspective. But, the page only changes once a day, so he doesn’t need to crawl it every half an hour. And, he could give Bloglines a plug or two. Of course, it’d be pretty easy to add a search function to Bloglines, and I plan on doing so soon. But I don’t think that’d make Bloglines and Feedster competitors.
Feedster Going through the web