Yahoo Blocks Bots From Delicious Bookmarks
February 28, 2008Yahoo’s Delicious (del.icio.us) social bookmarking property has been reportedly blocking spiders and bots from non-Yahoo search engines from visiting the site and spotting new sites, web pages and bookmarks. Experts believ that it is not a simple robots.txt exclusion. Instead it is a 404 response that is being served on the basis of the requesting User-Agent. They also found the Delicious pages that are listed in Google are lacking a title, cache, description and various other information.
Yahoo surely has a competitive advantage over MSN, Google, MSN and Ask.com as it is able to recognize web pages and other content through human bookmarking on Delicious much before the search engine bots can do so. Yahoo also has the ability to categorize web documents with the help of human descriptions and tagging, lending external meta data to these documents. This can result in more suitable web results as well as intent targeted rankings.
Yahoo has incorporated Delicious into its search results. Thus it is quite obvious that Delicious has a very significant position in Yahoo Search. Yahoo is now taking full benefit of its property by restricting its competition from crawling any such information. It is really a brave thing for Yahoo to do as Delicious is user powered.
1 Comment
RSS feed for comments on this post
TrackBack URI
Leave a comment
Just Search Weblog
Archives:
- July 2008
- June 2008
- May 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
Pages:
Meta:
Categories:
- Affiliate Marketing
- Analytics
- AOL
- Directories
- Domains
- eMail Marketing
- Internet Marketing
- Internet News
- Internet Service Providers
- IT
- Microsoft
- Mobile
- PPC
- SEM
- SEO
- Social Networking
- Yahoo!
Last five articles:
- Facebook’s iPhone App ver 1.1 with innovative features
- The German Wikipedia checker-approved version
- Consumers in the UK switching from traditional shops to online shopping
- Softness in Google’s advertising revenue self-inflicted, according to analysts
- Apple, Google, Netflix , Amazon and Microsoft try to dominate digital video market
I don’t believe that there is a real chance for Yahoo. del.icio.us is a nice relict from the time when Web 2.0 started. But it is not state-of-the-art at all. So if Yahoo would like to use this Social Bookmarking data for itself, I believe no other Search Engine has a problem with it. The market share of Yahoo is too small that this blocking could be important. Perhaps this is one of those tries of Yahoo to show more current search results, but they will not catch Google with it.
CommentbyWulffy February 28, 2008 @ 1:08 pm