Got Ads?
2/08/2006
  Google helps with robots.txt

Matt Cutts tells us how Google's sitemaps site now lets you test drive changes to your robots.txt files. That's a huge help. Thanks Google.

BTW, Google's Sitemaps really work. I was a bit of a conspiracy theorist about them (i.e. would google use the knowledge of who owns sites to mark down all of your sites if one was a bit iffy?). But they really do get you indexed faster.

For RouterComp, my new network equipment price comparison site, I put up a sitemap of about 3500 pages at Google, and Google had a lot of the pages in the index within 3 days! Yahoo hasn't slurp'd much past the homepage yet. And MSN, I don't think it's ever come by yet.

So don't delay - make sure you get that sitemap mojo workin'

 




<< Home

Subscribe to GotAds?



Links



Recent Posts

Google helps with robots.txt


Archives

February 2005 /  March 2005 /  April 2005 /  May 2005 /  June 2005 /  July 2005 /  August 2005 /  September 2005 /  October 2005 /  November 2005 /  December 2005 /  January 2006 /  February 2006 /  March 2006 /  April 2006 /  May 2006 /  June 2006 /  July 2006 /  August 2006 /  September 2006 /  October 2006 /  November 2006 /  December 2006 /  January 2007 /  February 2007 /  March 2007 /  April 2007 /  May 2007 /  June 2007 /  July 2007 /  August 2007 /  September 2007 /  October 2007 /  November 2007 /  December 2007 /  January 2008 /  February 2008 /  March 2008 /  April 2008 /  May 2008 /  June 2008 /  July 2008 /  August 2008 /  September 2008 /  November 2008 /  December 2008 /  January 2009 /  March 2009 /