Comments on: Best Robots.txt Tools: Generators and Analyzers http://www.searchenginejournal.com/robotstxt-generators-tools/8118/ Tue, 14 Feb 2012 09:28:52 +0000 hourly 1 http://wordpress.org/?v= By: alex http://www.searchenginejournal.com/robotstxt-generators-tools/8118/comment-page-1/#comment-1199686 alex Fri, 19 Feb 2010 02:31:12 +0000 http://www.searchenginejournal.com/best-robotstxt-tools-generators-and-analyzers/8118/#comment-1199686 can someone explain what is the point of blocking bad bots? can someone explain what is the point of blocking bad bots?

]]> By: Albert http://www.searchenginejournal.com/robotstxt-generators-tools/8118/comment-page-1/#comment-1101996 Albert Mon, 08 Jun 2009 12:37:26 +0000 http://www.searchenginejournal.com/best-robotstxt-tools-generators-and-analyzers/8118/#comment-1101996 But I won't allow bad bots... But I won’t allow bad bots…

]]> By: Albert http://www.searchenginejournal.com/robotstxt-generators-tools/8118/comment-page-1/#comment-1101995 Albert Mon, 08 Jun 2009 12:33:29 +0000 http://www.searchenginejournal.com/best-robotstxt-tools-generators-and-analyzers/8118/#comment-1101995 Thanks for the information Ann Smarty. Its is very useful. Not only google... I will allow all the bots... We need all people to come our site...! Thanks for the information Ann Smarty. Its is very useful.

Not only google… I will allow all the bots… We need all people to come our site…!

]]> By: Vic Late http://www.searchenginejournal.com/robotstxt-generators-tools/8118/comment-page-1/#comment-1092567 Vic Late Sun, 25 Jan 2009 14:30:57 +0000 http://www.searchenginejournal.com/best-robotstxt-tools-generators-and-analyzers/8118/#comment-1092567 Really good stuff ! and it works :) Really good stuff ! and it works :)

]]> By: Malte Landwehr http://www.searchenginejournal.com/robotstxt-generators-tools/8118/comment-page-1/#comment-1089600 Malte Landwehr Fri, 12 Dec 2008 17:07:36 +0000 http://www.searchenginejournal.com/best-robotstxt-tools-generators-and-analyzers/8118/#comment-1089600 I only need Notepad to create my robots.txt files but if I had to recommend a tool it would be the Google Robots.txt generator. I has everything you need and easy to use. And you can be sure that your robots.txt will work with Google ;) I only need Notepad to create my robots.txt files but if I had to recommend a tool it would be the Google Robots.txt generator. I has everything you need and easy to use. And you can be sure that your robots.txt will work with Google ;)

]]>