Comments on: 10 Ways to Increase Your Site Crawl Rate

By: Pankaj Singla

Pankaj Singla — Mon, 22 Feb 2010 08:57:58 +0000

Hi Ann, Thanks for the informative seo articles…….the site is very useful for beginner bloggers. Today i have read all most every article about crawl and indexation of google. But i did not find my answer. My problem is as follows” I have above 2000 pages website named sarkarinaukri.net. Before 10 Feb 2010 the post title shown in google while search keyword pharse but from that that my post title not shown in google, only blog title is coming. I think something is going to be wrong to my blog.”

In my sitemap shown in google webmaster tool url are also decreasing day by dya

Please suggest
Thanks

By: james

james — Tue, 16 Feb 2010 13:27:17 +0000

Thanks for the helpful tips. I have had a few problems with getting google to crawl my webpages recently and your post has really helped me get my website crawled properly again. This is a really helpful website you have alot of very helpful information. Thanks again

By: gptc team

gptc team — Fri, 29 Jan 2010 07:55:34 +0000

Very useful tips. I have query regarding the “Crawl rate Graph”. The data shown in the webmaster tool is not matching with my web access-log

By: dhanesh mane

dhanesh mane — Tue, 19 Jan 2010 09:08:58 +0000

Hey sonal,

This post is to increase crawl rate to your pages. I suggest you to post such questions in some other forums or yahoo answers. Its quick.
Well for your 404 problem I suggest you to implement the errordocument instead of redirecting them to home page.
Because redirecting will not solve the issue, server response code is important.

You can implement it with help of .htaccess file if u r running site on apache.
redirect rule is –
ErrorDocument 404 /error.php

This code will redirect all 404 requests to error.php and you design the error.php which will have some message like “The page that you are trying to open is not exists”. also provide some navigation there.

This will help your users and search engines also.

By: Airport Transfer

Airport Transfer — Tue, 19 Jan 2010 07:06:15 +0000

Very simple use 301 redirect the old page with new pages. if you would like to increase the crawl rate update your website content on regular basis. Only quality and updated website text or content can help you to increase the chances of your immediate crawl.

All the best Sonal!

By: sonal

sonal — Mon, 18 Jan 2010 05:47:24 +0000

I submitted some pages of my website in delicious, digg. but now i removed those pages from my website because google adsense fired me duplicate content. now these pages fired 404 error. i want to redirect 404 error page to my homepage..can u advise me?
how can i do this?

By: dhaneshmane

dhaneshmane — Tue, 22 Dec 2009 18:11:24 +0000

Hey thanks a lot for these steps. I am going to start working around these steps to increase my sites crawl rate.

By: Asad

Asad — Wed, 16 Dec 2009 09:07:03 +0000

my google Crawl stats, Pages crawled per day high:88, Average: 10, Low: 0. what ? this is best crawl stats ? Or not , please tell me anyone coz im new on google webmaster tools.

By: amit

amit — Sat, 05 Dec 2009 10:08:58 +0000

I posting content daily my website is 56 month old. 40-50 visitors daily. please check my website and tell me the solution.

By: Blaine sword

Blaine sword — Wed, 25 Nov 2009 23:05:42 +0000

Great article. I will start working on moe back links just as soon as I figure out where to get some good ones. Any ideas? Thanks again.