Start Free Trial
  1. SEJ
  2.  » 
  3. News

Google Improves Crawling and Indexing of Location-Adaptive Pages

Google Improves Crawling and Indexing of Location-Adaptive Pages

Pages can be designed to adapt to a user’s specific location, showing different content to users in different parts of the world.

While these types of pages are great for searchers in different countries, they presente crawling changes for Google. Since Googlebot uses US IP addresses, it may not be indexing all content on location-adaptive pages.

To combat this challenge Google has introduced improvements to Googlebot that will give it the ability to detect when its crawling location-adaptive pages. These improvements include geo-distributed crawling, and language-dependent crawling.

With geo-distributed crawling, Googlebot would start crawling a page using IP addresses that appear to be located both inside and outside the USA. With language-adaptive crawling, Googlebot would start to crawl with an Accept-Language HTTP header in the request.

Continue Reading Below

These new crawling configurations will be applied automatically, meaning you won’t have to change your CMS or server settings.

Even with these improvements in place, Google still says the best solution for accommodating visitors from other countries is to have separate URLs with rel=alternate hreflang annotations for each location. In addition to being better for users, it’s also best for ranking and indexing of content.

To learn more about hreflang and how to use it, check out this in depth guide that will walk you through the steps.


Subscribe to SEJ

Get our daily newsletter from SEJ's Founder Loren Baker about the latest news in the industry!

Topic(s) of Interest*
By clicking the "SUBSCRIBE" button, I agree and accept the content agreement and privacy policy of Search Engine Journal.

Matt Southern

Lead News Writer at Search Engine Journal

Matt Southern has been the lead news writer at Search Engine Journal since 2013. With a degree in communications, Matt ... [Read full bio]

Read the Next Article
Read the Next