Ann Smarty

Make the Most of SEO Competitive Research : Evaluating the Competition

February 18th, 2008 by Ann Smarty | 22 Comments

Why bother about your competitors? Well, a stupid question, I know. You can’t possibly think that you can enter a new niche and get on top without looking into what has been done before you. When done properly, competitor analysis will answer your most important strategic planning questions:

  • Is it worth trying to enter this niche? Will I be able to overdo my competitors? How fast? Will long and hard victory be worth the effort? What’s my expected ROI?
  • What should I do to succeed in this niche? What shouldn’t I?
  • Who are my perspective readers/customers? What are they used to? What do they like?
  • Well, and many more, but I will stop here for now not to miss the point.

Step 1. Evaluating your overall competition.

You can either do it ‘at home’ using Google search and Excel or try paid tools returning complete competitor’s report. I usually perform all possible ways of analysis because I (1) cannot fully rely on reports compiled by someone else (be it an automatic tool or another person); (2) do not feel I have the full understanding of a niche unless I spend long hours on searching Google and compiling data into tables (yep, preferably multiple ones, and then combining tables into one table; but that’s just me, you can safely get along with a single solid report).

The idea is simple: you throw all your keywords into a spreadsheet and add the following information:

  1. Google daily/monthly estimated reach (I was using data provided by Aaron’s keyword research tool);
  2. Overall number of results in Google (broad match);
  3. The site ranked #1 for each term;
  4. Number of results for [intitle:keyword];
  5. Number of results for [inanchor:keyword];
  6. Number of results for both [intitle:"keyword" and inanchor:"keyword"] (hat tip to Ciaran) - this is your exact competition, i.e. those who use SEO (optimized titles and incoming links anchor text).


To save time you can get this information via SEOMoz keyword difficulty tool (it will also provide you with lots of other useful information: average PageRank of the top 10 sites, how many root URLs can be found in top 10 results, etc). Naturally, the best combination is when #1 is high, #2 is low (not necessarily) and #4, #5 and #6 are the lowest possible - the cases framed in green:

overall competition

Step 2. Finding your direct competitors

After you compiled your targeted keyword list, you can sort by ‘#1 in G‘ column and see the sites that is most often ranked high in Google for your chosen keywords:

direct competitors

Be sure to explore your most successful competitor’s on-site optimization: titles, H1 and H2 tags, internal site architecture, etc. I have singled out two approaches that help me to perform this kind of analysis:

  1. Don’t be too skeptical. Unfortunately most often experienced SEOs analyzing onpage optimization think they can do much better. This thought can bring you to wrongful conclusions.
  2. Learn from their mistakes. (I know, this somehow interferes with the first one, so the most important is balancing between the two.) We all know how to do it right. So analyzing what a competitor did well doesn’t help a lot. The art of seeing mistakes and at the same time being able to keep from underestimating (see #1) always brings to the right solution in the end.

And now a few tools that can also prove helpful:

1. Google Adwords Keyword Tool (free) is useful for comparing Google advertisers’ competition data and your own findings and also for differentiating commercial terms from non-commercial ones. Keywords enjoying high advertisers‘ competition are most likely targeting potential customers (while more informative [and hence less competitive] phrases usually attract people who are collecting information rather than are really willing to buy). A good way to overcome high competition while sticking to more commercial phrases is to turn (moderately) commercial phrases into long tail (e.g. per our table: ‘Tennessee fsbo‘ into ‘townsend Tennessee fsbo‘).

2. Compete.com (paid with a few trial searches) also provides some helpful type of analysis that can help you to evaluate your competition:

  • Keyword Share” shows the percentage of total referrals a site receives from a particular keyword compared to its other referrals (= this keyword referrals/other keywords referrals).
  • Keyword Engagement” shows the average time visitors tend to spend on the site after being referred by this keyword.
  • Keyword Effectiveness” all people referred by this term/total time spent on the site.

While these metrics represented by Compete.com look really promising and useful, I mostly use them for self-education and out of curiosity - just because I am more used to ‘old school’ method of looking into my referrals and learn people’s actual behavior in practice. However this can still be very useful for learning the competitors’ referrals and visitors’ [probable] behavior.

Next time I will look into most effective ways of analyzing competitor’s link building strategies. So stay tuned!

Ann Smarty is a practing search engine optimization and link building consultant as well as a very active social media user and blogger.





Comments

22 responses so far ↓

  • Utah SEO Pro on Feb 18, 2008 at 11:22 pm

    Great post Ann. I’ve never paid for Compete but those benefits look enticing. I’ll check it out :) thanks

  • spostareduro on Feb 19, 2008 at 3:16 am

    Just want to say that I learned a a lot from this post Ann. Great job.

  • SeoMexFan on Feb 19, 2008 at 5:14 pm

    Ann,

    Great post. I actually learned from this post, on how to structure a Competition Research.

  • Internet Help on Feb 21, 2008 at 6:02 pm

    Nice to see good old fashioned manual analysis. Some of these SEO tools are fantastic however periodically it’s good to undertake comparison studies using more traditional methods.

    Good post

  • Bluerank on Feb 22, 2008 at 9:19 am

    great post

  • Dave @ Wordpress Blog on Feb 28, 2008 at 4:24 am

    Nice article Ann..SEEmoz has indeed a good tool but it’s only available to premium members. Nichwtach has a free tool where they show you the in anchor/title from your competitiors.

    And indeed good to read a solid article about keyword research without ’secret ninja techniques’

    Dave

  • Tom seo services on Feb 29, 2008 at 11:01 pm

    I’ll check it out :) thanks

  • Lucio Ribheiro on May 13, 2008 at 9:32 pm

    Being on the industry for quite few time its always great to find out other ways to do our jobs.
    thanks
    Lucio

  • Trevor on May 16, 2008 at 10:50 am

    Very informative article…especially the part about finding your top competitors in relation to the keywords you are targeting.

  • Automotive Social Network on May 25, 2008 at 8:35 pm

    These are really the first step to take before jumping into a web business. Especially if it is not worth all the effort.

  • Ernest on Jun 23, 2008 at 9:18 am

    Yeah another round of good tips, I’ll defintely be reviewing this and adding to the tool box so to speak! Thanks.

  • Web Agency Chieti on Jun 24, 2008 at 12:58 am

    Great suggestions Ann. It’s always a pleasure read your posts.

  • Eurodipity on Jun 29, 2008 at 7:05 pm

    Nice tools

  • ESEO on Jun 30, 2008 at 6:22 pm

    My question is how do we get competitive intel on content. I undertand how to check thier coding, and titles, etc., but how do we find out how much relative content a comp has? So that we know how much content we have to write in order to on top? I see pages with hundreds of thousands of pages, they can’t be writing this all.

    My question is when i am looking at keywords and I am trying to get a handle on how much true content a competitor has so that i may be able to match or exceed it is there a simple way of searching? Currently I do a google search of site:url.com and that brings back thousands of pages for my competitor and Im thinking to myself this cant be right and when i look through it seems that google has ranked some of thier dynamic data as well. Then i try (”keyword” site:url.com)and although i get s smaller number im still getting hundreds of thousands of pages and Im thinking to myself how do i compete they can’t have this many pages of content they are tricking the system somehow. Is there a way to determine hoe much content I truely need to be competitive. My search term is “aurora Colorado homes for sale” I a a real estate agent. The site that is ranked in the top 5 in all of my keywords is a site by the url of http://www.cohomefinder.com and they seem to have hundreds of thousands of pages of content. Is this true or are they tricking the system some how and if so how do i compete?

  • Ann Smarty on Jul 7, 2008 at 4:50 am

    @ESEO : I don’t think content quantity plays the major role here. Besides, you can’t be competing with only one site…

  • Mocazo on Jul 21, 2008 at 1:51 am

    Hi first we must know about your competition websites what they are giving some thing different to our project is it free or pay abserve all these things in ur mind:

    Welcome to Mocazo Club

    http://club.mocazo.com/group/mocazokishaan

    Mocazo Kishaan Upload your self-creation. It could be a music video of your rock band, short film, advertisement, a piece of photography, a poem…..may be any kind of talent acting, Cooking, Dancing, DJ (Disc Jockey), Handicrafts, Instrumental Music, Makeup artist, Others, Writing & Literature , Stand up Comedy , Sports, Singing, Photography, Painting, it could be anything original and rational…You can send in any number of entries. And if your content gets sold you get a part of the royalty. More details visit: http://club.mocazo.com/

    Regards
    Mocazo Club

  • Search Engine Ranking on Jul 30, 2008 at 5:53 pm

    If you want to spy on your competition, and see what keywords they are ranking for in GOOGL top 20 SERPs, then use SEOdigger.com It is an awesome tool that uses a 60 million key-word database and within seconds scans to see if any site ranks for any keyword in the database. It is absolutely brilliant. You can use it to see which key-words your current site is ranking for, it is very useful, because there may be many term that it comes up with, that you may have not thought of. I would rank this tool the best among all search engine ranking and placement tools available on the net TODAY.

  • Alma Gray on Sep 13, 2008 at 2:22 pm

    Semantic search is something I have been researching recently. I am glad to see the mention.

  • Limo Hire Nottingham on Oct 19, 2008 at 11:18 am

    i will try some of your tools

  • Robert falco on Oct 21, 2008 at 9:26 am

    Nice and informative post.

  • Josh Millrod on Feb 28, 2009 at 3:48 pm

    Another addition to the list of numbers you should collect might be a supply/demand ratio.

    Supply - # of pages with exact match
    Demand - # of monthly searches

    It’s a good way to tell how many pages are competing for each visitor for a given keyword. Also great for generating niche content.

  • Franz on May 13, 2009 at 7:08 pm

    … and one should have an EXCEL/ODT sheet that tracks these figures regularly plus the number of backlinks, site impressions, goal conversions and all that and show progress (hopefully) and give analytical hints on what change (was it a new keyword, a recent e-Mail campaign, or a backlink from a high PageRank site?) caused what improvement.

Leave a Comment