A few days ago i would suggest that you should…But lately i’ve seen some strange results on my blog.For example my tags and or categories ranking higher than my actual post.In fact in some cases my tag and or categories score a first page result whereas the actual post might be lower in first page or not first page at all…The search results for the specific keywords are of course less than 100,000 so this might be a reason for this “problem” since there are not many trustworthy results so google ranks high my supplemental results too…Anyhow i would like an expert to comment on this even if i commented on an on year old post :P

I also want easy solutions for other people to adopt if I make changes myself.

WordPress duplicate content can actually be used to your advantage if you want to go a little geeky in your SEO

http://andybeard.eu/2007/06/wordpress-seo-masterclass-for-competitive-niches.html

I took a step back to think about what value the category/archive pages have in relationship to the entire content when looking at our company blog. Essentially, the core value is in the individual posts – with the categories providing a user-friendly way to access specific content, but not necessarily unique within itself. If I block the duplication from being indexed, even though its just part of the user experience (and not meant to be misleading), the logic is that the Google can crawl and index exactly what I want.

The key difference here are that the domain already had some (not great but some) age and value with inbound links versus working with an entirely new domain. It’s also pretty early in the launch, so it may be too early to tell.

Interestingly, Google is crawling and indexing the material at an incredibly fast rate. Posts written 2 days ago are already in the main index.

The robots.txt solution did work for me and within a week my posts were out of supplemental. I know some others have seen the same thing I did, but some didn’t. Now I’m wondering if the plugin might be the reason.

First – I modified the permalink structure so that only the post title appeared after domain.com/blog/

Then, I blocked Google from indexing category pages and yearly archives (robots.txt). In the perfect world, I’d love to create unique content on each category, but that would have been incredibly time consuming and past efforts had failed to get other blogs out of the supplemental results.

For whatever reason, Yahoo and MSN don’t have issues with the duplication of archives.

Our posts are now individually indexed in Google’s regular results

Note – I actually have to give the props to Scoreboard Media. I’d been fishing around other people’s Robots files (that were using WordPress) and I liked their solution the best (and it’s working).

I may try to expand upon this whole thing on our blog, as it all happened in coordination with a web hosting change, redirect etc etc.

I found a couple of threads on Webmasterworld that led me to the solution which I blogged about (apologies for the link)

The gist of the solution was to block the feeds in my robots.txt file with the use of wildcards for Googlebot. In about a week all the posts were back in the main index.