Search Blogs Award Voting : Quality vs. Quantity

SMS Text

In this year’s Search Engine Journal Search Blogs Awards, I took a different approach at the blog rating system, giving voters the option to rate only the blogs that they want to rate. In the past, ranking each blog was required.

According to the instructions, voters were to rate blogs and other entries from 1 to 5, 5 being the highest and 1 the lowest. If they were not familiar with the blog, they could skip it. The idea in allowing this was for smaller blogs to be able to compete with blogs that have larger audience, and be judged by quality, not quantity of votes.

The true value of such awards is to share some search blogs, communities and groups which some readers may not normally visit and I hope that goal was met. I know that personally, I was introduced to several new blogs which I have made priorities on my RSS reader. If our audience and voters have done the same, the competition has served its purpose.

Some of the results are intriguing, and even different because of the selections and ratings by voters. For an example, 400 voters may have rated one blog with 30% of those votes being a 5, but 200 voters may have rated one blog with 35% of those votes being a 5.

This brings an interesting dilemma. Which is a better quality metric? The amount of votes or the percentage of readers voting for a particular blog?

So, I decided in some of the categories I will list two blogs as winners; based upon this dilemma.

Tomorrow we will be announcing the winners, and to all of you who voted, thank you

Loren Baker
Loren Baker is the Founder of SEJ, an Advisor at Alpha Brand Media and runs Foundation Digital, a digital marketing strategy & development agency.
Loren Baker
Get the latest news from Search Engine Journal!
We value your privacy! See our policy here.
  • CarstenCumbrowski

    I would suggest to calculate the rating for each blog separately, based on the votes that were given for the blog (excluding the ones that did not vote for a particular blog).

    The blog with the best rating in a category wins.

    You have to set a threshold or minimum number of votes that a blog requires to be included. I don’t know how many people voted, but a good number would be 5% as requirement for the inclusion. This means that at least 5% of the people who voted in general must have voted for a particular blog. If you don’t set a minimum, results could be skewed, because a blog with one 5 vote would be unbeatable.

    If two blogs have the same rating (with precision of 3 or more digits after the decimal point), we will have two winners instead of one.

    That is my suggestion. What do you think?

  • Search◊ Engines Web

    There was still some politics involved in the final selections – because THIS blog was not nominated …

    …and it SHOULD have been! 😐