Few days ago Head of Search Spam Matt Cutts gives us a video that describe how Google evaluating new search algorithm which one they are going to use or which one they are going throw away.
A question was asked by James Foster of Sydney:
What metrics Google used to calculate that one function of the ranking algorithm is gives the good quality result to user than other?
Matt Cutts give the answer into the three steps, that how they evaluate search algorithms:
- They test the results of the algorithms and compare their results rank with the new algorithms offline, If the URLs in the result are of high quality then the last algorithms takes place. The quality of a URL is based on search quality raters that how they rate the URLs in the last cases. If the URLs are not rated, then Google could request the raters to rate the new URLs or benchmark the previous search result to this set of new test. Based on these metrics, Google can decide to carry on to the next level.
- Online Tests, here Google have the sample of real live searchers and place them to the new results with the new test algorithm sets. If Google catch the high rate of clicks in new search results, then it shows that the results in this are better than older ones. Matt Cutts said that, this case is not for always but in general the more click at the specific search result page more is the quality result.
- After that the Search Quality Launch Committee of Google have to decide that the algorithm is going to live or not. Matt Cutts told that Google have a “very pretty system” but they need to filter some of his processes within the workflow.