Xoc Scale Search Engine Ratings

There are three factors in determining the quality of a spidering search engine (SE).

1. SQ (spider quality): The spider must come by frequently and must crawl deep. Must honor robots.txt. The results of spidering must then be rolled into online database quickly.
2. SR (search engine results page): The SERP must then show relevant results based off the data they have collected from the spider. Summary must give info on whether to click through or not. Page must be pleasant. 404s must be few and far between.
3. CS (customer service): Response from a human to questions in a quick and reasonable manner. Free and easy submit pages.

Let's call my ranking system the Xoc Scale (XS). It awards an engine up to 5 points for SQ, and 5 more for SR. Now you could also give points for Customer Service (CS), but the End-User (EU) doesn't care much about that, and the EU is picking the SE. So a CS score is placed in parens, but doesn't count toward XS ranking.

EUs are slow to change SEs, but if they continue to get bad results, they eventually decide to change, and they try a few engines, listen to friends, etc. So I believe the Xoc Scale eventually determines which engine they will likely switch to.

Based off this, and my own subjective analysis of my log files, I rate them like this:

1. Google: Spider is excellent, crawls deep. The database takes four weeks to update, which could be better and makes Google not good for looking for fast-breaking news. 4.5SQ. SERP is relevant. Usually the page I'm looking for is in the top few listings, and rarely after position 20. Listings could be a little clearer and allow better information to decide if I want to click-through. 4.5SR. Customer Service seems good and responsive in the one contact I've had with them, although the final outcome of what the engineers did could be slightly better; still they did something to their algorithm based on my request within 4 weeks. 4.5CS. FINAL RANKING: 9.0XS (4.5CS)
2. Fast: Spider is excellent, crawls deep. In my experience it crawls non-PDF files and dynamic content deeper and more frequently than Google. All pages that it finds get indexed. Needs PDF and dynamic content results. 4.5SQ. SR, though, needs a lot of work. The top results are just not relevant and pages that I'm looking for are frequently buried deep. 3.0SR. Submit page is fine, have had no dealings with customer service. Not enough info to rate CS. FINAL RANKING: 7.5XS(?CS)
3. AltaVista: Spider is good when you can get it, but not as good as Google or Fast. Results are slow to make their way into the database. 3.0SQ. Result pages are easy to read, but relevancy has declined a huge amount. 3.0SR. Customer Service got back to me in a few hours on my one contact with them. Submit page works well. 4.5CS (although others may feel different). FINAL RANKING: 6.0XS(4.5CS)
4. Inktomi: Spider is slow. Usually hits my home page once every couple of days, then goes away. Results are even slower to get online. 2SQ. Results page are relatively easy to read, and relevancy seems good, although outdated. 3.5SR. Have had no contact with CS. FINAL RANKING: 5.5XS(?CS)
5. Excite: Spider is slow. Usually hits my home page once every couple of days, then goes away. Results are even slower to get online. 2SQ. Results page allow a lot of spam, and because of slow updates have a lot of 404s. 2.5SR. No contact with CS. 2SQ. FINAL RANKING: 4.5XS(?CS)
6. Northern Light: Spider comes by frequently. Crawls moderately deep. Don't have enough info on how frequently it updates the database. 3.0?SQ. I find the SERP hard on the eyes and relevancy is extremely low. 1.5SR No contact with CS. FINAL RANKING: 4.5?XS(?CS)

Last updated 2001-04-17