Review scores are entirely subjective. What one person finds utterly distasteful, another may find to be the apex of cultural accomplishment (poop smeared on a canvas, for example). Perception influences review scores, no matter what anybody says; there’s no such thing as a completely objective review. That being said, we’ve come to the conclusion that numerical review scores, star ratings, and other quantitative metrics are inherently flawed, because a “90 out of 100″ may mean completely different things to different reviewers. What we needed to do was move to a qualitative metric for our reviews, providing a simple, easy to understand, and easily relatable scale of worth and value.
So that’s what we did.
Here is what our old review system looked like, from the last review it was used on:
Review
| Pros | Cons |
|---|---|
| Take a hike, air bands Local and online MP rocking out CRAZY. TRAIN. Three-part harmonies | Store loads slowly Requires pricey peripherals Song purchases would be easier at 80MSP |
| Rating |
It was simple, and effective, but required a numerical score.
Here is what our new system looks like, from its debut review:
Review Results
- Full wireless functionality
- Sharp sound, full 7.1
- Simple setup
- Improved comfort
- Hotswappable batteries with charger in base
- Battery life readout on game screen
- Fantastic range
- $299 is the price of a new console
Potentially holds same design flaw for larger headed individuals(edit: See video and new content above)- Wireless chatpad cannot be used simultaneously as wireless chat (edit: Xbox 360 flaw, not Warhead flaw – see first content edit for more details)
Final Word:
FANTASTIC
Now, with a numerical range like our 100 point scale, you had immediate context about what the score means. Simply seeing “FANTASTIC” doesn’t really give you much context, so here…have some context:
FANTASTIC
A “FANTASTIC” rating doesn’t necessarily mean that the reviewed product is perfect, but that its pros so thoroughly outweigh its cons that the cons become absolutely forgettable or forgivable.
GOOD
A “GOOD” rating means that the product is definitely worthwhile, and did more right than it did wrong. Some of the product’s problems may be a bit more glaring and blatant, but they don’t ruin the experience.
AVERAGE
An “AVERAGE” rating goes to products that neither impress nor disappoint, or impress and disappoint equally.
POOR
A “POOR” rating is pretty much the opposite of a “GOOD” rating. This product did more wrong than it did right, and what it did wrong, it did spectacularly wrong.
BAD
A “BAD” rating is reserved for the worst of the worst. This product has few, if any, redeeming qualities, and should be ashamed of itself. It’s bad, and it should feel bad.
This is our new review scale. One word, relatable context.
