The Nihon Review Forum

Everything Else => The Nihon Review => Topic started by: Tamashii on July 25, 2005, 02:22:00 PM

Title: The New Rating System
Post by: Tamashii on July 25, 2005, 02:22:00 PM
This thread is an attempt to calm the nerves of not only our reviewers (some have been "idle" for months...) but also our readers and members.

As you all know, there is a new rating system to "rate" the reviews. I'd like to say first off that a rating system does not immediately determine the quality of a title, but instead is only a guide. The true gem is the review itself.

THE RATING SYSTEM
It is a 0 to 10 system, with no decimals. 0 being "Bad enough that it does not deserve a grade whatsoever", and 10 being "Good enough that it should deserve the highest possible honors, but not to the extent that it is considered perfect". The notion that something can be perfect is flawed, therefore, 10 is not a perfect grade, but instead, a grade that represents 'near perfection', that it cannot, realistically, get any better. Also, a 5 is average. This system is a get-away from the classic school grading system that considers 70% as "average". Clearly that was flawed, so we have decided to use this out of 10 system, which suits our goals better.

Below are the "phrase" pairings for each grade, which are used to enhance the appeal of the grade and also to reduce confusion over what is average and what is not.

10 - Incredible
9 - Fantastic
8 - Awesome
7 - Good
6 - Above Average
5 - Average
4 - Below Average
3 - Poor
2 - Horrible
1 - Too Ugly
0 - Avoid At All Costs

[Music reviews still retain the out of 5 system for specific songs, but for the entire album in general, this sytem will be used]

THE HIGHLIGHTS SYSTEM
As you all know, we have rid ourselves of the highs/lows and favor a better, more flexible yet precise system called Highlights. The Highlights is a section where the reviewer lists several aspect of the title and gives each listed aspect a few words of praise OR disgust. The reviewer is not restricted to any specific aspect, one could even list "Atmosphere" or "Designs" as an aspect. The Highlights, as it suggests, only points out noteworthy aspects, whether it be positive or negative.
Here is an example from the review of Berserk by Kuma:

Characters: Fantastic characters and character relationships.
Plot: Intricate; full of twists, turns, and cliffhangers.
Ending: The biggest cliffhanger of all.
Music: Annoying.

Notice how "Ending" was not necessarily positive or negative, but it is nonetheless noteworthy. A reviewer can pull this off if they wish. The most important thing to remember is not whether or not it is positive or negative, but whether it is noteworthy.
Title: The New Rating System
Post by: yanyanman2 on July 30, 2005, 04:30:45 PM
yeah...its me hehe

this new grading system is terrific-- ive always preferreed 1-10 scales (no decimals), and the highlights feature is intuitive and really appropriate.  two thumbs up guys, ill be watchin the site :D

props to tama, pheld (or wutever he goes by these days), and all the old crew
peace and good luck

-juan
Title: The New Rating System
Post by: Tamashii on July 31, 2005, 11:04:25 AM
Awesome, thanks!

See you around!
Title: The New Rating System
Post by: ReadorDie on July 31, 2005, 07:33:10 PM
Question: So us reviews have to reformat our old reviews?
Title: The New Rating System
Post by: DarkKanti on August 01, 2005, 12:43:22 AM
Holy crap yanyanman!  Haven't seen him around in forever...

The new system kicks ass.  I have to give it to you tama, I really enjoy using this system.
Title: The New Rating System
Post by: Tamashii on August 01, 2005, 01:10:26 PM
ReadorDie: I think I made that clear in my emails, the "Cool new ideas" thread....and this....


Of course it kicks ass! I made it!

/cocky off
Title: The New Rating System
Post by: ReadorDie on August 01, 2005, 01:12:41 PM
Quote from: Tamashii
ReadorDie: I think I made that clear in my emails, the "Cool new ideas" thread....and this....


Of course it kicks ass! I made it!

/cocky off


I didn't get the emails, that's why.  Sorry bout that...

Oh, and Tama, I didn't think your cocky was EVER off.
Title: Re: The New Rating System
Post by: soundchazer on October 04, 2006, 11:05:23 AM
To be quite honest, I prefer this system that the one we use at "taht other place". It gives me a lot of headaches when reviewing.

Think about it. What is the difference between an 87 and an 85?

Just a thing that bugs me. I thought Awesome, Incredible and Fantastic where pretty much synonyms. Wouldn't a little more explanation help? Or at least change it to "Perfect" "Awesome" "Highly enjoyable" or something more descriptive?

Just a thought.
Title: Re: The New Rating System
Post by: sevenzig on October 04, 2006, 02:43:04 PM
Our vocabulary is limited, or at least mine is. I agree wholeheartedly.

Now if only we could get you all "from that other place" now that Kain resigned. :>
Title: Re: The New Rating System
Post by: Tamashii on October 04, 2006, 03:46:53 PM
God this old man isn't dead yet? What's up?
Title: Re: The New Rating System
Post by: soundchazer on October 04, 2006, 03:58:59 PM
Quote from: Tamashii
God this old man isn't dead yet? What's up?

Certainly not my willy wonka. I need viagra for that, being old and all. ;)
Title: Re: The New Rating System
Post by: Sorrow-kun on October 04, 2006, 04:32:44 PM
"Incredible" was changed to "As Good As It Gets" which nicely defines what type of title gets the top score: Not perfect, since that's impossible, but the among the best of the best.  "Too Ugly" was also changed to "Disgusting".  It is a good system, but there are times where I've thought two titles were streets apart in quality, but ended up giving them the same rating.  There are also lots of times where I've been torn between giving two ratings for a title, and not whether to give it the higher or lower rating.
Title: Re: The New Rating System
Post by: Tamashii on October 04, 2006, 04:39:37 PM
In those cases, I always try to make sense of it by having my own personal definition of each rating (which as I have mentioned in the past, is quite true for everyone here--not everyone sees an 8 as I would) and sticking to that definition whenever I write a review. I can understsand the difficulty at times on choosing certain ratings for certain anime, but isn't that true of any rating system? Does that 3-star really feel like a 3-star or is it a 3.752 stars? But we should all understand by now that the rating is not the significant part of a review, and is only superficial.

By the way, this thread is incredibly out-dated, especially the mention about the music rating. o.O wow I can't believe I wrote this over a year ago...how time flies!
Title: Re: The New Rating System
Post by: Kuma on October 05, 2006, 01:53:46 PM
Quote from: Sorrow-kun
It is a good system, but there are times where I've thought two titles were streets apart in quality, but ended up giving them the same rating.  There are also lots of times where I've been torn between giving two ratings for a title, and not whether to give it the higher or lower rating.


Same here, which is the reason I wanted us to have .5s available when the issue came up back in the day.  While there are the occasional reviews that have the same grade yet are noticeably different, adding .5s really wouldn't solve the problem.  I'm quite happy with our current system, although soundchazer does bring up a good point.