Please login or register.
Login with username, password and session length

The Nihon Review Forum

October 23, 2017, 09:49:17 AM
News: Check us out on Twitter and Facebook!
Pages: [1]   Go Down

Author Topic: The New Rating System  (Read 8332 times)

Offline Tamashii

  • Always Very Prepared
  • Administrator
  • Full Member
  • *****
  • Posts: 392
    • http://www.nihonreview.com

The New Rating System
« on: July 25, 2005, 02:22:00 PM »
This thread is an attempt to calm the nerves of not only our reviewers (some have been "idle" for months...) but also our readers and members.

As you all know, there is a new rating system to "rate" the reviews. I'd like to say first off that a rating system does not immediately determine the quality of a title, but instead is only a guide. The true gem is the review itself.

THE RATING SYSTEM
It is a 0 to 10 system, with no decimals. 0 being "Bad enough that it does not deserve a grade whatsoever", and 10 being "Good enough that it should deserve the highest possible honors, but not to the extent that it is considered perfect". The notion that something can be perfect is flawed, therefore, 10 is not a perfect grade, but instead, a grade that represents 'near perfection', that it cannot, realistically, get any better. Also, a 5 is average. This system is a get-away from the classic school grading system that considers 70% as "average". Clearly that was flawed, so we have decided to use this out of 10 system, which suits our goals better.

Below are the "phrase" pairings for each grade, which are used to enhance the appeal of the grade and also to reduce confusion over what is average and what is not.

10 - Incredible
9 - Fantastic
8 - Awesome
7 - Good
6 - Above Average
5 - Average
4 - Below Average
3 - Poor
2 - Horrible
1 - Too Ugly
0 - Avoid At All Costs

[Music reviews still retain the out of 5 system for specific songs, but for the entire album in general, this sytem will be used]

THE HIGHLIGHTS SYSTEM
As you all know, we have rid ourselves of the highs/lows and favor a better, more flexible yet precise system called Highlights. The Highlights is a section where the reviewer lists several aspect of the title and gives each listed aspect a few words of praise OR disgust. The reviewer is not restricted to any specific aspect, one could even list "Atmosphere" or "Designs" as an aspect. The Highlights, as it suggests, only points out noteworthy aspects, whether it be positive or negative.
Here is an example from the review of Berserk by Kuma:

Characters: Fantastic characters and character relationships.
Plot: Intricate; full of twists, turns, and cliffhangers.
Ending: The biggest cliffhanger of all.
Music: Annoying.

Notice how "Ending" was not necessarily positive or negative, but it is nonetheless noteworthy. A reviewer can pull this off if they wish. The most important thing to remember is not whether or not it is positive or negative, but whether it is noteworthy.
« Last Edit: July 25, 2005, 02:26:49 PM by Tamashii »

Offline yanyanman2

  • Newbie
  • *
  • Posts: 0

The New Rating System
« Reply #1 on: July 30, 2005, 04:30:45 PM »
yeah...its me hehe

this new grading system is terrific-- ive always preferreed 1-10 scales (no decimals), and the highlights feature is intuitive and really appropriate.  two thumbs up guys, ill be watchin the site :D

props to tama, pheld (or wutever he goes by these days), and all the old crew
peace and good luck

-juan

Offline Tamashii

  • Always Very Prepared
  • Administrator
  • Full Member
  • *****
  • Posts: 392
    • http://www.nihonreview.com

The New Rating System
« Reply #2 on: July 31, 2005, 11:04:25 AM »
Awesome, thanks!

See you around!

Offline ReadorDie

  • Teh Newbie Reviewer
  • Jr. Member
  • **
  • Posts: 58

The New Rating System
« Reply #3 on: July 31, 2005, 07:33:10 PM »
Question: So us reviews have to reformat our old reviews?

Offline DarkKanti

  • Justice For All
  • Ex-Reviewer
  • Full Member
  • *****
  • Posts: 256

The New Rating System
« Reply #4 on: August 01, 2005, 12:43:22 AM »
Holy crap yanyanman!  Haven't seen him around in forever...

The new system kicks ass.  I have to give it to you tama, I really enjoy using this system.

The Nihon Review Presents 2006: A Year in Review

Offline Tamashii

  • Always Very Prepared
  • Administrator
  • Full Member
  • *****
  • Posts: 392
    • http://www.nihonreview.com

The New Rating System
« Reply #5 on: August 01, 2005, 01:10:26 PM »
ReadorDie: I think I made that clear in my emails, the "Cool new ideas" thread....and this....


Of course it kicks ass! I made it!

/cocky off

Offline ReadorDie

  • Teh Newbie Reviewer
  • Jr. Member
  • **
  • Posts: 58

The New Rating System
« Reply #6 on: August 01, 2005, 01:12:41 PM »
Quote from: Tamashii
ReadorDie: I think I made that clear in my emails, the "Cool new ideas" thread....and this....


Of course it kicks ass! I made it!

/cocky off


I didn't get the emails, that's why.  Sorry bout that...

Oh, and Tama, I didn't think your cocky was EVER off.

Offline soundchazer

  • Jr. Member
  • **
  • Posts: 23

Re: The New Rating System
« Reply #7 on: October 04, 2006, 11:05:23 AM »
To be quite honest, I prefer this system that the one we use at "taht other place". It gives me a lot of headaches when reviewing.

Think about it. What is the difference between an 87 and an 85?

Just a thing that bugs me. I thought Awesome, Incredible and Fantastic where pretty much synonyms. Wouldn't a little more explanation help? Or at least change it to "Perfect" "Awesome" "Highly enjoyable" or something more descriptive?

Just a thought.


My DVD Collection
Currently viewing:
Honey & Clover 20/?? | Okusama wa mahou shoujo 9/??  |  Miracle Girls  10/51  |  Yakitate!! Japan 37/?? |Speed Grapher 16/??

Offline sevenzig

  • Administrator
  • Newbie
  • *****
  • Posts: 1
    • Chat with sevenzig using Skype
    • Steam Community :: sevenzig

Re: The New Rating System
« Reply #8 on: October 04, 2006, 02:43:04 PM »
Our vocabulary is limited, or at least mine is. I agree wholeheartedly.

Now if only we could get you all "from that other place" now that Kain resigned. :>

Offline Tamashii

  • Always Very Prepared
  • Administrator
  • Full Member
  • *****
  • Posts: 392
    • http://www.nihonreview.com

Re: The New Rating System
« Reply #9 on: October 04, 2006, 03:46:53 PM »
God this old man isn't dead yet? What's up?

Offline soundchazer

  • Jr. Member
  • **
  • Posts: 23

Re: The New Rating System
« Reply #10 on: October 04, 2006, 03:58:59 PM »
Quote from: Tamashii
God this old man isn't dead yet? What's up?

Certainly not my willy wonka. I need viagra for that, being old and all. ;)


My DVD Collection
Currently viewing:
Honey & Clover 20/?? | Okusama wa mahou shoujo 9/??  |  Miracle Girls  10/51  |  Yakitate!! Japan 37/?? |Speed Grapher 16/??

Offline Sorrow-kun

  • War Criminal
  • Administrator
  • Hero Member
  • *****
  • Posts: 1626
    • Sorrow-kun's Profile - MyAnimeList.net
    • Chat with sorrow-k using Skype
    • Steam Community :: Sorrow_kun
    • @Sorrow_kun
    • The Nihon Review

Re: The New Rating System
« Reply #11 on: October 04, 2006, 04:32:44 PM »
"Incredible" was changed to "As Good As It Gets" which nicely defines what type of title gets the top score: Not perfect, since that's impossible, but the among the best of the best.  "Too Ugly" was also changed to "Disgusting".  It is a good system, but there are times where I've thought two titles were streets apart in quality, but ended up giving them the same rating.  There are also lots of times where I've been torn between giving two ratings for a title, and not whether to give it the higher or lower rating.

Offline Tamashii

  • Always Very Prepared
  • Administrator
  • Full Member
  • *****
  • Posts: 392
    • http://www.nihonreview.com

Re: The New Rating System
« Reply #12 on: October 04, 2006, 04:39:37 PM »
In those cases, I always try to make sense of it by having my own personal definition of each rating (which as I have mentioned in the past, is quite true for everyone here--not everyone sees an 8 as I would) and sticking to that definition whenever I write a review. I can understsand the difficulty at times on choosing certain ratings for certain anime, but isn't that true of any rating system? Does that 3-star really feel like a 3-star or is it a 3.752 stars? But we should all understand by now that the rating is not the significant part of a review, and is only superficial.

By the way, this thread is incredibly out-dated, especially the mention about the music rating. o.O wow I can't believe I wrote this over a year ago...how time flies!

Offline Kuma

  • Avenging Viking Princess
  • Ex-Reviewer
  • Full Member
  • *****
  • Posts: 153

Re: The New Rating System
« Reply #13 on: October 05, 2006, 01:53:46 PM »
Quote from: Sorrow-kun
It is a good system, but there are times where I've thought two titles were streets apart in quality, but ended up giving them the same rating.  There are also lots of times where I've been torn between giving two ratings for a title, and not whether to give it the higher or lower rating.


Same here, which is the reason I wanted us to have .5s available when the issue came up back in the day.  While there are the occasional reviews that have the same grade yet are noticeably different, adding .5s really wouldn't solve the problem.  I'm quite happy with our current system, although soundchazer does bring up a good point.
Pages: [1]   Go Up