- Relative rank
- Score for each criterion
- Composite score for all criteria
|
Multiple raters compare (rank) people, products or ideas against each other based on a number of predetermined criteria. |
The central problem with most rating systems is that it requires judgments to be made in an absolute sense; they refer to ideals. But, most real world judgments are not made this way and - consciously or not - usually involve a comparison of alternatives. The OJQ makes use of this fact by asking raters to make comparisons rather than absolute judgments. As a result, Wyvern OJQ achieves a higher degree of rater agreement than other procedures that use non-comparative or likert scales. |