agree AgreeStat Analytics

2-Rater Agreement: Unweighted Analysis of Raw Categorical Ratings

If you want to evaluate the extent of agreement between 2 raters only (for 3 raters or more check this document) based on categorical ratings, offers 2 options. If your ratings are organized in the form of a contingency table then use this document or this one for guidelines.  However, if your dataset is set up in the form of 2 columns of raw ratings, then you need the "2 Columns of Raw Scores" page of shown in the figure below.

You may also play this video to see step by step how to enter your data and perform a basic unweighted analysis of categorical ratings from 2 raters.

ratings from 2 raters


A Video Showing the 2-Rater Analysis of Categorical Ratings with