agree AgreeStat Analytics

2-Rater Agreement: Weighted Analysis of Raw Categorical Ratings

If you want to perform a weighted analysis of the extent of agreement between 2 raters, based on ordinal ratings, offers 2 options. If your ratings are organized in the form of a contingency table then use this document for guidelines.  However, if your dataset is set up in the form of 2 columns of raw ratings, then you need the "2 Columns of Raw Scores" page of shown in the figure below.

You may also play this video to see step by step how to enter your data and perform a weighted analysis of categorical ratings from 2 raters.

ratings from 2 raters

A Video Showing the 2-Rater Weighted Analysis of Categorical Ratings with