AgreeStat/360: computing agreement coefficients from a contingency table (Cohen's kappa, Gwet's AC1/AC2, Krippendorff's alpha, and more)

Unweighted Analysis of Contingency Tables

Input Data

The dataset shown below is included in one of the example worksheets of AgreeStat 360. It summarizes the distribution of 107 human subjects by rater, and by psychiatric disorder. The raters are actually 2 diagnosis methods: the clinical and the research methods.

contingency table

Analysis with AgreeStat/360

To see how AgreeStat360 processes this dataset to produce various agreement coefficients, please play the video below. This video can also be watched on youtube.com for more clarity if needed.

Results

The output that AgreeStat360 produces is shown below. It contains 2 parts:

The input data along with marginal totals and percentages.
A total of 6 agreement coefficients, among which are Coehen's kappa, Gwet's AC1, and more. Each agreement coefficient is associated with a standard error, the 95% confidence interval and the p-value.

Output of agreestat/360 contingency table analysis