## Software Solutions

### AgreeStat for Excel / Windows, Mac

AgreeStat is a self-automated workbook that contains a VBA (Visual Basic for Applications) program, and therefore requires no installation. It is a point-and-click program that is easy to use, and that computes many well-known inter-rater reliability coefficients along with their standard errors. To use AgreeStat, choose one of the following 2 options:

Download a trial version of AgreeStat 2015.6.1-Windows (It contains sample datasets with instructions for analysis).
If you get an error message when opening the workbook, check
**here**. AgreeStat user's guide may be downloaded here.

Ready to buy? Please visit the
**store**.

Download a trial version of AgreeStat 2015.6-Mac, with User's Guide, and sample datasets for testing (the sample datasets also contain instructions for analysis). If you get the error message "Error in loading DLL," then check

**here**.

Ready to buy? Please visit the

**store**.

Are you using comma as the decimal symbol? Check

**here**!

Back to the top

### AgreeStat360.com / Cloud-Based

If you do not use Excel then I still expect you to use a browser to go on the Internet. The browser is indeed all you need to run AgreeStat360, the cloud version of AgreeStat.Whether you are using a PC (Windows, Linux, ...), a Mac, or even a Tablet, simply type agreestat360.com on your browser and you will have access to a convenient system for analyzing your inter-rater reliability data.

Back to the top

### R Packages & Functions

Users of the R language and computing envireonment can compute the same agreement coefficients as in AgreeStat/Excel. There are 2 ways this can be achieved:

The irrCAC and irrICC packages were both developed by Dr. Gwet to analyze Chance-corrected Agreement Coefficients (CAC) and Intraclass Correlation Coefficients (ICC). Package irrCAC is used for CAC analysis, while irrICC package is used for ICC analysis. Both packages can be installed either from CRAN as any other standard R package, or from github.

To install these packages from github, proceed as follows:

- devtools::install_github("kgwet/irrCAC")
- devtools::install_github("kgwet/irrICC")

Here is a list of downloadable R script files, each containing several R functions that can be used directly from R to compute various chance-corrected agreement coefficients:

*1) agree.coeff2.r
(for 2 raters only with ratings in a
contingency table)*

The functions in this script file compute various agreement coefficients and their standard errors when dealing with 2 raters, and ratings that are organized in the form of a contingency table (or a square matrix) showing counts of subjects by rater and category. You may use this format if each rater rated all subjects. Otherwise subjects rated by one rater and not by the other may not be properly classified.

*2)
agree.coeff3.dist.r (for 2
raters or more)*

The functions in this script file compute various agreement coefficients and their standard errors when dealing with multiple raters, and ratings that are organized in the form of an n x q table showing counts of raters by subject and category. Here n represents the number of subjects and q the number of categories.

*3)*

The functions in this script file compute various agreement coefficients and their standard errors when dealing with multiple raters, and rating data organized in the form of an n × r table showing the (alphanumeric) raw ratings that the raters assigned to the subjects. Here n represents the number of subjects and r the number of raters. The data is presented in the form of n rows containing r ratings each.

**agree.coeff3.raw.r**(for 2 raters or more - requires the script file "weights.gen.r" to be loaded as well.)*4) Weights.gen.r
(this script is required to run the
functions in the script file agree.coeff3.raw.r.)*

The functions in this script file generate various weights to be used when computing weighted agreement coefficients.

*5)
Paired t-test for agreement coefficients.r
This script file contains functions that
implement the paired t-test for testing the difference between 2
agreement coefficients for statistical significance, based on the
linearization method of Gwet (2016)*

In order to use any of the functions contained in these script files, you need to read the appropriate script into R. If you want to use the functions contained in"agree.coeff2.r" for example, then you will read this file into R as follows:

>source("C:\\YourDirectory\\agree.coeff2.r")

### SAS System

SAS
users who want to compute Cohen's kappa or Gwet's AC1 or AC2
coefficients for 2 raters, could do so using the FREQ procedure
after specifying the proper parameters. The data must be in the form
of a contingency table. Note that the AC1 option only became
available in SAS/STAT version 14.2. For coefficients other than
Cohen's kappa and Gwet's AC1, on may consider the **AgreeStat2Raters**
SAS macro.

Multiple-rater data are generally not organized in contingency
tables and cannot be analyzed with the FREQ procedure. Moreover,
Cohen's kappa is replaced with Fleiss' generalized kappa, which can
be calculated using the
**magree** SAS macro. More inofrmation on the
magree can be found
**here**. Gwet's AC1 and other agreement
statistics in this context can be calculated using the
**AgreeStat_Raw**
SAS macro.

Intraclass Correlation Coefficients could be calculated with SAS
using the
INTRACC macro. More information about the macro, including
examples can be found
**here**.

### Error Messages

You get an error message when launching AgreeStat / Windows?

This problem exists mainly on computers on which a security update recently released by Microsoft was
installed. Please check the link http://support.microsoft.com/kb/3025036/EN-US to see what Microsoft
suggests to do to get the program running.

AgreeStat / Mac: "Error in loading DLL" when Laucnhing the program

You may first want to test if VBA (Visual Basic for Applications) is installed and working. Click Tools-Macros-Record New Macro. If you get a message, "Cannot Record Macro", it means VBA isn't working and AgreeStat won't either. In this case, proceed to the next step.

The message "Error in loading DLL" is often an indication that it is necessary to reinstall Microsoft Excel and to make sure VBA is Enabled. The following link http://support.microsoft.com/kb/2435801 may help.

### Using Comma as the Decimal Symbol?

If you are from a country that uses the comma as the decimal symbol, and/or the dot as the list separator, you need to take the following actions in order to run these Excel macros smoothly:- Go to CONTROL PANEL
- Clock, Language, and Region
- Region and Language
- Additional settings ...
- Then you can change the decimal symbol, and the list separator.