AgreeStat Analytics
Research & Software for Analyzing Inter-Rater Reliability Data

 

About

The 4th edition of the handbook of inter-rater reliability covers chance-corrected agreement coefficients as well as intraclass correlation coefficients for quantitative measurements.  Various techniques are discussed in great details and many examples are used for illustration.

Below, you will find a summary of each chapter for review.  You may also want to review the Errata webpage of this book for errors reported by other readers.

• Chapter 1: Introduction
• Chapter 2: Agreement Coefficients for Nominal Ratings: A Review
• Chapter 3: Agreement Coefficients for Ordinal, Interval, and Ratio Data
• Chapter 4: Constructing Agreement Coefficients: AC1 and Aickin's α
• Chapter 5: Agreement Coefficients and Statistical Inference
• Chapter 6: Benchmarking Inter-Rater Reliability Coefficients
• Chapter 7: Intraclass Correlation: A Measure of Raters' Agreement
• Chapter 8: Intraclass Correlations in One-Factor Studies
• Chapter 9: Intraclass Correlations under the Random Factorial Design
• Chapter 10: Intraclass Correlations under the Mixed Factorial Design
• Chapter 11: Inter-Rater Reliability: Conditional Analysis
• Chapter 12: Measures of Association and Item Analysis

Handbook of Inter-Rater Reliability, 4th Edition, by Kilem Li Gwet, PhD

 

Handbook of Inter-Rater Reliability, 5th Edition, by Kilem Li Gwet, PhD

Volume 1/CAC       Volume 2/ICC

Work on the 5th edition of the Handbook of Inter-Rater Reliability is in progress. Due to a large
increase in number of pages from the 4th edition, I decided that the 5th edition will be released in 2 volumes. Volume 1 will be devoted to the Chance-corrected Agreement Coefficients (CAC), while Volume 2 will focus on the Intraclass Correlation Coefficient (ICC). You have the opportunity to review the early drafts of many chapters of this 5th edition and to submit your comments or/and questions to me.

I will appreciate it very much if you can report any typo or error to me after you review. Volume 1 chapters that are available can be downloaded here. Volume 2 chapters on the other hand would be downloaded here.