Krippendorff’s Alpha is another measurement of inter-rater reliability. The advantage of this approach is that it supports categorical, ordinal, interval, and ratio data and also handles missing data.
Topics
- Basic Concepts
- Standard Error and Confidence Intervals
- Non-Categorical Ratings
- Real Statistics Support
References
Gwet, K. L. (2015) On Krippendorff’s alpha coefficient
https://agreestat.com/papers/onkrippendorffalpha_rev10052015.pdf
Krippendorff, K. (2004) Reliability in content analysis: some common misconceptions and recommendations. University of Pennsylvania paper.
http://faculty.washington.edu/jwilker/559/Krippendorf.pdf
Girard, J. M. (2016) Krippendorff’s alpha coefficient, GitHub
https://github.com/jmgirard/mReliability/wiki/Krippendorff’s-alpha-coefficient
Gwet, K. L. (2015) Standard error of Krippendorff’s alpha coefficient
http://inter-rater-reliability.blogspot.it/2015/08/standard-error-of-krippendorffs-alpha.html
Excellent