Krippendorff’s Alpha is another measurement of inter-rater reliability. The advantage of this approach is that it supports categorical, ordinal, interval, and ratio data and also handles missing data.
Topics
- Basic Concepts
- Standard Error and Confidence Intervals
- Non-Categorical Ratings
- Real Statistics Support
Links
References
Gwet, K. L. (2015) On Krippendorff’s alpha coefficient
https://agreestat.com/papers/onkrippendorffalpha_rev10052015.pdf
Krippendorff, K. (2004) Reliability in content analysis: some common misconceptions and recommendations. University of Pennsylvania paper.
https://www.academia.edu/21851693/Reliability_in_Content_Analysis_Some_Common_Misconceptions_and_Recommendations
Girard, J. M. (2016) Krippendorff’s alpha coefficient, GitHub
https://github.com/jmgirard/mReliability/wiki/Krippendorff’s-alpha-coefficient
Gwet, K. L. (2015) Standard error of Krippendorff’s alpha coefficient
http://inter-rater-reliability.blogspot.it/2015/08/standard-error-of-krippendorffs-alpha.html
Excellent