Classical Test Theory and Item analysis describes techniques that evaluate the effectiveness of items in tests. The two principal measures used in item analysis are item difficulty and item discrimination.
Topics
- Basic Concepts
- Interpretation
- Real Statistics Functions
- Handling Partial Credit
- Real Statistics Data Analysis Tool
References
Matlock-Hetzel, S. (1997) Basic concepts in item and test analysis. Texas A&M
http://ericae.net/ft/tamu/Espy.htm
Office of Educational Assessment (2016) Understanding item analysis. University of Washington
http://www.washington.edu/assessment/scanning-scoring/scoring/reports/item-analysis/
Zimmaro, D. M. (2016) Writing good multiple choice exams
https://ctl.utexas.edu/sites/default/files/writing-good-multiple-choice-exams-fic-120116.pdf
Vallejo-Elias, J.(2016) Interpretation of discrimination data from multiple-choice test items
No longer available online
Albano, A. (2016) Introduction to educational and psychological measurement, Course Notes. University of Nebraska-Lincoln
https://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=1005&context=prtunl
Can you help with Reliability and Ferguson’s Delta? I know the formulas to calculate by hand but I have no idea how to translate that into an Excel spreadsheet. I was in undergrad a long time ago but working on my masters before I turn the big 50! This is not easy.
Shelly,
The following shows how to calculate Ferguson’s delta in Excel.
https://www.researchgate.net/profile/Rakesh-Pandey-5/post/Is-there-any-software-or-SPSS-macro-to-compute-delta/attachment/59d61d9979197b807797862d/AS%3A271757708070912%401441803494227/download/delta+calculated+for+BES.xlsx
The following article seems to suggest that Ferguson’s delta is not very useful
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2691398/
Charles
i want to see how calculate difficulty index by using excel
See https://www.real-statistics.com/reliability/item-analysis/item-analysis-basic-concepts/
Charles
Dear Charles ,
what is the formula of Difficulty Level for test items ,because I am M.A student and I have to show the difficulty level of my test items.I have 60 items and I have to show the difficulty level of each item !
your cooperation is highly appreciated
bekhal /Iraq
Bekhal,
See the webpage https://real-statistics.com/reliability/item-analysis/item-analysis-basic-concepts/
Charles
How to know upper and lower group?
What to put in the upper and lower groups is up to you. You can pick any cutoff values you choose. Often it is the top 1/3 and the bottom 1/3.
Charles