Using Item Analysis to Evaluate a Model of Pisa-Like Reading Test Developed by Teachers

This study aimed at evaluating PISA-like reading test developed by teachers participating in the teacher training for teaching PISA-like reading. To serve the purpose, an experimental test was administered to ۱۰۷ students aged ۱۵-۱۶ using a set of text and questions constructed according to the criteria of PISA Reading test Level ۱. Item analysis was performed following the sampling using Rasch Measurement, deemed essential for determining the ideal index of test items relative to students’ ability in making correct response. The component of the calculation comprises reliability, separation, dan standard error. The Rasch model was constructed manually using Microsoft Excel to obtain the result of the calculation, and a Wright Map was also made manually to illustrate the result of the calculation. The results of the item analysis indicated that the test and the items the teachers constructed have met good criteria. The results revealed an even distribution of test item difficulty at the targeted level. The samples’ ability to make correct answers, however, was decentralized towards the test items of moderate level of difficulty. Only a limited number of students have showed good ability in their response to test items of higher difficulty.

Keywords:

Teacher Training , RASCH measurement , ability , difficulty