Examining the Interrater Reliability Between Self- and Teacher Assessment of Students’ Oral Performances

The increasing popularity of self-assessment prompted several scholars to investigate its effectiveness and accuracy in relation to teacher assessment. However, most of these studies focused only on the consistency estimate perspective. Thus, the current study investigated the interrater reliability between self- and teacher assessment of students’ oral performance in Filipino. Specifically, this study used two perspectives (i.e., consistency estimate and consensus estimate perspectives) to see the full picture of interrater reliability between self- and teacher assessment. Fifty (۵۰) college students from various specializations participated in this study. They assessed their respective oral performances using an in-class observation self-assessment with self-viewing. Findings reveal that teacher and students’ SA results posted a very strong positive relationship and that their ratings agree with each other. High positive correlations suggest that both the students and the teacher consistently apply the rating scale. These results were attributed to the use of a micro-analytic rating scale, assessment training, and rating procedure used during SA. Implications for classroom assessment and future studies were discussed.

Keywords:

Language assessment , Assessment for learning , Performance Evaluation