Published in: مجله افق های زبان، دوره: 2، شماره: 2
COI code: JR_LGHOR-2-2_005
Paper Language: English
How to Download This Paper
For Downloading the Fulltext of CIVILICA papers please visit the orginal Persian Section of website.
Authors بررسي مهارت مصححين در سنجش مهارت گفتاري: بهره گيري از مدل چند وجهي راشHouman Bijani - Zanjan Branch, Islamic Azad University, Zanjan, Iran
Abstract:Since scoring oral language proficiency is performed by raters, they are an essential part of performance assessment. One important feature of raters is their teaching and rating experience which has attracted considerable attention. In a majority of previous studies on rater training, extremely severe or lenient raters, benefited more from training programs and thus results of this training showed significant severity/leniency reduction in their rating behavior. However, they mostly investigated the application of FACETS on only one or two facets and few have used a pre, post-training design. Besides, empirical studies have reported contrasting outcomes, not showing clearly which group of raters does rating more reliably than the other. In this study, 20 experienced and inexperienced raters rated the oral performances produced by 200 test-takers before and after a training program. The results indicated that training leads to higher measures of interrater consistency and reduces measures of biases towards using rating scale categories. Moreover, since it is almost impossible to completely eradicate rater variability even if training is applied, rater training procedure had better had better be regarded as a procedure to make raters more self-consistent (intrarater reliability) rather than consistent with each other (interrater reliability). The findings of this study indicated that inexperienced and experienced raters’ rating quality improved after training; however, inexperienced raters underwent higher consistency and less bias. Hence, there is no evidence that inexperienced raters should be excluded from rating solely because of their lack of adequate experience. Moreover, Inexperienced raters, being more economical than the experienced ones, cost less for decision-makers for rating. Therefore, instead of charging a bulky budget on experienced raters, decision-makers had better use the budget for establishing better training programs.
Keywords:Bias, Interrater consistency, Intrarater consistency, Multifaceted Rasch measurement (MFRM), Rater expertise
COI code: JR_LGHOR-2-2_005
how to cite to this paper:If you want to refer to this article in your research, you can easily use the following in the resources and references section:
Bijani, Houman, 2018, بررسي مهارت مصححين در سنجش مهارت گفتاري: بهره گيري از مدل چند وجهي راش, Journal of Language Horizons 2 (2), https://www.civilica.com/Paper-JR_LGHOR-JR_LGHOR-2-2_005.htmlInside the text, wherever referred to or an achievement of this article is mentioned, after mentioning the article, inside the parental, the following specifications are written.
First Time: (Bijani, Houman, 2018)
Second and more: (Bijani, 2018)
For a complete overview of how to citation please review the following CIVILICA Guide (Citation)
The University/Research Center Information:
Type: Azad University
Paper No.: 4271
in University Ranking and Scientometrics the Iranian universities and research centers are evaluated based on scientific papers.
Research Info Management
Export Citation info of this paper to research management softwares
New Related Papers
- Immobilization of lipase on modified and unmodified HTlcs by adsorption
- Investigation of investment progress: case study
- Experimental study of rotary dryer in production of dry NaCl crystals
- Theoretical investigation of a stream; Case study
- The applied investigation of exit waste stream from Petrochemical industries
The Above articles are recently indexed in the related subjects
Iran Scientific Advertisment Netword
Share this paper
WHAT IS COI?
COI is a national code dedicated to all Iranian Conference and Journal Papers. the COI of each paper can be verified online.