CIVILICA We Respect the Science
Publisher of Iranian Journals and Conference Proceedings
Paper
title

بررسي مهارت مصححين در سنجش مهارت گفتاري: بهره گيري از مدل چند وجهي راش

Credit to Download: 1 | Page Numbers 22 | Abstract Views: 109
Year: 2018
COI code: JR_LGHOR-2-2_005
Paper Language: English

How to Download This Paper

For Downloading the Fulltext of CIVILICA papers please visit the orginal Persian Section of website.

Authors بررسي مهارت مصححين در سنجش مهارت گفتاري: بهره گيري از مدل چند وجهي راش

  Houman Bijani - Zanjan Branch, Islamic Azad University, Zanjan, Iran

Abstract:

Since scoring oral language proficiency is performed by raters, they are an essential part of performance assessment. One important feature of raters is their teaching and rating experience which has attracted considerable attention. In a majority of previous studies on rater training, extremely severe or lenient raters, benefited more from training programs and thus results of this training showed significant severity/leniency reduction in their rating behavior. However, they mostly investigated the application of FACETS on only one or two facets and few have used a pre, post-training design. Besides, empirical studies have reported contrasting outcomes, not showing clearly which group of raters does rating more reliably than the other. In this study, 20 experienced and inexperienced raters rated the oral performances produced by 200 test-takers before and after a training program. The results indicated that training leads to higher measures of interrater consistency and reduces measures of biases towards using rating scale categories. Moreover, since it is almost impossible to completely eradicate rater variability even if training is applied, rater training procedure had better had better be regarded as a procedure to make raters more self-consistent (intrarater reliability) rather than consistent with each other (interrater reliability). The findings of this study indicated that inexperienced and experienced raters’ rating quality improved after training; however, inexperienced raters underwent higher consistency and less bias. Hence, there is no evidence that inexperienced raters should be excluded from rating solely because of their lack of adequate experience. Moreover, Inexperienced raters, being more economical than the experienced ones, cost less for decision-makers for rating. Therefore, instead of charging a bulky budget on experienced raters, decision-makers had better use the budget for establishing better training programs.

Keywords:

Bias, Interrater consistency, Intrarater consistency, Multifaceted Rasch measurement (MFRM), Rater expertise

Perma Link

https://www.civilica.com/Paper-JR_LGHOR-JR_LGHOR-2-2_005.html
COI code: JR_LGHOR-2-2_005

how to cite to this paper:

If you want to refer to this article in your research, you can easily use the following in the resources and references section:
Bijani, Houman, 2018, بررسي مهارت مصححين در سنجش مهارت گفتاري: بهره گيري از مدل چند وجهي راش, Journal of Language Horizons 2 (2), https://www.civilica.com/Paper-JR_LGHOR-JR_LGHOR-2-2_005.htmlInside the text, wherever referred to or an achievement of this article is mentioned, after mentioning the article, inside the parental, the following specifications are written.
First Time: (Bijani, Houman, 2018)
Second and more: (Bijani, 2018)
For a complete overview of how to citation please review the following CIVILICA Guide (Citation)

Scientometrics

The University/Research Center Information:
Type: Azad University
Paper No.: 4271
in University Ranking and Scientometrics the Iranian universities and research centers are evaluated based on scientific papers.

Research Info Management

Export Citation info of this paper to research management softwares

New Related Papers

Iran Scientific Advertisment Netword

Share this paper

WHAT IS COI?

COI is a national code dedicated to all Iranian Conference and Journal Papers. the COI of each paper can be verified online.