Academic Discipline DIF in an English Language Proficiency Test

The purpose of this study was to detect differentially functioning items in the University of Tehran English Proficiency Test (UTEPT) which is a high stake test of English developed and administered by the Language Testing Centre of the University of Tehran. This paper is based on the answers of ۴۰۰ test takers to the test. All participants earned a master degree either in humanities or science and engineering. To achieve the purpose of this study, the participants were divided into two equal groups. The results of generalized Mantel-Haenszel indicated that out of ۱۰۰ items ۱۲ items were displaying DIF. Logistic regression procedure also flagged ۱۴ items as exhibiting DIF. Nevertheless, the associated test of effect size for logistic regression showed that none of these effect sizes were large according to the guidelines proposed by both Zumbo and Thomas (۱۹۹۷) and Jodoin and Gierl (۲۰۰۱). Therefore, it was concluded that UTEPT doesn't show significant academic discipline DIF and is equally fair to both humanities and science and engineering groups.     

Keywords:

DIF , Generalized Mantel-Haenszel , Logistic Regression , DIF magnitude