Delineating Discrepancies between TOEFL PBT and CBT

The increasing use of computer-based mode in language testing raises concern over its similarities with and differences from paper-based format. The present study aimed to delineate discrepancies between TOEFL PBT and CBT. For that objective, a quantitative method was employed to probe into scores equivalence, the performance of male-female participants, the relationship between completion time and test score, and test mode’s effects on participants’ performance. Totally, ۱۲۴ undergraduates partook in the current research whose ages ranged from ۱۹ – ۲۱ years (M = ۲۰, SD = .۶۶). To analyze the data, MANOVA, Pearson correlation, and regression tests were run. The findings uncovered that: (۱) PBT and CBT were equivalent in scores; (۲) male and female’s scores were not significantly different; (۳) there was a moderately negative correlation between completion time and score; (۴) computer familiarity, habit in using computers, and perception toward CBT did not affect performance in TOEFL. For researchers, the implication of this study concerns the interchangeability of the two-test modes. For CBT test designers, it concerns the appropriate inclusion of visuals, time related measurement, and procedures to design computer-based tests.

Keywords:

CBT , computer familiarity , discrepancies , equivalent , PBT