Computer-Based Testing (CBT) vs Paper-Based Testing (PBT): A Study of Score Equivalence, Computer Familiarity, Attitude and Aversion

How changing administration mode can affect students’ test performance is a crucial question when considering changing from PBT to CBT. Furthermore, the interaction between individual differences (e.g. prior computer familiarity, attitudes and aversion) and CBT performance should be investigated in equivalence studies in which the score equivalency and reliability is examined in order to replace CBT with PBT. Testing administration mode effect is the main concern of Asian researchers from the countries such as Iran, Turkey, China, Malaysia, Saudi Arabia and Jordon when they begin to accomplish CBT along with PBT in their educational system or consider CBT to replace PBT. The researcher of the present study investigated whether test takers’ scores are equivalent across two modes. Based on One group, Pre-test, Post-test design in which the same participants took two versions of two equivalent tests as pre and post-tests with seven days interval, data were collected using CBT and PBT versions of a multiple-choice test and Computer Aversion, Attitudes, and Familiarity Index (CAAFI) questionnaire was also used to examine the correlations of those variables with CBT performance. Paired sample t test results showed that participants produced relatively similar scores, although they insignificantly outperformed on PBT. Additionally, analysis of the overall scores on the CAAFI obtained from CBT testing session indicated no statistically significant correlation between computer familiarity, attitudes, aversion and mode preference variables and test takers’ CBT scores. and they were not considered the variables that might affect the performance on CBT.

Computer-Based Testing (CBT) vs Paper-Based Testing (PBT): A Study of Score Equivalence, Computer Familiarity, Attitude and Aversion Keywords:

Computer-Based Testing , Paper-Based Testing , Testing Mode Preference , Computer Familiarity , Computer Attitude , Computer Aversion