L۲ pragmatics underrepresentation as a washback mechanism in EFL contexts: Linking test-design features to high-stakes test use

Considering the status of 'washback' in validity theory and research, Messick warns that, to establish test validity, one should not rely merely on washback, with all its complexity, but should instead probe test design properties (i.e., authenticity and directness) and test-use characteristics likely to produce or intensify washback. Authenticity ensures that nothing essential is missing in the assessment of the focal construct, or minimal construct-underrepresentation. Similarly, directness deals with minimal construct-irrelevant variance. This study aimed to explore inadequate representation of L۲ pragmatics in EFL curriculum and instruction of Iranian high schools as negative washback of construct-underrepresentation of this important dimension of communicative competence in the high-stakes National University Entrance Test (NUET). The participants were ۱۰۰ EFL teachers, a sample of ۲۲۰ pre-NUET students, and ۵۰ post-NUET students in northwest, center, and southwest of Iran. A method-triangulation procedure was employed using questionnaires, observations, and semi-structured interviews. The results showed that the test's construct validity is compromised, meaning that NUET is too narrow and deficient, fails to sufficiently sample pragmatic competence as an important facet of ۲discrete-point lexico-grammatical knowledge. Further, the findings demonstrated intense negative washback on L۲ teaching-learning processes resulting from using NUET scores for drawing high-stakes action inferences in Iran. The findings suggest that, to facilitate optimal positive washback and adequate sampling of the criterion domain in L۲ education, NUET must strive to minimize construct-underrepresentation and construct-irrelevant variance in design.

Keywords:

Construct validity , washback , construct-underrepresentation , L۲ pragmatics