L۲ pragmatics underrepresentation as a washback mechanism in EFL contexts: Linking test-design features to high-stakes test use

Publish Year: 1393
نوع سند: مقاله ژورنالی
زبان: English
View: 209

This Paper With 29 Page And PDF Format Ready To Download

  • Certificate
  • من نویسنده این مقاله هستم

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این Paper:

شناسه ملی سند علمی:

JR_TELJ-8-1_001

تاریخ نمایه سازی: 6 اردیبهشت 1400

Abstract:

Considering the status of 'washback' in validity theory and research, Messick warns that, to establish test validity, one should not rely merely on washback, with all its complexity, but should instead probe test design properties (i.e., authenticity and directness) and test-use characteristics likely to produce or intensify washback. Authenticity ensures that nothing essential is missing in the assessment of the focal construct, or minimal construct-underrepresentation. Similarly, directness deals with minimal construct-irrelevant variance. This study aimed to explore inadequate representation of L۲ pragmatics in EFL curriculum and instruction of Iranian high schools as negative washback of construct-underrepresentation of this important dimension of communicative competence in the high-stakes National University Entrance Test (NUET). The participants were ۱۰۰ EFL teachers, a sample of ۲۲۰ pre-NUET students, and ۵۰ post-NUET students in northwest, center, and southwest of Iran. A method-triangulation procedure was employed using questionnaires, observations, and semi-structured interviews. The results showed that the test's construct validity is compromised, meaning that NUET is too narrow and deficient, fails to sufficiently sample pragmatic competence as an important facet of ۲discrete-point lexico-grammatical knowledge. Further, the findings demonstrated intense negative washback on L۲ teaching-learning processes resulting from using NUET scores for drawing high-stakes action inferences in Iran. The findings suggest that, to facilitate optimal positive washback and adequate sampling of the criterion domain in L۲ education, NUET must strive to minimize construct-underrepresentation and construct-irrelevant variance in design.

Authors

Azizullah Mirzaei

Shahrekord University

Masoud Rahimi Domakani

Shahrekord University

Masoumeh Seyyed Rezaei

Shahrekord University

مراجع و منابع این Paper:

لیست زیر مراجع و منابع استفاده شده در این Paper را نمایش می دهد. این مراجع به صورت کاملا ماشینی و بر اساس هوش مصنوعی استخراج شده اند و لذا ممکن است دارای اشکالاتی باشند که به مرور زمان دقت استخراج این محتوا افزایش می یابد. مراجعی که مقالات مربوط به آنها در سیویلیکا نمایه شده و پیدا شده اند، به خود Paper لینک شده اند :
  • Alderson, J. C., & Wall, D. (1993). Does washback exist? ...
  • Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: ...
  • Bachman, L. F. (2005). Building and supporting a case for ...
  • Bachman, L. F., & Palmer, A. S. (1996). Language testing ...
  • Bardovi-Harlig, K. (1996). Pragmatics and language teaching: Bringing pragmatics and ...
  • Canale, M., & Swain, M. (1980). Theoretical bases of communicative ...
  • Celce-Murcia, M., & Olshtain, E. (2000). Discourse and context in ...
  • Chapman, D. W., & Snyder, C. W. J. (2000). Can ...
  • Cheng, L. (1997). How does washback influence teaching? Implications for ...
  • Cheng, L. (2005). Changing language teaching through language testing: A ...
  • Cohen, A. (2010). Approaches to assessing pragmatic ability. In N. ...
  • Downing, S. M. (2002). Threats to the validity of locally ...
  • Eslami-Rasekh, Z. (2005). Raising the pragmatic awareness of language learners. ...
  • Eslami, Z. R., & Mirzaei, A. (2012). Assessment of second ...
  • Frederiksen, J.R., & Collins, A. (1989). A systems approach to ...
  • Ghorbani, M. R. (2008). The washback effect of the university ...
  • Grabowsky, K. (2008). Measuring pragmatic knowledge: Issues of construct underrepresentation ...
  • Green, A. (2006). Watching for Washback: Observing the Influence of ...
  • Haladyna, T. M., & Downing, S. M. (2004). Construct-irrelevant varriance ...
  • Hawkey, R. (2006). Impact theory and practics. Studies in Language ...
  • Ishihara, N. (2010). Where does instructional pragmatics fit and to ...
  • Ishihara, N., & Cohen, A. (2010). Teaching and learning pragmatics: ...
  • Kasper, G., & Rose K. R. (2002). Pragmatic Development in ...
  • McNamara, T. (2006). Validity in language testing: The challenge of ...
  • McNamara, T. (2012). Language assessments as shibboleths: A poststructuralist perspective. ...
  • Messick, S. (1996). Validity and washback in language testing. Language ...
  • Mirzaei, A., & Roshani, N. (2011). A critical study of ...
  • Morrow, K. (1986). The evaluation of tests of communicative performance. ...
  • Pearson, I. (1988). Tests as levers for change. In D. ...
  • Riazi, M., & Razavipour, K. (2011). (In) agency of EFL ...
  • Roever, C. (2011). Testing of second language pragmatics: Past and ...
  • Rose, K., & Kasper, G. (2001). Pragmatics in language teaching. ...
  • Secretariat of Higher Council of Education in Iran (2006). Collection ...
  • Shohamy, E. (2001). The power of tests: A critical perspective ...
  • Stecher, B., Chun, T., & Barron, S. (2004). The effects ...
  • Swain, M. (1985). Large-scale communicative testing. In Y. P. Lee, ...
  • Taguchi, N. (2012). Context, individual differences and pragmatic competence. London: ...
  • Wall, D. (2005). The impact of high-stakes examination on classroom ...
  • Xi, X. (2010). How do we go about investigating test ...
  • Xie, Q. (2013). Does test preparation work? Implication for score ...
  • نمایش کامل مراجع