Syntactic Complexity of Russian Unified State Exam Texts in English: A Study on Reliability and Validity

In this study we analyze texts used in Russian Unified State Exam on English language. Texts that formed small research corpora were retrieved from ۲ resources: official USE database as a reference point, and popular website used by pupils for USE training “Neznaika” (https://neznaika.pro/). The size of two corpora is balanced: USE has ۱۱۹۳۴ tokens and “Neznaika” - ۱۱۹۱۸ tokens. We share Biber’s point of view that linguistic tendencies are quite stable with ten text samples per genre or register (Biber ۲۰۰۷). We retrieved ۲۰ texts from each resource. This research takes into consideration analysis on syntactic complexity, the main subject of research is the syntactic type of the sentence. The present study focuses on two research questions: RQ۱: What sentence types pattern is typical for USE texts? RQ۲: Are the materials of the training sites reliable and valid? The methods employed in the study are the identification and manual counting of the sentence types, absolute and normalized frequency calculation. While analyzing the texts, we witnessed greater range of tokens per text (tpt) in unofficial texts for training. For “Neznaika” database the range was ۴۹۰ - ۷۹۰ (tpt), while an official USE database texts demonstrated lower variance: ۵۳۹ – ۶۸۶ tpt. The number of sentences in “Neznaika” (۶۶۴) and official USE texts database (۶۷۰) is almost equal. The number of sentence types in “Neznaika” and official USE texts database also does not extend correlation limits.

Keywords:

Syntactic Complexity , Unified State Exam , Syntactic Pattern , Text Complexity , Quantitative Linguistics