Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of Results

Autor: Georgy Vasin, Daria Panova, Maksim Rudnev, Ksenia Tarasova, Svetlana Avdeeva
Rok vydání: 2017
Předmět:
Zdroj: Voprosy Obrazovaniya / Educational Studies Moscow. :104-132
ISSN: 2412-4354
1814-9545
Popis: Svetlana Avdeeva - PhD in Technical Sciences, Deputy Executive Director, National Training Foundation; Deputy Head, Center of Education Quality Monitoring, Institute of Education, National Research University Higher School of Economics. Address: Bld. 1, 1905 Goda Str., 123022 Moscow, Russian Federation. E-mail: avdeeva@ntf.ruMaksim Rudnev - Candidate of Sciences in Sociology, Leading Researcher, Laboratory for Comparative Studies in Mass Consciousness, National Research University Higher School of Economics. Address: 20 Myasnitskaya Str., 101000 Moscow, Russian Federation. E-mail: mrudnev@hse.ru Georgy Vasin - Psychometrician, Department of ICT Development in Education, National Training Foundation. Address: Bld. 1, 71905 Goda Str., 123022 Moscow, Russian Federation. E-mail: vasin@ntf.ru Ksenia Tarasova - Candidate of Sciences in Pedagogy, Leading Specialist, National Training Foundation. Address: Bld. 1, 1905 Goda Str., 123022 Moscow, Russian Federation. E-mail: kvtarasova@mail.ru Daria Panova - Assessment Content Developer, National Training Foundation. Address: Bld. 1, 1905 Goda Str., 123022 Moscow, Russian Federation. Email: panova@ntf.ru The study describes the Information and Communication Literacy Test (the ICL Test), an instrument to measure information and communication technology competence in middle school students (grades 7-9). An overview of the existing instruments proves that there are no other ICT competence assessment instruments applicable to Russian students today. The assessment was constructed using an innovative systematic approach (evidence-centered assessment design, ECD). The ICL Test results were calculated using Bayesian networks, which are more effective than the Item Response Theory in this case. The ICL Test revealed a high level of construct, content, convergent, divergent and face validity as well as good reliability. The instrument conforms to both Russian and international educational standards according to Webb’s criteria for alignment. The ICL Test results were used to assess ICT competence and identify the factors that influence its development in regions of Russia, Armenia and Belarus. The conclusion is that the ICL Test can be applied to both Russian and foreign education systems.
Databáze: OpenAIRE