267 / 2018-08-31 21:39:36

A Study of score reports for diagnostic language assessment

score reports,diagnostic language assessment,validity

全体主题 > 人工智能技术在语言测评中的应用

With the rapid increase in computer technology, it is now feasible to provide an Internet delivered, computer-based diagnostic language assessment at the classroom level. The UDig is a computer-based diagnostic language assessment (http://uzx.iceshi.org), developed by Foreign Language Teaching and Research Press for Chinese senior high school students. After taking the assessment, the students not only get their sub-skill scores but also verbal description of their strengths and weaknesses, which related to English curriculum and China's Standards of English (CSE). However, the validity of the score reports is less investigated. This study aims to explore the students and teachers’ perception of the score reports from the UDig. The subjects are 225 students and their 4 teachers from four different senior high schools who had used the UDig for 1 year. A questionnaire was design to investigate whether the score reports provide valid feedback of their weaknesses and give suggestions for their future learning. In addition, 8 students and 4 teachers were also interviewed to collect both quantitative and qualitative data. The findings show that 81.4% of the students believe the score reports could provide feedback of their weakness, which is consistent with their teachers’ judgments; and 62% of the students believe suggestions for their future learning are very concrete and useful. This means the score reports need to be improved and teachers’ involvements are still important to help students’ future learning. The study also finds that the UDig could motivate students for its instant and multi-dimensional feedback.