<Research Paper>Validating Classroom Assessments Measuring Learner Knowledge of Academic Vocabulary
-
- Rylander John
- Program-Specific Senior Lecturers, International Academic Research and Resource Center for Language Education
Bibliographic Information
- Other Title
-
- Validating Classroom Assessments Measuring Learner Knowledge of Academic Vocabulary
Search this article
Description
This research investigates the reliability of vocabulary assessments used in English language skill classes at Kyoto University, Japan. Specifically it examines assessments designed to measure learner knowledge of a set of 477 vocabulary items from the Kyoto University Academic Vocabulary Database (京大学術語彙データベース : 基本英単語1110) in the first-year curriculum of a combined skills writing/listening course. Learners provided responses to two item types--multiple-choice and fill-in-the-blank--in an online quiz format constructed using Google Forms and delivered using QR codes. Results show that the vocabulary instruments revealed good model fit based on a Rasch analysis of each quiz version. Follow-up statistical analyses were performed in the form of t tests. These analyses, which used Rasch logits of item difficulty, revealed that items measuring receptive knowledge showed lower item difficulty than those measuring productive ability. A person-level analysis of gains over time showed somewhat mixed results, with just two of the five sample populations revealing gains between spring and fall semesters. This analysis was performed as part of a larger needs analysis project with results providing insights into how best to structure additional in-house created materials.
Journal
-
- 京都大学国際高等教育院紀要
-
京都大学国際高等教育院紀要 1 83-110, 2018-03
The Institute for Liberal Arts and Sciences, Kyoto University
- Tweet
Keywords
Details 詳細情報について
-
- CRID
- 1390009224844837888
-
- NII Article ID
- 120006471150
-
- HANDLE
- 2433/231228
-
- NDL BIB ID
- 030496940
-
- ISSN
- 24339512
-
- Text Lang
- en
-
- Data Source
-
- JaLC
- IRDB
- NDL
- CiNii Articles
-
- Abstract License Flag
- Allowed