title: Optimizing the compatibility between rating scales and measures of productive second language competence.
abstract: This study presents a systematic investigation concerning the performance of different rating scales used in the English section of a university entrance examination to assess 1,287 Japanese test takers' ability to write a third-person introduction speech. Although the rating scales did not conform to all of the expectations of the Rasch model, they successfully defined a meaningful continuum of English communicative competence. In some cases, the expectations of the Rasch model needed to be weighed against the specific assessment needs of the university entrance examination. This investigation also found that the degree of compatibility between the number of points allotted to the different rating scales and the various requirements of an introduction speech played a considerable role in determining the extent to which the different rating scales conformed to the expectations of the Rasch model. Compatibility thus becomes an important factor to consider for optimal rating scale performance.
authors.affiliation: Toyo University, Faculty of Business Administration, 5-28-20 Hakusan, Bunkyo-ku, Tokyo 112-8606, Japan. Christopher@toyo.jp
authors.forename: Christopher
authors.initials: C
authors.lastname: Weaver
mesh_terms: D000124:Achievement; D000293:Adolescent; D003479:Curriculum; D004521:Educational Measurement / Q000706:statistics & numerical data*; D005260:Female; D006801:Humans; D007564:Japan; D008297:Male; D019303:Multilingualism; D012570:School Admission Criteria; D013334:Students / Q000523:psychology*; D014495:Universities; D014894:Weights and Measures; D055815:Young Adult