Show simple item record

dc.contributor.authorErguvan, Inan Deniz
dc.contributor.authorAksu Dunya, Beyza
dc.date.accessioned2020-02-12T08:18:49Z
dc.date.available2020-02-12T08:18:49Z
dc.date.issued2020-02-07
dc.identifier.citationErguvan, I.D. & Aksu Dunya, B. Lang Test Asia (2020) 10: 1. https://doi.org/10.1186/s40468-020-0098-3en_US
dc.identifier.issn2229-0443
dc.identifier.urihttp://hdl.handle.net/11772/2569
dc.description.abstractThis study examined the rater severity of instructors using a multi-trait rubric in a freshman composition course offered in a private university in Kuwait. Use of standardized multi-trait rubrics is a recent development in this course and student feedback and anchor papers provided by instructors for each essay exam necessitated the assessment of rater effects, including severity/leniency and restriction of range in ratings among instructors. Data were collected from three instructors teaching the same course in Summer 2019, who rated the first midterm exam essays of their students and shared the scores with the researcher. Also, two students from each class were randomly selected and a total of six papers were marked by all instructors for anchoring purposes. Many- facet Rasch model (MFRM) was employed for data analysis. The results showed that although the raters used the rubric consistently during scoring across all examinees and tasks, they differed in their degree of leniency and severity, and tended to assign scores of 70 and 80 more frequently than the other scores. The study shows that composition instructors may differ in their rating behavior and this may cause dissatisfaction, creating a sense of unfairness among the students of severe instructors. The findings of this study are expected to help writing departments to monitor their inter-rater reliability and consistency in their ratings. The most practical way to achieve this is by organizing rater training workshops.en_US
dc.language.isoengen_US
dc.publisherSpringeren_US
dc.relation.isversionofhttps://doi.org/10.1186/s40468-020-0098-3en_US
dc.rightsinfo:eu-repo/semantics/openAccessen_US
dc.subjectFreshman compositionen_US
dc.subjectMulti-trait rubricen_US
dc.subjectMany-facet Rasch modelen_US
dc.subjectRater behavioren_US
dc.subjectLeniency and severityen_US
dc.subjectÇok yönlü Rasch modelien_US
dc.titleAnalyzing rater severity in a freshman composition course using many facet Rasch measurementen_US
dc.typearticleen_US
dc.relation.journalLanguage Testing in Asiaen_US
dc.contributor.departmentBartın Üniversitesi, Eğitim Fakültesi, Eğitim Bilimleri Bölümüen_US
dc.identifier.volume10en_US
dc.identifier.issue1en_US
dc.identifier.startpage1en_US
dc.identifier.endpage20en_US


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record