A Study on Rubric Development to Evaluate Writing Skill in Teaching Turkish as a Foreign Language

Abstract

This study aimed to develop a valid and reliable rubric for evaluating writing skill in teaching Turkish as a foreign language. The problems experienced in the scoring of the writing exams in institutions and the absence of a standard rubric in the field were the starting point of this study. The research was carried out on the teachers who were teaching at Bartın University Language Education Center. The data collection tool was developed by examining the relevant literature and similar rubric on the subject. In addition, the qualitative findings obtained as a result of the interview questions directed to the experts during the data collection process were used. Data were collected from teachers who are experts in their fields with a questionnaire consisting of 30 items. The obtained data were analyzed. The reliability of the rubric was made by examining the consistency of the scores given by the raters. Kendall W agreement coefficient method was used to determine the reliability. As a result of the analysis, it was found that the reliability of the rubrics developed were .700 for A1 level, .801 for A2 level, .828 for B1-B2 levels, and .807 for C1 level. In line with the results, the consistency coefficient values approaching 1 provides evidence for the reliability of the developed rubrics. As a result of the analysis, it can be said that rubrics developed in accordance with A1-A2-, B1-B2, C1 levels are valid and reliable measurement tools and can be used in the evaluation of writing exams.