|
| << vorige | volgende >> |
Tijdschrift beschrijving
Alle jaargangen van het bijbehorende tijdschrift
Alle afleveringen van het bijbehorende jaargang
Alle artikelen van de bijbehorende aflevering
Details van artikel 5 van 8 gevonden artikelen
| Titel: |
How important is content in the ratings of essay assessments? |
| Auteur: |
Shermis, Mark D. Shneyderman, Aleksandr Attali, Yigal |
| Verschenen in: |
Assessment in education |
| Paginering: | Jaargang 15 (2008) nr. 1 pagina's 91-105 |
| Jaar: |
2008-03 |
| Inhoud: |
This study was designed to examine the extent to which 'content' accounts for variance in scores assigned in automated essay scoring protocols. Specifically it was hypothesised that certain writing genre would emphasise content more than others. Data were drawn from 1668 essays calibrated at two grade levels (6 and 8) using e-rater™, an automated essay scoring engine with established validity and reliability. E-rater v 2.0's scoring algorithm divides 12 variables into 'content' (scores assigned to essays with similar vocabulary; similarity of vocabulary to essays with the highest scores) and 'non-content' (grammar, usage, mechanics, style, and discourse structure) related components. The essays were classified by genre: persuasive, expository, and descriptive. The analysis showed that there were significant main effects due to grade, F(1,1653) = 58.71, p < .001, and genre F(2, 1653) = 20.57, p < .001. The interaction of grade and genre was not significant. Eighth grade students had significantly higher mean scores than sixth grade students and descriptive essays were rated significantly higher than those classified as persuasive or expository. Prompts elicited 'content' according to expectations with lowest proportion of content variance in persuasive essays, followed by expository and then descriptive. Content accounted for approximately 0-6% of the overall variance when all predictor variables were used. It accounted for approximately 35-58% of the overall variance when 'content' variables alone were used in the prediction equation. |
| Uitgever: |
Routledge |
| Bronbestand: |
Elektronische Wetenschappelijke Tijdschriften |
Details van artikel 5 van 8 gevonden artikelen
| << vorige | volgende >> |