Validity and Fairness in Technology- Based Assessment: Detecting Construct- Irrelevant Variance in an Open-Ended, Computerized Mathematics Task
Titel:
Validity and Fairness in Technology- Based Assessment: Detecting Construct- Irrelevant Variance in an Open-Ended, Computerized Mathematics Task
Auteur:
Gallagher, Ann Bennett, Randy Elliot Cahalan, Cara Rock, Donald A.
Verschenen in:
Educational assessment
Paginering:
Jaargang 8 (2002) nr. 1 pagina's 27-41
Jaar:
2002-02-01
Inhoud:
The purpose of this study was to evaluate whether variance due to computer-based presentation was associated with performance on a new constructed-response type-Mathematical Expression (ME) -that requires examinees to enter mathematical expressions. Participants took parallel computer-based and paper-based tests consisting of ME items, plus a test of their skill in editing and entering data using the computer interface. Analysis of variance was used to assess differences in ME performance across delivery modes, with and without controlling for edit/entry performance. Comparisons of reliability, speededness, and relations with external indicators were also conducted. Although no statistical evidence of construct-irrelevant variance was detected, some examinees reported mechanical difficulties in responding and indicated a preference for the paper-and-pencil test.