Automaatika referaat (eng)
for trained human raters. Several validity studies have suggested that AES engines tap
the same construct as that being evaluated by human raters. Page, Keith, & LaVoie
(1995) examined the construct validity of AES, Keith (2003) summarized several
discriminant and true score validity studies of the technology, and Attali & Burstein
(2006) demonstrated the relationship between AES and instructional activities associated
with writing.
AES is not without its detractors. Ericcson & Haswell (2006) performed a
comprehensive critique of the technology from the perspective of those who teach
postsecondary writing. Objections to the technology ranged from a concern about the ethics
of using computers rather than humans to teach writing to the lack of synchronicity
between how human graders approach the rating task and the process by which AES
evaluates a writing sample to failed implementations of AES in university placement