Design and evaluation of automated writing evaluation models: Relationships with writing in naturalistic settings

•Automated writing evaluation models predict scores on writing produced in graduate courses.•Coursework scores predicted from (a) model designed to directly predict them.•Coursework scores predicted from (b) model derived from 30min essay human score.•(a) and (b) predict coursework scores equally well, but with different feature weights.•Different subgroups favored by (a) and (b).