An Empirical Study Comparing Two Automatic Graders For Programming. Moocs Context

The present paper compares Algo+, an assessment tool for computer programs, to an automatic grader used in a MOOC course at EPFL. This empirical study explores the practicability and the behaviour of Algo+ and analyses whether Algo+ can be used to evaluate a large scale of programs. Algo+ is a prototype based on a static analysis approach for automated assessment of algorithms where programs are not executed but analysed by looking at their instructions. The second tool, EPFL grader, is used to grade programs submitted by students in MOOCs of Introductory programming with C++ at EPFL and is based on a compiler approach. In this technique submissions are assessed via a battery of unit tests where the student program is run with standard input and assessed on whether they produced the correct output.