Do systems pass university entrance exams?

•We describe a Question Answering task over real exams to enter University.•We define an evaluation methodology that can be reused for developing new systems.•We include an in-depth analysis of results from different points of view.•We show that current technologies are unable to pass the proposed exams.•We identify the most difficult questions and offer future directions.