Comparing Evaluation Techniques For Text Readability Software For Adults With Intellectual Disabilities
ASSETS(2009)
摘要
In this paper, we compare alternative techniques for evaluating a software system for simplifying the readability of texts for adults with mild intellectual disabilities (ID). We introduce our research on the development of software to automatically simplify news articles, display them, and read them aloud for adults with ID. Using a Wizard-of-Oz prototype, we conducted experiments with a group of adults with ID to test alternative formats of questions to measure comprehension of the information in the news articles. We have found that some forms of questions work well at measuring the difficulty level of a text: multiple-choice questions with three answer choices, each illustrated with clip-art or a photo. Sonic types of questions do a poor job: yes/no questions and Likert-scale questions in which participants report their perception of the text's difficulty level. Our findings inform the design of future evaluation studies of computational linguistic software for adults with ID; this study may also be of interest to researchers conducting usability studies or other surveys with adults with ID.
更多查看译文
关键词
Assistive Technology,Intellectual Disabilities,Natural Language Processing,Text Readability Assessment,Text Comprehension
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络