Human performance regression testing
Software Engineering(2013)
摘要
As software systems evolve, new interface features such as keyboard shortcuts and toolbars are introduced. While it is common to regression test the new features for functional correctness, there has been less focus on systematic regression testing for usability, due to the effort and time involved in human studies. Cognitive modeling tools such as CogTool provide some help by computing predictions of user performance, but they still require manual effort to describe the user interface and tasks, limiting regression testing efforts. In recent work, we developed CogTool Helper to reduce the effort required to generate human performance models of existing systems. We build on this work by providing task specific test case generation and present our vision for human performance regression testing (HPRT) that generates large numbers of test cases and evaluates a range of human performance predictions for the same task. We examine the feasibility of HPRT on four tasks in LibreOffice, find several regressions, and then discuss how a project team could use this information. We also illustrate that we can increase efficiency with sampling by leveraging an inference algorithm. Samples that take approximately 50% of the runtime lose at most 10% of the performance predictions.
更多查看译文
关键词
systematic regression testing,user performance,manual effort,performance prediction,human study,regression testing effort,human performance prediction,task specific test case,human performance regression testing,human performance model,software maintenance,usability,computational modeling,testing,user interfaces,predictive models,graphical user interfaces,hprt,human factors,human computer interaction,regression analysis,public domain software,software systems
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络