Tools for Assessment of Operator Contribution to System Performance

In order to focus the enhancement of operator-system interactions on increasing mission effectiveness, and to reduce critical errors, the Navy needs an improved capability to assess submarine Combat Control System performance with respect to supporting the human operator in performing his mission. This paper describes our work on the development of the Data Integration for Validation of Effectiveness of Systems (DIVES) toolset, which addresses this measurement challenge. Currently, DIVES provides a method for collecting observer- and operator-based data, and a prototype system for integrating those data with system-based data streams to provide information for analysis of mission effectiveness. The DIVES system underwent initial test and evaluation in an event at the Naval Undersea Warfare Center Division Newport in November 2007. This paper presents initial results and conclusions from this test, as well as describes future directions for enhancement and use of the DIVES toolset.