Evaluating Multivariate Visualizations As Multi-Objective Decision Aids

When choosing a solution, decision makers are often required to account for multiple conflicting objectives. This is a situation that can result in a potentially huge number of candidate solutions. Despite the wide selection of multivariate visualizations that can potentially help decide between various candidates, no designated means exist to assess the effectiveness of these visualizations under different circumstances. As a first contribution in this work, we developed a method to evaluate different types of multivariate visualization. The method focuses on the visualization's ability to facilitate a better understanding of inter-objective trade-offs as a proxy to more sensible decision making. We used the method to evaluate two existing visualization aids: Parallel-Coordinates and an adaptation of Self Organizing Maps (SOM). Both visualizations were compared with tabular data presentation. Our results show that the first visualization is more effective than a plain tabular visualization for the purpose of multi-objective decision making.