DecisionMind : revealing human cognition states in data analytics-driven decision making with a multimodal interface

Despite the recognized value of machine learning (ML) techniques and high expectation of applying ML techniques within various applications, significant barriers to widespread adoption and local implementation of ML approaches still exist in the areas of trust (of ML results), comprehension (of ML processes) and related workload, as well as confidence (in decision making based on ML results) by users. This paper argues that the revealing of human cognition states with a multimodal interface during ML-based data analytics-driven decision making could provide a rich view for both ML researchers and domain experts to learn the effectiveness of ML technologies in applications. On the one hand, human cognition states could help understand to what degree users accept innovative technologies. On the other hand, through understanding human cognition states during data analytics-driven decision making, ML-based decision attributes and even ML models can be adaptively refined in order to make ML transparent. The paper also identifies examples of impact challenges and obstacles, as well as high-demand research directions in making ML transparent.