"Begin with the End in Mind": Incorporating UX Evaluation Metrics into Design Materials of Participatory Design

Participatory Design (PD) aims to empower users by involving them in various design decisions. However, it was found that the PD’s evaluation criteria are usually set by the product team and used only at the end of a design process, without adequate user participation. To address this issue, we proposed introducing UX evaluation metrics into design materials at the participatory design INPUT phase. Using a case study of designing a chatbot for community members to report safety incidents, we studied the impact of this approach with 58 participants from two workshops. Our results showed that the integration of UX evaluation metrics efficiently rationalized participants’ contributions and helped identify key evaluation metrics when setting values for new AI systems, enhancing PD workshop insights. In addition to examining the use of the Program Theory Model to explain PD, our empirical investigation added a new dimension to this model.