Designing Closed-Loop Models for Task Allocation

HHAI 2023: AUGMENTING HUMAN INTELLECT(2023)

引用 0|浏览22
暂无评分
摘要
Automatically assigning tasks to people is challenging because human performance can vary across tasks for many reasons. This challenge is further compounded in real-life settings in which no oracle exists to assess the quality of human decisions and task assignments made. Instead, we find ourselves in a "closed" decision-making loop in which the same fallible human decisions we rely on in practice must also be used to guide task allocation. How can imperfect and potentially biased human decisions train an accurate allocation model? Our key insight is to exploit weak prior information on human-task similarity to bootstrap model training. We show that the use of such a weak prior can improve task allocation accuracy, even when human decision-makers are fallible and biased. We present both theoretical analysis and empirical evaluation over synthetic data and a social media toxicity detection task. Results demonstrate the efficacy of our approach.
更多
查看译文
关键词
task allocation,closed training,crowdsourcing
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络