Linguistic Resources for 2012 Knowledge Base Population Evaluation.

Knowledge Base Population (KBP) is an evaluation track of the Text Analysis Conference (TAC), a workshop series organized by the National Institute of Standards and Technology (NIST). The KBP evaluation includes three tasks that target information extraction and question answering technologies: Entity Linking, Slot Filling, and Cold Start. The Cold Start task was introduced in 2012 in an effort to combine and enhance technologies developed for Slot Filling and Entity Linking. Linguistic Data Consortium (LDC) has supported the TAC KBP evaluation since 2009, each year producing new linguistic resources including data, annotations, system assessments, tools and specifications. This paper describes the resource creation efforts in support of TAC KBP 2012, with an emphasis on procedures and methodologies for query selection, annotation, and assessment.