Leveraging pattern semantics for extracting entities in enterprises

Entity Extraction is a process of identifying meaningful en-tities from text documents. In enterprises, extracting enti-ties improves enterprise effciency by facilitating numerous applications, including search, recommendation, etc. How-ever, the problem is particularly challenging on enterprise domains due to several reasons. First, the lack of redun-dancy of enterprise entities makes previous web-based sys-tems like NELL and OpenIE not effective, since using only high-precision/low-recall patterns like those systems would miss the majority of sparse enterprise entities, while using more low-precision patterns in sparse setting also introduces noise drastically. Second, semantic drift is common in enter-prises (\Blue" refers to \Windows Blue"), such that public signals from the web cannot be directly applied on entities. Moreover, many internal entities never appear on the web. Sparse internal signals are the only source for discovering them. To address these challenges, we propose an end-To-end framework for extracting entities in enterprises, taking the input of enterprise corpus and limited seeds to generate a high-quality entity collection as output. We introduce the novel concept of Semantic Pattern Graph to leverage pub-lic signals to understand the underlying semantics of lexical patterns, reinforce pattern evaluation using mined seman-tics, and yield more accurate and complete entities. Experi-ments on Microsoft enterprise data show the effectiveness of our approach.