Purple SOX extraction management system

Autor: Bohannon, Philip, Merugu, Srujana, Yu, Cong, Agarwal, Vipul, DeRose, Pedro, Iyer, Arun, Jain, Ankur, Kakade, Vinay, Muralidharan, Mridul, Ramakrishnan, Raghu, Shen, Warren
Zdroj: ACM SIGMOD Record; March 2009, Vol. 37 Issue: 4 p21-27, 7p
Abstrakt: We describe the Purple SOX (PSOX) EMS, a prototype Extraction Management System currently being built at Yahoo!. The goal of the PSOX EMS is to manage a large number of sophisticated extraction pipelines across different application domains, at the web scale and with minimum human involvement. Three key value propositions are described: extensibility, the ability to swap in and out extraction operators; explainability, the ability to track the provenance of extraction results; and social feedback support, the facility for gathering and reconciling multiple, potentially conflicting sources.
Databáze: Supplemental Index