Toward an End-to-end Anomaly Discovery System

Anomaly detection is critical in enterprises, with applications including financial fraud, defending network intrusions, and detecting imminent device failures. Although previously research has proposed a variety of stand-alone methods for detecting particular types of anomalies, there is no end-to-end solution for data scientists to effectively discover anomalies over large volumes of varied data. To build such a system, several critical challenges have to be solved: How to determine which among many alternative anomaly detection algorithms is the best for a given task and to find the proper parameter settings? How to leverage a small amount of end-user feedback to improve the anomaly extraction process? How to best present the anomaly detection results such that users do not have to evaluate the potentially large number of anomaly candidates one by one? This talk will present our solution, called ADS, that solves all above problems. ADS supports all stages of anomaly discovery by seamlessly integrating anomaly-related services within one integrated platform. It enables tuning-free anomaly detection, anomaly summarization and explanation services, and the ability to integrate user-feedback into the discovery process.