Re: Ideas on how to use Spark for anomaly detection on a stream of data

2014-11-25 Thread Sean Owen
Yes, and I prepared a basic talk on this exact topic. Slides here:
http://www.slideshare.net/srowen/anomaly-detection-with-apache-spark-41975155

This is elaborated in a chapter of an upcoming book that's available
in early release; you can look at the accompanying source code to get
some ideas too: https://github.com/sryza/aas/tree/master/kmeans

On Mon, Nov 24, 2014 at 10:17 PM, Natu Lauchande nlaucha...@gmail.com wrote:
 Hi all,

 I am getting started with Spark.

 I would like to use for a spike on anomaly detection in a massive stream of
 metrics.

 Can Spark easily handle this use case ?

 Thanks,
 Natu

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Re: Ideas on how to use Spark for anomaly detection on a stream of data

2014-11-25 Thread Natu Lauchande
Fantastic!!! Exactly what i was looking for.


Thanks,
Natu

On Tue, Nov 25, 2014 at 10:46 AM, Sean Owen so...@cloudera.com wrote:

 Yes, and I prepared a basic talk on this exact topic. Slides here:

 http://www.slideshare.net/srowen/anomaly-detection-with-apache-spark-41975155

 This is elaborated in a chapter of an upcoming book that's available
 in early release; you can look at the accompanying source code to get
 some ideas too: https://github.com/sryza/aas/tree/master/kmeans

 On Mon, Nov 24, 2014 at 10:17 PM, Natu Lauchande nlaucha...@gmail.com
 wrote:
  Hi all,
 
  I am getting started with Spark.
 
  I would like to use for a spike on anomaly detection in a massive stream
 of
  metrics.
 
  Can Spark easily handle this use case ?
 
  Thanks,
  Natu



Ideas on how to use Spark for anomaly detection on a stream of data

2014-11-24 Thread Natu Lauchande
Hi all,

I am getting started with Spark.

I would like to use for a spike on anomaly detection in a massive stream
of  metrics.

Can Spark easily handle this use case ?

Thanks,
Natu