Re: [Proposal] Enabling time series analysis on spark metrics

2016-03-03 Thread Karan Kumar
ish metrics? Seems reasonable. > > > On Tue, Mar 1, 2016 at 8:17 AM, Karan Kumar <karankumar1...@gmail.com> > wrote: > >> +dev mailing list >> >> Time series analysis on metrics becomes quite useful when running spark >> jobs using a workflow manager like

Re: [Proposal] Enabling time series analysis on spark metrics

2016-03-01 Thread Karan Kumar
+dev mailing list Time series analysis on metrics becomes quite useful when running spark jobs using a workflow manager like oozie. Would love to take this up if the community thinks its worthwhile. On Tue, Feb 23, 2016 at 2:59 PM, Karan Kumar <karankumar1...@gmail.com> wrote: > HI

[Proposal] Enabling time series analysis on spark metrics

2016-02-23 Thread Karan Kumar
HI Spark at the moment uses application ID to report metrics. I was thinking that if we can create an option to export metrics on a user-controlled key. This will allow us to do time series analysis on counters by dumping these counters in a DB such as graphite. One of the approaches I had in