Hi, We enabled JmxSink in metric.properties, but we see minimal metrics like memory usage and all. How can we introduce metrics at application level like throughput (message processed / sec). We tried to create MetricRegistry and increment counter in Map function but that doesn't help. Or is there any other way to benchmark the our application against spark ?
Thanks Pankaj On Tue, Jan 21, 2014 at 3:24 PM, Pankaj Mittal <[email protected] > wrote: > Hi, > > We are using spark with KafkaDstream. Now How can we monitor spark and get > some metrics like rate at which messages are being received or processed > w.r.t. a worker or cluster wide ? > > Thanks > Pankaj >
