Thanks John. I had tried profiling locally with yourkit but my recollection was that almost all of the time was spent in backtype.storm.timer sleep which didn't smell right to me.
On Tue, Apr 19, 2016 at 8:43 PM, <[email protected]> wrote: > One thing you can do is profile a worker process with jvisualvm to see > what time is spent where for each executor thread as well as the netty and > lmax layers. > > --John > > Sent from my iPhone > > On Apr 19, 2016, at 8:41 PM, Kevin Conaway <[email protected]> > wrote: > > In Storm 0.10, is there a way to monitor the _maxSpoutPending_ value? I > don' see it exposed in any of the metrics that storm publishes but I'd like > to be able to see how much time each tuple spends waiting and how big the > pending queue size is for each spout task. Is this possible? > > Our topology has one spout and one bolt. The average bolt execute latency > is ~20ms but the overall spout latency is ~60ms. I'd like to know where > those other 40ms are being spent. > > Thank you > > -- > Kevin Conaway > http://www.linkedin.com/pub/kevin-conaway/7/107/580/ > https://github.com/kevinconaway > > -- Kevin Conaway http://www.linkedin.com/pub/kevin-conaway/7/107/580/ https://github.com/kevinconaway
