Re: measuring time taken in map, reduceByKey, filter, flatMap

2015-01-30 Thread Akhil Das
I believe From the webui (running on port 8080) you will get these measurements. Thanks Best Regards On Sat, Jan 31, 2015 at 9:29 AM, Josh J wrote: > Hi, > > I have a stream pipeline which invokes map, reduceByKey, filter, and > flatMap. How can I measure the time taken in each stage? > > Thank

measuring time taken in map, reduceByKey, filter, flatMap

2015-01-30 Thread Josh J
Hi, I have a stream pipeline which invokes map, reduceByKey, filter, and flatMap. How can I measure the time taken in each stage? Thanks, Josh