Total Shuffle Read and Write Size of Spark workload

2016-09-15 Thread Cristina Rozee
Hello, I am running a spark application and I would like to know the total amount of shuffle data (read + write ) so could anyone let me know how to get this information? Thank you Cristina.

Re: Total Shuffle Read and Write Size of Spark workload

2016-09-19 Thread Cristina Rozee
Could you please explain a little bit? On Sun, Sep 18, 2016 at 10:19 PM, Jacek Laskowski wrote: > SparkListener perhaps? > > Jacek > > On 15 Sep 2016 1:41 p.m., "Cristina Rozee" > wrote: > >> Hello, >> >> I am running a spark application and I

Re: Total Shuffle Read and Write Size of Spark workload

2016-09-19 Thread Cristina Rozee
s arising from > such loss, damage or destruction. > > > > On 19 September 2016 at 10:34, Cristina Rozee > wrote: > >> Could you please explain a little bit? >> >> >> On Sun, Sep 18, 2016 at 10:19 PM, Jacek Laskowski >> wrote: >> >>>