Re: Total Shuffle Read and Write Size of Spark workload

2016-09-19 Thread Cristina Rozee
no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > On 19 September 2016 at 10:34, Cristina Rozee <rozee.crist...@gmail.com> > wrote: > >> Could you please explain a little bit? >> >> >> On Sun, Sep 18, 2016 at 10:

Re: Total Shuffle Read and Write Size of Spark workload

2016-09-19 Thread Cristina Rozee
Could you please explain a little bit? On Sun, Sep 18, 2016 at 10:19 PM, Jacek Laskowski <ja...@japila.pl> wrote: > SparkListener perhaps? > > Jacek > > On 15 Sep 2016 1:41 p.m., "Cristina Rozee" <rozee.crist...@gmail.com> > wrote: > >> Hello, &

Total Shuffle Read and Write Size of Spark workload

2016-09-15 Thread Cristina Rozee
Hello, I am running a spark application and I would like to know the total amount of shuffle data (read + write ) so could anyone let me know how to get this information? Thank you Cristina.