Hi,

I would like to ask how to check how much memory of executor was used
during run of application. I know where to check cache memory usage in logs
and in web UI (in Storage tab), but where can I check size of rest of the
heap (used e.g. for aggregation and cogroups during shuffle)? Because it
also can be reason of overflow:
https://spark.apache.org/docs/0.6.0/tuning.html#memory-usage-of-reduce-tasks

Thanks,
Grzegorz

Reply via email to