Hi, I would like to ask how to check how much memory of executor was used during run of application. I know where to check cache memory usage in logs and in web UI (in Storage tab), but where can I check size of rest of the heap (used e.g. for aggregation and cogroups during shuffle)? Because it also can be reason of overflow: https://spark.apache.org/docs/0.6.0/tuning.html#memory-usage-of-reduce-tasks
Thanks, Grzegorz