Josh Rosen created SPARK-18236: ---------------------------------- Summary: Reduce memory usage of Spark UI and HistoryServer by reducing duplicate objects Key: SPARK-18236 URL: https://issues.apache.org/jira/browse/SPARK-18236 Project: Spark Issue Type: Improvement Components: Web UI Reporter: Josh Rosen Assignee: Josh Rosen
When profiling heap dumps from the Spark History Server and live Spark web UIs, I found a tremendous amount of memory being wasted on duplicate objects and strings. A few small changes can cut per-task UI memory by half or more. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org