[
https://issues.apache.org/jira/browse/SPARK-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215391#comment-14215391
]
Apache Spark commented on SPARK-4266:
-------------------------------------
User 'kayousterhout' has created a pull request for this issue:
https://github.com/apache/spark/pull/3328
> Avoid expensive JavaScript for StagePages with huge numbers of tasks
> --------------------------------------------------------------------
>
> Key: SPARK-4266
> URL: https://issues.apache.org/jira/browse/SPARK-4266
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Critical
>
> Some of the new javascript added to handle hiding metrics significantly slows
> the page load for stages with a lot of tasks (e.g., for a job with 10K tasks,
> it took over a minute for the page to finish loading in Chrome on my laptop).
> There are at least two issues here:
> (1) The new table striping java script is much slower than the old CSS. The
> fancier javascript is only needed for the stage summary table, so we should
> change the task table back to using CSS so that it doesn't slow the page load
> for jobs with lots of tasks.
> (2) The javascript associated with hiding metrics is expensive when jobs have
> lots of tasks, I think because the jQuery selectors have to traverse a much
> larger DOM. The ID selectors are much more efficient, so we should consider
> switching to these, and/or avoiding this code in additional-metrics.js:
> $("input:checkbox:not(:checked)").each(function() {
> var column = "table ." + $(this).attr("name");
> $(column).hide();
> });
> by initially hiding the data when we generate the page in the render function
> instead, which should be easy to do.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
