Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/2342#issuecomment-94558457
@sarutak can you do some sanity testing to see how large this can
realistically scale too at the stage level? For instance try with 10 tasks, 100
tasks, 500 tasks, 1000 tasks, etc? I feel for stage graphs we may need to do
something lighter weight like the one proposed in #5547. Running this patch
with a stage of 10,000 tasks crashed my browser.
This one seems most useful for the top level jobs view - since overall
there is less data and we don't need to worry as much about scalability.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
