Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/6082#issuecomment-102042036
@ehnalis I don't understand your response. Do you not have a cluster to
run on? I understand hadoop and the possibility to have lots of different
configs. I'm asking you to run very simple scenarios. Theoretical is great,
but theoretical doesn't always match reality. I know about backoffs and the
are great in certain cases.
On a simple cluster (10 nodes) run a small spark job by itself on the
cluster with this change compared to without this change and heartbeat set to 3
seconds. what is the overall improvement in job time?
Run this on the same cluster with job in front of it, does this change have
any effect at all?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
