Github user ehnalis commented on the pull request:
https://github.com/apache/spark/pull/6082#issuecomment-102037597
@tgravescs Hehe, that would be an overkill for anyone. Theoretically this
solution will provide a long list of benefits over constant HB rate. I would
refer, cite to thousands of research papers from this field, but I really want
to avoid that.
To evaluate the performance benefit in practice would require a larger
cluster to be set up with a dozen stress-tests on not-so-synthetic workloads.
Actually, I might improve this in the future with a configuration to be
able to change the back-off algorithm. Maybe to exponential.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
