Github user thegiive commented on the pull request:
https://github.com/apache/spark/pull/7958#issuecomment-128226959
Hi @CodingCat : Thanks for commenting. Viirya and I are in the same team.
We know currently Spark standalone has only one FIFO scheduler outside the
application and that what we want to change.
Base on our team's simulation and observe, a advance scheduler will boost
the spark standalone cluster's CPU/memory resource usage A LOT. We are working
on implement a better scheduler than current version. For now, the most
important thing is to setup a suitable and extensive interface on the
scheduler. In the scheduler interface is ready, we can treat our scheduler as a
extension or plugin of Apache Spark.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
