Github user CodingCat commented on the pull request:
https://github.com/apache/spark/pull/731#issuecomment-50014048
@nishkamravi2 I got your point now... yes, this patch is to enable the user
to run multiple executors with a single worker instead of running multiple
workers
as @shivaram said, this is mainly for a better way of utilizing the memory
space
from my opinion, we should still keep supporting the multiple worker per
server mechanism...before 1.0, when I used Spark, one of the big headache for
me is that the worker can die due to the overloaded executor.....causing other
executors die together....from 1.0, it seems to be much better, (maybe because
we kill the executor process in its own thread now, but I'm not
sure)....multiple workers can prevent this case
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
