Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/9095#issuecomment-147734023
Actually YARN doesn't allocate any. The only reason it reports 1 is because
cpu scheduling is disabled and its trying to return something reasonable.YARN
does not limit you to 1 core.
Before the cpu scheduler was available this is the only way to get more
then 1 core for your application and if you are on an older version of hadoop
you didn't have the cpu scheduler as an option. Basically if yarn isn't
managing then its up to the user to do something reasonable with that resource.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
