Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/396#issuecomment-40369872
Spark shouldn't be using it directly since it got marked as private in the
Hadoop 2.2 release. I believe Spark was using that api before the 2.2 release
so it was easy to miss.
Also when it was changed it to private, MapReduce was not updated to stop
using it, so Hadoop is breaking its own api rules.
These functions are utility functions and could be used by many types of
applications so ideally some new class in YARN with these functions is created
that is public.
I think we should commit this pr (after review) since spark on yarn can't
be run against 2.4 release now and then if a new Yarn utility class is created
we can look at using that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
