Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/12197#discussion_r58796667
--- Diff: docs/building-spark.md ---
@@ -190,13 +190,6 @@ or
Java 8 tests are automatically enabled when a Java 8 JDK is detected.
If you have JDK 8 installed but it is not the system default, you can set
JAVA_HOME to point to JDK 8 before running the tests.
-# Building for PySpark on YARN
-
-PySpark on YARN is only supported if the jar is built with Maven. Further,
there is a known problem
-with building this assembly jar on Red Hat based operating systems (see
[SPARK-1753](https://issues.apache.org/jira/browse/SPARK-1753)). If you wish to
-run PySpark on a YARN cluster with Red Hat installed, we recommend that
you build the jar elsewhere,
-then ship it over to the cluster. We are investigating the exact cause for
this.
--- End diff --
hah, I guess the investigation never happened.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]