Repository: spark Updated Branches: refs/heads/master 005d1c5f2 -> e26db9be4
[docs] [SPARK-4820] Spark build encounters "File name too long" on some encrypted filesystems Added a note instructing users how to build Spark in an encrypted file system. Author: Theodore Vasiloudis <[email protected]> Closes #5041 from thvasilo/patch-2 and squashes the following commits: 09d890b [Theodore Vasiloudis] Workaroung for buiding in an encrypted filesystem Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e26db9be Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e26db9be Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e26db9be Branch: refs/heads/master Commit: e26db9be47b295c4ec9e651f4cce321ba1fddfcd Parents: 005d1c5 Author: Theodore Vasiloudis <[email protected]> Authored: Tue Mar 17 11:25:01 2015 +0000 Committer: Sean Owen <[email protected]> Committed: Tue Mar 17 11:26:11 2015 +0000 ---------------------------------------------------------------------- docs/building-spark.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/e26db9be/docs/building-spark.md ---------------------------------------------------------------------- diff --git a/docs/building-spark.md b/docs/building-spark.md index 57d0ca8..ea79c5b 100644 --- a/docs/building-spark.md +++ b/docs/building-spark.md @@ -23,6 +23,18 @@ build/mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package Other build examples can be found below. +**Note:** When building on an encrypted filesystem (if your home directory is encrypted, for example), then the Spark build might fail with a "Filename too long" error. As a workaround, add the following in the configuration args of the `scala-maven-plugin` in the project `pom.xml`: + + <arg>-Xmax-classfile-name</arg> + <arg>128</arg> + +and in `project/SparkBuild.scala` add: + + scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"), + +to the `sharedSettings` val. See also [this PR](https://github.com/apache/spark/pull/2883/files) if you are unsure of where to add these lines. + + # Setting up Maven's Memory Usage You'll need to configure Maven to use more memory than usual by setting `MAVEN_OPTS`. We recommend the following settings: --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
