[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396683#comment-16396683
]
Jurgen Parker commented on SPARK-4820:
--
I suggest you to use Long Path Tool. It relay helped me solve the issue.
> Spark build encounters "File name too long" on some encrypted filesystems
> -
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
>Reporter: Patrick Wendell
>Assignee: Theodore Vasiloudis
>Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The
> fix has some potential downstream issues (it will modify the classnames) so
> until we understand better how many users are affected we aren't going to
> merge it. However, I'd like to include the issue and workaround here. If you
> encounter this issue please comment on the JIRA so we can assess the
> frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + -Xmax-classfile-name
> + 128
> {code}
> In SBT add:
> {code}
> +scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100966#comment-16100966
]
antonkulaga commented on SPARK-4820:
This issue is valid for Spark 2.2.0 on Ubuntu 16.04 and it is a BLOCKER! I am
blocked in some projects because I cannot overcome this stupid error
> Spark build encounters "File name too long" on some encrypted filesystems
> -
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
>Reporter: Patrick Wendell
>Assignee: Theodore Vasiloudis
>Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The
> fix has some potential downstream issues (it will modify the classnames) so
> until we understand better how many users are affected we aren't going to
> merge it. However, I'd like to include the issue and workaround here. If you
> encounter this issue please comment on the JIRA so we can assess the
> frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + -Xmax-classfile-name
> + 128
> {code}
> In SBT add:
> {code}
> +scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017912#comment-16017912
]
Paul Praet commented on SPARK-4820:
---
I confirm - still an issue when trying to build Spark 2.1.1 on Ubuntu 16.04.
> Spark build encounters "File name too long" on some encrypted filesystems
> -
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
>Reporter: Patrick Wendell
>Assignee: Theodore Vasiloudis
>Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The
> fix has some potential downstream issues (it will modify the classnames) so
> until we understand better how many users are affected we aren't going to
> merge it. However, I'd like to include the issue and workaround here. If you
> encounter this issue please comment on the JIRA so we can assess the
> frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + -Xmax-classfile-name
> + 128
> {code}
> In SBT add:
> {code}
> +scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350090#comment-15350090
]
Paul Dennis commented on SPARK-4820:
I am seeing this with on Ubuntu 16.04 building from scratch.
{{monospaced}}
[INFO] Compiling 480 Scala sources and 74 Java sources to
/home/pd40/git/spark/core/target/scala-2.11/classes...
[WARNING]
/home/pd40/git/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:78:
class Accumulator in package spark is deprecated: use AccumulatorV2
[WARNING] accumulator: Accumulator[JList[Array[Byte]]])
[WARNING] ^
[WARNING]
/home/pd40/git/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:71:
class Accumulator in package spark is deprecated: use AccumulatorV2
[WARNING] private[spark] case class PythonFunction(
[WARNING] ^
[WARNING]
/home/pd40/git/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:873:
trait AccumulatorParam in package spark is deprecated: use AccumulatorV2
[WARNING] extends AccumulatorParam[JList[Array[Byte]]] {
[WARNING] ^
[WARNING]
/home/pd40/git/spark/core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala:459:
trait AccumulableParam in package spark is deprecated: use AccumulatorV2
[WARNING] param: org.apache.spark.AccumulableParam[R, T]) extends
AccumulatorV2[T, R] {
[WARNING] ^
[ERROR]
/home/pd40/git/spark/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala:297:
File name too long
This can happen on some encrypted or legacy file systems. Please see SI-3623
for more details.
[ERROR] logInfo(s"Asked to remove non-existent executor $executorId")
[ERROR] ^
[ERROR]
/home/pd40/git/spark/core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala:306:
File name too long
This can happen on some encrypted or legacy file systems. Please see SI-3623
for more details.
[ERROR] reason.map(r => s" (reason: $r)").getOrElse(""))
[ERROR]^
[ERROR]
/home/pd40/git/spark/core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala:306:
File name too long
This can happen on some encrypted or legacy file systems. Please see SI-3623
for more details.
[ERROR] reason.map(r => s" (reason: $r)").getOrElse(""))
[ERROR] ^
[WARNING] four warnings found
[ERROR] three errors found
{{monospaced}}
The workaround worked with scalacOptions inserted at line 260
[here|https://github.com/pd40/spark/commit/020e9340e14ef9488fec0d07e23351d155c2da8d]
{{quote}}
@@ -257,6 +257,7 @@ object SparkBuild extends PomBuild {
publishMavenStyle in MavenCompile := true,
publishLocal in MavenCompile <<= publishTask(publishLocalConfiguration in
MavenCompile, deliverLocal),
publishLocalBoth <<= Seq(publishLocal in MavenCompile,
publishLocal).dependOn,
+scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
{{quote}}
> Spark build encounters "File name too long" on some encrypted filesystems
> -
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
>Reporter: Patrick Wendell
>Assignee: Theodore Vasiloudis
>Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The
> fix has some potential downstream issues (it will modify the classnames) so
> until we understand better how many users are affected we aren't going to
> merge it. However, I'd like to include the issue and workaround here. If you
> encounter this issue please comment on the JIRA so we can assess the
> frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + -Xmax-classfile-name
> + 128
> {code}
> In SBT add:
> {code}
> +scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299232#comment-15299232
]
Niko commented on SPARK-4820:
-
Yep, still an issue. I'm using Ubuntu 15.10 and building from scratch.
> Spark build encounters "File name too long" on some encrypted filesystems
> -
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
>Reporter: Patrick Wendell
>Assignee: Theodore Vasiloudis
>Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The
> fix has some potential downstream issues (it will modify the classnames) so
> until we understand better how many users are affected we aren't going to
> merge it. However, I'd like to include the issue and workaround here. If you
> encounter this issue please comment on the JIRA so we can assess the
> frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + -Xmax-classfile-name
> + 128
> {code}
> In SBT add:
> {code}
> +scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283330#comment-15283330
]
Joel Bondurant commented on SPARK-4820:
---
RE: "If you encounter this issue please comment on the JIRA so we can assess
the frequency."
On ubuntu 15.10, Sparky 1.6.1 builds choke on disk crypto.
> sudo sbt/sbt clean assembly && echo ':('
...
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[warn] 45 warnings found
[error] two errors found
[error] (core/compile:compile) Compilation failed
[error] Total time: 253 s, completed May 13, 2016 5:08:04 PM
:(
> Spark build encounters "File name too long" on some encrypted filesystems
> -
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
>Reporter: Patrick Wendell
>Assignee: Theodore Vasiloudis
>Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The
> fix has some potential downstream issues (it will modify the classnames) so
> until we understand better how many users are affected we aren't going to
> merge it. However, I'd like to include the issue and workaround here. If you
> encounter this issue please comment on the JIRA so we can assess the
> frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + -Xmax-classfile-name
> + 128
> {code}
> In SBT add:
> {code}
> +scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263733#comment-15263733
]
Sean Owen commented on SPARK-4820:
--
We can't commit this change to the build since it will cause other problems
with class names.
> Spark build encounters "File name too long" on some encrypted filesystems
> -
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
>Reporter: Patrick Wendell
>Assignee: Theodore Vasiloudis
>Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The
> fix has some potential downstream issues (it will modify the classnames) so
> until we understand better how many users are affected we aren't going to
> merge it. However, I'd like to include the issue and workaround here. If you
> encounter this issue please comment on the JIRA so we can assess the
> frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + -Xmax-classfile-name
> + 128
> {code}
> In SBT add:
> {code}
> +scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263516#comment-15263516
]
William Grim commented on SPARK-4820:
-
Hi, this is still an issue to this day. I just started using Spark and am
building Spark 1.6.1 on both my workstation at home and my workstation at work.
On both systems, I use Ubuntu 15.10, both with some fairly beefy hardware (32
GB RAM at home and 16 GB at work). Is it possible just to go ahead and get
this fix into the pom and SBT? Does that earlier warning actually hold valid?
If it does, we should figure out what's wrong with that instead of (all of?) us
modifying the build each time.
> Spark build encounters "File name too long" on some encrypted filesystems
> -
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
>Reporter: Patrick Wendell
>Assignee: Theodore Vasiloudis
>Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The
> fix has some potential downstream issues (it will modify the classnames) so
> until we understand better how many users are affected we aren't going to
> merge it. However, I'd like to include the issue and workaround here. If you
> encounter this issue please comment on the JIRA so we can assess the
> frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + -Xmax-classfile-name
> + 128
> {code}
> In SBT add:
> {code}
> +scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362949#comment-14362949
]
Apache Spark commented on SPARK-4820:
-
User 'thvasilo' has created a pull request for this issue:
https://github.com/apache/spark/pull/5041
Spark build encounters File name too long on some encrypted filesystems
-
Key: SPARK-4820
URL: https://issues.apache.org/jira/browse/SPARK-4820
Project: Spark
Issue Type: Bug
Components: Build
Reporter: Patrick Wendell
Priority: Minor
This was reported by Luchesar Cekov on github along with a proposed fix. The
fix has some potential downstream issues (it will modify the classnames) so
until we understand better how many users are affected we aren't going to
merge it. However, I'd like to include the issue and workaround here. If you
encounter this issue please comment on the JIRA so we can assess the
frequency.
The issue produces this error:
{code}
[error] == Expanded type of tree ==
[error]
[error] ConstantType(value = Constant(Throwable))
[error]
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[error] two errors found
{code}
The workaround is in maven under the compile options add:
{code}
+ arg-Xmax-classfile-name/arg
+ arg128/arg
{code}
In SBT add:
{code}
+scalacOptions in Compile ++= Seq(-Xmax-classfile-name, 128),
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360443#comment-14360443
]
Óscar Puertas commented on SPARK-4820:
--
I see, but I have no an encrypted file system and it's failing too. Seems to be
related to long paths.
Spark build encounters File name too long on some encrypted filesystems
-
Key: SPARK-4820
URL: https://issues.apache.org/jira/browse/SPARK-4820
Project: Spark
Issue Type: Bug
Components: Build
Reporter: Patrick Wendell
Priority: Minor
This was reported by Luchesar Cekov on github along with a proposed fix. The
fix has some potential downstream issues (it will modify the classnames) so
until we understand better how many users are affected we aren't going to
merge it. However, I'd like to include the issue and workaround here. If you
encounter this issue please comment on the JIRA so we can assess the
frequency.
The issue produces this error:
{code}
[error] == Expanded type of tree ==
[error]
[error] ConstantType(value = Constant(Throwable))
[error]
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[error] two errors found
{code}
The workaround is in maven under the compile options add:
{code}
+ arg-Xmax-classfile-name/arg
+ arg128/arg
{code}
In SBT add:
{code}
+scalacOptions in Compile ++= Seq(-Xmax-classfile-name, 128),
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360407#comment-14360407
]
Óscar Puertas commented on SPARK-4820:
--
Still failing for the 1.3 branch.
Spark build encounters File name too long on some encrypted filesystems
-
Key: SPARK-4820
URL: https://issues.apache.org/jira/browse/SPARK-4820
Project: Spark
Issue Type: Bug
Components: Build
Reporter: Patrick Wendell
This was reported by Luchesar Cekov on github along with a proposed fix. The
fix has some potential downstream issues (it will modify the classnames) so
until we understand better how many users are affected we aren't going to
merge it. However, I'd like to include the issue and workaround here. If you
encounter this issue please comment on the JIRA so we can assess the
frequency.
The issue produces this error:
{code}
[error] == Expanded type of tree ==
[error]
[error] ConstantType(value = Constant(Throwable))
[error]
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[error] two errors found
{code}
The workaround is in maven under the compile options add:
{code}
+ arg-Xmax-classfile-name/arg
+ arg128/arg
{code}
In SBT add:
{code}
+scalacOptions in Compile ++= Seq(-Xmax-classfile-name, 128),
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360610#comment-14360610
]
Theodore Vasiloudis commented on SPARK-4820:
[~srowen] Including a warning in the Building Spark docs then might be
warranted?
Spark build encounters File name too long on some encrypted filesystems
-
Key: SPARK-4820
URL: https://issues.apache.org/jira/browse/SPARK-4820
Project: Spark
Issue Type: Bug
Components: Build
Reporter: Patrick Wendell
Priority: Minor
This was reported by Luchesar Cekov on github along with a proposed fix. The
fix has some potential downstream issues (it will modify the classnames) so
until we understand better how many users are affected we aren't going to
merge it. However, I'd like to include the issue and workaround here. If you
encounter this issue please comment on the JIRA so we can assess the
frequency.
The issue produces this error:
{code}
[error] == Expanded type of tree ==
[error]
[error] ConstantType(value = Constant(Throwable))
[error]
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[error] two errors found
{code}
The workaround is in maven under the compile options add:
{code}
+ arg-Xmax-classfile-name/arg
+ arg128/arg
{code}
In SBT add:
{code}
+scalacOptions in Compile ++= Seq(-Xmax-classfile-name, 128),
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360616#comment-14360616
]
Sean Owen commented on SPARK-4820:
--
Most certainly worth a note at least, yes. Feel free to make a PR if you have a
moment.
Spark build encounters File name too long on some encrypted filesystems
-
Key: SPARK-4820
URL: https://issues.apache.org/jira/browse/SPARK-4820
Project: Spark
Issue Type: Bug
Components: Build
Reporter: Patrick Wendell
Priority: Minor
This was reported by Luchesar Cekov on github along with a proposed fix. The
fix has some potential downstream issues (it will modify the classnames) so
until we understand better how many users are affected we aren't going to
merge it. However, I'd like to include the issue and workaround here. If you
encounter this issue please comment on the JIRA so we can assess the
frequency.
The issue produces this error:
{code}
[error] == Expanded type of tree ==
[error]
[error] ConstantType(value = Constant(Throwable))
[error]
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[error] two errors found
{code}
The workaround is in maven under the compile options add:
{code}
+ arg-Xmax-classfile-name/arg
+ arg128/arg
{code}
In SBT add:
{code}
+scalacOptions in Compile ++= Seq(-Xmax-classfile-name, 128),
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356688#comment-14356688
]
Theodore Vasiloudis commented on SPARK-4820:
Can confirm for 1.2.1 in encfs as well, had to build /tmp instead.
Spark build encounters File name too long on some encrypted filesystems
-
Key: SPARK-4820
URL: https://issues.apache.org/jira/browse/SPARK-4820
Project: Spark
Issue Type: Bug
Components: Build
Reporter: Patrick Wendell
This was reported by Luchesar Cekov on github along with a proposed fix. The
fix has some potential downstream issues (it will modify the classnames) so
until we understand better how many users are affected we aren't going to
merge it. However, I'd like to include the issue and workaround here. If you
encounter this issue please comment on the JIRA so we can assess the
frequency.
The issue produces this error:
{code}
[error] == Expanded type of tree ==
[error]
[error] ConstantType(value = Constant(Throwable))
[error]
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[error] two errors found
{code}
The workaround is in maven under the compile options add:
{code}
+ arg-Xmax-classfile-name/arg
+ arg128/arg
{code}
In SBT add:
{code}
+scalacOptions in Compile ++= Seq(-Xmax-classfile-name, 128),
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311061#comment-14311061
]
Jian Zhou commented on SPARK-4820:
--
Encountered this issue in encfs, and this workaround works.
Spark build encounters File name too long on some encrypted filesystems
-
Key: SPARK-4820
URL: https://issues.apache.org/jira/browse/SPARK-4820
Project: Spark
Issue Type: Bug
Components: Build
Reporter: Patrick Wendell
This was reported by Luchesar Cekov on github along with a proposed fix. The
fix has some potential downstream issues (it will modify the classnames) so
until we understand better how many users are affected we aren't going to
merge it. However, I'd like to include the issue and workaround here. If you
encounter this issue please comment on the JIRA so we can assess the
frequency.
The issue produces this error:
{code}
[error] == Expanded type of tree ==
[error]
[error] ConstantType(value = Constant(Throwable))
[error]
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[error] two errors found
{code}
The workaround is in maven under the compile options add:
{code}
+ arg-Xmax-classfile-name/arg
+ arg128/arg
{code}
In SBT add:
{code}
+scalacOptions in Compile ++= Seq(-Xmax-classfile-name, 128),
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257116#comment-14257116
]
Iljya Kalai commented on SPARK-4820:
Thanks for creating this issue, and thanks to Luchesar for providing a
workaround. Are the ramifications of pulling this into the head repository
known? It would be great if compiling on encrypted drives just worked. It's a
bit unfortunate that new Spark users with encrypted drives will get slammed by
this issue upon trying to compile Spark for the first time.
Spark build encounters File name too long on some encrypted filesystems
-
Key: SPARK-4820
URL: https://issues.apache.org/jira/browse/SPARK-4820
Project: Spark
Issue Type: Bug
Reporter: Patrick Wendell
This was reported by Luchesar Cekov on github along with a proposed fix. The
fix has some potential downstream issues (it will modify the classnames) so
until we understand better how many users are affected we aren't going to
merge it. However, I'd like to include the issue and workaround here. If you
encounter this issue please comment on the JIRA so we can assess the
frequency.
The issue produces this error:
{code}
[error] == Expanded type of tree ==
[error]
[error] ConstantType(value = Constant(Throwable))
[error]
[error] uncaught exception during compilation: java.io.IOException
[error] File name too long
[error] two errors found
{code}
The workaround is in maven under the compile options add:
{code}
+ arg-Xmax-classfile-name/arg
+ arg128/arg
{code}
In SBT add:
{code}
+scalacOptions in Compile ++= Seq(-Xmax-classfile-name, 128),
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
