Marcelo Vanzin created SPARK-23787:
--------------------------------------
Summary: SparkSubmitSuite::"" fails on Hadoop 2.9
Key: SPARK-23787
URL: https://issues.apache.org/jira/browse/SPARK-23787
Project: Spark
Issue Type: Bug
Components: Spark Core, Tests
Affects Versions: 2.4.0
Reporter: Marcelo Vanzin
{noformat}
[info] - download list of files to local (10 milliseconds)
[info]
"http:///work/apache/spark/target/tmp/spark-a17bc160-641b-41e1-95be-a2e31b175e09/testJar3393247632492201277.jar";
did not start with substring "file:" (SparkSubmitSuite.scala:1022)
[info] org.scalatest.exceptions.TestFailedException:
[info] at
org.scalatest.MatchersHelper$.indicateFailure(MatchersHelper.scala:340)
[info] at
org.scalatest.Matchers$ShouldMethodHelper$.shouldMatcher(Matchers.scala:6668)
[info] at org.scalatest.Matchers$AnyShouldWrapper.should(Matchers.scala:6704)
[info] at
org.apache.spark.deploy.SparkSubmitSuite.org$apache$spark$deploy$SparkSubmitSuite$$testRemoteResources(SparkSubmitSuite.scala:1022)
[info] at
org.apache.spark.deploy.SparkSubmitSuite$$anonfun$18.apply$mcV$sp(SparkSubmitSuite.scala:962)
[info] at
org.apache.spark.deploy.SparkSubmitSuite$$anonfun$18.apply(SparkSubmitSuite.scala:962)
[info] at
org.apache.spark.deploy.SparkSubmitSuite$$anonfun$18.apply(SparkSubmitSuite.scala:962)
{noformat}
That's because Hadoop 2.9 supports http as a file system, and the test expects
the Hadoop libraries not to. I also found a couple of other bugs in the test
(although the code itself for the feature is fine).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
