[
https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-17611.
------------------------------------
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 2.1.0
> YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things
> -----------------------------------------------------------------------------
>
> Key: SPARK-17611
> URL: https://issues.apache.org/jira/browse/SPARK-17611
> Project: Spark
> Issue Type: Bug
> Components: Tests, YARN
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
> Priority: Minor
> Fix For: 2.1.0
>
>
> If you look at the logs, you'll see exceptions like this:
> {noformat}
> 16/09/20 10:03:45.081
> pool-1-thread-1-ScalaTest-running-YarnShuffleServiceSuite ERROR
> YarnShuffleService: Exception when initializing application application_0_0001
> java.lang.NullPointerException
> at io.netty.buffer.Unpooled.wrappedBuffer(Unpooled.java:183)
> at
> org.apache.spark.network.util.JavaUtils.bytesToString(JavaUtils.java:80)
> at
> org.apache.spark.network.sasl.ShuffleSecretManager.registerApp(ShuffleSecretManager.java:62)
> at
> org.apache.spark.network.yarn.YarnShuffleService.initializeApplication(YarnShuffleService.java:254)
> at
> org.apache.spark.network.yarn.YarnShuffleServiceSuite$$anonfun$1.apply$mcV$sp(YarnShuffleServiceSuite.scala:89)
> at
> org.apache.spark.network.yarn.YarnShuffleServiceSuite$$anonfun$1.apply(YarnShuffleServiceSuite.scala:81)
> at
> org.apache.spark.network.yarn.YarnShuffleServiceSuite$$anonfun$1.apply(YarnShuffleServiceSuite.scala:81)
> {noformat}
> The underlying reason is that the suite is testing with auth on, but
> providing a null auth secret. But because of catch blocks in the shuffle
> service code, and failure to properly check things in the suite, the tests
> pass even though the underlying code is failing.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
