[
https://issues.apache.org/jira/browse/SPARK-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365419#comment-14365419
]
Steve Loughran commented on SPARK-3351:
---------------------------------------
Thomas: what Yarn version was this against?
There's been a guard against this in
{{FinishApplicationMasterRequestPBImpl.setTrackingUrl()}} since YARN-918 &
2.1.0-beta.
> Yarn YarnRMClientImpl.shutdown can be called before register - NPE
> ------------------------------------------------------------------
>
> Key: SPARK-3351
> URL: https://issues.apache.org/jira/browse/SPARK-3351
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.2.0
> Reporter: Thomas Graves
>
> If the SparkContext exits while its in the
> applicationmaster.waitForSparkContextInitialized then the
> YarnRMClientImpl.shutdown can be called before register and you get a null
> pointer exception on the uihistoryAddress.
> 14/09/02 18:59:21 INFO ApplicationMaster: Finishing ApplicationMaster with
> FAILED (diag message: Timed out waiting for SparkContext.)
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.yarn.proto.YarnServiceProtos$FinishApplicationMasterRequestProto$Builder.setTrackingUrl(YarnServiceProtos.java:2312)
> at
> org.apache.hadoop.yarn.api.protocolrecords.impl.pb.FinishApplicationMasterRequestPBImpl.setTrackingUrl(FinishApplicationMasterRequestPBImpl.java:121)
> at
> org.apache.spark.deploy.yarn.YarnRMClientImpl.shutdown(YarnRMClientImpl.scala:73)
> at
> org.apache.spark.deploy.yarn.ApplicationMaster.finish(ApplicationMaster.scala:140)
> at
> org.apache.spark.deploy.yarn.ApplicationMaster.runDriver(ApplicationMaster.scala:178)
> at
> org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:113)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
