Lantao Jin created SPARK-29112:
----------------------------------

             Summary: Expose more details when ApplicationMaster reporter faces 
a fatal exception
                 Key: SPARK-29112
                 URL: https://issues.apache.org/jira/browse/SPARK-29112
             Project: Spark
          Issue Type: Bug
          Components: YARN
    Affects Versions: 2.4.4, 3.0.0
            Reporter: Lantao Jin


In {{ApplicationMaster.Reporter}} thread, fatal exception information is 
swallowed. It's better to expose.
A thrift server was shutdown due to some fatal exception but no useful 
information from log.
{code}
19/09/16 06:59:54,498 INFO [Reporter] yarn.ApplicationMaster:54 : Final app 
status: FAILED, exitCode: 12, (reason: Exception was thrown 1 time(s) from 
Reporter thread.)
19/09/16 06:59:54,500 ERROR [Driver] thriftserver.HiveThriftServer2:91 : Error 
starting HiveThriftServer2
java.lang.InterruptedException: sleep interrupted
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.spark.sql.hive.thriftserver.HiveThriftServer2$.main(HiveThriftServer2.scala:160)
        at 
org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.main(HiveThriftServer2.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4.run(ApplicationMaster.scala:708)
{code}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to