Supreeth Sharma created ZEPPELIN-3392:
-----------------------------------------
Summary: User need to be informed if path to the provided jar file
is incorrect
Key: ZEPPELIN-3392
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3392
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-server
Affects Versions: 0.8.0
Reporter: Supreeth Sharma
Fix For: 0.8.0
The user need to be informed if path to the provided jar file is incorrect.
Steps to reproduce :
Step 1: Create para1 as below:
{code:java}
%livy2.conf
livy.spark.jars /tmp/spark2-examples-assembly-2.3.0.3.0.0.0-1145.jar
livy.spark.app.name per_user_hrt_1_1livy2
{code}
where '/tmp/spark2-examples-assembly-2.3.0.3.0.0.0-1145.jar' is incorect
Step 2: Run para2 as below
{code:java}
%livy2
sc.version
{code}
If user provides incorrect jar file path, then first para which creates the
config("%livy2.conf") runs fine without providing any errors or warnings.
Now when the user tries to run subsequent para, then it fails with very generic
message as below and it doesn't provide any information for user to know that
the failure is due to bad configuration.
{code:java}
org.apache.zeppelin.livy.LivyException: Session 45 is finished, appId: null,
log: [ at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682),
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:177), at
org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227), at
org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136), at
org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala), 18/04/05 18:02:07
INFO ShutdownHookManager: Shutdown hook called, 18/04/05 18:02:07 INFO
ShutdownHookManager: Deleting directory
/tmp/spark-5522cee9-9df3-4482-a827-e08001e6f6a3,
YARN Diagnostics: , java.lang.Exception: No YARN application is found with tag
livy-session-45-kt6n4cuy in 120 seconds. Please check your cluster status, it
is may be very busy.,
org.apache.livy.utils.SparkYarnApp.org$apache$livy$utils$SparkYarnApp$$getAppIdFromTag(SparkYarnApp.scala:182)
org.apache.livy.utils.SparkYarnApp$$anonfun$1$$anonfun$4.apply(SparkYarnApp.scala:239)
org.apache.livy.utils.SparkYarnApp$$anonfun$1$$anonfun$4.apply(SparkYarnApp.scala:236)
scala.Option.getOrElse(Option.scala:121)
org.apache.livy.utils.SparkYarnApp$$anonfun$1.apply$mcV$sp(SparkYarnApp.scala:236)
org.apache.livy.Utils$$anon$1.run(Utils.scala:94)]
at
org.apache.zeppelin.livy.BaseLivyInterpreter.createSession(BaseLivyInterpreter.java:351)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
