Supreeth Sharma created ZEPPELIN-3392:

             Summary: User need to be informed if path to the provided jar file 
is incorrect
                 Key: ZEPPELIN-3392
             Project: Zeppelin
          Issue Type: Bug
          Components: zeppelin-server
    Affects Versions: 0.8.0
            Reporter: Supreeth Sharma
             Fix For: 0.8.0

The user need to be informed if path to the provided jar file is incorrect.

Steps to reproduce :
Step 1: Create para1 as below:
livy.spark.jars /tmp/spark2-examples-assembly- per_user_hrt_1_1livy2
where '/tmp/spark2-examples-assembly-' is incorect

Step 2: Run para2 as below
If user provides incorrect jar file path, then first para which creates the 
config("%livy2.conf") runs fine without providing any errors or warnings.

Now when the user tries to run subsequent para, then it fails with very generic 
message as below and it doesn't provide any information for user to know that 
the failure is due to bad configuration.
org.apache.zeppelin.livy.LivyException: Session 45 is finished, appId: null, 
log: [     at,
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:177),     at 
org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227),  at 
org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136),    at 
org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala), 18/04/05 18:02:07 
INFO ShutdownHookManager: Shutdown hook called, 18/04/05 18:02:07 INFO 
ShutdownHookManager: Deleting directory 
YARN Diagnostics: , java.lang.Exception: No YARN application is found with tag 
livy-session-45-kt6n4cuy in 120 seconds. Please check your cluster status, it 
is may be very busy.,$apache$livy$utils$SparkYarnApp$$getAppIdFromTag(SparkYarnApp.scala:182)

This message was sent by Atlassian JIRA

Reply via email to