Question for Apache Livy

2018-05-14 Thread Sarthak Singhal
Hi, How to set --master, --deploy-mode, --driver-class-path and --driver-java-options through Apache Livy? I want to set the master, spark deploy-mode, driver-class-path and driver-java-options for the Spark job when the job is triggered through Apache Livy without having to restart the Livy se

About new API set to create interactive and batch session

2018-05-14 Thread Saisai Shao
Hi Team, In our current API design to create interactive / batch session, we assume end user could upload jars, pyFiles and related dependencies to HDFS before creating the session, and we use one POST request to create session. But usually end user may not have the permission to access the HDFS i