Hi Jeff, Thank you for reply.
Spark->Advanced livy-conf livy.spark.master was already set as yarn-cluster while I executed my note book. Thanks, Minquan From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com] Sent: Monday, June 05, 2017 7:26 PM To: users@zeppelin.apache.org Subject: Re: how to configure livy.sparkr to run job across cluster nodes Please check the conf of your livy server. livy.spark.master should be yarn-cluster It doesn't take effect to set it in zeppelin interpreter Best Regard, Jeff Zhang From: Minquan Xu <m...@smg.com<mailto:m...@smg.com>> Reply-To: "users@zeppelin.apache.org<mailto:users@zeppelin.apache.org>" <users@zeppelin.apache.org<mailto:users@zeppelin.apache.org>> Date: Tuesday, June 6, 2017 at 1:36 AM To: "users@zeppelin.apache.org<mailto:users@zeppelin.apache.org>" <users@zeppelin.apache.org<mailto:users@zeppelin.apache.org>> Subject: FW: how to configure livy.sparkr to run job across cluster nodes From: Minquan Xu Sent: Monday, June 05, 2017 12:34 PM To: 'users@zeppelin.apache.org<mailto:'users@zeppelin.apache.org>' <users@zeppelin.apache.org<mailto:users@zeppelin.apache.org>> Subject: how to configure livy.sparkr to run job across cluster nodes Hi All, My livy sparkr appears to run jobs in local mode, i.g, the jobs are not in yarn resource manager UI, while spark.pyspark and Jupyer Toree SperkR jobs run across cluster nodes. Platform: hortonworks hdp 2.6, zeppelin version 0.70, os: linux 2.6. In the zeppelin interpreter, livy.spark.master is set as yarn-client. Any suggestion is appreciated. %livy.sparkr livy.spark.master yarn-client %spark.pyspark Yarn ResourceManager UI [cid:image002.png@01D2DEAA.4209F0C0] Jupyter toree SparkR [cid:image003.png@01D2DEAA.4209F0C0] Thanks, Minquan ________________________________ This email and any attachments thereto may contain private, confidential, and privileged material for the sole use of the intended recipient. Any review, copying, or distribution of this email (or any attachments thereto) by others is strictly prohibited. If you are not the intended recipient, please contact the sender immediately and permanently delete the original and any copies of this email and any attachments thereto. ________________________________
