RE: how to load pandas into pyspark (centos 6 with python 2.6)

Sorry for the stupid question How can I use pip? Zeppelin will run pip through the shell interpreter but my system global python is 2.6… [cid:image002.jpg@01D3FF37.8827CBF0] thanks Manuel From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Friday, June 8, 2018 1:45 PM To:

Re: how to load pandas into pyspark (centos 6 with python 2.6)

pip should be available under your python3.6.5, you can use that to install pandas Manuel Sopena Ballesteros 于2018年6月8日周五 上午11:40写道： > Hi Jeff, > > > > Thank you very much for your quick response. My zeppelin is deployed using > HDP (hortonworks platform) so I already have spark/yarn

RE: how to load pandas into pyspark (centos 6 with python 2.6)

Hi Jeff, Thank you very much for your quick response. My zeppelin is deployed using HDP (hortonworks platform) so I already have spark/yarn integration and I am using zeppelin.pyspark.python to tell pyspark to run python 3.6: zeppelin.pyspark.python --> /tmp/Python-3.6.5/python I do have root

Re: how to load pandas into pyspark (centos 6 with python 2.6)

First I would suggest you to use python 2.7 or python 3.x, because spark2.x has drop the support of python 2.6. Second you need to configure PYSPARK_PYTHON in spark interpreter setting to point to the python that you installed. (I don't know what do you mena that you can't install pandas system

how to load pandas into pyspark (centos 6 with python 2.6)

Dear Zeppelin community, I am trying to load pandas into my zeppelin %spark2.pyspark interpreter. The system I am using is centos 6 with python 2.6 so I can't install pandas system wide through pip as suggested in the documentation. What can I do if I want to add modules into the

Re: NewSparkInterpreter fails on yarn-cluster

Hi Thomas, I try to the latest branch-0.8, it works for me. Could you try again to verify it ? Thomas Bünger 于2018年6月7日周四 下午8:34写道： > I specifically mean visualisation via ZeppelinContext inside a Spark > interpreter. (e.g. "z.show(...)") > The visualisation of SparkSQL results inside a

Re: Zeppelin 0.8

I am doing the release, the latest RC4 is canceled, I will start RC5 in the next few days. Best Regard, Jeff Zhang From: Benjamin Kim mailto:bbuil...@gmail.com>> Reply-To: "users@zeppelin.apache.org" mailto:users@zeppelin.apache.org>> Date: Thursday, June

Re: Zeppelin 0.8

Can anyone tell me what the status is for 0.8 release? > On May 2, 2018, at 4:43 PM, Jeff Zhang wrote: > > > Yes, 0.8 will support spark 2.3 > > Benjamin Kim mailto:bbuil...@gmail.com>>于2018年5月3日周四 > 上午1:59写道： > Will Zeppelin 0.8 have Spark 2.3 support? > >> On Apr 30, 2018, at 1:27 AM,

Re: Credentials for JDBC

Hi 종열, Can you show me how? Thanks, Ben > On Jun 6, 2018, at 10:32 PM, Jongyoul Lee wrote: > > We have a trick to get credential information from a credential page. I'll > take into it. > > On Thu, Jun 7, 2018 at 7:53 AM, Benjamin Kim > wrote: > I created a JDBC

Re: NewSparkInterpreter fails on yarn-cluster

I specifically mean visualisation via ZeppelinContext inside a Spark interpreter. (e.g. "z.show(...)") The visualisation of SparkSQL results inside a SparkSQLInterpreter work fine, also in yarn-cluster mode. Am Do., 7. Juni 2018 um 14:30 Uhr schrieb Thomas Bünger < thom.bu...@googlemail.com>: >

Re: NewSparkInterpreter fails on yarn-cluster

Hey Jeff, I tried your changes and now it works nicely. Thank you very much! But I still can't use any of the forms and visualizations in yarn-cluster? I was hoping that this got resolved with the new SparkInterpreter so that I can switch from yarn-client to yarn-cluster mode in 0.8, but I'm