Python interpreter getting hung

2018-10-08 Thread Ben Vogan
Hi there, We are using Zeppelin in a shared environment and are having persistent problems with the Python interpreter getting into a state where paragraphs are PENDING forever. I have looked at the zeppelin-interpreter-python*.log files and there is virtually nothing in there - just starting/fin

Re: Zeppelin Stops Loading Notes

2017-08-19 Thread Ben Vogan
I have seen Zeppelin get into this state once. I restarted it without investigating the logs however so I don't have anything useful to go on as to why. --Ben On Sat, Aug 19, 2017 at 8:17 AM, Paul Brenner wrote: > You were correct. We had "export ZEPPELIN_SSL_PORT=false” in our > zeppelin-env.

Locking a paragraph for editing

2017-07-20 Thread Ben Vogan
Hi all, Is it possible to allow someone to view and run paragraphs in a note, but not allow them to edit them? If so, how do I do that? Thanks, -- *BENJAMIN VOGAN* | Data Platform Team Lead

Re: Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ben Vogan
gt; rdd = sc.parallelize([[u'El Niño']]) >> df = sqlc.createDataFrame( >> rdd, schema=StructType([StructField("unicode data", >> StringType(), True)]) >> ) >> df.show() >> z.show(df) > > > shows unicode charac

Zeppelin OAuth

2017-07-11 Thread Ben Vogan
Hi all, Does anyone have instructions on how to configure Zeppelin for OAuth (I'm trying to use Google)? Failing that, I can put Zeppelin behind an OAuth proxy, but would then need a Shiro component that would take the user identity out of the request headers and log the user in. Has anyone done

Re: Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ben Vogan
ncode character u'\xf1' in >> position 0: ordinal not in range(128) >> > > >> $ export LC_ALL="en_US.utf8" >> $ python -c "print (u'\xf1')" >> ñ >> > > >> $ unset LC_ALL >> $ env | grep LC >> $ &g

Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ben Vogan
Hi all, I am trying to use the zeppelin context to show the contents of a pandas DataFrame and getting the following error: Traceback (most recent call last): File "/tmp/zeppelin_python-7554503996532642522.py", line 278, in raise Exception(traceback.format_exc()) Exception: Traceback (most

Re: Centos 7 Compatibility

2017-06-21 Thread Ben Vogan
ing on CentOS 7.2? Did you make > any different/non-standard configuration changes to get it to work > properly? If so, could you please share them. > > On Wed, Jun 21, 2017 at 12:30 PM, Ben Vogan wrote: > >> I have been running Zeppelin on CentOS 7.2 for the last couple of mo

Re: Centos 7 Compatibility

2017-06-21 Thread Ben Vogan
I have been running Zeppelin on CentOS 7.2 for the last couple of months without issue. --Ben On Wed, Jun 21, 2017 at 12:37 PM, Jim Lola wrote: > The beauty of Open Source, like Apache Zeppelin, is that you can try SW on > new OS's. > > Per the Apache Zepplin documentation, CentOS 6 is supporte

Re: Livy - add external libraries from additional maven repo

2017-05-30 Thread Ben Vogan
For what it's worth I have successfully added jar files and maven packages to sessions using zeppelin & livy 0.3 - although not using %dep. In the interpreter settings I set the livy.spark.jars setting for jars that are on my HDFS cluster, and livy.spark.jars.packages for maven packages - although

Re: Integrating with Airflow

2017-05-19 Thread Ben Vogan
as a single task in Airflow. > In my opinion, each paragraph has to be a task... then it'll be very > useful. > > > Thanks, > Ruslan > > > On Fri, May 19, 2017 at 4:55 PM, Ben Vogan wrote: > >> I do not expect the relationship between DAGs to be described i

Re: Integrating with Airflow

2017-05-19 Thread Ben Vogan
ore finalized workflows I guess? > > Thanks for bringing this up. > > > > -- > Ruslan Dautkhanov > > On Fri, May 19, 2017 at 2:20 PM, Ben Vogan wrote: > >> Hi all, >> >> We are really enjoying the workflow of interacting with our data via >> Ze

Integrating with Airflow

2017-05-19 Thread Ben Vogan
Hi all, We are really enjoying the workflow of interacting with our data via Zeppelin, but are not sold on using the built in cron scheduling capability. We would like to be able to create more complex DAGs that are better suited for something like Airflow. I was curious as to whether anyone has

Re: Hive interpreter Error as soon as Hive query uses MapRed

2017-05-19 Thread Ben Vogan
I am running CDH 5.7 and Spark 1.6 as well and hive is working for me with the following configuration: Properties namevalue common.max_count 1000 default.driver org.apache.hive.jdbc.HiveDriver default.password default.url jdbc:hive2://hdfs004:1 default.user hive zeppelin.interpreter.localRepo

Re: Illegal Inheritance error

2017-05-16 Thread Ben Vogan
l status: UNDEFINED On Mon, May 15, 2017 at 6:53 PM, Jeff Zhang wrote: > > It is weird that the yarn app log shows the SQLContext is created > successfully, but in zeppelin side it shows error of "Fail to create > SQLContext" > > Ben Vogan 于2017年5月15日周一 下午8:07写道: &g

Re: Illegal Inheritance error

2017-05-15 Thread Ben Vogan
zeppelin do you use ? And can you check the yarn app log ? > > > Ben Vogan 于2017年5月15日周一 下午5:56写道: > >> Hi all, >> >> For some reason today I'm getting a stack: >> >> org.apache.zeppelin.livy.LivyException: Fail to create >> SQLContext,:4: error: illegal

Re: Illegal Inheritance error

2017-05-15 Thread Ben Vogan
s and there is an open session on yarn. Some help on this would be greatly appreciated! --Ben On Sun, May 14, 2017 at 6:16 AM, Ben Vogan wrote: > Hi all, > > I've been using Zeppelin for a couple of weeks now with a stable > configuration, but all of a sudden I am gettin

Illegal Inheritance error

2017-05-14 Thread Ben Vogan
Hi all, I've been using Zeppelin for a couple of weeks now with a stable configuration, but all of a sudden I am getting "Illegal inheritance" errors like so: INFO [2017-05-14 03:25:32,678] ({pool-2-thread-56} Paragraph.java[jobRun]:362) - run paragraph 20170514-032326_663206142 using livy org.a

ZeppelinContext textbox for passwords

2017-05-09 Thread Ben Vogan
Hi there, Is it possible to create a textbox for accepting passwords via the ZeppelinContext (i.e. one that masks input)? I do not see any way to do so, but I hope I'm missing something. Thanks, -- *BENJAMIN VOGAN* | Data Platform Team Lead

Re: org.apache.spark.SparkException: Could not parse Master URL: 'yarn'

2017-04-13 Thread Ben Vogan
e. > > In your case, you might want to look at this page: http://archive-primary. > cloudera.com/cdh5/cdh/5/ > So I guess something like http://archive-primary. > cloudera.com/cdh5/cdh/5/spark-1.6.0-cdh5.7.6.tar.gz should work as a > value for SPARK_EXECUTOR_URI. > > -- > Chaora

org.apache.spark.SparkException: Could not parse Master URL: 'yarn'

2017-04-12 Thread Ben Vogan
Hello all, I am trying to install Zeppelin 0.7.1 on my CDH 5.7 Cluster. I have been following the instructions here: https://zeppelin.apache.org/docs/0.7.1/install/install.html https://zeppelin.apache.org/docs/0.7.1/install/configuration.html https://zeppelin.apache.org/docs/0.7.1/interpreter/sp