Re: "output disappears" after running a paragraph - on recent master snapshot

2017-01-30 Thread Ruslan Dautkhanov
in Chrome or anything like that. -- Ruslan Dautkhanov On Sun, Jan 29, 2017 at 2:43 PM, moon soo Lee <m...@apache.org> wrote: > Hi, > > I'm not sure which action can possibly make output blinks and disappears. > But > > ERROR [2017-01-28 11:13:53,338] ({pool-4-thread-1} > Ap

Re: 'File size limit Exceeded' when importing notes - even for small files

2017-01-17 Thread Ruslan Dautkhanov
>From the screenshot "JSON file size cannot exceed MB". Notice there is no number between "exceed" and "MB". Not sure if we're missing a setting or an environment variable to define the limit? It now prevents us from importing any notebooks. -- Ruslan Dautkhan

Re: Zeppelin Spark2 / Hive issue

2016-11-14 Thread Ruslan Dautkhanov
Thank you Herman! That was it. -- Ruslan Dautkhanov On Mon, Nov 14, 2016 at 7:23 AM, herman...@teeupdata.com < herman...@teeupdata.com> wrote: > You may check if you have hive-site.xml under zeppelin/spark config > folder… > > Thanks > Herman. > > > >

Zeppelin Spark2 / Hive issue

2016-11-14 Thread Ruslan Dautkhanov
sPath and* *SPARK_CLASSPATH*. *Use only the former*." Sidenote: that's interesting that spark-shell with the same SPARK_CLASSPATH gives opposite message - " *SPARK_CLASSPATH *was detected (set to '...'). *This is deprecated in Spark 1.0*+. " Thank you, Ruslan Dautkhanov [0] export JAVA_

Re: 0.7.0 is good to try?

2016-11-22 Thread Ruslan Dautkhanov
nch changes multiple times a day, so no guarantees. > > Thanks, > moon > > On Tue, Nov 22, 2016 at 5:05 PM Ruslan Dautkhanov <dautkha...@gmail.com> > wrote: > >> We'd like to try Zeppelin 0.7.0 from the current snapshot. >> Jira shows there are just two in-progres

Re: 0.6.2 build fails

2016-11-23 Thread Ruslan Dautkhanov
> Could you add *-Pvendor-repo *option to build Zeppelin with CDH? > You can refer to http://zeppelin.apache.org/doc > s/0.7.0-SNAPSHOT/install/build.html#build-command-examples . > Thanks. > > 2016-11-23 16:05 GMT+09:00 Ruslan Dautkhanov <dautkha...@gmail.com>: > > Fol

SparkInterpreter.java[getSQLContext_1]:256 - Can't create HiveContext. Fallback to SQLContext

2016-11-26 Thread Ruslan Dautkhanov
Getting SparkInterpreter.java[getSQLContext_1]:256 - Can't create HiveContext. Fallback to SQLContext See full stack [1] below. Java 7 Zeppelin 0.6.2 CDH 5.8.3 Spark 1.6 How to fix this? Thank you. [1] WARN [2016-11-26 09:38:39,028] ({pool-2-thread-2}

Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'"

2016-11-26 Thread Ruslan Dautkhanov
Yes I can work with hiveContext from spark-shell. Back to the original question. Getting You must *build Spark with Hive*. Export 'SPARK_HIVE=true' See full stack [2] above. Any ideas? -- Ruslan Dautkhanov On Thu, Nov 24, 2016 at 4:48 PM, Jeff Zhang <zjf...@gmail.com> wrote: >

"You must build Spark with Hive. Export 'SPARK_HIVE=true'"

2016-11-21 Thread Ruslan Dautkhanov
lin_home/conf for - hive-site.xml - hdfs-site.xml - core-site.xml - yarn-site.xml Thank you, Ruslan Dautkhanov

0.7.0 is good to try?

2016-11-22 Thread Ruslan Dautkhanov
We'd like to try Zeppelin 0.7.0 from the current snapshot. Jira shows there are just two in-progress tickets left so it's close to release? How stable is to use against Spark 1.6, Spark 2, PySpark interpreters? Thanks, Ruslan

sqlContext can't find tables, while HiveContext can

2016-11-24 Thread Ruslan Dautkhanov
Problem 1, with sqlContext) Spark 1.6 CDH 5.8.3 Zeppelin 0.6.2 Running > sqlCtx = SQLContext(sc) > sqlCtx.sql('select * from marketview.spend_dim') shows exception "Table not found" . The same runs find when using hiveContext. See full stack in [1] The same stack in the log file [2]. I

Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'"

2016-11-27 Thread Ruslan Dautkhanov
Also, to get rid of this problem (once HiveContext(sc) was assigned at least twice to a variable, the only fix is - ro restart Zeppelin :-( -- Ruslan Dautkhanov On Sun, Nov 27, 2016 at 9:00 AM, Ruslan Dautkhanov <dautkha...@gmail.com> wrote: > I found a pattern when this happens. &

Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'"

2016-11-27 Thread Ruslan Dautkhanov
to a variable more than once, and use that variable between assignments. -- Ruslan Dautkhanov On Mon, Nov 21, 2016 at 2:52 PM, Ruslan Dautkhanov <dautkha...@gmail.com> wrote: > Getting > You must *build Spark with Hive*. Export 'SPARK_HIVE=true' > See full stack [2] below. > &g

R interpreter build fails

2016-11-28 Thread Ruslan Dautkhanov
lin-zrinterpreter_2.10 -- Ruslan Dautkhanov

0.7 Shiro LDAP authentication changes? Unable to instantiate class [org.apache.zeppelin.server.LdapGroupRealm]

2016-11-28 Thread Ruslan Dautkhanov
Zeppelin 0.7.0 built from yesterday's snapshot. Getting below error stack when trying to start Zeppelin 0.7.0. The same shiro config works fine in 0.6.2. We're using LDAP authentication configured in shiro.ini as ldapRealm = org.apache.zeppelin.server.LdapGroupRealm

Re: 0.7 Shiro LDAP authentication changes? Unable to instantiate class [org.apache.zeppelin.server.LdapGroupRealm]

2016-11-28 Thread Ruslan Dautkhanov
r.java:151) at org.apache.shiro.config.ReflectionBuilder.buildObjects( ReflectionBuilder.java:119) at org.apache.shiro.config.IniSecurityManagerFactory.buildInstances( IniSecurityManagerFactory.java:161) -- Ruslan Dautkhanov On Mon, Nov 28, 2016 at 8:23 AM, Ruslan Dautkhanov <dautkha...@gma

Re: 0.7 Shiro LDAP authentication changes? Unable to instantiate class [org.apache.zeppelin.server.LdapGroupRealm]

2016-11-28 Thread Ruslan Dautkhanov
) Thanks, Ruslan On Mon, Nov 28, 2016 at 9:13 AM, Ruslan Dautkhanov <dautkha...@gmail.com> wrote: > Looking at 0.7 docs, Shiro LDAP authentication shiro.ini configuration > looks the same. > http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/security/shir > oauthentication.html

Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'"

2016-11-24 Thread Ruslan Dautkhanov
Yep, CDH doesn't have Spark compiled with Thrift server. My understanding Zeppelin uses spark-shell REPL and not Spark thrift server. Thank you. -- Ruslan Dautkhanov On Thu, Nov 24, 2016 at 1:57 AM, Jeff Zhang <zjf...@gmail.com> wrote: > AFAIK, spark of CDH don’t support spark thri

how to build Zeppelin with a defined list of interpreters

2016-11-27 Thread Ruslan Dautkhanov
Getting [1] error stack when trying to build Zeppelin from 0.7-snapshot. We will not use most of the built-in Zeppelin interpreters, including Scio which is failing. How we can switch off (black-list) certain interpreters from Zeppelin build at all?

Re: Zeppelin Spark2 / Hive issue

2016-11-18 Thread Ruslan Dautkhanov
ssionState$$anon$1.(HiveSessionState.scala:63) at org.apache.spark.sql.hive.HiveSessionState.analyzer$lzycompute(HiveSessionState.scala:63) at org.apache.spark.sql.hive.HiveSessionState.analyzer(HiveSessionState.scala:62) -- Ruslan Dautkhanov On Mon, Nov 14, 2016 at 7:23

Re: multi-tennant Zeppelin notebook

2016-11-29 Thread Ruslan Dautkhanov
fic paths. > I didn't see any issue about impersonate spark interpreter using --proxy-user. Do you mind create one? Complete: https://issues.apache.org/jira/browse/ZEPPELIN-1730 Thank you. -- Ruslan Dautkhanov On Tue, Nov 29, 2016 at 3:30 PM, moon soo Lee <m...@apache.org> wrote: &

Re: 0.7 Shiro LDAP authentication changes? Unable to instantiate class [org.apache.zeppelin.server.LdapGroupRealm]

2016-11-29 Thread Ruslan Dautkhanov
Thank you Khalid. That was it. I was able to start 0.7.0 with ldap shiro config now. -- Ruslan Dautkhanov On Tue, Nov 29, 2016 at 12:15 AM, Khalid Huseynov <khalid...@nflabs.com> wrote: > I think during refactoring LdapGroupRealm has moved into different package, > so could you

Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'"

2016-11-29 Thread Ruslan Dautkhanov
, it's only fixable by restarting Zeppelin server which is super inconvenient. Thanks. -- Ruslan Dautkhanov On Tue, Nov 29, 2016 at 12:54 PM, Felix Cheung <felixcheun...@hotmail.com> wrote: > Can you reuse the HiveContext instead of making new ones with > Hi

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

2016-12-08 Thread Ruslan Dautkhanov
I got a lucky jira number :-) https://issues.apache.org/jira/browse/ZEPPELIN-1777 Thank you Jeff. -- Ruslan Dautkhanov On Thu, Dec 8, 2016 at 10:50 PM, Jeff Zhang <zjf...@gmail.com> wrote: > hmm, I think so, please file a ticket for it. > > > > Ruslan Dautkhanov <da

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

2016-12-08 Thread Ruslan Dautkhanov
image 1] -- Ruslan Dautkhanov On Wed, Nov 30, 2016 at 7:34 PM, Jeff Zhang <zjf...@gmail.com> wrote: > Hi Ruslan, > > I miss another thing, You also need to delete file conf/interpreter.json > which store the original setting. Otherwise the original setting is always >

code generation: paragraph generates another paragraph

2016-12-12 Thread Ruslan Dautkhanov
We'd like to have paragraph's code generated by a preceding paragraph. For example, one of the use cases we have is when %pyspark generates Hive DDLs. (can't run those in Spark in some cases) Any chance an output of a paragraph can be redirected to a following paragraph? I was thinking something

Re: Export note as a PDF

2016-12-08 Thread Ruslan Dautkhanov
xport as a PDF" Please vote up if you would find that useful too. Thank you. -- Ruslan Dautkhanov On Wed, Dec 7, 2016 at 10:32 PM, Hyunsung Jo <hyunsung...@gmail.com> wrote: > Hi Ruslan, > > Not aware of Zeppelin's roadmap, but perhaps the tag line of the > ZeppelinHub

Passing variables from %pyspark to %sh

2017-01-11 Thread Ruslan Dautkhanov
={var1} --param9={var2} where var1 and var2 would be implied to be fetched as z.get('var1') and z.get('var2') respectively. Other thoughts? Thank you, Ruslan Dautkhanov

Re: Passing variables from %pyspark to %sh

2017-01-13 Thread Ruslan Dautkhanov
Created https://issues.apache.org/jira/browse/ZEPPELIN-1967 (JIRA had some issues.. https://twitter.com/infrabot - had to wait a couple of days.) Great ideas. Thank you everyone. -- Ruslan Dautkhanov On Thu, Jan 12, 2017 at 8:55 AM, t p <tauis2...@gmail.com> wrote: > Is somet

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

2016-11-30 Thread Ruslan Dautkhanov
"className": "org.apache.zeppelin.spark.SparkInterpreter", to section "className": "org.apache.zeppelin.spark.PySparkInterpreter", pySpark is still not default. -- Ruslan Dautkhanov On Tue, Nov 29, 2016 at 10:36 PM, Jeff Zhang <zjf...@gmail.com> wrote: > No, you don't need

shiro.ini [urls] authorization: lock Zeppelin to one user

2016-11-30 Thread Ruslan Dautkhanov
Until we have a good multitenancy support in Zeppelin, we'd have to run individual Zeppelin instances for each user. We were trying to use following shiro.ini configurations: > [urls] > /api/version = anon > /** = user["rdautkhanov@CORP.DOMAIN"] Also tried > /** = authc,

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

2016-11-29 Thread Ruslan Dautkhanov
Thank you Jeff. Do I have to create interpreter/spark directory in $ZEPPELIN_HOME/conf or in $ZEPPELIN_HOME directory? So zeppelin.interpreters in zeppelin-site.xml is deprecated in 0.7? Thanks! -- Ruslan Dautkhanov On Tue, Nov 29, 2016 at 6:54 PM, Jeff Zhang <zjf...@gmail.com>

sparkContext to get Spark Driver's URL

2016-11-30 Thread Ruslan Dautkhanov
Any easy way to get Spark Driver's URL (i.e. from sparkContext )? I always have to go to CM -> YARN applications -> choose my Spark job -> click Application Master etc. to get Spark's Driver UI. Any way we could derive driver's URL programmatically from SparkContext variable? ps. Long haul - it

Re: Interpreter zombie processes

2016-12-16 Thread Ruslan Dautkhanov
Thank you everyone for confirming this issue. Created https://issues.apache.org/jira/browse/ZEPPELIN-1832 Thanks again. -- Ruslan Dautkhanov On Fri, Dec 16, 2016 at 2:48 AM, blaubaer <rene.pfitz...@nzz.ch> wrote: > We are seeing this problem as well, regularly actually. E

Re: Should zeppelin.pyspark.python be used on the worker nodes ?

2017-03-20 Thread Ruslan Dautkhanov
> from pyspark.conf import SparkConf > ImportError: No module named *pyspark.conf* William, you probably meant from pyspark import SparkConf ? -- Ruslan Dautkhanov On Mon, Mar 20, 2017 at 2:12 PM, William Markito Oliveira < william.mark...@gmail.com> wrote: > Ah! Thanks Ru

Re: Should zeppelin.pyspark.python be used on the worker nodes ?

2017-03-20 Thread Ruslan Dautkhanov
You're right - it will not be dynamic. You may want to check https://issues.apache.org/jira/browse/ZEPPELIN-2195 https://github.com/apache/zeppelin/pull/2079 it seems it is fixed in a current snapshot of Zeppelin (comitted 3 weeks ago). -- Ruslan Dautkhanov On Mon, Mar 20, 2017 at 1:21 PM

Re: Should zeppelin.pyspark.python be used on the worker nodes ?

2017-03-20 Thread Ruslan Dautkhanov
confusion. -- Ruslan Dautkhanov On Mon, Mar 20, 2017 at 12:59 PM, William Markito Oliveira < mark...@apache.org> wrote: > I'm trying to use zeppelin.pyspark.python as the variable to set the > python that Spark worker nodes should use for my job, but it doesn't seem > to be wo

multiple instances of the same interpreter type

2017-04-06 Thread Ruslan Dautkhanov
of %sh interpreter. Is this a known issue? -- Ruslan Dautkhanov

Re: Other paragraphs do not wait for %sh paragraphs to finish.

2017-04-06 Thread Ruslan Dautkhanov
Filed https://issues.apache.org/jira/browse/ZEPPELIN-2368 We had users asking the same.. it forced them to run paragraphs one by one manually. -- Ruslan Dautkhanov On Wed, Apr 5, 2017 at 4:57 PM, moon soo Lee <m...@apache.org> wrote: > Hi, > > That's expected behavio

Re: Other paragraphs do not wait for %sh paragraphs to finish.

2017-04-06 Thread Ruslan Dautkhanov
out errors). It will be a compromise between completely sequential run and having a way to define a DAG. -- Ruslan Dautkhanov On Thu, Apr 6, 2017 at 1:32 AM, Jeff Zhang <zjf...@gmail.com> wrote: > > That's correct, it needs define dependency between paragraphs, e.g. > %spark

Re: Is there a way to close interpreter after inactivity

2017-03-01 Thread Ruslan Dautkhanov
https://issues.apache.org/jira/browse/ZEPPELIN-2197 This was created just yesterday :-) On Wed, Mar 1, 2017 at 12:54 PM Alexander Filipchik wrote: > Hi, > > Is there any way to close an isolated interpreter after some timeout? > Let's say set an inactivity timeout of 30

Re: Roadmap for 0.8.0

2017-04-02 Thread Ruslan Dautkhanov
sues.apache.org/jira/browse/ZEPPELIN-1660 "Home directory references (i.e. ~/zeppelin/) in zeppelin-env.sh don't work as expected" Less of a critical compared to the above two, but it could complement the multi-tenancy feature very well. Best regards, Ruslan Dautkhanov On Wed, Mar 22,

Re: Roadmap for 0.8.0

2017-04-05 Thread Ruslan Dautkhanov
rkflow. Thank you, Ruslan Dautkhanov On Wed, Apr 5, 2017 at 12:01 AM, Jeff Zhang <zjf...@gmail.com> wrote: > > Hi Ruslan, > > Regarding 'make zeppelinContext available in shell interpreter', you may > want to check https://issues.apache.org/jira/browse/ZEPPELIN-1595 >

Re: multiple instances of the same interpreter type

2017-04-07 Thread Ruslan Dautkhanov
preter will be instantiated Globally in shared process." -- Ruslan Dautkhanov On Thu, Apr 6, 2017 at 6:34 PM, Jeff Zhang <zjf...@gmail.com> wrote: > > What mode do you use ? > > > > Ruslan Dautkhanov <dautkha...@gmail.com>于2017年4月7日周五 上午12:49写道: > >>

Re: Cloudera Spark 2.2

2017-08-02 Thread Ruslan Dautkhanov
It was built. I think binaries are only available for official releases? -- Ruslan Dautkhanov On Wed, Aug 2, 2017 at 4:41 PM, Benjamin Kim <bbuil...@gmail.com> wrote: > Did you build Zeppelin or download the binary? > > On Wed, Aug 2, 2017 at 3:40 PM Ruslan Dautkhanov <da

Re: Cloudera Spark 2.2

2017-08-01 Thread Ruslan Dautkhanov
Might need to recompile Zeppelin with Scala 2.11? Also Spark 2.2 now requires JDK8 I believe. -- Ruslan Dautkhanov On Tue, Aug 1, 2017 at 6:26 PM, Benjamin Kim <bbuil...@gmail.com> wrote: > Here is more. > > org.apache.zeppelin.interpreter.InterpreterException: WARNING:

Re: JDBC use with zeppelin

2017-07-10 Thread Ruslan Dautkhanov
S=/etc/hive/conf:/var/lib/sqoop/ojdbc7.jar -- Ruslan Dautkhanov On Mon, Jul 10, 2017 at 12:10 PM, <dar...@ontrenet.com> wrote: > Hi > > We want to use a jdbc driver with pyspark through Zeppelin. Not the custom > interpreter but from sqlContext where we can read into datafram

Re: Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ruslan Dautkhanov
Your example works fine for me too. We're on Zeppelin snapshot ~2 months old. -- Ruslan Dautkhanov On Tue, Jul 11, 2017 at 3:11 PM, Ben Vogan <b...@shopkick.com> wrote: > Here is the specific example that is failing: > > import pandas > z.show(pandas.DataFrame([u'Jalape\x

Re: Query about the high availability of Zeppelin

2017-06-30 Thread Ruslan Dautkhanov
I think if you have a shared storage for notebooks (for example, NFS mounted from a third server), and a load-balancer that supports sticky sessions (like F5) on top, it should be possible to have HA without any code change in Zeppelin. Am I missing something? -- Ruslan Dautkhanov On Fri, Jun

Re: How do I configure R interpreter in Zeppelin?

2017-04-26 Thread Ruslan Dautkhanov
QueryInterpreter > Comma separated interpreter configurations. First > interpreter become a default > -- Ruslan Dautkhanov On Sun, Mar 19, 2017 at 1:07 PM, moon soo Lee <m...@apache.org> wrote: > Easiest way to figure out what your environment needs is, > > 1. run SPARK

Re: How do I configure R interpreter in Zeppelin?

2017-04-26 Thread Ruslan Dautkhanov
ssage.java:69) at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65) at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122) -- Ruslan Dautkhanov On Wed, Apr 26, 2017 at 2:13 PM

Re: Cloudera Spark 2.2

2017-08-04 Thread Ruslan Dautkhanov
gt; mvn clean package -DskipTests -Pspark-2.1 -Dhadoop.version=2.6.0-cdh5.10.1 > -Phadoop-2.6 -Pvendor-repo -Pscala-2.10 -Psparkr -pl > '!alluxio,!flink,!ignite,!lens,!cassandra,!bigquery,!scio' -e You may needs additional steps depending which interpreters you use (like R etc). -- Rusla

Re: Export Zeppelin notebook with built-int visualization

2017-05-03 Thread Ruslan Dautkhanov
Hope to see this as implemented one day https://issues.apache.org/jira/browse/ZEPPELIN-1774 On Wed, May 3, 2017 at 5:05 AM Petr Knez wrote: > I know about feature (link to paragraph) but it not works if Zeppelin has > enabled Shiro authorization. > It works only for me (if

zeppelin static web reource names - id dups

2017-05-11 Thread Ruslan Dautkhanov
Maven generates some of the web resource names, for example, css files. - What are those hex ids in file names? - Why those ids duplicate in file names up to 5 times? (see example below in *bold*) $ find . -name "main*css" > ./spark-dependencies/target/spark-2.1.0/docs/css/main.css > >

Re: ZeppelinContext textbox for passwords

2017-05-09 Thread Ruslan Dautkhanov
as it gets stuck): [image: Inline image 2] I think if Zeppelin could understand that there is an interactive prompt, this will be helpful not only with password prompts but any other cases (including shell interpreter). -- Ruslan Dautkhanov On Tue, May 9, 2017 at 4:59 PM, Ben Vogan <b...@shopki

NullPointerException at org.apache.zeppelin.spark.Utils.buildJobGroupId

2017-05-10 Thread Ruslan Dautkhanov
Has anyone experienced below exception? It started happening inconsistently after upgrade to a last week master snapshot of Zeppelin. We have multiple users reported the same issue. java.lang.NullPointerException at org.apache.zeppelin.spark.Utils.buildJobGroupId(Utils.java:112) at

Re: Integrating with Airflow

2017-05-19 Thread Ruslan Dautkhanov
ll. The > python part of Airflow is really just describing what gets run and it isn't > hard to run something that isn't written in python. > > On Fri, May 19, 2017 at 2:52 PM, Ruslan Dautkhanov <dautkha...@gmail.com> > wrote: > >> We also use both Zeppelin a

Re: Recent Improvements Apache Zeppelin Livy Integration

2017-05-04 Thread Ruslan Dautkhanov
Thanks for sharing this Jeff! Once Zeppelin supports yarn-cluster, what would be main benefits of using Livy Spark interpreters, instead of just the Spark interpreters? -- Ruslan Dautkhanov On Thu, May 4, 2017 at 10:51 PM, Jeff Zhang <zjf...@gmail.com> wrote: > For anyone that

Re: Can't download moderately large data or number of rows to csv

2017-05-02 Thread Ruslan Dautkhanov
). They run Zeppelin on edge nodes that have NFS mounts to a drop zone. ps. Hue has a limit too, by default 100k rows https://github.com/cloudera/hue/blob/release-3.12.0/desktop/conf.dist/hue.ini#L905 Not sure how much it scales up. -- Ruslan Dautkhanov On Tue, May 2, 2017 at 10:41 AM, Paul

Re: [ANNOUNCE] Apache Zeppelin 0.7.3 released

2017-09-22 Thread Ruslan Dautkhanov
That's awesome. Congrats everyone! Hope to see 0.8.0 release soon too - it has nice new features we would love to see. -- Ruslan Dautkhanov On Fri, Sep 22, 2017 at 1:36 AM, Mina Lee <mina...@apache.org> wrote: > The Apache Zeppelin community is pleased to announce the ava

Re: Cloudera Data Science Workbench and Zeppelin

2017-09-11 Thread Ruslan Dautkhanov
://issues.apache.org/jira/browse/ZEPPELIN-2040 completed .. Thanks -- Ruslan Dautkhanov On Sun, Sep 10, 2017 at 9:13 PM, Yeshwanth Jagini <y...@yotabitesllc.com> wrote: > Cloudera Data Science workbench is totally a different product. Cloudera > acquired it from https://sense.io/ > &g

zeppelin build fails with DependencyConvergence error

2017-08-27 Thread Ruslan Dautkhanov
Building from a current Zeppelin snapshot fails with zeppelin build fails with org.apache.maven.plugins.enforcer.DependencyConvergence see details below. Build command /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo

Re: zeppelin build fails with DependencyConvergence error

2017-08-28 Thread Ruslan Dautkhanov
.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) -- Ruslan Dautkhanov On Sun, Aug 27,

note.json or interpreter.json format change?

2017-08-28 Thread Ruslan Dautkhanov
notebooks not show up? Thanks, Ruslan Dautkhanov

Re: note.json or interpreter.json format change?

2017-08-28 Thread Ruslan Dautkhanov
by: java.text.ParseException: Unparseable date: "2017-08-27 19:56:22.229" at java.text.DateFormat.parse(DateFormat.java:357) at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:79) ... 50 more -- Ruslan Dautkhanov On Mon, Aug 28, 2017 at 11:32

Re: note.json or interpreter.json format change?

2017-08-28 Thread Ruslan Dautkhanov
patibility. Can somebody please point me to PR / jria for this change? Any workarounds that would make an upgrade easier? Also, this change makes reverting zeppelin upgrades impossible. -- Ruslan Dautkhanov On Mon, Aug 28, 2017 at 11:35 AM, Ruslan Dautkhanov <dautkha...@gmail.com> wrote

Re: note.json or interpreter.json format change?

2017-08-28 Thread Ruslan Dautkhanov
the newer version of Zeppelin - they'll not show up in list of available notebooks. -- Ruslan Dautkhanov On Mon, Aug 28, 2017 at 6:07 PM, Jianfeng (Jeff) Zhang < jzh...@hortonworks.com> wrote: > > Do you use the latest zeppelin master branch ? I see this issue before, > but

Re: Re: Roadmap for 0.8.0

2017-10-23 Thread Ruslan Dautkhanov
Sorry for bringing up an older topic .. I agree "latest" / "stable" makes a lot of sense. Also what was *not* discussed in this thread is release cadence target. IMHO, 2-3 releases a year should give a quicker turnover to release latest fixes and improvements / quicker feedback from the users?

Re: [DISCUSS] Change some default settings for avoiding unintended usages

2017-11-29 Thread Ruslan Dautkhanov
Would be nice if each user's interpreter is started in its own docker container a-la cloudera data science workbench. Then each user's shell interpreter is pretty isolated. Actually, from a CDSW session you could pop up a terminal session to your container which I found pretty neat. -- Ruslan

Re: zeppelin build fails with DependencyConvergence error

2017-12-18 Thread Ruslan Dautkhanov
will contribute back to the project when we find solution. Thanks for the suggestion Felix. Is this known if Zeppelin can work fine with jasckson 2.*2*.3? (certain dependencies currently list jackson 2.*5*.3) -- Ruslan Dautkhanov On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <felixch

Re: I need data download button in the Reports mode

2017-11-09 Thread Ruslan Dautkhanov
Chrome can print to pdf. In Destination "printer" change to "Save as pdf". -- Ruslan Dautkhanov On Thu, Nov 9, 2017 at 10:31 AM, shyla deshpande <deshpandesh...@gmail.com> wrote: > Hello all, > > I want the users to be able to download the data in report

IPython is available, use IPython for PySparkInterpreter

2017-12-10 Thread Ruslan Dautkhanov
Getting "IPython is available, use IPython for PySparkInterpreter" warning after starting pyspark interpreter. How do I default %pyspark to ipython? Tried to change to "class": "org.apache.zeppelin.spark.PySparkInterpreter", to "class": "org.apache.zeppelin.spark.IPySparkInterpreter", in

Re: IPython is available, use IPython for PySparkInterpreter

2017-12-11 Thread Ruslan Dautkhanov
t; fallback when ipython interpreter become much more mature. > > > > > Ruslan Dautkhanov <dautkha...@gmail.com>于2017年12月11日周一 下午1:20写道: > >> Getting "IPython is available, use IPython for PySparkInterpreter" >> warning after starting pyspark interpret

Re: zeppelin build fails with DependencyConvergence error

2017-12-11 Thread Ruslan Dautkhanov
org.codehaus.jackson > + jackson-mapper-asl > + > + > + org.codehaus.jackson > + jackson-core-asl > + > + > + org.apache.zookeeper > + zookeeper > + > > > On Sun, Aug 27, 2017 at 2:25

nightly builds?

2018-05-09 Thread Ruslan Dautkhanov
hat aren't available on latest official release. Also it gives new features exposure to more testing, so it should be a win-win for users and developers. Some other open source projects employ nightly builds. Thanks! Ruslan Dautkhanov

Re: Zeppelin 0.8 rc1

2018-05-16 Thread Ruslan Dautkhanov
I didn't know 0.8 rc1/rc2 were out. Was it advertised on the dev list? Thanks for sharing this. -- Ruslan Dautkhanov On Sun, May 13, 2018 at 1:23 AM, Rotem Herzberg < rotem.herzb...@gigaspaces.com> wrote: > Hello all, > > I've downloaded and built the zeppelin v0.8

Re: Zeppelin 0.8 rc1

2018-05-21 Thread Ruslan Dautkhanov
Thank you Jeff. -- Ruslan Dautkhanov On Wed, May 16, 2018 at 6:19 PM, Jeff Zhang <zjf...@gmail.com> wrote: > Yes, the voting thread is on dev mail list. > > https://lists.apache.org/thread.html/c6435f3fcfab4c516e2ef90f436575 > 3268546293afa1ae2c50cc54f9@%3Cdev.zepp

Re: Silly question...

2018-05-25 Thread Ruslan Dautkhanov
You may want to check if %spark.dep https://zeppelin.apache.org/docs/latest/interpreter/spark.html#3-dynamic-dependency-loading-via-sparkdep-interpreter helps here. -- Ruslan Dautkhanov On Fri, May 25, 2018 at 12:46 PM, Michael Segel <msegel_had...@hotmail.com> wrote: > What’s the

note imports broken?

2018-05-23 Thread Ruslan Dautkhanov
Was anybody able to import notes on 0.8 RC or a recent master snapshot? Notes import seems to be broken Filed https://issues.apache.org/jira/browse/ZEPPELIN-3485 This looks serious to me. -- Ruslan Dautkhanov

WARNING: A provider org.apache.zeppelin.rest.LoginRestApi registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime

2018-05-22 Thread Ruslan Dautkhanov
G: A HTTP GET method, public javax.ws.rs.core.Response > org.apache.zeppelin.rest.CredentialRestApi.getCredentials(java.lang.String) > throws java.io.IOException,java.lang.IllegalArgumentException, should not > consume any entity. -- Ruslan Dautkhanov

Re: Stdout both to file and console

2018-06-19 Thread Ruslan Dautkhanov
If you set pretty verbose level in log4j then you can see output in log files. I've seen it there. Then you can use regexps to strip out paragraph outputs from rest of debugging messages. May work as a one off effort. Might be a good idea to file an enhancement request - this can be also useful

Re: Brain dead question on my part...

2018-06-04 Thread Ruslan Dautkhanov
Nope add that as a spark interpreter setting. 0.7.2 should work fine with Spark 2.2 afaik. You may want to go with Zeppelin 0.8 when you upgrade to Spark 2.3. -- Ruslan Dautkhanov On Mon, Jun 4, 2018 at 10:29 AM, Michael Segel wrote: > I’m assuming that I want to set this in ./conf/zeppe

Re: Brain dead question on my part...

2018-06-04 Thread Ruslan Dautkhanov
Can you send a screenshot with the error and complete exception stack? -- Ruslan Dautkhanov On Mon, Jun 4, 2018 at 10:40 AM, Michael Segel wrote: > Hmmm. Still not working. > Added it to the interpreter setting and restarted the interpreter. > > The issue is that I need to

Re: Stdout both to file and console

2018-06-20 Thread Ruslan Dautkhanov
pache.zeppelin.interpreter.remote.RemoteInterpreterServer=DEBUG > log4j.logger.org.glassfish.jersey.internal.inject.Providers=SEVERE -- Ruslan Dautkhanov On Wed, Jun 20, 2018 at 3:01 AM Alessandro Liparoti < alessandro.l...@gmail.com> wrote: > Hi, > yes spark UI is a tool I already use for it but as Rusian mentioned would > be

Re: save data in a notebook to use in subsequent scripts

2018-04-30 Thread Ruslan Dautkhanov
Not sure if Spark-Cassandra connector would be helpful? https://github.com/datastax/spark-cassandra-connector -- Ruslan Dautkhanov On Mon, Apr 30, 2018 at 7:38 AM, Soheil Pourbafrani <soheil.i...@gmail.com> wrote: > Is it possible to save a Cassandra query result in a variab

Re: zeppelin build fails with DependencyConvergence error

2018-01-11 Thread Ruslan Dautkhanov
Thank you Jeff -- Ruslan Dautkhanov On Thu, Jan 11, 2018 at 1:57 AM, Jeff Zhang <zjf...@gmail.com> wrote: > > ZEPPELIN-3119 will fix this. Will update this thread once it is done > > > > > Ruslan Dautkhanov <dautkha...@gmail.com>于2017年12月29日周五 上午6:04写道: &g

TimeoutLifecycleManager

2018-02-12 Thread Ruslan Dautkhanov
f attempts to timeout the interpreter in the logs even at DEBUG level. Thanks, Ruslan Dautkhanov

ipython/grpc issues

2018-02-14 Thread Ruslan Dautkhanov
ved data on > closed stream > INFO [2018-02-14 10:39:10,924] ({grpc-default-worker-ELG-1-2} > AbstractClientStream2.java[inboundDataReceived]:249) > - Received data on closed stream > INFO [2018-02-14 10:39:10,925] ({grpc-default-worker-ELG-1-2} > AbstractClientStream2.java[inboundDataReceived]:249) - Received data on > closed stream -- Ruslan Dautkhanov

z.show() compatibility and new UI grid

2018-02-14 Thread Ruslan Dautkhanov
quot;"" ---> 82 limit = > len(df) > self.max_result 83 header_buf = StringIO("") > 84 if show_index: TypeError: object of type 'DataFrame' has no len() > > -- Ruslan Dautkhanov

Fwd: [grpc/grpc] Unicode support in Python 2? (#14446)

2018-02-19 Thread Ruslan Dautkhanov
ed message -- From: kpayson64 <notificati...@github.com> Date: Mon, Feb 19, 2018 at 2:47 PM Subject: Re: [grpc/grpc] Unicode support in Python 2? (#14446) To: grpc/grpc <g...@noreply.github.com> Cc: Ruslan Dautkhanov <dautkha...@gmail.com>, Author < aut...@noreply.github.

Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released

2018-08-08 Thread Ruslan Dautkhanov
Thanks Jeff! Should there be a Zeppelin 0.8.1 release sometime soon with all the fixes for issues that the users have faced in 0.8.0? -- Ruslan Dautkhanov On Mon, Jul 23, 2018 at 12:24 AM Jeff Zhang wrote: > > Thanks Ruslan, I will fix it. > > Ruslan Dautkhanov 于2018年7月23

Re: Sometimes tab deletes text

2018-08-08 Thread Ruslan Dautkhanov
/2812/files -- Ruslan Dautkhanov On Wed, Aug 8, 2018 at 10:01 AM Paul Brenner wrote: > ok, I went ahead and opened > https://issues.apache.org/jira/browse/ZEPPELIN-3692 > <https://share.polymail.io/v1/z/b/NWI2

Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json

2018-08-13 Thread Ruslan Dautkhanov
Thanks for bringing this up for discussion. My 2 cents below. I am with Maksim and Felix on concerns with special characters now allowed in notebook names, and also concerns with different charsets. Russian language, for example, most commonly use iso-8859-5, koi-8r/u, windows-1251 charsets etc.

Re: Zeppelin distributed architecture design

2018-07-18 Thread Ruslan Dautkhanov
Thank you luxun, I left a couple of comments in that google document. -- Ruslan Dautkhanov On Tue, Jul 17, 2018 at 11:30 PM liuxun wrote: > hi,Ruslan Dautkhanov > > Thank you very much for your question. according to your advice, I added 3 > schematics to illustrate. >

Re: Zeppelin distributed architecture design

2018-07-17 Thread Ruslan Dautkhanov
users to a survived instance? Thanks, Ruslan Dautkhanov On Tue, Jul 17, 2018 at 2:46 AM liuxun wrote: > hi: > > Our company installed and deployed a lot of zeppelin for data analysis. > The single server version of zeppelin could not meet our application > scenarios, so we trans

Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released

2018-07-22 Thread Ruslan Dautkhanov
https://zeppelin.apache.org/ home page still reads "WHAT'S NEW IN Apache Zeppelin 0.7" -- Ruslan Dautkhanov On Fri, Jun 29, 2018 at 4:56 AM Spico Florin wrote: > Hi! > I tried to get the docker image for this version 0.8.0, but it seems > that is not in the official do

Re: Paragraphs collapsing

2018-07-10 Thread Ruslan Dautkhanov
I've seen this a couple of times.. -- Ruslan Dautkhanov On Tue, Jul 10, 2018 at 2:34 PM Paul Brenner wrote: > We are using 0.8 release and noticed that the editor section of paragraphs > will randomly collapse when you leave a notebook open for a while. Clicking > "hide ed

Re: Paragraphs collapsing

2018-07-11 Thread Ruslan Dautkhanov
. -- Ruslan Dautkhanov On Wed, Jul 11, 2018 at 8:34 AM Paul Brenner wrote: > I created https://issues.apache.org/jira/browse/ZEPPELIN-3616 > <https://share.polymail.io/v1/z/b/NWI0NjE0ZjY5ZWQ5/vfDe3e-5eTzwzo9OQ-55bPTEMeVmaOuuZP-yX5lXQ11joN96teso2sc3Evt0OMTYRlgcbbiNTR

hadoop.security.auth_to_local

2018-07-06 Thread Ruslan Dautkhanov
I assume some users are connecting to Spark in Zeppelin through Livy. It seems Livy doesn't support `hadoop.security.auth_to_local` - filed https://issues.apache.org/jira/browse/LIVY-481 Has anyone ran into this issue? It seems Livy's `livy.server.auth.kerberos.name-rules` config was trying to

Re: [DISCUSS] Is interpreter binding necessary ?

2018-07-06 Thread Ruslan Dautkhanov
+1 to remove it Setting default interpreter is not very useful anyway (for example, we can't make %pyspark default without manually editing xml files in Zeppelin distro). https://issues.apache.org/jira/browse/ZEPPELIN-3282 -- Ruslan Dautkhanov On Fri, Jul 6, 2018 at 7:27 AM Paul Brenner

  1   2   >