zeppelin 0.8.0-rc2 pyspark error
Hi All,
I am running the streaming pyspark programme from pyspark interpreter by using
zeppelin-0.8.0-rc2 code .
When pyspark streaming programme is being submitted, it is giving following
error message, When we see the driver logs.
ERROR [2018-07-06 06:35:14,026] ({JobScheduler} Logging.scala[logError]:91) -
Error generating jobs for time 1530858914000 ms
org.apache.zeppelin.py4j.Py4JException: Command Part is unknown: yro464
and following is the pyspark programme
%spark.pyspark
import time
from pyspark.streaming import StreamingContext
ssc = StreamingContext(sc, 1)
rddQueue = []
for i in range(5):
rddQueue += [ssc.sparkContext.parallelize([j for j in range(1, 1001)], 10)]
print rddQueue
#Create the QueueInputDStream and use it do some processing
inputStream = ssc.queueStream(rddQueue)
mappedStream = inputStream.map(lambda x: (x % 10, 1))
reducedStream = mappedStream.reduceByKey(lambda a, b: a + b)
reducedStream.pprint()
ssc.start()
time.sleep(6)
ssc.stop(stopSparkContext=True, stopGraceFully=True)
any idea what we can do for this.
Regards
Naveen
zeppelin 0.8.0-rc2 pyspark error
Hi All,
I am running the streaming pyspark programme from pyspark interpreter by using
zeppelin-0.8.0-rc2 code .
When pyspark streaming programme is being submitted, it is giving following
error message, When we see the driver logs.
ERROR [2018-07-06 06:35:14,026] ({JobScheduler} Logging.scala[logError]:91) -
Error generating jobs for time 1530858914000 ms
org.apache.zeppelin.py4j.Py4JException: Command Part is unknown: yro464
and following is the pyspark programme
%spark.pyspark
import time
from pyspark.streaming import StreamingContext
ssc = StreamingContext(sc, 1)
rddQueue = []
for i in range(5):
rddQueue += [ssc.sparkContext.parallelize([j for j in range(1, 1001)], 10)]
print rddQueue
#Create the QueueInputDStream and use it do some processing
inputStream = ssc.queueStream(rddQueue)
mappedStream = inputStream.map(lambda x: (x % 10, 1))
reducedStream = mappedStream.reduceByKey(lambda a, b: a + b)
reducedStream.pprint()
ssc.start()
time.sleep(6)
ssc.stop(stopSparkContext=True, stopGraceFully=True)
any idea what we can do for this.
Regards
Naveen
zeppelin on k8s with ingress path is not working
Hi,
We are trying to deploy zeppelin on kubernetes using nginx ingress controller.
When we set a "/" path for ingress, we are able to access GUI. When we set a
path ("/zeppelinui"), zeppelin responds back with 404 as the jetty server is
unable to find "/zeppelinui" resource. Can somebody help me in understanding
how to make zeppelinui accessible with an ingress path.
Regards
Naveen
RE: zeppelin start is failing on zeppelin v0.8.0-rc2
Hi Zhang, We took the source code from the given link and built the same. Its working properly, zeppelin server is able to start without any issues. Thanks again for all your help and sharing the information. Regards Naveen -Original Message- From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Thursday, May 17, 2018 7:14 PM To: dev@zeppelin.apache.org Subject: Re: zeppelin start is failing on zeppelin v0.8.0-rc2 This is because there's no .git folder in this tar file. You can use the rc2 source code in https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.8.0-rc2/ Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) < naveenakumar_gurushantap.panchappana...@nokia.com>于2018年5月17日周四 下午8:47写道： > The mvn command used to build the source code is > > mvn clean install -DskipTests -Drat.skip=true -Pspark-2.2 -Phadoop2 > -Pscala-2.11 > > we will try with without profiles and get back. > > Regards > Naveen > > > From: Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) > Sent: Thursday, May 17, 2018 6:13 PM > To: dev@zeppelin.apache.org > Subject: zeppelin start is failing on zeppelin v0.8.0-rc2 > > Hi All, > > We have cloned the source code > https://github.com/apache/zeppelin/archive/v0.8.0-rc2.tar.gz from this > uri built the source code after generating zeppelin tar ball. > > When we are issuing the command to start zeppelin server > bin/zeppelin.sh start > > We are getting the following exception while starting the zeppelin > server itself. > > OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; > support was removed in 8.0 > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/opt/zeppelin0.8/zeppelin-0.8.0/lib/interpreter/slf4j-log4j1 > 2-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/opt/zeppelin0.8/zeppelin-0.8.0/lib/slf4j-log4j12-1.7.10.jar > !/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > Exception in thread "main" java.lang.ExceptionInInitializerError > at > org.apache.zeppelin.conf.ZeppelinConfiguration.create(ZeppelinConfiguration.java:136) > at > org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:169 > ) Caused by: java.lang.NullPointerException > at > java.util.Properties$LineReader.readLine(Properties.java:434) > at java.util.Properties.load0(Properties.java:353) > at java.util.Properties.load(Properties.java:341) > at org.apache.zeppelin.util.Util.(Util.java:41) > ... 2 more > > > We set the spark home in zeppelin-env.sh as well. > > Regards > Naveen > >
zeppelin code build is failing
Hi All, I am trying to build zeppelin source code offline , I mean to say without setting http,https proxies in npm. Because as we are building on our own environment there proxies are not available only our art factories are available. So we are setting npm registry to point to our artifactory and set ssl to false. When I was building I am getting the following error for zeppelin-web module. Error is as follows. 18:48:53 [INFO] [4mRunning "htmlhint:src" (htmlhint) task[24m 18:48:53 [INFO] [32m>> [39m40 files lint free. 18:48:53 [INFO] 18:48:53 [INFO] [4mRunning "wiredep:test" (wiredep) task[24m 18:48:53 [INFO] [33mWarning: Error: Cannot find where you keep your Bower packages. Use --force to continue.[39m 18:48:53 [INFO] 18:48:53 [INFO] [31mAborted due to warnings.[39m 18:48:53 [INFO] 18:48:53 [INFO] 18:48:53 [INFO] Execution Time (2018-05-24 18:48:52 UTC) 18:48:53 [INFO] loading tasks 170ms ? 48% 18:48:53 [INFO] htmlhint:src76ms ? 21% 18:48:53 [INFO] wiredep:test 110ms ? 31% 18:48:53 [INFO] Total 357ms 18:48:53 [INFO] 18:48:53 [ERROR] npm ERR! code ELIFECYCLE 18:48:53 [ERROR] npm ERR! errno 3 18:48:53 [ERROR] npm ERR! zeppelin-web@0.0.0 build:dist: `npm-run-all prebuild && grunt pre-webpack-dist && webpack && grunt post-webpack-dist` 18:48:53 [ERROR] npm ERR! Exit status 3 18:48:53 [ERROR] npm ERR! 18:48:53 [ERROR] npm ERR! Failed at the zeppelin-web@0.0.0 build:dist script. 18:48:53 [ERROR] npm ERR! This is probably not a problem with npm. There is likely additional logging output above. 18:48:53 [ERROR] 18:48:53 [ERROR] npm ERR! A complete log of this run can be found in: 18:48:53 [ERROR] npm ERR! /home/jenkins/.npm/_logs/2018-05-24T18_48_53_366Z-debug.log 18:48:53 [INFO] 18:48:53 [INFO] BUILD FAILURE 18:48:53 [INFO] 18:48:53 [INFO] Total time: 01:18 min 18:48:53 [INFO] Finished at: 2018-05-24T18:48:53+00:00 18:48:53 [INFO] Final Memory: 29M/833M 18:48:53 [INFO] 18:48:53 [ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.4:npm (npm build) on project zeppelin-web: Failed to run task: 'npm run build:dist' failed. org.apache.commons.exec.ExecuteException: Process exited with an error: 3 (Exit value: 3) -> [Help 1] 18:48:53 [ERROR] 18:48:53 [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. 18:48:53 [ERROR] Re-run Maven using the -X switch to enable full debug logging. 18:48:53 [ERROR] 18:48:53 [ERROR] For more information about the errors and possible solutions, please read the following articles: 18:48:53 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException 18:48:53 /home/jenkins/workspace/CTO/CSF/Analytics/CSF-K8SZEPPELIN_CI Any idea why it has happening, or should we have to set something other than proxy to make build go through. Regards Naveen
cleaning up of built zeppelin source code.
Hi All, After building zeppelin source code, I want to clean up the dependencies all it has downloaded including node , maven etc. In a way I want to revert back built code to original code. Mvn clean command, I have used, but is there any thing should also be done for cleaning process. Command--> mvn clean Regards Naveen
RE: zeppelin start is failing on zeppelin v0.8.0-rc2
The mvn command used to build the source code is mvn clean install -DskipTests -Drat.skip=true -Pspark-2.2 -Phadoop2 -Pscala-2.11 we will try with without profiles and get back. Regards Naveen From: Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) Sent: Thursday, May 17, 2018 6:13 PM To: dev@zeppelin.apache.org Subject: zeppelin start is failing on zeppelin v0.8.0-rc2 Hi All, We have cloned the source code https://github.com/apache/zeppelin/archive/v0.8.0-rc2.tar.gz from this uri built the source code after generating zeppelin tar ball. When we are issuing the command to start zeppelin server bin/zeppelin.sh start We are getting the following exception while starting the zeppelin server itself. OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/zeppelin0.8/zeppelin-0.8.0/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/zeppelin0.8/zeppelin-0.8.0/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Exception in thread "main" java.lang.ExceptionInInitializerError at org.apache.zeppelin.conf.ZeppelinConfiguration.create(ZeppelinConfiguration.java:136) at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:169) Caused by: java.lang.NullPointerException at java.util.Properties$LineReader.readLine(Properties.java:434) at java.util.Properties.load0(Properties.java:353) at java.util.Properties.load(Properties.java:341) at org.apache.zeppelin.util.Util.(Util.java:41) ... 2 more We set the spark home in zeppelin-env.sh as well. Regards Naveen
zeppelin start is failing on zeppelin v0.8.0-rc2
Hi All, We have cloned the source code https://github.com/apache/zeppelin/archive/v0.8.0-rc2.tar.gz from this uri built the source code after generating zeppelin tar ball. When we are issuing the command to start zeppelin server bin/zeppelin.sh start We are getting the following exception while starting the zeppelin server itself. OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/zeppelin0.8/zeppelin-0.8.0/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/zeppelin0.8/zeppelin-0.8.0/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Exception in thread "main" java.lang.ExceptionInInitializerError at org.apache.zeppelin.conf.ZeppelinConfiguration.create(ZeppelinConfiguration.java:136) at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:169) Caused by: java.lang.NullPointerException at java.util.Properties$LineReader.readLine(Properties.java:434) at java.util.Properties.load0(Properties.java:353) at java.util.Properties.load(Properties.java:341) at org.apache.zeppelin.util.Util.(Util.java:41) ... 2 more We set the spark home in zeppelin-env.sh as well. Regards Naveen
support of PR#2637 in 0.8.0
Hi All, Zeppelin 0.8.0 supports Spark 2.3.0. Spark 2.3.0 supports running in Kubernetes cluster. Will Zeppelin support working with Spark on Kubernetes? Will 0.8.0 include the PR#2637? Regards Naveen
RE: merging of https://github.com/apache/zeppelin/pull/2637 change
Hi Zhang, As of now we did not create any PR for this change. We were using the PR#2637 and encountered issues mentioned. In 0.9.0 are there any plans for K8s integration. Regards Naveen -Original Message- From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Wednesday, May 9, 2018 2:37 PM To: dev@zeppelin.apache.org Cc: janos.mat...@gmail.com Subject: Re: merging of https://github.com/apache/zeppelin/pull/2637 change Hi Naveen, Thanks for the k8s integration work. Usually for any PR, contributors don't need so many above steps you mentioned. Contributor just need to run the following command then start zeppelin in you local machine and verify your PR. mvn clean package -DskipTests If you hit any issues, either it is your PR's bug or zeppelin's PR. Zeppelin do have many changes in 0.9, you need to rebase your PR first. and we could talk about the details in your PR. Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) < naveenakumar_gurushantap.panchappana...@nokia.com>于2018年5月9日周三 下午4:57写道： > Hi All, > > We had one of the requirement of supporting zeppelin deployment over > Kubernetes cluster and running spark jobs over zeppelin through spark > interpreter. > > > * As a first step, we have cloned the zeppelin source code having last > commit id: 685eb9249d1c1d821ce57f1ed0559f1539dfbe69 > * While building source code with the above commit id we faced > following issues: > > 1. after cloning the source to particular directory, there are some > modifications needed. Otherwise user will get the errors related to 'npm' > is not installed properly and the directory where actually the > zeppelin code is cloned the folder should be three level inner folder > of root folder of the machine where actually it has been cloned. > Otherwise internally code will be not able to create plugin folder > after three level up from the cloned folder. zeppelin-distribution of zeppelin source > code> > 2. In our environment proxy urls should be added to .bowerrc file > of the zeppelin-web project of the zeppelin source code. This can be > updated in the build user guide. > 3. All profiles are not correctly supported by the zeppelin code. > Some specific profiles needs to be added during the build time. < > -Pyarn -Ppyspark >So the following maven goal needs to be executed > from zeppelin parent directory to perform zeppelin code build. > 4. maven command to execute from the zeppelin parent directory. > mvn clean install -DskipTests -Drat.skip=true -Pspark-2.2 -Phadoop2 > -Pscala-2.11 -s settings.xml > 5. after executing the above mvn command build was successful on > all 49 sub module packages of zeppelin. > 6. Then cd into zeppelin-distribution and execute following mvn goal. > > mvn org.apache.maven.plugins:maven-assembly-plugin:3.0.0:single -P > apache-release. > > * After building the source code we took > https://github.com/apache/zeppelin/pull/2637 this PR ,added to the > code and built the source code. > * And when the zeppelin is deployed to kubernates cluster, and spark > job is being submitted, drivers and executors came up but were > referring to the spark interpreter class SparkInterpreterLauncher.java > and not SparkK8SInterpreterLauncher.java of above mentioned PR > * After reviewing the PR, we found that there is one condition in > 'interpretersetting.java' that checks if deploy mode is cluster and > then only launches SparkK8SInterpreterLauncher.java otherwise launches > SparkInterpreterLauncher.java code. > * Setting the value from the Zeppelin GUI did not work. > * So we modified interpreter-setting.json file of > zeppelin-0.9.0-SNAPSHOT/interpreter/spark to include > spark.submit.deployMode as cluster > * After these changes, when the driver is spawned it gives the > following exception: > > ClassNotFoundException:org.apache.zeppelin.interpreter.remote.RemoteIn > terpreterServer as it is using spark-interpreter-0.9.0-SNAPSHOT.jar > > during spark submit job, > > * To resolve the above issue, interpreter.sh was modified to execute > the spark submit command using zeppelin-interpreter-0.9.0-SNAPSHOT.jar > * when above mentioned jar is used to spawn spark submit command one > more exception was encountered > * ClassNotFoundException cerner.ether class not found > * to resolve ClassNotFoundException cerner.ether class error > spark-interpreter-0.9.0-SNAPSHOT.jar needs to be mentioned in > classpath using --jars option during spark submit. > > * After integrating all above changes, zeppelin submit of spark jobs > started using SparkK8SInterpreterLauncher.java. > Now our proposal is after doing all above modifications should it go > for upstream for mer
merging of https://github.com/apache/zeppelin/pull/2637 change
Hi All, We had one of the requirement of supporting zeppelin deployment over Kubernetes cluster and running spark jobs over zeppelin through spark interpreter. * As a first step, we have cloned the zeppelin source code having last commit id: 685eb9249d1c1d821ce57f1ed0559f1539dfbe69 * While building source code with the above commit id we faced following issues: 1. after cloning the source to particular directory, there are some modifications needed. Otherwise user will get the errors related to 'npm' is not installed properly and the directory where actually the zeppelin code is cloned the folder should be three level inner folder of root folder of the machine where actually it has been cloned. Otherwise internally code will be not able to create plugin folder after three level up from the cloned folder. 2. In our environment proxy urls should be added to .bowerrc file of the zeppelin-web project of the zeppelin source code. This can be updated in the build user guide. 3. All profiles are not correctly supported by the zeppelin code. Some specific profiles needs to be added during the build time. < -Pyarn -Ppyspark >So the following maven goal needs to be executed from zeppelin parent directory to perform zeppelin code build. 4. maven command to execute from the zeppelin parent directory. mvn clean install -DskipTests -Drat.skip=true -Pspark-2.2 -Phadoop2 -Pscala-2.11 -s settings.xml 5. after executing the above mvn command build was successful on all 49 sub module packages of zeppelin. 6. Then cd into zeppelin-distribution and execute following mvn goal. mvn org.apache.maven.plugins:maven-assembly-plugin:3.0.0:single -P apache-release. * After building the source code we took https://github.com/apache/zeppelin/pull/2637 this PR ,added to the code and built the source code. * And when the zeppelin is deployed to kubernates cluster, and spark job is being submitted, drivers and executors came up but were referring to the spark interpreter class SparkInterpreterLauncher.java and not SparkK8SInterpreterLauncher.java of above mentioned PR * After reviewing the PR, we found that there is one condition in 'interpretersetting.java' that checks if deploy mode is cluster and then only launches SparkK8SInterpreterLauncher.java otherwise launches SparkInterpreterLauncher.java code. * Setting the value from the Zeppelin GUI did not work. * So we modified interpreter-setting.json file of zeppelin-0.9.0-SNAPSHOT/interpreter/spark to include spark.submit.deployMode as cluster * After these changes, when the driver is spawned it gives the following exception: ClassNotFoundException:org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer as it is using spark-interpreter-0.9.0-SNAPSHOT.jar during spark submit job, * To resolve the above issue, interpreter.sh was modified to execute the spark submit command using zeppelin-interpreter-0.9.0-SNAPSHOT.jar * when above mentioned jar is used to spawn spark submit command one more exception was encountered * ClassNotFoundException cerner.ether class not found * to resolve ClassNotFoundException cerner.ether class error spark-interpreter-0.9.0-SNAPSHOT.jar needs to be mentioned in classpath using --jars option during spark submit. * After integrating all above changes, zeppelin submit of spark jobs started using SparkK8SInterpreterLauncher.java. Now our proposal is after doing all above modifications should it go for upstream for merging with the zeppelin source code or not. Please let us know if the above procedure we followed is proper way or not. One more question when will the above mentioned PR is planned for merging with the source code. Some changes may be needed for the K8_URL handling. We can help with community developers so that these changes can be integrated to the zeppelin source code. Regards Naveen
RE: pspark interpreter not working for matplot library
Hi Zhang,
Last commit id for the zeppelin repo is
685eb9249d1c1d821ce57f1ed0559f1539dfbe69
Regards
Naveen
-Original Message-
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Monday, April 30, 2018 3:23 PM
To: dev@zeppelin.apache.org
Subject: Re: pspark interpreter not working for matplot library
Which commit are you in ? I suspect you may mix with different zeppelin
versions.
Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一 下午5:48写道：
> Hi Zhang,
>
> When I use the following code for matplot lib
>
> %pyspark
> import matplotlib.pyplot as plt
> plt.close() # Added here to reset the plot when rerunning the
> paragraph z.configure_mpl(angular=True, close=False) plt.plot([1, 2,
> 3], label=r'$y=x$')
>
>
> its giving the following error.
>
> Fail to execute line 3: z.configure_mpl(angular=True, close=False)
> Traceback (most recent call last):
> File "/tmp/zeppelin_pyspark-2003011753933267610.py", line 226, in
>
> exec(code, _zcUserQueryNameSpace)
> File "", line 3, in
> File "/tmp/zeppelin_context.py", line 194, in configure_mpl
> import mpl_config
> ImportError: No module named mpl_config
>
> Regards
> Naveen
>
>
> -Original Message-
> From: Jeff Zhang [mailto:zjf...@gmail.com]
> Sent: Monday, April 30, 2018 1:46 PM
> To: dev@zeppelin.apache.org
> Subject: Re: pspark interpreter not working for matplot library
>
> 2 Approaches for you.
>
> 1. Use the ipython approach I mentioned above 2. Disable ipython by
> setting zeppelin.pyspark.useIPython to false
>
>
>
> Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> 下午4:09写道：
>
> > Hi Zhang
> >
> > In the link what you have given there they are not using pyspark
> > only they are using python interpreter
> >
> > We are facing the problem when we are using pyspark interpreter.
> >
> > Regards
> > Naveen
> >
> >
> >
> > -Original Message-
> > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > Sent: Monday, April 30, 2018 1:18 PM
> > To: dev@zeppelin.apache.org
> > Subject: Re: pspark interpreter not working for matplot library
> >
> > Here's one sample notebook for your reference
> >
> >
> > https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS9lN2Q3ODNiOD
> > Rk
> > NjA0ZjVjODM1OWZlMWExZjM4OTk3Zi9ub3RlLmpzb24
> >
> >
> > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> > 下午3:43写道：
> >
> > > Do we have any sample notebook where the following code is being used.
> > >
> > > %matplotlib inline
> > >
> > > Just to understand how it is being used, and one more thing like
> > > we are not using any ipython , we are using plan python2.X
> > >
> > > And one thing what we saw is when we use z.show(plt) instruction
> > > its able to show the graph but if we use this instruction more
> > > than once it is mixing the previous plots as well.
> > > The sample code is
> > >
> > > %pyspark
> > > import matplotlib.pyplot as plt
> > > plt.plot([1, 6, 3])
> > > plt.figure()
> > > z.show(plt)
> > > x = [0, 2, 4, 6, 8]
> > > y = [0, 3, 3, 7, 0]
> > > plt.plot(x, y)
> > > z.show(plt)
> > > plt.savefig('MyFirstPlot.png')
> > >
> > > Is there any solution for this.
> > >
> > >
> > > -Original Message-
> > > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > > Sent: Monday, April 30, 2018 12:47 PM
> > > To: dev@zeppelin.apache.org
> > > Subject: Re: pspark interpreter not working for matplot library
> > >
> > > Zeppelin has unit test for that guaranteed it could use matplotlib
> > > in both pyspark & python interpreter.
> > >
> > > The only change starting from 0.8 is that zeppelin would use
> > > ipython for python interpreter and pyspark interpreter if it is available.
> > > In that case, you can use mtpplotlib the same way in zeppelin as
> > > it is in
> > jupyter.
> > > That means you can do inline plotting by adding the following code
> > >
> > > %matplotlib inline
> > >
> > >
> > > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > > naveenakumar_gurushantap.panchappana..
RE: pspark interpreter not working for matplot library
Hi Zhang
There are number of commits which are available in got log which commit I need
check.
Regards
Naveen
-Original Message-
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Monday, April 30, 2018 3:23 PM
To: dev@zeppelin.apache.org
Subject: Re: pspark interpreter not working for matplot library
Which commit are you in ? I suspect you may mix with different zeppelin
versions.
Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一 下午5:48写道：
> Hi Zhang,
>
> When I use the following code for matplot lib
>
> %pyspark
> import matplotlib.pyplot as plt
> plt.close() # Added here to reset the plot when rerunning the
> paragraph z.configure_mpl(angular=True, close=False) plt.plot([1, 2,
> 3], label=r'$y=x$')
>
>
> its giving the following error.
>
> Fail to execute line 3: z.configure_mpl(angular=True, close=False)
> Traceback (most recent call last):
> File "/tmp/zeppelin_pyspark-2003011753933267610.py", line 226, in
>
> exec(code, _zcUserQueryNameSpace)
> File "", line 3, in
> File "/tmp/zeppelin_context.py", line 194, in configure_mpl
> import mpl_config
> ImportError: No module named mpl_config
>
> Regards
> Naveen
>
>
> -Original Message-
> From: Jeff Zhang [mailto:zjf...@gmail.com]
> Sent: Monday, April 30, 2018 1:46 PM
> To: dev@zeppelin.apache.org
> Subject: Re: pspark interpreter not working for matplot library
>
> 2 Approaches for you.
>
> 1. Use the ipython approach I mentioned above 2. Disable ipython by
> setting zeppelin.pyspark.useIPython to false
>
>
>
> Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> 下午4:09写道：
>
> > Hi Zhang
> >
> > In the link what you have given there they are not using pyspark
> > only they are using python interpreter
> >
> > We are facing the problem when we are using pyspark interpreter.
> >
> > Regards
> > Naveen
> >
> >
> >
> > -Original Message-
> > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > Sent: Monday, April 30, 2018 1:18 PM
> > To: dev@zeppelin.apache.org
> > Subject: Re: pspark interpreter not working for matplot library
> >
> > Here's one sample notebook for your reference
> >
> >
> > https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS9lN2Q3ODNiOD
> > Rk
> > NjA0ZjVjODM1OWZlMWExZjM4OTk3Zi9ub3RlLmpzb24
> >
> >
> > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> > 下午3:43写道：
> >
> > > Do we have any sample notebook where the following code is being used.
> > >
> > > %matplotlib inline
> > >
> > > Just to understand how it is being used, and one more thing like
> > > we are not using any ipython , we are using plan python2.X
> > >
> > > And one thing what we saw is when we use z.show(plt) instruction
> > > its able to show the graph but if we use this instruction more
> > > than once it is mixing the previous plots as well.
> > > The sample code is
> > >
> > > %pyspark
> > > import matplotlib.pyplot as plt
> > > plt.plot([1, 6, 3])
> > > plt.figure()
> > > z.show(plt)
> > > x = [0, 2, 4, 6, 8]
> > > y = [0, 3, 3, 7, 0]
> > > plt.plot(x, y)
> > > z.show(plt)
> > > plt.savefig('MyFirstPlot.png')
> > >
> > > Is there any solution for this.
> > >
> > >
> > > -Original Message-
> > > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > > Sent: Monday, April 30, 2018 12:47 PM
> > > To: dev@zeppelin.apache.org
> > > Subject: Re: pspark interpreter not working for matplot library
> > >
> > > Zeppelin has unit test for that guaranteed it could use matplotlib
> > > in both pyspark & python interpreter.
> > >
> > > The only change starting from 0.8 is that zeppelin would use
> > > ipython for python interpreter and pyspark interpreter if it is available.
> > > In that case, you can use mtpplotlib the same way in zeppelin as
> > > it is in
> > jupyter.
> > > That means you can do inline plotting by adding the following code
> > >
> > > %matplotlib inline
> > >
> > >
> > > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > > naveenakumar_gurushantap.panchappana..
RE: pspark interpreter not working for matplot library
Hi Zhang,
When I use the following code for matplot lib
%pyspark
import matplotlib.pyplot as plt
plt.close() # Added here to reset the plot when rerunning the paragraph
z.configure_mpl(angular=True, close=False)
plt.plot([1, 2, 3], label=r'$y=x$')
its giving the following error.
Fail to execute line 3: z.configure_mpl(angular=True, close=False)
Traceback (most recent call last):
File "/tmp/zeppelin_pyspark-2003011753933267610.py", line 226, in
exec(code, _zcUserQueryNameSpace)
File "", line 3, in
File "/tmp/zeppelin_context.py", line 194, in configure_mpl
import mpl_config
ImportError: No module named mpl_config
Regards
Naveen
-Original Message-
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Monday, April 30, 2018 1:46 PM
To: dev@zeppelin.apache.org
Subject: Re: pspark interpreter not working for matplot library
2 Approaches for you.
1. Use the ipython approach I mentioned above 2. Disable ipython by setting
zeppelin.pyspark.useIPython to false
Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一 下午4:09写道：
> Hi Zhang
>
> In the link what you have given there they are not using pyspark only
> they are using python interpreter
>
> We are facing the problem when we are using pyspark interpreter.
>
> Regards
> Naveen
>
>
>
> -Original Message-
> From: Jeff Zhang [mailto:zjf...@gmail.com]
> Sent: Monday, April 30, 2018 1:18 PM
> To: dev@zeppelin.apache.org
> Subject: Re: pspark interpreter not working for matplot library
>
> Here's one sample notebook for your reference
>
>
> https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS9lN2Q3ODNiODRk
> NjA0ZjVjODM1OWZlMWExZjM4OTk3Zi9ub3RlLmpzb24
>
>
> Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> 下午3:43写道：
>
> > Do we have any sample notebook where the following code is being used.
> >
> > %matplotlib inline
> >
> > Just to understand how it is being used, and one more thing like we
> > are not using any ipython , we are using plan python2.X
> >
> > And one thing what we saw is when we use z.show(plt) instruction its
> > able to show the graph but if we use this instruction more than once
> > it is mixing the previous plots as well.
> > The sample code is
> >
> > %pyspark
> > import matplotlib.pyplot as plt
> > plt.plot([1, 6, 3])
> > plt.figure()
> > z.show(plt)
> > x = [0, 2, 4, 6, 8]
> > y = [0, 3, 3, 7, 0]
> > plt.plot(x, y)
> > z.show(plt)
> > plt.savefig('MyFirstPlot.png')
> >
> > Is there any solution for this.
> >
> >
> > -Original Message-
> > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > Sent: Monday, April 30, 2018 12:47 PM
> > To: dev@zeppelin.apache.org
> > Subject: Re: pspark interpreter not working for matplot library
> >
> > Zeppelin has unit test for that guaranteed it could use matplotlib
> > in both pyspark & python interpreter.
> >
> > The only change starting from 0.8 is that zeppelin would use ipython
> > for python interpreter and pyspark interpreter if it is available.
> > In that case, you can use mtpplotlib the same way in zeppelin as it
> > is in
> jupyter.
> > That means you can do inline plotting by adding the following code
> >
> > %matplotlib inline
> >
> >
> > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> > 下午12:35写道：
> >
> > > The zeppelin version is 0.9.0 Snapshot
> > >
> > > Regards
> > > Naveen
> > >
> > >
> > > -Original Message-
> > > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > > Sent: Sunday, April 29, 2018 8:00 AM
> > > To: dev@zeppelin.apache.org
> > > Subject: Re: pspark interpreter not working for matplot library
> > >
> > > Which version of zeppelin do you use ?
> > >
> > >
> > > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月29日周日
> > > 上午4:20写道：
> > >
> > > > Hi All,
> > > >
> > > > I am trying to run pyspark interpreter by using matplot library
> > > > which plots simple graph,but its not showing any graph plot
> > > > diagram instead it returning one general object, but when we use
> > > > python interpreter it is able to plot the graph.
> > > >
> > > > Pyspark programme
> > > > %pyspark
> > > > import matplotlib.pyplot as plt
> > > > plt.plot([1, 6, 3])
> > > > plt.figure()
> > > > x = [0, 2, 4, 6, 8]
> > > > y = [0, 3, 3, 7, 0]
> > > > plt.plot(x, y)
> > > >
> > > > output: []
> > > >
> > > > python interpreter
> > > > %python
> > > > import matplotlib.pyplot as plt
> > > > plt.plot([1, 6, 3])
> > > > plt.figure()
> > > > x = [0, 2, 4, 6, 8]
> > > > y = [0, 3, 3, 7, 0]
> > > > plt.plot(x, y)
> > > > output:
> > > > it able to plot the programme
> > > >
> > > > can any one please help on this.
> > > >
> > > > Regards
> > > > Naveen
> > > >
> > > >
> > >
> >
>
RE: pspark interpreter not working for matplot library
Hi Zhang,
Do we have any sample pyspark notebook which uses matplot library for 0.9.0
So that it will be clear like how we have to use instructions to plot the graph.
Regards
Naveen
-Original Message-
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Monday, April 30, 2018 1:46 PM
To: dev@zeppelin.apache.org
Subject: Re: pspark interpreter not working for matplot library
2 Approaches for you.
1. Use the ipython approach I mentioned above 2. Disable ipython by setting
zeppelin.pyspark.useIPython to false
Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一 下午4:09写道：
> Hi Zhang
>
> In the link what you have given there they are not using pyspark only
> they are using python interpreter
>
> We are facing the problem when we are using pyspark interpreter.
>
> Regards
> Naveen
>
>
>
> -Original Message-
> From: Jeff Zhang [mailto:zjf...@gmail.com]
> Sent: Monday, April 30, 2018 1:18 PM
> To: dev@zeppelin.apache.org
> Subject: Re: pspark interpreter not working for matplot library
>
> Here's one sample notebook for your reference
>
>
> https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS9lN2Q3ODNiODRk
> NjA0ZjVjODM1OWZlMWExZjM4OTk3Zi9ub3RlLmpzb24
>
>
> Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> 下午3:43写道：
>
> > Do we have any sample notebook where the following code is being used.
> >
> > %matplotlib inline
> >
> > Just to understand how it is being used, and one more thing like we
> > are not using any ipython , we are using plan python2.X
> >
> > And one thing what we saw is when we use z.show(plt) instruction its
> > able to show the graph but if we use this instruction more than once
> > it is mixing the previous plots as well.
> > The sample code is
> >
> > %pyspark
> > import matplotlib.pyplot as plt
> > plt.plot([1, 6, 3])
> > plt.figure()
> > z.show(plt)
> > x = [0, 2, 4, 6, 8]
> > y = [0, 3, 3, 7, 0]
> > plt.plot(x, y)
> > z.show(plt)
> > plt.savefig('MyFirstPlot.png')
> >
> > Is there any solution for this.
> >
> >
> > -Original Message-
> > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > Sent: Monday, April 30, 2018 12:47 PM
> > To: dev@zeppelin.apache.org
> > Subject: Re: pspark interpreter not working for matplot library
> >
> > Zeppelin has unit test for that guaranteed it could use matplotlib
> > in both pyspark & python interpreter.
> >
> > The only change starting from 0.8 is that zeppelin would use ipython
> > for python interpreter and pyspark interpreter if it is available.
> > In that case, you can use mtpplotlib the same way in zeppelin as it
> > is in
> jupyter.
> > That means you can do inline plotting by adding the following code
> >
> > %matplotlib inline
> >
> >
> > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> > 下午12:35写道：
> >
> > > The zeppelin version is 0.9.0 Snapshot
> > >
> > > Regards
> > > Naveen
> > >
> > >
> > > -Original Message-
> > > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > > Sent: Sunday, April 29, 2018 8:00 AM
> > > To: dev@zeppelin.apache.org
> > > Subject: Re: pspark interpreter not working for matplot library
> > >
> > > Which version of zeppelin do you use ?
> > >
> > >
> > > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月29日周日
> > > 上午4:20写道：
> > >
> > > > Hi All,
> > > >
> > > > I am trying to run pyspark interpreter by using matplot library
> > > > which plots simple graph,but its not showing any graph plot
> > > > diagram instead it returning one general object, but when we use
> > > > python interpreter it is able to plot the graph.
> > > >
> > > > Pyspark programme
> > > > %pyspark
> > > > import matplotlib.pyplot as plt
> > > > plt.plot([1, 6, 3])
> > > > plt.figure()
> > > > x = [0, 2, 4, 6, 8]
> > > > y = [0, 3, 3, 7, 0]
> > > > plt.plot(x, y)
> > > >
> > > > output: []
> > > >
> > > > python interpreter
> > > > %python
> > > > import matplotlib.pyplot as plt
> > > > plt.plot([1, 6, 3])
> > > > plt.figure()
> > > > x = [0, 2, 4, 6, 8]
> > > > y = [0, 3, 3, 7, 0]
> > > > plt.plot(x, y)
> > > > output:
> > > > it able to plot the programme
> > > >
> > > > can any one please help on this.
> > > >
> > > > Regards
> > > > Naveen
> > > >
> > > >
> > >
> >
>
RE: pspark interpreter not working for matplot library
Hi Zhang,
We have set the property what you have mentioned to false, I mean I have used
2nd approach still no luck.
Regards
Naveen
-Original Message-
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Monday, April 30, 2018 1:46 PM
To: dev@zeppelin.apache.org
Subject: Re: pspark interpreter not working for matplot library
2 Approaches for you.
1. Use the ipython approach I mentioned above 2. Disable ipython by setting
zeppelin.pyspark.useIPython to false
Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一 下午4:09写道：
> Hi Zhang
>
> In the link what you have given there they are not using pyspark only
> they are using python interpreter
>
> We are facing the problem when we are using pyspark interpreter.
>
> Regards
> Naveen
>
>
>
> -Original Message-
> From: Jeff Zhang [mailto:zjf...@gmail.com]
> Sent: Monday, April 30, 2018 1:18 PM
> To: dev@zeppelin.apache.org
> Subject: Re: pspark interpreter not working for matplot library
>
> Here's one sample notebook for your reference
>
>
> https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS9lN2Q3ODNiODRk
> NjA0ZjVjODM1OWZlMWExZjM4OTk3Zi9ub3RlLmpzb24
>
>
> Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> 下午3:43写道：
>
> > Do we have any sample notebook where the following code is being used.
> >
> > %matplotlib inline
> >
> > Just to understand how it is being used, and one more thing like we
> > are not using any ipython , we are using plan python2.X
> >
> > And one thing what we saw is when we use z.show(plt) instruction its
> > able to show the graph but if we use this instruction more than once
> > it is mixing the previous plots as well.
> > The sample code is
> >
> > %pyspark
> > import matplotlib.pyplot as plt
> > plt.plot([1, 6, 3])
> > plt.figure()
> > z.show(plt)
> > x = [0, 2, 4, 6, 8]
> > y = [0, 3, 3, 7, 0]
> > plt.plot(x, y)
> > z.show(plt)
> > plt.savefig('MyFirstPlot.png')
> >
> > Is there any solution for this.
> >
> >
> > -Original Message-
> > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > Sent: Monday, April 30, 2018 12:47 PM
> > To: dev@zeppelin.apache.org
> > Subject: Re: pspark interpreter not working for matplot library
> >
> > Zeppelin has unit test for that guaranteed it could use matplotlib
> > in both pyspark & python interpreter.
> >
> > The only change starting from 0.8 is that zeppelin would use ipython
> > for python interpreter and pyspark interpreter if it is available.
> > In that case, you can use mtpplotlib the same way in zeppelin as it
> > is in
> jupyter.
> > That means you can do inline plotting by adding the following code
> >
> > %matplotlib inline
> >
> >
> > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> > 下午12:35写道：
> >
> > > The zeppelin version is 0.9.0 Snapshot
> > >
> > > Regards
> > > Naveen
> > >
> > >
> > > -Original Message-
> > > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > > Sent: Sunday, April 29, 2018 8:00 AM
> > > To: dev@zeppelin.apache.org
> > > Subject: Re: pspark interpreter not working for matplot library
> > >
> > > Which version of zeppelin do you use ?
> > >
> > >
> > > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月29日周日
> > > 上午4:20写道：
> > >
> > > > Hi All,
> > > >
> > > > I am trying to run pyspark interpreter by using matplot library
> > > > which plots simple graph,but its not showing any graph plot
> > > > diagram instead it returning one general object, but when we use
> > > > python interpreter it is able to plot the graph.
> > > >
> > > > Pyspark programme
> > > > %pyspark
> > > > import matplotlib.pyplot as plt
> > > > plt.plot([1, 6, 3])
> > > > plt.figure()
> > > > x = [0, 2, 4, 6, 8]
> > > > y = [0, 3, 3, 7, 0]
> > > > plt.plot(x, y)
> > > >
> > > > output: []
> > > >
> > > > python interpreter
> > > > %python
> > > > import matplotlib.pyplot as plt
> > > > plt.plot([1, 6, 3])
> > > > plt.figure()
> > > > x = [0, 2, 4, 6, 8]
> > > > y = [0, 3, 3, 7, 0]
> > > > plt.plot(x, y)
> > > > output:
> > > > it able to plot the programme
> > > >
> > > > can any one please help on this.
> > > >
> > > > Regards
> > > > Naveen
> > > >
> > > >
> > >
> >
>
RE: pspark interpreter not working for matplot library
Hi Zhang
In the link what you have given there they are not using pyspark only they are
using python interpreter
We are facing the problem when we are using pyspark interpreter.
Regards
Naveen
-Original Message-
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Monday, April 30, 2018 1:18 PM
To: dev@zeppelin.apache.org
Subject: Re: pspark interpreter not working for matplot library
Here's one sample notebook for your reference
https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS9lN2Q3ODNiODRkNjA0ZjVjODM1OWZlMWExZjM4OTk3Zi9ub3RlLmpzb24
Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一 下午3:43写道：
> Do we have any sample notebook where the following code is being used.
>
> %matplotlib inline
>
> Just to understand how it is being used, and one more thing like we
> are not using any ipython , we are using plan python2.X
>
> And one thing what we saw is when we use z.show(plt) instruction its
> able to show the graph but if we use this instruction more than once
> it is mixing the previous plots as well.
> The sample code is
>
> %pyspark
> import matplotlib.pyplot as plt
> plt.plot([1, 6, 3])
> plt.figure()
> z.show(plt)
> x = [0, 2, 4, 6, 8]
> y = [0, 3, 3, 7, 0]
> plt.plot(x, y)
> z.show(plt)
> plt.savefig('MyFirstPlot.png')
>
> Is there any solution for this.
>
>
> -Original Message-
> From: Jeff Zhang [mailto:zjf...@gmail.com]
> Sent: Monday, April 30, 2018 12:47 PM
> To: dev@zeppelin.apache.org
> Subject: Re: pspark interpreter not working for matplot library
>
> Zeppelin has unit test for that guaranteed it could use matplotlib in
> both pyspark & python interpreter.
>
> The only change starting from 0.8 is that zeppelin would use ipython
> for python interpreter and pyspark interpreter if it is available. In
> that case, you can use mtpplotlib the same way in zeppelin as it is in
> jupyter.
> That means you can do inline plotting by adding the following code
>
> %matplotlib inline
>
>
> Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一
> 下午12:35写道：
>
> > The zeppelin version is 0.9.0 Snapshot
> >
> > Regards
> > Naveen
> >
> >
> > -Original Message-
> > From: Jeff Zhang [mailto:zjf...@gmail.com]
> > Sent: Sunday, April 29, 2018 8:00 AM
> > To: dev@zeppelin.apache.org
> > Subject: Re: pspark interpreter not working for matplot library
> >
> > Which version of zeppelin do you use ?
> >
> >
> > Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> > naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月29日周日
> > 上午4:20写道：
> >
> > > Hi All,
> > >
> > > I am trying to run pyspark interpreter by using matplot library
> > > which plots simple graph,but its not showing any graph plot
> > > diagram instead it returning one general object, but when we use
> > > python interpreter it is able to plot the graph.
> > >
> > > Pyspark programme
> > > %pyspark
> > > import matplotlib.pyplot as plt
> > > plt.plot([1, 6, 3])
> > > plt.figure()
> > > x = [0, 2, 4, 6, 8]
> > > y = [0, 3, 3, 7, 0]
> > > plt.plot(x, y)
> > >
> > > output: []
> > >
> > > python interpreter
> > > %python
> > > import matplotlib.pyplot as plt
> > > plt.plot([1, 6, 3])
> > > plt.figure()
> > > x = [0, 2, 4, 6, 8]
> > > y = [0, 3, 3, 7, 0]
> > > plt.plot(x, y)
> > > output:
> > > it able to plot the programme
> > >
> > > can any one please help on this.
> > >
> > > Regards
> > > Naveen
> > >
> > >
> >
>
RE: pspark interpreter not working for matplot library
Do we have any sample notebook where the following code is being used.
%matplotlib inline
Just to understand how it is being used, and one more thing like we are not
using any ipython , we are using plan python2.X
And one thing what we saw is when we use z.show(plt) instruction its able to
show the graph but if we use this instruction more than once it is mixing the
previous plots as well.
The sample code is
%pyspark
import matplotlib.pyplot as plt
plt.plot([1, 6, 3])
plt.figure()
z.show(plt)
x = [0, 2, 4, 6, 8]
y = [0, 3, 3, 7, 0]
plt.plot(x, y)
z.show(plt)
plt.savefig('MyFirstPlot.png')
Is there any solution for this.
-Original Message-
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Monday, April 30, 2018 12:47 PM
To: dev@zeppelin.apache.org
Subject: Re: pspark interpreter not working for matplot library
Zeppelin has unit test for that guaranteed it could use matplotlib in both
pyspark & python interpreter.
The only change starting from 0.8 is that zeppelin would use ipython for python
interpreter and pyspark interpreter if it is available. In that case, you can
use mtpplotlib the same way in zeppelin as it is in jupyter.
That means you can do inline plotting by adding the following code
%matplotlib inline
Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月30日周一 下午12:35写道：
> The zeppelin version is 0.9.0 Snapshot
>
> Regards
> Naveen
>
>
> -Original Message-
> From: Jeff Zhang [mailto:zjf...@gmail.com]
> Sent: Sunday, April 29, 2018 8:00 AM
> To: dev@zeppelin.apache.org
> Subject: Re: pspark interpreter not working for matplot library
>
> Which version of zeppelin do you use ?
>
>
> Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
> naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月29日周日
> 上午4:20写道：
>
> > Hi All,
> >
> > I am trying to run pyspark interpreter by using matplot library
> > which plots simple graph,but its not showing any graph plot diagram
> > instead it returning one general object, but when we use python
> > interpreter it is able to plot the graph.
> >
> > Pyspark programme
> > %pyspark
> > import matplotlib.pyplot as plt
> > plt.plot([1, 6, 3])
> > plt.figure()
> > x = [0, 2, 4, 6, 8]
> > y = [0, 3, 3, 7, 0]
> > plt.plot(x, y)
> >
> > output: []
> >
> > python interpreter
> > %python
> > import matplotlib.pyplot as plt
> > plt.plot([1, 6, 3])
> > plt.figure()
> > x = [0, 2, 4, 6, 8]
> > y = [0, 3, 3, 7, 0]
> > plt.plot(x, y)
> > output:
> > it able to plot the programme
> >
> > can any one please help on this.
> >
> > Regards
> > Naveen
> >
> >
>
RE: pspark interpreter not working for matplot library
The zeppelin version is 0.9.0 Snapshot Regards Naveen -Original Message- From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Sunday, April 29, 2018 8:00 AM To: dev@zeppelin.apache.org Subject: Re: pspark interpreter not working for matplot library Which version of zeppelin do you use ? Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) < naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月29日周日 上午4:20写道： > Hi All, > > I am trying to run pyspark interpreter by using matplot library which > plots simple graph,but its not showing any graph plot diagram instead > it returning one general object, but when we use python interpreter it > is able to plot the graph. > > Pyspark programme > %pyspark > import matplotlib.pyplot as plt > plt.plot([1, 6, 3]) > plt.figure() > x = [0, 2, 4, 6, 8] > y = [0, 3, 3, 7, 0] > plt.plot(x, y) > > output: [] > > python interpreter > %python > import matplotlib.pyplot as plt > plt.plot([1, 6, 3]) > plt.figure() > x = [0, 2, 4, 6, 8] > y = [0, 3, 3, 7, 0] > plt.plot(x, y) > output: > it able to plot the programme > > can any one please help on this. > > Regards > Naveen > >
pspark interpreter not working for matplot library
Hi All, I am trying to run pyspark interpreter by using matplot library which plots simple graph,but its not showing any graph plot diagram instead it returning one general object, but when we use python interpreter it is able to plot the graph. Pyspark programme %pyspark import matplotlib.pyplot as plt plt.plot([1, 6, 3]) plt.figure() x = [0, 2, 4, 6, 8] y = [0, 3, 3, 7, 0] plt.plot(x, y) output: [] python interpreter %python import matplotlib.pyplot as plt plt.plot([1, 6, 3]) plt.figure() x = [0, 2, 4, 6, 8] y = [0, 3, 3, 7, 0] plt.plot(x, y) output: it able to plot the programme can any one please help on this. Regards Naveen
RE: zeppelin build is failing
Hi Jeff, Is there any other alternative way of building the code,till fix comes. Regards Naveen -Original Message- From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Saturday, April 7, 2018 8:07 AM To: dev@zeppelin.apache.org Subject: Re: zeppelin build is failing This is due to ZEPPELIN-3367, I will fix it soon. Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) < naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月7日周六 上午5:30写道： > Hi All, > > I am trying out building latest zeppelin source on one of my vm machine . > > I getting the following error can any body help on this. > > Zeppelin 0.9.0-SNAPSHOT SUCCESS [ 3.985 > s] [INFO] Zeppelin: Interpreter Parent ... SUCCESS > [ > 0.859 s] > [INFO] Zeppelin: Interpreter .. SUCCESS [ > 11.889 s] > [INFO] Zeppelin: Display system apis .. SUCCESS [ > 16.443 s] > [INFO] Zeppelin: Spark Parent . SUCCESS [ > 1.133 s] > [INFO] Zeppelin: Spark Scala Parent ... SUCCESS [ > 13.495 s] > [INFO] Zeppelin: Spark Interpreter Scala_2.11 . SUCCESS [ > 8.681 s] > [INFO] Zeppelin: Spark Interpreter Scala_2.10 . SUCCESS [ > 9.181 s] > [INFO] Zeppelin: Spark Shims .. SUCCESS [ > 0.985 s] > [INFO] Zeppelin: Spark1 Shims . SUCCESS [ > 3.905 s] > [INFO] Zeppelin: Spark2 Shims . SUCCESS [ > 3.629 s] > [INFO] Zeppelin: Python interpreter ... SUCCESS [ > 17.105 s] > [INFO] Zeppelin: Spark Interpreter SUCCESS [ > 37.335 s] > [INFO] Zeppelin: Zengine .. SUCCESS [ > 8.997 s] > [INFO] Zeppelin: Groovy interpreter ... SUCCESS [ > 1.375 s] > [INFO] Zeppelin: Spark dependencies ... SUCCESS [ > 50.364 s] > [INFO] Zeppelin: Markdown interpreter . SUCCESS [ > 1.612 s] > [INFO] Zeppelin: Angular interpreter .. SUCCESS [ > 1.182 s] > [INFO] Zeppelin: Shell interpreter SUCCESS [ > 1.348 s] > [INFO] Zeppelin: Livy interpreter . SUCCESS [ > 3.897 s] > [INFO] Zeppelin: HBase interpreter SUCCESS [ > 4.578 s] > [INFO] Zeppelin: Apache Pig Interpreter ... SUCCESS [ > 6.657 s] > [INFO] Zeppelin: JDBC interpreter . SUCCESS [ > 2.123 s] > [INFO] Zeppelin: File System Interpreters . SUCCESS [ > 1.926 s] > [INFO] Zeppelin: Flink SUCCESS [ > 8.150 s] > [INFO] Zeppelin: Apache Ignite interpreter SUCCESS [ > 2.706 s] > [INFO] Zeppelin: Kylin interpreter SUCCESS [ > 1.465 s] > [INFO] Zeppelin: Lens interpreter . SUCCESS [ > 8.852 s] > [INFO] Zeppelin: Apache Cassandra interpreter . SUCCESS > [01:00 min] [INFO] Zeppelin: Elasticsearch interpreter > SUCCESS [ > 4.360 s] > [INFO] Zeppelin: BigQuery interpreter . SUCCESS [ > 1.731 s] > [INFO] Zeppelin: Alluxio interpreter .. SUCCESS [ > 3.478 s] > [INFO] Zeppelin: Scio . SUCCESS [ > 47.500 s] > [INFO] Zeppelin: Neo4j interpreter SUCCESS [ > 3.099 s] > [INFO] Zeppelin: Sap .. SUCCESS [ > 1.234 s] > [INFO] Zeppelin: web Application .. SUCCESS > [17:26 min] [INFO] Zeppelin: Server > ... SUCCESS [01:39 min] [INFO] > Zeppelin: Jupyter Support .. SUCCESS [ > 1.051 s] > [INFO] Zeppelin: Plugins Parent ... FAILURE [ > 2.499 s] > [INFO] Zeppelin: Plugin S3NotebookRepo SKIPPED > [INFO] Zeppelin: Plugin VFSNotebookRepo ... SKIPPED > [INFO] Zeppelin: Plugin GitNotebookRepo ... SKIPPED > [INFO] Zeppelin: Plugin GitHubNotebookRepo SKIPPED > [INFO] Zeppelin: Plugin AzureNotebookRepo . SKIPPED > [INFO] Zeppelin: Plugin GCSNotebookRepo ... SKIPPED > [INFO] Zeppelin: Plugin MongoNotebookRepo . SKIPPED > [INFO] Zeppelin: Plugin ZeppelinHubRepo ... SKIPPED > [INFO] Zeppelin: Plugin FileSystemNotebookRepo SKIPPED > [INFO] Zeppelin: Packaging distribution 0.9.0-SNAPSHOT SKIPPED > [INFO] > -- > -- > [INFO]
zeppelin build is failing
Hi All, I am trying out building latest zeppelin source on one of my vm machine . I getting the following error can any body help on this. Zeppelin 0.9.0-SNAPSHOT SUCCESS [ 3.985 s] [INFO] Zeppelin: Interpreter Parent ... SUCCESS [ 0.859 s] [INFO] Zeppelin: Interpreter .. SUCCESS [ 11.889 s] [INFO] Zeppelin: Display system apis .. SUCCESS [ 16.443 s] [INFO] Zeppelin: Spark Parent . SUCCESS [ 1.133 s] [INFO] Zeppelin: Spark Scala Parent ... SUCCESS [ 13.495 s] [INFO] Zeppelin: Spark Interpreter Scala_2.11 . SUCCESS [ 8.681 s] [INFO] Zeppelin: Spark Interpreter Scala_2.10 . SUCCESS [ 9.181 s] [INFO] Zeppelin: Spark Shims .. SUCCESS [ 0.985 s] [INFO] Zeppelin: Spark1 Shims . SUCCESS [ 3.905 s] [INFO] Zeppelin: Spark2 Shims . SUCCESS [ 3.629 s] [INFO] Zeppelin: Python interpreter ... SUCCESS [ 17.105 s] [INFO] Zeppelin: Spark Interpreter SUCCESS [ 37.335 s] [INFO] Zeppelin: Zengine .. SUCCESS [ 8.997 s] [INFO] Zeppelin: Groovy interpreter ... SUCCESS [ 1.375 s] [INFO] Zeppelin: Spark dependencies ... SUCCESS [ 50.364 s] [INFO] Zeppelin: Markdown interpreter . SUCCESS [ 1.612 s] [INFO] Zeppelin: Angular interpreter .. SUCCESS [ 1.182 s] [INFO] Zeppelin: Shell interpreter SUCCESS [ 1.348 s] [INFO] Zeppelin: Livy interpreter . SUCCESS [ 3.897 s] [INFO] Zeppelin: HBase interpreter SUCCESS [ 4.578 s] [INFO] Zeppelin: Apache Pig Interpreter ... SUCCESS [ 6.657 s] [INFO] Zeppelin: JDBC interpreter . SUCCESS [ 2.123 s] [INFO] Zeppelin: File System Interpreters . SUCCESS [ 1.926 s] [INFO] Zeppelin: Flink SUCCESS [ 8.150 s] [INFO] Zeppelin: Apache Ignite interpreter SUCCESS [ 2.706 s] [INFO] Zeppelin: Kylin interpreter SUCCESS [ 1.465 s] [INFO] Zeppelin: Lens interpreter . SUCCESS [ 8.852 s] [INFO] Zeppelin: Apache Cassandra interpreter . SUCCESS [01:00 min] [INFO] Zeppelin: Elasticsearch interpreter SUCCESS [ 4.360 s] [INFO] Zeppelin: BigQuery interpreter . SUCCESS [ 1.731 s] [INFO] Zeppelin: Alluxio interpreter .. SUCCESS [ 3.478 s] [INFO] Zeppelin: Scio . SUCCESS [ 47.500 s] [INFO] Zeppelin: Neo4j interpreter SUCCESS [ 3.099 s] [INFO] Zeppelin: Sap .. SUCCESS [ 1.234 s] [INFO] Zeppelin: web Application .. SUCCESS [17:26 min] [INFO] Zeppelin: Server ... SUCCESS [01:39 min] [INFO] Zeppelin: Jupyter Support .. SUCCESS [ 1.051 s] [INFO] Zeppelin: Plugins Parent ... FAILURE [ 2.499 s] [INFO] Zeppelin: Plugin S3NotebookRepo SKIPPED [INFO] Zeppelin: Plugin VFSNotebookRepo ... SKIPPED [INFO] Zeppelin: Plugin GitNotebookRepo ... SKIPPED [INFO] Zeppelin: Plugin GitHubNotebookRepo SKIPPED [INFO] Zeppelin: Plugin AzureNotebookRepo . SKIPPED [INFO] Zeppelin: Plugin GCSNotebookRepo ... SKIPPED [INFO] Zeppelin: Plugin MongoNotebookRepo . SKIPPED [INFO] Zeppelin: Plugin ZeppelinHubRepo ... SKIPPED [INFO] Zeppelin: Plugin FileSystemNotebookRepo SKIPPED [INFO] Zeppelin: Packaging distribution 0.9.0-SNAPSHOT SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 25:06 min [INFO] Finished at: 2018-04-06T16:06:04-05:00 [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-dependency-plugin:2.8:copy (copy-plugin-artifact) on project zengine-plugins-parent: Error copying artifact from /u/npanchap/zeppelin/zeppelin-plugins/.flattened-pom.xml to /u/npanchap/zeppelin/zeppelin-plugins/target/../../../../plugins/Maven Dependency Plugin/zengine-plugins-parent-0.9.0-SNAPSHOT.pom: /u/npanchap/zeppelin/zeppelin-plugins/target/../../../../plugins/Maven Dependency Plugin/zengine-plugins-parent-0.9.0-SNAPSHOT.pom (No such file or directory) -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR]
