[GitHub] zeppelin issue #2285: ZEPPELIN-2450. Move spark profile to pom file of paren...
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2285 @Leemoonsoo @felixcheung @jongyoul Please help review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: CI status is lost in PR page
Yes, somehow, PR page does not display CI status. I don't know exact reason. I filed an INFRA issue https://issues.apache.org/jira/browse/INFRA-14005. On Tue, Apr 25, 2017 at 10:42 PM Jeff Zhang wrote: > I didn't see the CI status in the PR page recently, I need to check travis > manually. Does anyone experience the same thing ? > > > > [image: image.png] >
[GitHub] zeppelin pull request #2286: Jenkins CI test
GitHub user Leemoonsoo opened a pull request: https://github.com/apache/zeppelin/pull/2286 Jenkins CI test will not be merged. for test purpose. You can merge this pull request into a Git repository by running: $ git pull https://github.com/Leemoonsoo/zeppelin ci_test Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2286.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2286 commit 27dfcc43aaf0fdee19c78743d2871e29893a7580 Author: Lee moon soo Date: 2017-04-26T06:15:52Z test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2280: ZEPPELIN-2445. Display which line of python code raise...
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2280 Thanks @felixcheung , will merge it if no more comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
CI status is lost in PR page
I didn't see the CI status in the PR page recently, I need to check travis manually. Does anyone experience the same thing ? [image: image.png]
[GitHub] zeppelin pull request #2285: ZEPPELIN-2450. Move spark profile to pom file o...
GitHub user zjffdu reopened a pull request: https://github.com/apache/zeppelin/pull/2285 ZEPPELIN-2450. Move spark profile to pom file of parent project ### What is this PR for? 2 issues of spark profile: * Duplicated profiles in spark and spark-dependencies * The default profile can not be activated because it is in sub module. This cause spark module always use spark 2.0.2 in intellij even when I activate profile spark-2.1, this cause I fail to run `PySparkInterpreterTest` in intellij. This PR move spark profiles to pom file of parent project. By default, profile spark-2.1 and scala-2.10 will be activated. ### What type of PR is it? [ Improvement | Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2450 ### How should this be tested? CI pass ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2450 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2285.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2285 commit 469ee91d4639d083e99c1ab63897e0df81df9e6f Author: Jeff Zhang Date: 2017-04-26T03:27:20Z ZEPPELIN-2450. Move spark profile to pom file of parent project --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2285: ZEPPELIN-2450. Move spark profile to pom file o...
Github user zjffdu closed the pull request at: https://github.com/apache/zeppelin/pull/2285 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2285: ZEPPELIN-2450. Move spark profile to pom file o...
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/2285 ZEPPELIN-2450. Move spark profile to pom file of parent project ### What is this PR for? 2 issues of spark profile: * Duplicated profiles in spark and spark-dependencies * The default profile can not be activated because it is in sub module. This cause spark module always use spark 2.0.2 in intellij even when I activate profile spark-2.1, this cause I fail to run `PySparkInterpreterTest` in intellij. This PR move spark profiles to pom file of parent project. By default, profile spark-2.1 and scala-2.10 will be activated. ### What type of PR is it? [ Improvement | Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2450 ### How should this be tested? CI pass ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2450 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2285.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2285 commit 469ee91d4639d083e99c1ab63897e0df81df9e6f Author: Jeff Zhang Date: 2017-04-26T03:27:20Z ZEPPELIN-2450. Move spark profile to pom file of parent project --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2239: Show dialog if owners field set to be empty on shiro
Github user soralee commented on the issue: https://github.com/apache/zeppelin/pull/2239 @felixcheung I updated as your advice! @khalidhuseynov I added a logic which is reverted with old value if user cancel button like above `4 step`. How about this? > 4. then, the default owners value is disappeared. ![revert_shiro](https://cloud.githubusercontent.com/assets/8110458/25418845/bfd841d4-2a89-11e7-97d7-63e7072d0b99.gif) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2275: [ZEPPELIN-2442] button to create note into folder (nav...
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/2275 cool, love the hover and tooltip --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2279: [WIP] [HOTFIX] Add livy build in .travis
Github user zjffdu closed the pull request at: https://github.com/apache/zeppelin/pull/2279 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2279: [WIP] [HOTFIX] Add livy build in .travis
GitHub user zjffdu reopened a pull request: https://github.com/apache/zeppelin/pull/2279 [WIP] [HOTFIX] Add livy build in .travis ### What is this PR for? livy integration test is ignored, this PR add livy integration test in travis ### What type of PR is it? [Hot Fix] ### Todos * [ ] - Task ### What is the Jira issue? * No jira created ### How should this be tested? CI pass ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin hotfix_livy Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2279.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2279 commit 908210e1cf0f8d15ed2e36e7865d378bb05287a7 Author: Jeff Zhang Date: 2017-04-21T09:38:51Z [HOTFIX] Add livy build in .travis --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2239: Show dialog if owners field set to be empty on shiro
Github user soralee commented on the issue: https://github.com/apache/zeppelin/pull/2239 @khalidhuseynov Thanks for opinion! Yeah, I see. This PR is for showing a dialog when (already existing backend logic) that note's permission set Readers/Writers but Owners is empty. I think I would better to focus the purpose! So, next step is that I'd like to update this PR as @felixcheung addressed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2284: [ZEPPELIN-2451]: Add JDBC config option for cal...
GitHub user randerzander opened a pull request: https://github.com/apache/zeppelin/pull/2284 [ZEPPELIN-2451]: Add JDBC config option for calling connection.commit after paragraph execution ### What is this PR for? Adding config for automatically calling commit after JDBC paragraph execution ### What type of PR is it? [Improvement] ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2451 ### How should this be tested? Create property zeppelin.jdbc.autocommit with value "true" under the JDBC interpreter, run an INSERT statement against a database. The insert should be committed and should be accessible in the database. Create property zeppelin.jdbc.autocommit with value "false" under the JDBC interpreter, run an INSERT statement against a database. The insert should not be committed and will not be in the database. ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes You can merge this pull request into a Git repository by running: $ git pull https://github.com/randerzander/zeppelin master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2284.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2284 commit 07b7a3a6461acbcbe2b06e843d23fceae33c396e Author: Randy Gelhausen Date: 2017-04-26T02:51:25Z ZEPPELIN-2451: Add JDBC config option for calling connection.commit after paragraph execution --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-2451) Add JDBC config option for calling connection.commit after paragraph execution
Randy Gelhausen created ZEPPELIN-2451: - Summary: Add JDBC config option for calling connection.commit after paragraph execution Key: ZEPPELIN-2451 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2451 Project: Zeppelin Issue Type: Bug Components: Interpreters Reporter: Randy Gelhausen Assignee: Randy Gelhausen [ZEPPELIN-1645](https://issues.apache.org/jira/browse/ZEPPELIN-1645) added code to automatically call connection.commit() after JDBC paragraph execution, but some JDBC drivers do not support the connection.commit method, [calcite-druid](https://calcite.apache.org/docs/druid_adapter.html) for instance. The interpreter should have a zeppelin.jdbc.autocommit property which allows user to decide whether the interpreter should call commit after each paragraph execution. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2450) Move spark profile to pom file of parent project
Jeff Zhang created ZEPPELIN-2450: Summary: Move spark profile to pom file of parent project Key: ZEPPELIN-2450 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2450 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Assignee: Jeff Zhang 2 issues of spark profile: * duplicated profiles in spark and spark-dependencies * the default profile can not be activated because it is in sub module -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zeppelin issue #2280: ZEPPELIN-2445. Display which line of python code raise...
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2280 @felixcheung @Leemoonsoo Please help review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2283: [ZEPPELIN-2443] SSL Support for Groovy Interpre...
Github user dlukyanov closed the pull request at: https://github.com/apache/zeppelin/pull/2283 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2278: [ZEPPELIN-2431] Corrected deletion of notes by incorre...
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/2278 if no more opinions, i will merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2275: [ZEPPELIN-2442] button to create note into folder (nav...
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2275 @felixcheung added tooltip ![peek 2017-04-25 16-33](https://cloud.githubusercontent.com/assets/25951039/25383645/6c6c1a74-29d6-11e7-86e8-0e1244a2bad4.gif) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2283: [ZEPPELIN-2443] SSL Support for Groovy Interpre...
GitHub user dlukyanov opened a pull request: https://github.com/apache/zeppelin/pull/2283 [ZEPPELIN-2443] SSL Support for Groovy Interpreter HTTP requests ### What is this PR for? Target: Create ability to call http services with custom keystores in a groovy way. The following should work: ``` //connect to host xxx.yyy with special keystore HTTP.get( url: "https://xxx.yyy/zzz";, ssl: " HTTP.getKeystoreSSLContext('./xxx_yyy_keystore.jks', 'testpass') " ) //take context initialization code from groovy interpreter properties HTTP.get( url: "https://xxx.yyy/zzz";, ssl: g.SSL_CONTEXT_FROM_GROOVY_INTERPRET_PROPERTIES ) //connect to host xxx.yyy with trust all (do not check trust certificates - dev mode only) HTTP.get( url: "https://xxx.yyy/zzz";, ssl: " HTTP.getNaiveSSLContext() " ) // HTTP.get( url: "https://xxx.yyy/zzz";, ssl: " MyCustomSSLBuilder.build() " ) ``` ### What type of PR is it? Improvement ### Todos * [ ] - Task ### What is the Jira issue? [ZEPPELIN-2443] ### How should this be tested? follow the samples above or in documentation ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? YES You can merge this pull request into a Git repository by running: $ git pull https://github.com/dlukyanov/zeppelin master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2283.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2283 commit fa779ea5df077a746ed92c1e8f6e81fd98206560 Author: dlukyanov Date: 2017-03-14T20:00:13Z groovy interpreter commit db4c35be09349b5459c9af7a665b5d9edb371215 Author: dlukyanov Date: 2017-03-14T20:51:29Z Update README.md commit addf167f31fd0fec79625433c342c8fe12188da5 Author: dlukyanov Date: 2017-03-15T04:58:02Z retry commit aa427cdd88e859ba19bf67a81994792d364e1858 Author: dlukyanov Date: 2017-03-17T07:40:20Z retry commit 5fa26e00c3503afd6622809673030227cbb07519 Author: dlukyanov Date: 2017-03-19T07:48:53Z ZEPPELIN-2176 groovy interpreter, fix unchecked, add to configs, move HTTP.groovy to resources to simplify build, add default z-properties commit 2646fa8e48bf2c0025ed6d4fcad1ab10068fb33e Author: dlukyanov Date: 2017-03-19T07:55:29Z ZEPPELIN-2176 groovy interpreter, fix unchecked, add to configs, move HTTP.groovy to resources to simplify build, add default z-properties commit 0d7732a1f1cbffe1cba0f93da2346ea110385206 Author: dlukyanov Date: 2017-03-19T10:44:45Z retry commit b34b42ab5e01112590e653e47e0bf86459fac204 Author: dlukyanov Date: 2017-03-21T05:09:36Z retry commit dd388b3607246d80de61c0cd27e82a512ee7f2c7 Author: dlukyanov Date: 2017-03-21T18:26:20Z retry commit 41a17026ed03ae0b105a52c01812d487d91c06e3 Author: dlukyanov Date: 2017-03-25T22:06:51Z ZEPPELIN-2176 https://github.com/apache/zeppelin/pull/2135#issuecomment-288829494 - implement shared script variables - move docs - implement run methods commit 4abf649bda03b6e88c34c325940e9f4817de5c46 Author: dm Date: 2017-03-27T19:08:16Z Merge branch 'master' of https://github.com/apache/zeppelin commit a5b37a1099c5260f17f7eaf74516a3dae1c1a663 Author: dlukyanov Date: 2017-03-27T19:26:59Z ZEPPELIN-2176 https://github.com/apache/zeppelin/pull/2135#issuecomment-289308850 - Inside of docs directory, groovy.md will need some header to be compiled with Jekyll - Menu in docs also need link to groovy - .travis.yml we need add !groovy commit ca8bea69516ca66300f6f8898a99e4fe1694cfd9 Author: dlukyanov Date: 2017-03-27T19:36:30Z Update groovy.md commit fe08159e89388e5dafeec415719bb8fdf8a5892e Author: dlukyanov Date: 2017-03-27T20:36:06Z retry commit 3dd53e2586b119f633c9f33130a4ca360eb7108f Author: dlukyanov Date: 2017-03-29T19:17:11Z ZEPPELIN-2176 comments from @AhyoungRyu - Zeppelin follows Google Java code - interpreter alphabetical order in _navigation.html - direct link to MarkupBuilder in groovy help commit ca6594705773e837a8dca31638c89687d7211b2f Author: dlukyanov Date: 2017-03-29T19:45:30Z deprecated commit 89c3ed5c10ab1f2392cc44cbe14aeb2787f47942 Author: dlukyanov Date: 2017-03-29T21:37:22Z retry commit faf213fee422fb561bd35584cb8ad40cfe4160d9 Author: dlukyanov Date: 2017-03-30T17:29:00Z ZEPPELIN-2176 comments from @AhyoungRyu - remove @author - remove commented code commit 87de2f0a214cc4564e8589a96715d51da7e89ab2 Author: dlukyanov Date: 2017-04-21T11:50:01Z ZEPPELIN-2443 commit ec334a33e024595f4457ac10edaa3c7bcda5b922 Author: dlukyanov Date: 2017-04-
[GitHub] zeppelin pull request #1455: ZEPPELIN-1484 Organize env.sh and site.xml conf...
Github user r-kamath closed the pull request at: https://github.com/apache/zeppelin/pull/1455 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #470: Add more unit tests for notebook controller
Github user r-kamath closed the pull request at: https://github.com/apache/zeppelin/pull/470 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2239: Show dialog if owners field set to be empty on shiro
Github user khalidhuseynov commented on the issue: https://github.com/apache/zeppelin/pull/2239 @soralee it's disappearance is based on multi-user logic and it's correct since if note have `owners`, `readers`, `writers` as `user1` it doesn't have anything to do in `admin`'s list. That's why I was telling that not sure that this PR makes sense, because of intervening into that flow. From another point when creating note, it's `owner` is automatically assigned as current user without asking as well, so I think having already existing logic and assigning current user as owner (unless having admin feature) is fine, and we don't need much changes on it for now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2239: Show dialog if owners field set to be empty on shiro
Github user soralee commented on the issue: https://github.com/apache/zeppelin/pull/2239 @khalidhuseynov thanks for checking it really! You're right! I think so too! this should be considered. Furthermore, I checked above steps which I addressed, I saw that zeppelin run strange operation. Let me improve it so that it does not disappear. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2239: Show dialog if owners field set to be empty on shiro
Github user khalidhuseynov commented on the issue: https://github.com/apache/zeppelin/pull/2239 @soralee yeah the steps are correct. so if you follow those steps and click `Save`, say for `Note A`, then `Note A` will disappear from the list of your notes, and then you will not have permissions to view `Note A` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2282: Fix python interpreter as to use max result setting
Github user paularmand commented on the issue: https://github.com/apache/zeppelin/pull/2282 Ready for review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2282: fix python interpreter as to use max result set...
GitHub user paularmand opened a pull request: https://github.com/apache/zeppelin/pull/2282 fix python interpreter as to use max result setting ### What is this PR for? zeppelin_python.py used a hard-coded 1000 rows limit when returning results. This PR makes sure that the interpreter retrieves the max_results from PythonInterpreter.java and that the latter retrieves this configuration from the configuration via the properties object. ### What type of PR is it? Bug Fix ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2447 ### How should this be tested? + use %python interpreter + make a dataframe with more than a 1000 rows + z.show the dataframe + export it in csv + the numbers of rows should exceed 1000 rows ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/paularmand/zeppelin python_interpreter_max_results Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2282.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2282 commit 507c6e88ea2e0d5410cf02c20a177b8b0e93b2f6 Author: Paul-Armand Verhaegen Date: 2017-04-25T08:10:19Z fix python interpreter as to use max result setting --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Travis jobs
Hi devs! Does anybody know what is the purpose of the second Travis job? I thought it should run all core unit tests but I found that it doesn't run anything. Actually it runs 5 integration tests from org.apache.zeppelin.integration package but all of them are skipped because of TEST_SELENIUM=false. As a result we have zeppelin-server unit tests which don't used at all (in any of Travis jobs). I guess that it is because of the exclamation mark in "-Dtest" property: -Dtest='!ZeppelinSparkClusterTest,!org.apache.zeppelin.spark.*' which is not supported by maven-surefire-plugin of version 2.17 (which is used in Zeppelin). Exclamation mark is supported started from 2.19 but still does not work properly. Instead of this we can use surefire "exclude" property in pom.xml by passing parameter from command line: .travis.yaml: -Dtests.to.exclude='ZeppelinSparkClusterTest,org.apache.zeppelin.spark.*' pom.xml: ${tests.to.exclude} So should we run all core unit tests in the second Travis job or not? Regards, Alexander
[jira] [Created] (ZEPPELIN-2449) pyspark kafka streaming second run error
Jeon ChangBae created ZEPPELIN-2449: --- Summary: pyspark kafka streaming second run error Key: ZEPPELIN-2449 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2449 Project: Zeppelin Issue Type: Bug Components: pySpark Affects Versions: 0.7.1 Reporter: Jeon ChangBae run after stop(second run) below code, I have bleow message. %spark.pyspark #from pyspark import SparkContext from pyspark.streaming import StreamingContext from pyspark.streaming.kafka import KafkaUtils ssc = StreamingContext(sc, 3) kvs = KafkaUtils.createDirectStream(ssc, ['fw'], {"metadata.broker.list": 'queue:9200'}) lines = kvs.map(lambda x: x[1]) counts = lines.flatMap(lambda line: line.split(" ")) \ .map(lambda word: (word, 1)) \ .reduceByKey(lambda a, b: a+b) counts.pprint() ssc.start() try: ssc.awaitTermination() except KeyboardInterrupt: ssc.stop() Traceback (most recent call last): File "/tmp/zeppelin_pyspark-5081537614820689398.py", line 325, in sc.setJobGroup(jobGroup, "Zeppelin") File "/opt/zeppelin-0.7.1-bin-all/interpreter/spark/pyspark/pyspark.zip/pyspark/context.py", line 902, in setJobGroup self._jsc.setJobGroup(groupId, description, interruptOnCancel) AttributeError: 'NoneType' object has no attribute 'setJobGroup' -- This message was sent by Atlassian JIRA (v6.3.15#6346)