[jira] [Created] (ZEPPELIN-2508) [TABLE] Persist column type and sort config
Hoon Park created ZEPPELIN-2508: --- Summary: [TABLE] Persist column type and sort config Key: ZEPPELIN-2508 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2508 Project: Zeppelin Issue Type: Bug Components: front-end Reporter: Hoon Park Should persist column type (text, numeric, date) and sort (increasing, decreasing, none) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2507) [TABLE] dropdown button for table column name should not be {{display: block}}
Hoon Park created ZEPPELIN-2507: --- Summary: [TABLE] dropdown button for table column name should not be {{display: block}} Key: ZEPPELIN-2507 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2507 Project: Zeppelin Issue Type: Bug Reporter: Hoon Park Attachments: screenshot-1.png dropdown button for table column name should not be {{display: block}}. I attached a screenshot. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2506) "Interpreter null not found" when a note is not bound to any interpreters
Ruslan Dautkhanov created ZEPPELIN-2506: --- Summary: "Interpreter null not found" when a note is not bound to any interpreters Key: ZEPPELIN-2506 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2506 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1, 0.7.2, 0.8.0 Reporter: Ruslan Dautkhanov When we setup a new user or upgrade a note, interpreter.json file is copied from a template file. So "interpreterBindings" is empty or irrelevant to notes that an upgraded user has. It causes following exception: {noformat} org.apache.zeppelin.interpreter.InterpreterException: paragraph_1491878547585_-790720711's Interpreter null not found at org.apache.zeppelin.notebook.Note.run(Note.java:625) at org.apache.zeppelin.socket.NotebookServer.persistAndExecuteSingleParagraph(NotebookServer.java:1781) at org.apache.zeppelin.socket.NotebookServer.runParagraph(NotebookServer.java:1741) at org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:288) {noformat} It would be better to show error message *that the note is not bound to any notes, and not let execute any paragraphs until this is fixed*. If a paragraph has an explicit interpreter type defined, then this error is slightly different but this does not change the matter {noformat} paragraph_1491878547585_-790720711's Interpreter pyspark not found org.apache.zeppelin.interpreter.InterpreterException: paragraph_1491878547585_-790720711's Interpreter pyspark not found at org.apache.zeppelin.notebook.Note.run(Note.java:625) at org.apache.zeppelin.socket.NotebookServer.persistAndExecuteSingleParagraph(NotebookServer.java:1781) at org.apache.zeppelin.socket.NotebookServer.runParagraph(NotebookServer.java:1741) at org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:288) at org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:59) at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128) at org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69) at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65) at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122) at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161) at org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309) at org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214) at org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220) at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258) at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632) at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2503) The title of linked paragraphs is misaligned and not bold
Danish Khan created ZEPPELIN-2503: - Summary: The title of linked paragraphs is misaligned and not bold Key: ZEPPELIN-2503 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2503 Project: Zeppelin Issue Type: Bug Components: GUI Affects Versions: 0.7.2 Reporter: Danish Khan The title of a paragraph appears fine in editable notebook. (Note it is bold) https://ibb.co/eCFcD5 However, when these paragraphs are linked, and opened separately in the iFrame, the title is misaligned and unpronounced. https://ibb.co/j2vimQ Expected behavior: The linked paragraph title should be properly aligned, and should be bold, so it's pronounced just as in editable notebook. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Re: Add a dependency in pom.xml of zeppelin-sever.
That should be fine, we could discuss it in your PR. Kang Minwoo于2017年5月5日周五 上午10:51写道: > I use it for Implementation OAuth2 > > Best Regard, > Minwoo Kang > > _ > From: Jianfeng (Jeff) Zhang > > Sent: 목요일, 5월 4, 2017 10:08 오후 > Subject: Re: Add a dependency in pom.xml of zeppelin-sever. > To: > > > > > Can you describe for what purpose ? > > > Best Regard, > Jeff Zhang > > > > > > On 5/4/17, 8:11 PM, "Kang Minwoo" > wrote: > > >Hello > > > >Can I add a dependency in pom.xml of zeppelin-sever? > >Is there any rule? > > > >Best regards, > >Minwoo Kang > > > >Best regards, > >Minwoo Kang > > > >
Re: Add a dependency in pom.xml of zeppelin-sever.
I use it for Implementation OAuth2 Best Regard, Minwoo Kang _ From: Jianfeng (Jeff) Zhang> Sent: 목요일, 5월 4, 2017 10:08 오후 Subject: Re: Add a dependency in pom.xml of zeppelin-sever. To: > Can you describe for what purpose ? Best Regard, Jeff Zhang On 5/4/17, 8:11 PM, "Kang Minwoo" > wrote: >Hello > >Can I add a dependency in pom.xml of zeppelin-sever? >Is there any rule? > >Best regards, >Minwoo Kang > >Best regards, >Minwoo Kang
[GitHub] zeppelin pull request #2322: [ZEPPELIN-2502] RemoteInterpreterServer hang fo...
GitHub user andreaTP opened a pull request: https://github.com/apache/zeppelin/pull/2322 [ZEPPELIN-2502] RemoteInterpreterServer hang forever during shutdown ### What is this PR for? There is the chance to have a RemoteServerInterpreter hang forever during shutdown ### What type of PR is it? [Bug Fix] ### What is the Jira issue? [ZEPPELIN-2502] ### How should this be tested? Unit test provided for the fix. ### Questions: * Is there breaking changes for older versions? * Does this needs documentation? You can merge this pull request into a Git repository by running: $ git pull https://github.com/nokia/zeppelin processHang Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2322.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2322 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-2502) RemoteInterpreterServer hang forever during shutdown
Andrea Peruffo created ZEPPELIN-2502: Summary: RemoteInterpreterServer hang forever during shutdown Key: ZEPPELIN-2502 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2502 Project: Zeppelin Issue Type: Bug Components: zeppelin-interpreter Affects Versions: 0.7.1, 0.7.0, 0.7.2, 0.8.0 Reporter: Andrea Peruffo TL;DR; there is the opportunity that RemoteServerInterpreter does never terminate during shutdown causing zombies JVMs around. a proper Unit test is provided here: https://github.com/nokia/zeppelin/blob/35161ba8595782275a1f597f9267a92c226a6cc9/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterServerTest.java#L92 VERSION: bug detected on 0.7.0 but applicable on master DETAILED: I was digging a problem with zombie JVM process caused by the interaction of long running Spark jobs in the cluster and Spark interpreter restarts done via UI. I managed to reproduce a scenario where a SparkSubmit process never ends, and analyzing the stack trace I ended up finding potential conditions where I can have zombies in RemoteInterpreter. I'm still not 100% sure this will solve but it is anyhow a fix to a bug that can manifest itself sooner or later. My stack trace of the hanging process was: Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.31-b07 mixed mode): "Attach Listener" #118 daemon prio=9 os_prio=0 tid=0x7fb03c001000 nid=0x104e waiting on condition [0x] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "pool-2-thread-6" #114 prio=5 os_prio=0 tid=0x7fb00c004000 nid=0xe52 waiting on condition [0x7faf963c1000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0xc00da470> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Locked ownable synchronizers: - None "pool-2-thread-5" #108 prio=5 os_prio=0 tid=0x7fb01403d000 nid=0xd8d waiting on condition [0x7faf966c4000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0xc00da470> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Locked ownable synchronizers: - None "pool-2-thread-4" #107 prio=5 os_prio=0 tid=0x7fb01403c000 nid=0xd8c in Object.wait() [0x7faf967c5000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.zeppelin.scheduler.FIFOScheduler.run(FIFOScheduler.java:112) - locked <0xdc206700> (a java.util.LinkedList) - locked <0xdc206700> (a java.util.LinkedList) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at
[GitHub] zeppelin issue #2288: [ZEPPELIN-2452] block update paragraph event on revisi...
Github user khalidhuseynov commented on the issue: https://github.com/apache/zeppelin/pull/2288 I think this and #2289 are required in `branch-0.7` as well, isn't it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2321: [ZEPPELIN-2498] add more info and config for Ld...
GitHub user khalidhuseynov opened a pull request: https://github.com/apache/zeppelin/pull/2321 [ZEPPELIN-2498] add more info and config for Ldap authentication ### What is this PR for? This is to add some necessary configs for ldap authentication. ### What type of PR is it? Improvement |Documentation ### Todos * [x] - add system user and security manager info * [ ] - address feedback ### What is the Jira issue? [ZEPPELIN-2498](https://issues.apache.org/jira/browse/ZEPPELIN-2498) ### How should this be tested? 1. copy `conf/shiro.ini.template` into `conf/shiro.ini` 2. fill out the fields for `LdapGroupRealm` in `shiro.ini` with info from your ldap server 3. login with your own ldap credentials ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/khalidhuseynov/zeppelin fix/ZEPPELIN-2498 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2321.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2321 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2292: [HOTFIX] Remove adduser while creating note
GitHub user jongyoul reopened a pull request: https://github.com/apache/zeppelin/pull/2292 [HOTFIX] Remove adduser while creating note ### What is this PR for? Adding user paragraph while creating paragraph makes default paragraph and user paragraph have same reference. It breaks personalized mode works well. ### What type of PR is it? [Bug Fix | Hot Fix] ### Todos * [x] - Remove `addUser` from `createParagraph` * [x] - Add test case for it ### What is the Jira issue? N/A ### How should this be tested? N/A ### Screenshots (if appropriate) N/A ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/jongyoul/zeppelin hotfix/remove-wrong-adduser-and-add-testcase Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2292.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2292 commit 6ed521a4ba78e736edd0d491e57fa655fc831955 Author: Jongyoul LeeDate: 2017-04-26T17:01:23Z Removed adduser while creating note Added test to guarantee paragraph.getUserParagraph is different from paragraph itself --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2292: [HOTFIX] Remove adduser while creating note
Github user jongyoul closed the pull request at: https://github.com/apache/zeppelin/pull/2292 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2318: [ZEPPELIN-2492] Use single Dockerfile for each ...
Github user 1ambda closed the pull request at: https://github.com/apache/zeppelin/pull/2318 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2318: [ZEPPELIN-2492] Use single Dockerfile for each ...
GitHub user 1ambda reopened a pull request: https://github.com/apache/zeppelin/pull/2318 [ZEPPELIN-2492] Use single Dockerfile for each tag ### What is this PR for? Use single `Dockerfile` for each release since [apache infra uses tag pushes](https://issues.apache.org/jira/browse/INFRA-12781) to build an image. - https://issues.apache.org/jira/browse/INFRA-12781 After release process finishes, dockerhub will build using the pushed tag. ### What type of PR is it? [Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? [ZEPPELIN-2492](https://issues.apache.org/jira/browse/ZEPPELIN-2492) ### How should this be tested? 1. `./dev/change_zeppelin_version.sh 0.8.0-SNAPSHOT 0.7.1` 2. Check that version is properly set: `vi scrtips/docker/zeppelin/bin/Dockerfile` 3. Build docker image `cd scripts/docker/zeppelin/bin; docker build -t zeppelin:0.7.1 ./` 4. Run the image: `docker run -p 8080:8080 --rm --name zeppelin zeppelin:0.7.1` ### Screenshots (if appropriate) NONE ### Questions: * Does the licenses files need update? - NO * Is there breaking changes for older versions? - NO * Does this needs documentation? - NO You can merge this pull request into a Git repository by running: $ git pull https://github.com/1ambda/zeppelin ZEPPELIN-2492/use-single-dockerfile-for-each-tag Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2318.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2318 commit 5826c8ccb71cd737df3dc9f680c421ab681529d5 Author: 1ambda <1am...@gmail.com> Date: 2017-05-04T07:26:55Z fix: Use single dockerfile for tag push commit 483bec35eb2dc043d27f36aa175f1234d1ed0756 Author: 1ambda <1am...@gmail.com> Date: 2017-05-04T07:29:13Z docs: Update README for Dockerfile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2271: [ZEPPELIN-2414] Memory leak under scoped mode of Spark...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/2271 You can close/reopen the issue to trigger Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2125: [ZEPPELIN-2222] Add Network Visualization
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2125 1. Regarding to `continuous-integration/appveyor/pr â AppVeyor build failed`, you should rebase. Since master has `.appvepor.yml` file. 2. In case of Jenkins, you are failing to profile 3 (selenium test) - [raw log](https://s3.amazonaws.com/archive.travis-ci.org/jobs/227364420/log.txt?X-Amz-Expires=30=20170504T121444Z=AWS4-HMAC-SHA256=AKIAJRYRXRSVGNKPKO5A/20170504/us-east-1/s3/aws4_request=host=1a7a934aff18da242587c547c957ace22807c6a84edcc70be96d48465c161611) ``` Tests in error: AuthenticationIT.testGroupPermission:190->AbstractZeppelinIT.pollingWait:94 û Timeout InterpreterIT.testShowDescriptionOnInterpreterCreate:69 û ElementNotVisible El... ``` They might be flaky tests. You can simply pass them by clicking `restart` button in travis. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Add a dependency in pom.xml of zeppelin-sever.
Hello Can I add a dependency in pom.xml of zeppelin-sever? Is there any rule? Best regards, Minwoo Kang Best regards, Minwoo Kang
[GitHub] zeppelin pull request #2288: [ZEPPELIN-2452] block update paragraph event on...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/2288 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2289: [ZEPPELIN-2452] Can not handle message in revis...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/2289 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-2499) Improve documentation for mapping LDAP/AD groups into Zeppelin roles
Khalid Huseynov created ZEPPELIN-2499: - Summary: Improve documentation for mapping LDAP/AD groups into Zeppelin roles Key: ZEPPELIN-2499 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2499 Project: Zeppelin Issue Type: Sub-task Reporter: Khalid Huseynov I think current documentation in https://zeppelin.apache.org/docs/0.7.0/security/shiroauthentication.html#groups-and-permissions-optional for mapping groups and permissions isn't clear enough. Need to add more connection to Zeppelin roles (e.g. readers, writers) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2498) Improve LDAP authentication related conf and documentation
Khalid Huseynov created ZEPPELIN-2498: - Summary: Improve LDAP authentication related conf and documentation Key: ZEPPELIN-2498 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2498 Project: Zeppelin Issue Type: Sub-task Reporter: Khalid Huseynov current documentation and conf/shiro.ini content isn't complete enough for straightforward usage of LDAP authentication. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2497) [Umbrella] Improve authentication/auhorization and other security related documentation
Khalid Huseynov created ZEPPELIN-2497: - Summary: [Umbrella] Improve authentication/auhorization and other security related documentation Key: ZEPPELIN-2497 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2497 Project: Zeppelin Issue Type: Task Reporter: Khalid Huseynov Assignee: Khalid Huseynov Current documentation for [authentication|https://zeppelin.apache.org/docs/0.7.0/security/shiroauthentication.html] and [authorisation|https://zeppelin.apache.org/docs/0.7.0/security/notebook_authorization.html] with different realms isn't complete and clear enough for straightforward use. So I think more setup parameters and documentation should be added -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2496) Error listing a HDFS directory with a large number of files
Victor Ferrer created ZEPPELIN-2496: --- Summary: Error listing a HDFS directory with a large number of files Key: ZEPPELIN-2496 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2496 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.1 Environment: Centos 7 - CDH 5 Reporter: Victor Ferrer Hi, I have noticed an incorrect behavior while using the HDFS (%file) interpreter. For instance, when I list this directory, I get the correct result: {noformat} %file ls -l /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=1 {noformat} {noformat} -rw-r--r-- 3hdfs supergroup 893762672017-05-03 12:29GMT /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=1/part-r-0-ac4e728a-332e-40ca-b42b-daaf783fe227.snappy.parquet -rw-r--r-- 3hdfs supergroup 885856752017-05-03 12:29GMT /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=1/part-r-1-ac4e728a-332e-40ca-b42b-daaf783fe227.snappy.parquet {noformat} However, when I switch to a bigger directory, I get an error stating that the directory could not be found: {noformat} %file ls -l /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2 {noformat} {noformat} Could not find file or directory: /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2 {noformat} If I dig in the logs, I get this error message: {noformat} ERROR [2017-05-04 12:05:44,910] ({pool-2-thread-14} HDFSFileInterpreter.java[listAll]:227) - listall: listDir /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2 com.google.gson.JsonSyntaxException: java.io.EOFException: End of input at line 1 column 311752 at com.google.gson.Gson.fromJson(Gson.java:800) at com.google.gson.Gson.fromJson(Gson.java:757) at com.google.gson.Gson.fromJson(Gson.java:706) at com.google.gson.Gson.fromJson(Gson.java:678) at org.apache.zeppelin.file.HDFSFileInterpreter.listAll(HDFSFileInterpreter.java:212) at org.apache.zeppelin.file.FileInterpreter.interpret(FileInterpreter.java:130) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:95) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:490) at org.apache.zeppelin.scheduler.Job.run(Job.java:175) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.EOFException: End of input at line 1 column 311752 at com.google.gson.stream.JsonReader.nextNonWhitespace(JsonReader.java:954) at com.google.gson.stream.JsonReader.nextInArray(JsonReader.java:677) at com.google.gson.stream.JsonReader.peek(JsonReader.java:376) at com.google.gson.stream.JsonReader.hasNext(JsonReader.java:349) at com.google.gson.internal.bind.ArrayTypeAdapter.read(ArrayTypeAdapter.java:71) at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93) at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172) at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93) at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172) at com.google.gson.Gson.fromJson(Gson.java:791) ... 16 more ERROR [2017-05-04 12:05:44,911] ({pool-2-thread-14} FileInterpreter.java[interpret]:133) - Error listing files in path /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2 org.apache.zeppelin.interpreter.InterpreterException: Could not find file or directory: /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2 at org.apache.zeppelin.file.HDFSFileInterpreter.listAll(HDFSFileInterpreter.java:228) at org.apache.zeppelin.file.FileInterpreter.interpret(FileInterpreter.java:130) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:95) at
[jira] [Created] (ZEPPELIN-2495) Support Oauth2
Minwoo Kang created ZEPPELIN-2495: - Summary: Support Oauth2 Key: ZEPPELIN-2495 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2495 Project: Zeppelin Issue Type: Improvement Reporter: Minwoo Kang Assignee: Minwoo Kang This issue is Supporting Oauth2. Many enterprises use Oauth2 for authorization. If Oauth2 were supported, It is easy to integrate In-house system. If you have any idea to this issue, please leave a message. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zeppelin issue #2125: [ZEPPELIN-2222] Add Network Visualization
Github user conker84 commented on the issue: https://github.com/apache/zeppelin/pull/2125 i tried but it still fails... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2182: [HOLD][ZEPPELIN-2248] Fix javax.ws.rs and cxf version ...
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2182 @sohaibiftikhar Sorry for confusing you. I didn't know #932 set the CI. Please test it with that PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/932 @echarles Sorry, I haven't checked it correctly. Thanks for checking it again. I'll test it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]
Github user echarles commented on the issue: https://github.com/apache/zeppelin/pull/932 Jenkins build is now green. @jongyoul @bzz Any other inputs/questions on this PR ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2182: [HOLD][ZEPPELIN-2248] Fix javax.ws.rs and cxf version ...
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2182 @sohaibiftikhar #932 didn't adopt CI then you'd better test this build and fix some minor issues from it. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2320: [MINOR] Move remoteinterpreter into zengine
GitHub user jongyoul opened a pull request: https://github.com/apache/zeppelin/pull/2320 [MINOR] Move remoteinterpreter into zengine ### What is this PR for? RemoteInterpreter is only used in the server side then zeppelin-interpreter doesn't have to include this class. Moving this class helps to reduce interpreter binary size and change RemoteInterpreter without adding more dependencies if we want ### What type of PR is it? [Refactoring] ### Todos * [x] - Move RemoteInterpreter and related files out of zeppelin-interpreter module ### What is the Jira issue? N/A ### How should this be tested? N/A ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/jongyoul/zeppelin minor/move-remoteinterpreter-into-zengine Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2320.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2320 commit 7e8721592d13c782d9028b6c52f4360980eb7d02 Author: Jongyoul LeeDate: 2017-05-03T16:39:21Z move some files of remote packages from zeppelin-interpreter to zeppelin-zengine commit b7e0b9436a55a2251af637b976222b7333556296 Author: Jongyoul Lee Date: 2017-05-04T08:15:45Z moved some files related remote interpreter and fix some minor things commit 0a881c1b3869e5005a99f55eae177caf5a85ee13 Author: Jongyoul Lee Date: 2017-05-04T08:20:28Z Removed unused package imported Removed unnecessary classes imported --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2319: [ZEPPELIN-2437] Executions of notebooks are blo...
GitHub user hammertank opened a pull request: https://github.com/apache/zeppelin/pull/2319 [ZEPPELIN-2437] Executions of notebooks are blocked after running 50 different notebooks under SparkInterpreter scoped mode ### What is this PR for? Removes Scheduler when RemoteInterpreterServer close an interpreter. ### What type of PR is it? [Bug Fix] ### Todos * [x] - Removes Scheduler when calling RemoteInterpreterServer.close() ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2437 ### How should this be tested? RemoteInterpreterServerTest#testClose(TBD) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/hammertank/zeppelin ZEPPELIN-2437 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2319.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2319 commit d5a3ffa94e56d45534caedf71e7adfd7b70c8bf4 Author: Jeff ZhangDate: 2017-03-22T07:19:42Z [HOTFIX][ZEPPELIN-2294]. Interpreter fail exception is not propagated to frontend ### What is this PR for? This PR would address the issue of Interpreter fail exception is not propagated to frontend. This is due to the bug fix of restarting button issue. Make referenceCount as number of sessions attached to this process. Open and close all the interpreters in one session together. I don't think there's scenario for close a single interpreter for now. ### What type of PR is it? [Bug Fix | Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2294 ### How should this be tested? I don't have time to write test, just verify zombie process issue manually in the following scenario * Per User + Isolated * Per Note + Isolated * Per User + Scoped * Per Note + Scoped ### Screenshots (if appropriate) Before ![2017-03-22_1538](https://cloud.githubusercontent.com/assets/164491/24198052/227d42e6-0f3f-11e7-9918-bf9827e44f92.png) After ![2017-03-22_1523](https://cloud.githubusercontent.com/assets/164491/24198062/31043cc0-0f3f-11e7-8ab3-87938e3918ce.png) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #2175 from zjffdu/ZEPPELIN-2294 and squashes the following commits: a3f8aa0b [Jeff Zhang] [ZEPPELIN-2294]. Interpreter fail exception is not propagated to frontend (cherry picked from commit 0aea2416dc60fb6e2e181ee1c593d9d2c575bcb7) Signed-off-by: Jongyoul Lee (cherry picked from commit ddf2378) commit 4a4aea3686d2e0445f066127db9f95c300cece7e Author: z0621 Date: 2017-05-04T07:12:04Z Remove Scheduler when Interpreter is closed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-2494) API Display Type
Eric Charles created ZEPPELIN-2494: -- Summary: API Display Type Key: ZEPPELIN-2494 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2494 Project: Zeppelin Issue Type: New Feature Components: zeppelin-zengine Reporter: Eric Charles A recurring request goes around automation where users are willing to use the notebook in a scheduled tool. This means also that the output of the notes have to be processed by some software. To indicate an output to be processed by a tool, we should produced structured content, in other words JSON. The current output (DisplayType) are TEXT, HTML, TABLE... but nothing is forseen for JSON. I propose to add a type API (because %json is already taken by a spell, and anyway API better indicates the intent). -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zeppelin pull request #2318: [ZEPPELIN-2492] Use single Dockerfile for each ...
GitHub user 1ambda opened a pull request: https://github.com/apache/zeppelin/pull/2318 [ZEPPELIN-2492] Use single Dockerfile for each tag ### What is this PR for? Use single `Dockerfile` for each release since [apache infra uses tag pushes](https://issues.apache.org/jira/browse/INFRA-12781) to build an image. - https://issues.apache.org/jira/browse/INFRA-12781 After release process finishes, dockerhub will build using the pushed tag. ### What type of PR is it? [Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? [ZEPPELIN-2492](https://issues.apache.org/jira/browse/ZEPPELIN-2492) ### How should this be tested? 1. `./dev/change_zeppelin_version.sh 0.8.0-SNAPSHOT 0.7.1` 2. Check that version is properly set: `vi scrtips/docker/zeppelin/bin/Dockerfile` 3. Build docker image `cd scripts/docker/zeppelin/bin; docker build -t zeppelin:0.7.1 ./` 4. Run the image: `docker run -p 8080:8080 --rm --name zeppelin zeppelin:0.7.1` ### Screenshots (if appropriate) NONE ### Questions: * Does the licenses files need update? - NO * Is there breaking changes for older versions? - NO * Does this needs documentation? - NO You can merge this pull request into a Git repository by running: $ git pull https://github.com/1ambda/zeppelin ZEPPELIN-2492/use-single-dockerfile-for-each-tag Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2318.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2318 commit 5826c8ccb71cd737df3dc9f680c421ab681529d5 Author: 1ambda <1am...@gmail.com> Date: 2017-05-04T07:26:55Z fix: Use single dockerfile for tag push commit 483bec35eb2dc043d27f36aa175f1234d1ed0756 Author: 1ambda <1am...@gmail.com> Date: 2017-05-04T07:29:13Z docs: Update README for Dockerfile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2271: [ZEPPELIN-2414] Memory leak under scoped mode of Spark...
Github user hammertank commented on the issue: https://github.com/apache/zeppelin/pull/2271 @Leemoonsoo re-commit as required. Please review again. Jenkins did not get the final travis-ci results successfully. Is there a way to trigger Jenkins to fetch again without a push? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2274: [ZEPPELIN-2388] Improve the keyboard shortcuts dialog
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2274 need to be rebased to make CI green. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---