[jira] [Created] (ZEPPELIN-6019) Remove submarine
Jongyoul Lee created ZEPPELIN-6019: -- Summary: Remove submarine Key: ZEPPELIN-6019 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6019 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee https://lists.apache.org/thread/lzh28tn4psfbtp8ooc4ftw3rc9m949cn -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6009) Remove Shell interpreter and its tests
Jongyoul Lee created ZEPPELIN-6009: -- Summary: Remove Shell interpreter and its tests Key: ZEPPELIN-6009 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6009 Project: Zeppelin Issue Type: Task Components: Interpreters, shell Reporter: Jongyoul Lee Assignee: Jongyoul Lee -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5998) Verify executables
Jongyoul Lee created ZEPPELIN-5998: -- Summary: Verify executables Key: ZEPPELIN-5998 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5998 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee Zeppelin uses pre-installed executables when running it. It would be good to check if executables are not infected. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5994) Fix cron tests for ZeppelinRestApiTest
Jongyoul Lee created ZEPPELIN-5994: -- Summary: Fix cron tests for ZeppelinRestApiTest Key: ZEPPELIN-5994 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5994 Project: Zeppelin Issue Type: Task Affects Versions: 0.11.1 Reporter: Jongyoul Lee For security, the cron feature will be disabled in anonymous mode. it tests in ZeppelinRestApiTest without authentication mode. I disabled them first and will fix them -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5990) Disable sesitive configuration for JDBC url
Jongyoul Lee created ZEPPELIN-5990: -- Summary: Disable sesitive configuration for JDBC url Key: ZEPPELIN-5990 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5990 Project: Zeppelin Issue Type: Task Affects Versions: 0.10.1, 0.11.0 Reporter: Jongyoul Lee Assignee: Jongyoul Lee Fix For: 0.11.1, 0.12.0 Some JDBC configurations may make potential security issues so I want to disable the configurations. ref. https://github.com/apache/dolphinscheduler/blob/dev/dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-mysql/src/main/java/org/apache/dolphinscheduler/plugin/datasource/mysql/param/MySQLDataSourceProcessor.java -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5957) Move gh-pages branch to zeppelin-site repository
Jongyoul Lee created ZEPPELIN-5957: -- Summary: Move gh-pages branch to zeppelin-site repository Key: ZEPPELIN-5957 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5957 Project: Zeppelin Issue Type: Task Components: zeppelin-site-repo Reporter: Jongyoul Lee https://github.com/apache/zeppelin-site -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5956) Separate cluster manager to extra profile
Jongyoul Lee created ZEPPELIN-5956: -- Summary: Separate cluster manager to extra profile Key: ZEPPELIN-5956 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5956 Project: Zeppelin Issue Type: Task Components: Interpreters, zeppelin-server Affects Versions: 0.10.1 Reporter: Jongyoul Lee Deactivate cluster manager by default because it's not managed well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5876) Reimplement `isAlive()` for `ProcessLauncher`
Jongyoul Lee created ZEPPELIN-5876: -- Summary: Reimplement `isAlive()` for `ProcessLauncher` Key: ZEPPELIN-5876 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5876 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Currently, `ProcessLauncher` has a basic implementation for `isAlive()` method as it's only being used in Test. It should be implemented again for returning correct status. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5875) Flaky test `TimeoutLifecycleManagerTest`
Jongyoul Lee created ZEPPELIN-5875:
--
Summary: Flaky test `TimeoutLifecycleManagerTest`
Key: ZEPPELIN-5875
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5875
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.10.1
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
```
INFO [2022-11-29 16:31:56,067] (\{main}
TimeoutLifecycleManagerTest.java[testTimeout_2]:125) - Wait for interpreter to
be started
WARN [2022-11-29 16:31:56,177] (\{Exec Default Executor}
ExecRemoteInterpreterProcess.java[onProcessComplete]:226) - Process is exited
with exit value 0
INFO [2022-11-29 16:31:56,177] (\{Exec Default Executor}
ProcessLauncher.java[transition]:109) - Process state is transitioned to
COMPLETED
INFO [2022-11-29 16:31:57,067] (\{main}
TimeoutLifecycleManagerTest.java[testTimeout_2]:125) - Wait for interpreter to
be started
INFO [2022-11-29 16:31:58,068] (\{main}
TimeoutLifecycleManagerTest.java[testTimeout_2]:125) - Wait for interpreter to
be started
INFO [2022-11-29 16:31:59,068] (\{main}
TimeoutLifecycleManagerTest.java[testTimeout_2]:125) - Wait for interpreter to
be started
INFO [2022-11-29 16:32:00,069] (\{main}
TimeoutLifecycleManagerTest.java[testTimeout_2]:125) - Wait for interpreter to
be started
INFO [2022-11-29 16:32:01,069] (\{main}
TimeoutLifecycleManagerTest.java[testTimeout_2]:125) - Wait for interpreter to
be started
INFO [2022-11-29 16:32:02,070] (\{main}
TimeoutLifecycleManagerTest.java[testTimeout_2]:125) - Wait for interpreter to
be started
INFO [2022-11-29 16:32:03,070] (\{main}
TimeoutLifecycleManagerTest.java[testTimeout_2]:125) - Wait for interpreter to
be started
```
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5866) Divide checkstyle goal from verify goal
Jongyoul Lee created ZEPPELIN-5866: -- Summary: Divide checkstyle goal from verify goal Key: ZEPPELIN-5866 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5866 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Assignee: Jongyoul Lee Currently `checkstyle` is included in `verify` step. It's useful in general but sometimes, we cannot catch what error exactly happens by flaky tests. I think it would be helpful to make it a separate task to check style only -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5864) Clean up scala complie options
Jongyoul Lee created ZEPPELIN-5864: -- Summary: Clean up scala complie options Key: ZEPPELIN-5864 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5864 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Simplify and merge several scala options -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5860) Update maven-checkstyle-plugin to 3.2.0
Jongyoul Lee created ZEPPELIN-5860: -- Summary: Update maven-checkstyle-plugin to 3.2.0 Key: ZEPPELIN-5860 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5860 Project: Zeppelin Issue Type: Improvement Components: CI-infra Reporter: Jongyoul Lee Assignee: Jongyoul Lee The current version of maven-checkstyle-plugin is 2.17 which is from 2015. I would like to add a new feature including disallowing multiple empty lines so I'll update it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5727) Remove hadoop dependency on zeppelin-server's LdapRealm
Jongyoul Lee created ZEPPELIN-5727: -- Summary: Remove hadoop dependency on zeppelin-server's LdapRealm Key: ZEPPELIN-5727 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5727 Project: Zeppelin Issue Type: Improvement Components: zeppelin-server Reporter: Jongyoul Lee Assignee: Jongyoul Lee Current LDAP Realm uses Hadoop's Credential provider but it's a wrapper of java.security.keystore. I'll replace it to use java.security package directly in order to remove dependency of Hadoop common -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (ZEPPELIN-5726) Default AuthenticationService
Jongyoul Lee created ZEPPELIN-5726: -- Summary: Default AuthenticationService Key: ZEPPELIN-5726 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5726 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee Assignee: Jongyoul Lee -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (ZEPPELIN-5725) Remove anonymous mode
Jongyoul Lee created ZEPPELIN-5725: -- Summary: Remove anonymous mode Key: ZEPPELIN-5725 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5725 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (ZEPPELIN-5723) Remove Kylin interpreter
Jongyoul Lee created ZEPPELIN-5723: -- Summary: Remove Kylin interpreter Key: ZEPPELIN-5723 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5723 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee Assignee: Jongyoul Lee https://wiki.apache.org/confluence/display/ZEPPELIN/Interpreter+Maintenance -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (ZEPPELIN-5627) Revmoe Angular interpreter
Jongyoul Lee created ZEPPELIN-5627: -- Summary: Revmoe Angular interpreter Key: ZEPPELIN-5627 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5627 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee https://cwiki.apache.org/confluence/display/ZEPPELIN/Interpreter+Maintenance -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (ZEPPELIN-5623) Remove Lens interpreters
Jongyoul Lee created ZEPPELIN-5623: -- Summary: Remove Lens interpreters Key: ZEPPELIN-5623 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5623 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee The project was retired. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (ZEPPELIN-5537) Remove code for ZeppelinHub
Jongyoul Lee created ZEPPELIN-5537: -- Summary: Remove code for ZeppelinHub Key: ZEPPELIN-5537 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5537 Project: Zeppelin Issue Type: Task Affects Versions: 0.10.0 Reporter: Jongyoul Lee Assignee: Jongyoul Lee Fix For: 0.11.0 Attachments: image-2021-09-24-21-06-55-346.png ZeppelinHub([http://www.zeppelinhub.com)|http://www.zeppelinhub.com%29/] is no longer available and the code uses test code in a production environment. I think it would be better to remove that code in order to simplify the whole code. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-5535) Replace `NotebookSocket` with `javax.websocket.Session`
Jongyoul Lee created ZEPPELIN-5535: -- Summary: Replace `NotebookSocket` with `javax.websocket.Session` Key: ZEPPELIN-5535 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5535 Project: Zeppelin Issue Type: Improvement Components: Core Affects Versions: 0.10.0 Reporter: Jongyoul Lee Assignee: Jongyoul Lee NotebookSocket is being used to wrarp Websocket session created by Jetty. It depends on Jetty itself so I would like to change it to use JSR356 in order to remove tight dependency against Jetty. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-5527) Remove the dependency of `zeppelin-markdown` from `zeppelin-jupyter`
Jongyoul Lee created ZEPPELIN-5527: -- Summary: Remove the dependency of `zeppelin-markdown` from `zeppelin-jupyter` Key: ZEPPELIN-5527 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5527 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Assignee: Jongyoul Lee Supporting `ipynb` by `zeppelin-jupyter` uses `markdown` modules in order to parse markdown paragraph. It looks reasonable but it makes confusions between modules. E.g. `zeppelin-server` depends on `zeppelin-jupyter` so `markdown` is included in `zeppelin-server`. To simplify it, we'd better remove the dependency and implement it directly. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-5518) Change jetty's websocket to JSR356
Jongyoul Lee created ZEPPELIN-5518: -- Summary: Change jetty's websocket to JSR356 Key: ZEPPELIN-5518 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5518 Project: Zeppelin Issue Type: Improvement Components: Core Reporter: Jongyoul Lee Assignee: Jongyoul Lee -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4999) Simplify InterpreterSettingManager by dividing features
Jongyoul Lee created ZEPPELIN-4999: -- Summary: Simplify InterpreterSettingManager by dividing features Key: ZEPPELIN-4999 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4999 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Assignee: Jongyoul Lee -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4998) Move to a new CI
Jongyoul Lee created ZEPPELIN-4998: -- Summary: Move to a new CI Key: ZEPPELIN-4998 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4998 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4126) Add audit log
Jongyoul Lee created ZEPPELIN-4126: -- Summary: Add audit log Key: ZEPPELIN-4126 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4126 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Zeppelin doesn't have auditing features at all. This leaves scripts that users execute with a different logger. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4093) Replace some listeners and callback to use queue
Jongyoul Lee created ZEPPELIN-4093: -- Summary: Replace some listeners and callback to use queue Key: ZEPPELIN-4093 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4093 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Assignee: Jongyoul Lee Zeppelin has many listeners and callbacks to communicate with components and pass the behaviors to other components. This makes hard to read the code and predict behaviors. It would be better to use queues in order to pass messages to other components and websockets as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4064) Add Appveyor to support Windows environment
Jongyoul Lee created ZEPPELIN-4064: -- Summary: Add Appveyor to support Windows environment Key: ZEPPELIN-4064 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4064 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.8.1 Reporter: Jongyoul Lee Some issues related to instability in Windows environment were reported after releasing 0.8.1. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3981) Upgrade the build system for FE
Jongyoul Lee created ZEPPELIN-3981: -- Summary: Upgrade the build system for FE Key: ZEPPELIN-3981 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3981 Project: Zeppelin Issue Type: Improvement Components: front-end Reporter: Jongyoul Lee Front End is one of the most important parts to make Zeppelin valuable. From an early age, Zeppelin has focused on developing FE features and they were the strongest points. But recently, no one has been in charge of FE anymore and the FE side became outdated and remained as of old. So, it would be better to upgrade them to the latest version and keep them up-to-date. languages: js technologies: webpack, bower, grunt, npm, yarn, node... -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3917) Change CI using docker
Jongyoul Lee created ZEPPELIN-3917: -- Summary: Change CI using docker Key: ZEPPELIN-3917 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3917 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee We install a lot of things when we test it. It would be better to use a preinstalled docker image. It also gives the same environment to test Z locally -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3892) Make SecurityUtils as a service
Jongyoul Lee created ZEPPELIN-3892: -- Summary: Make SecurityUtils as a service Key: ZEPPELIN-3892 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3892 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Currently, we cannot change zeppelin's security feature not to use Shiro. I think it would be better to change it as a service so that user can choose other security scheme easily. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3740) Adopt google-java-format
Jongyoul Lee created ZEPPELIN-3740: -- Summary: Adopt google-java-format Key: ZEPPELIN-3740 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3740 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee google-java-format and its maven plugin validate format and change files as well. It would help to manage our codes. I'll add it in the current pom.xml and enable one by one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3733) Refactor `Notebook*` classes to remove circular dependencies and several listeners
Jongyoul Lee created ZEPPELIN-3733: -- Summary: Refactor `Notebook*` classes to remove circular dependencies and several listeners Key: ZEPPELIN-3733 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3733 Project: Zeppelin Issue Type: Improvement Components: zeppelin-server, zeppelin-zengine Reporter: Jongyoul Lee Assignee: Jongyoul Lee `Notebook*` classes have many problems. We need to refactor these classes. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3650) Fix this bug that show output twice "sometimes" after refreshing browser
Jongyoul Lee created ZEPPELIN-3650: -- Summary: Fix this bug that show output twice "sometimes" after refreshing browser Key: ZEPPELIN-3650 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3650 Project: Zeppelin Issue Type: Bug Reporter: Jongyoul Lee Assignee: Jongyoul Lee Sometimes, Zeppelin UI shows output twice. It might seems to be related to `result` and `results`. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3648) Implement new methods related to handling ZeppelinContext via paragraph
Jongyoul Lee created ZEPPELIN-3648: -- Summary: Implement new methods related to handling ZeppelinContext via paragraph Key: ZEPPELIN-3648 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3648 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee Assignee: Jongyoul Lee It's enough to test handling ZeppelinContext. E.g. textbox, check form -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3647) Implement InterpreterModeActionsIT again not to use IntegrationTest
Jongyoul Lee created ZEPPELIN-3647: -- Summary: Implement InterpreterModeActionsIT again not to use IntegrationTest Key: ZEPPELIN-3647 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3647 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee Assignee: Jongyoul Lee It doesn't need to test under integration tests -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3627) Remove starting server option for some functional tests
Jongyoul Lee created ZEPPELIN-3627: -- Summary: Remove starting server option for some functional tests Key: ZEPPELIN-3627 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3627 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Assignee: Jongyoul Lee Some functional tests use an actual server to test it. But just check to call only one method. it doesn't need to start a server. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3609) Refactor `ZeppelinServer` to use `jersey-hk2`
Jongyoul Lee created ZEPPELIN-3609: -- Summary: Refactor `ZeppelinServer` to use `jersey-hk2` Key: ZEPPELIN-3609 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3609 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee `hk2` is already included in `zeppelin-server` module. we can simplify initialization code. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3605) Extract cron-related code to another class from `Notebook`
Jongyoul Lee created ZEPPELIN-3605: -- Summary: Extract cron-related code to another class from `Notebook` Key: ZEPPELIN-3605 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3605 Project: Zeppelin Issue Type: Improvement Components: Core Reporter: Jongyoul Lee Assignee: Jongyoul Lee To clean up code base, it would be better to extract some code to complicated class like `Notebook` -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3600) Change logger level dynamically
Jongyoul Lee created ZEPPELIN-3600: -- Summary: Change logger level dynamically Key: ZEPPELIN-3600 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3600 Project: Zeppelin Issue Type: Bug Environment: It would be better to change log level dynamically if it's needed Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3593) Change LuceneSearch's directory to file system from memory
Jongyoul Lee created ZEPPELIN-3593: -- Summary: Change LuceneSearch's directory to file system from memory Key: ZEPPELIN-3593 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3593 Project: Zeppelin Issue Type: Bug Components: zeppelin-zengine Affects Versions: 0.8.0 Environment: Currently, search service uses memory to store indexed data. It would be better to replace it to the file system. Reporter: Jongyoul Lee Assignee: Jongyoul Lee -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3490) Yarn cluster mode doesn't work with dependencies set by interpreter tab
Jongyoul Lee created ZEPPELIN-3490: -- Summary: Yarn cluster mode doesn't work with dependencies set by interpreter tab Key: ZEPPELIN-3490 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3490 Project: Zeppelin Issue Type: Bug Affects Versions: 0.8.0 Reporter: Jongyoul Lee Assignee: Jongyoul Lee In a yarn cluster mode, Spark Interpreter doesn't include dependencies set by interpreter tab page because it's not deployed to yarn environment. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3432) Fix results object when throwing exception while running job
Jongyoul Lee created ZEPPELIN-3432:
--
Summary: Fix results object when throwing exception while running
job
Key: ZEPPELIN-3432
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3432
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.3
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
Attachments: image-2018-04-27-13-56-35-409.png
{noformat}
INFO [2018-04-27 12:51:28,562] ({pool-2-thread-3}
SchedulerFactory.java[jobStarted]:109) - Job 20180427-123612_1851631951 started
by scheduler interpreter_1108320718
INFO [2018-04-27 12:51:28,564] ({pool-2-thread-3}
OldSparkInterpreter.java[populateSparkWebUrl]:930) - Sending metadata to
Zeppelin server: {message=Spark UI enabled, url=http://10.133.69.85:4041}
INFO [2018-04-27 12:51:28,567] ({pool-2-thread-3} Logging.scala[logInfo]:54) -
Parsing command: show tables invalid
ERROR [2018-04-27 12:51:28,569] ({pool-2-thread-3} Job.java[run]:185) - Job
failed
org.apache.zeppelin.interpreter.InterpreterException:
java.lang.reflect.InvocationTargetException
at
org.apache.zeppelin.spark.SparkSqlInterpreter.interpret(SparkSqlInterpreter.java:123)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:103)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:623)
at org.apache.zeppelin.scheduler.Job.run(Job.java:183)
at
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:140)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.zeppelin.spark.SparkSqlInterpreter.interpret(SparkSqlInterpreter.java:120)
... 11 more
Caused by: org.apache.spark.sql.catalyst.parser.ParseException:
extraneous input 'invalid' expecting (line 1, pos 12)
== SQL ==
show tables invalid
^^^
at
org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197)
at
org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99)
at
org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45)
at
org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53)
at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:600)
at org.apache.spark.sql.SQLContext.sql(SQLContext.scala:699)
... 16 more
INFO [2018-04-27 12:51:28,570] ({pool-2-thread-3}
SchedulerFactory.java[jobFinished]:115) - Job 20180427-123612_1851631951
finished by scheduler interpreter_1108320718
ERROR [2018-04-27 12:51:28,570] ({pool-1-thread-5}
TThreadPoolServer.java[run]:296) - Error occurred during processing of message.
java.lang.ClassCastException: java.lang.String cannot be cast to
org.apache.zeppelin.interpreter.InterpreterResult
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer.interpret(RemoteInterpreterServer.java:456)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$interpret.getResult(RemoteInterpreterService.java:1859)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$interpret.getResult(RemoteInterpreterService.java:1844)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{noformat}
!image-2018-04-27-13-56-35-409.png!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3425) Indicate proper information when loading interpreter list in helium/interpreter
Jongyoul Lee created ZEPPELIN-3425: -- Summary: Indicate proper information when loading interpreter list in helium/interpreter Key: ZEPPELIN-3425 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3425 Project: Zeppelin Issue Type: New Feature Reporter: Jongyoul Lee Assignee: Jongyoul Lee Currently, interpreter list of helium menu always shows `enable` button. But we could show the proper icon when it's already installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3424) Create custom script to get Helium resources
Jongyoul Lee created ZEPPELIN-3424: -- Summary: Create custom script to get Helium resources Key: ZEPPELIN-3424 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3424 Project: Zeppelin Issue Type: New Feature Reporter: Jongyoul Lee Assignee: Jongyoul Lee We need to provide a way to build a custom/user-defined helium information files. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3422) Add JMX support
Jongyoul Lee created ZEPPELIN-3422: -- Summary: Add JMX support Key: ZEPPELIN-3422 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3422 Project: Zeppelin Issue Type: New Feature Reporter: Jongyoul Lee Assignee: Jongyoul Lee It would be better to add some properties and state supported by JMX -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3411) Long running logic inside synchronized block in InterpreterSettingManager
Jongyoul Lee created ZEPPELIN-3411:
--
Summary: Long running logic inside synchronized block in
InterpreterSettingManager
Key: ZEPPELIN-3411
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3411
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.3
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
Restarting interpreter with an abnormal case, e.g. SparkInterpreter's hang,
it's inside a synchronized block of {{InterpreterSettings}}. It leads other
unintended behaviors like not showing interpreter list when users try to create
a new note and interpreter tab.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3382) Check Interpreter directory to add new interpreter dynamically
Jongyoul Lee created ZEPPELIN-3382:
--
Summary: Check Interpreter directory to add new interpreter
dynamically
Key: ZEPPELIN-3382
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3382
Project: Zeppelin
Issue Type: Improvement
Components: Interpreters
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
This feature will help to add a new interpreter dynamically by copying new
interpreter files into interpreter/\{specific_name}. Currently, we have to
restart to read interpreter directory to refresh interpreter templates' list
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3366) Remove spark dependency when packaging it
Jongyoul Lee created ZEPPELIN-3366: -- Summary: Remove spark dependency when packaging it Key: ZEPPELIN-3366 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3366 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Assignee: Jongyoul Lee When building/packaging Zeppelin, downloading spark dependency make the build time longer and the build size bigger. Instead of it, it would be better to download Spark binary package when launching Zeppelin at the first time and to make it configurable if they don't want to download it and use their own one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3116) Update selenium
Jongyoul Lee created ZEPPELIN-3116: -- Summary: Update selenium Key: ZEPPELIN-3116 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3116 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee Assignee: Jongyoul Lee Current versions of selenium and browsers have webdriver by default to test selenium. We can reduce download time of firebug for testing them. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3100) Update nodejs and npm
Jongyoul Lee created ZEPPELIN-3100: -- Summary: Update nodejs and npm Key: ZEPPELIN-3100 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3100 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee Assignee: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3050) Reduce web build time
Jongyoul Lee created ZEPPELIN-3050: -- Summary: Reduce web build time Key: ZEPPELIN-3050 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3050 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3032) Inter paragraphs’ queries
Jongyoul Lee created ZEPPELIN-3032: -- Summary: Inter paragraphs’ queries Key: ZEPPELIN-3032 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3032 Project: Zeppelin Issue Type: Bug Reporter: Jongyoul Lee Assignee: Jongyoul Lee It will be nice to support queries using the result of existing paragraphs. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3031) Provide Oauth login mechanism
Jongyoul Lee created ZEPPELIN-3031: -- Summary: Provide Oauth login mechanism Key: ZEPPELIN-3031 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3031 Project: Zeppelin Issue Type: Bug Components: zeppelin-server Reporter: Jongyoul Lee Assignee: Jongyoul Lee Zeppelin provides Shiro as authentication mechanism. We can extend it to -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2759) Flaky Test: InterpreterOutputChangeWatcher.test
Jongyoul Lee created ZEPPELIN-2759:
--
Summary: Flaky Test: InterpreterOutputChangeWatcher.test
Key: ZEPPELIN-2759
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2759
Project: Zeppelin
Issue Type: Sub-task
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
{noformat}
Running org.apache.zeppelin.interpreter.InterpreterOutputChangeWatcherTest
15:12:09,215 INFO
org.apache.zeppelin.interpreter.InterpreterOutputChangeWatcher:71 - watch
/tmp/ZeppelinLTest_1498403528213
15:12:10,223 INFO
org.apache.zeppelin.interpreter.InterpreterOutputChangeWatcher:125 - File
change detected /tmp/ZeppelinLTest_1498403528213/test1
15:12:10,224 INFO
org.apache.zeppelin.interpreter.InterpreterOutputChangeWatcher:125 - File
change detected /tmp/ZeppelinLTest_1498403528213/test1
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 32.034 sec <<<
FAILURE! - in org.apache.zeppelin.interpreter.InterpreterOutputChangeWatcherTest
test(org.apache.zeppelin.interpreter.InterpreterOutputChangeWatcherTest) Time
elapsed: 32.031 sec <<< FAILURE!
java.lang.AssertionError: expected:<1> but was:<2>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:645)
at org.junit.Assert.assertEquals(Assert.java:631)
at
org.apache.zeppelin.interpreter.InterpreterOutputChangeWatcherTest.test(InterpreterOutputChangeWatcherTest.java:95)
{noformat}
Test works as expected but we need to improve measuring method.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2665) Support Mesos Cluster launching interpreter
Jongyoul Lee created ZEPPELIN-2665: -- Summary: Support Mesos Cluster launching interpreter Key: ZEPPELIN-2665 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2665 Project: Zeppelin Issue Type: New Feature Reporter: Jongyoul Lee Assignee: Jongyoul Lee Apache Mesos is the famous framework to manage lifecycle of process and help to launch process into remote machine. It would be nice to support mesos framework when Zeppelin launches interpreters -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2645) Adding way to register RemoteInterpreterServer's port into InterpreterProcess
Jongyoul Lee created ZEPPELIN-2645: -- Summary: Adding way to register RemoteInterpreterServer's port into InterpreterProcess Key: ZEPPELIN-2645 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2645 Project: Zeppelin Issue Type: Bug Reporter: Jongyoul Lee Assignee: Jongyoul Lee >From now, the port of interpreter is fixed by Zeppelin server, and which >connect interpreter via this port. But it's not fragile running interpreter >remotely. Then I suggest reverse way to pass the port information from >interpreter to server. It require one more communication channel and I'll use >netty for it. This issue is initialized from ZEPPELIN-2035 and related to >ZEPPELIN-2040. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2616) Add docs to describe how to use this feature
Jongyoul Lee created ZEPPELIN-2616: -- Summary: Add docs to describe how to use this feature Key: ZEPPELIN-2616 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2616 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2590) Convert jupyter file format to zeppelin's note format
Jongyoul Lee created ZEPPELIN-2590: -- Summary: Convert jupyter file format to zeppelin's note format Key: ZEPPELIN-2590 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2590 Project: Zeppelin Issue Type: Bug Reporter: Jongyoul Lee Assignee: Jongyoul Lee Priority: Trivial For the first step to support Jupyter notebook, it would be better to provides converter for jupyter notebook format -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2385) Release 0.8.0
Jongyoul Lee created ZEPPELIN-2385: -- Summary: Release 0.8.0 Key: ZEPPELIN-2385 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2385 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee This is an umbrella issue for the next major release -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2276) Release 0.7.2
Jongyoul Lee created ZEPPELIN-2276: -- Summary: Release 0.7.2 Key: ZEPPELIN-2276 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2276 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee 0.7.1 couldn't cover all of blocked issues. This issue will cover rest of them -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2248) Fix javax.ws.rs and cxf version mismatch
Jongyoul Lee created ZEPPELIN-2248:
--
Summary: Fix javax.ws.rs and cxf version mismatch
Key: ZEPPELIN-2248
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2248
Project: Zeppelin
Issue Type: Bug
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
Current version of cxf, jersey, jetty are not matched and use different version
JAX-RS version. this cause the error below:
{noformat}
INFO [2017-03-12 18:30:07,646] ({qtp1909546776-19}
AbstractValidatingSessionManager.java[enableSessionValidation]:230) - Enabling
session validation scheduler...
WARN [2017-03-12 18:30:10,073] ({qtp1909546776-20}
ServletHandler.java[doHandle]:620) -
javax.servlet.ServletException: Filtered request failed.
at
org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:384)
at
org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.apache.zeppelin.server.CorsFilter.doFilter(CorsFilter.java:72)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:499)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodError:
javax.ws.rs.ClientErrorException.validate(Ljavax/ws/rs/core/Response;Ljavax/ws/rs/core/Response$Status$Family;)Ljavax/ws/rs/core/Response;
at javax.ws.rs.ClientErrorException.(ClientErrorException.java:88)
at
org.apache.cxf.jaxrs.utils.JAXRSUtils.findTargetMethod(JAXRSUtils.java:503)
at
org.apache.cxf.jaxrs.interceptor.JAXRSInInterceptor.processRequest(JAXRSInInterceptor.java:198)
at
org.apache.cxf.jaxrs.interceptor.JAXRSInInterceptor.handleMessage(JAXRSInInterceptor.java:90)
at
org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272)
at
org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
at
org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
at
org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:222)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:153)
at
org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:167)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:286)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:211)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:575)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:262)
at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669)
at
org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
at
org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
at
[jira] [Created] (ZEPPELIN-2202) Disable "Personalized mode" toggle when paragraphs are running
Jongyoul Lee created ZEPPELIN-2202: -- Summary: Disable "Personalized mode" toggle when paragraphs are running Key: ZEPPELIN-2202 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2202 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee Priority: Minor It looks natural to disable "Personalized mode" button while running paragraphs -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2187) Previous output seems to be cached in personalized mode
Jongyoul Lee created ZEPPELIN-2187: -- Summary: Previous output seems to be cached in personalized mode Key: ZEPPELIN-2187 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2187 Project: Zeppelin Issue Type: Bug Reporter: Jongyoul Lee Priority: Critical While using personalized mode, previous run result looks cached and show in the next run -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2179) "clear output" doesn't work in "personalized mode"
Jongyoul Lee created ZEPPELIN-2179: -- Summary: "clear output" doesn't work in "personalized mode" Key: ZEPPELIN-2179 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2179 Project: Zeppelin Issue Type: Bug Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2178) "Personalized mode" doesn't work properly
Jongyoul Lee created ZEPPELIN-2178: -- Summary: "Personalized mode" doesn't work properly Key: ZEPPELIN-2178 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2178 Project: Zeppelin Issue Type: Bug Reporter: Jongyoul Lee "Personalized mode" would fail with unknown reason. We need to make tests for this mode and to verify by adding test cases. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2096) Change LazyInterpreter to ClassloaderInterpreter when creating interpreter into RemoteInterpreterServer
Jongyoul Lee created ZEPPELIN-2096: -- Summary: Change LazyInterpreter to ClassloaderInterpreter when creating interpreter into RemoteInterpreterServer Key: ZEPPELIN-2096 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2096 Project: Zeppelin Issue Type: Bug Reporter: Jongyoul Lee ZEPPELIN-1972 supports to preserve class loader because scala may fails with some [scala bug|https://issues.scala-lang.org/browse/SI-9587]. It looks like a simple solution to avoid this bug. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2057) Extract InterpreterSetting functions from InterpreterFactory
Jongyoul Lee created ZEPPELIN-2057: -- Summary: Extract InterpreterSetting functions from InterpreterFactory Key: ZEPPELIN-2057 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2057 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee I'll introduce `InterpreterSettingManager` and it'll handle all function related InterpreterSetting -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2056) Restructuring InterpreterFactory
Jongyoul Lee created ZEPPELIN-2056: -- Summary: Restructuring InterpreterFactory Key: ZEPPELIN-2056 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2056 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee Zeppelin's InterpreterFactory is too big thus need to divide some functions into different classes. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2041) Introduce a new abstraction layer for managing and launching interpreters
Jongyoul Lee created ZEPPELIN-2041: -- Summary: Introduce a new abstraction layer for managing and launching interpreters Key: ZEPPELIN-2041 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2041 Project: Zeppelin Issue Type: Sub-task Components: zeppelin-server Reporter: Jongyoul Lee Assignee: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2040) ClusterManager to support launching interpreter in a cluster
Jongyoul Lee created ZEPPELIN-2040: -- Summary: ClusterManager to support launching interpreter in a cluster Key: ZEPPELIN-2040 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2040 Project: Zeppelin Issue Type: New Feature Components: zeppelin-interpreter, zeppelin-server Reporter: Jongyoul Lee Assignee: Jongyoul Lee Zeppelin's interpreter launches in a same machine of Zeppelin server only. This umbrella issue covers to support launching interpreters in remote machine including Yarn, Mesos and AWS. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2013) Exceeded logs fails CI
Jongyoul Lee created ZEPPELIN-2013: -- Summary: Exceeded logs fails CI Key: ZEPPELIN-2013 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2013 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee Assignee: Jongyoul Lee 09:40:51,817 INFO org.apache.zeppelin.dep.DependencyResolver:102 - copy /home/travis/build/apache/zeppelin/zeppelin-server/../local-repo/org/apache/drill/exec/vector/1.6.0/vector-1.6.0.jar to ../local-repo/2C9CY118N 09:40:51,818 INFO org.apache.zeppelin.dep.DependencyResolver:102 - copy /home/travis/build/apache/zeppelin/zeppelin-server/../local-repo/com/beust/jcommander/1.30/jcommander-1.30.jar to ../local-repo/2C9CY118N 09:40:51,819 INFO org.apache.zeppelin.dep.DependencyResolver:102 - copy /home/travis/build/apache/zeppelin/zeppelin-server/../local-repo/org/apache/curator/curator-x-discovery/2.7.1/curator-x-discovery-2.7.1.jar to ../local-repo/2C9CY118N 09:40:51,819 INFO org.apache.zeppelin.dep.DependencyResolver:102 - copy /home/travis/build/apache/zeppelin/zeppelin-server/../local-repo/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar to ../local-repo/2C9CY118N 09:40:51,820 INFO org.apache.zeppelin.dep.DependencyResolver:102 - copy /home/travis/build/apache/zeppelin/zeppelin-server/../local-repo/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar to ../local-repo/2C9CY118N The log length has exceeded the limit of 4 MB (this usually means that the test suite is raising the same exception over and over). The job has been terminated -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2003) Remove PostgresqlInterpreter
Jongyoul Lee created ZEPPELIN-2003: -- Summary: Remove PostgresqlInterpreter Key: ZEPPELIN-2003 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2003 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee Assignee: Jongyoul Lee JDBCInterpreter covers all functions of PostgresqlInterpreter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1981) Fix all flaky tests
Jongyoul Lee created ZEPPELIN-1981: -- Summary: Fix all flaky tests Key: ZEPPELIN-1981 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1981 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1925) Update docs of making helium application
Jongyoul Lee created ZEPPELIN-1925: -- Summary: Update docs of making helium application Key: ZEPPELIN-1925 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1925 Project: Zeppelin Issue Type: Task Components: helium Reporter: Jongyoul Lee Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1879) Make GUI for setting custom interpreter runner
Jongyoul Lee created ZEPPELIN-1879: -- Summary: Make GUI for setting custom interpreter runner Key: ZEPPELIN-1879 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1879 Project: Zeppelin Issue Type: Task Components: zeppelin-server Reporter: Jongyoul Lee Priority: Minor interpreter-setting.json has new value for custom interpreter runner. It would be modified via interpreter-setting.json manually but it would be better to edit them via interpreter tab in GUI. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1862) Divide DevInterpreter of helium
Jongyoul Lee created ZEPPELIN-1862: -- Summary: Divide DevInterpreter of helium Key: ZEPPELIN-1862 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1862 Project: Zeppelin Issue Type: New Feature Components: helium Reporter: Jongyoul Lee Assignee: Jongyoul Lee Priority: Minor DevInterpreter is located inside zeppelin-interpreter package, but I don't think it's proper position because every other interpreter will include those Interpreter by default. Thus, it's most proper to divide that Interpreter with separate package -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1861) Support custom interpreter.sh script to run interpreter
Jongyoul Lee created ZEPPELIN-1861: -- Summary: Support custom interpreter.sh script to run interpreter Key: ZEPPELIN-1861 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1861 Project: Zeppelin Issue Type: New Feature Components: zeppelin-server Reporter: Jongyoul Lee Assignee: Jongyoul Lee Priority: Minor Current interpreter.sh seems complicated and almost interpreter doesn't need additional jars provided current interpreter.sh. And users can customize their own script. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1599) Remove support on some old versions of Spark.
Jongyoul Lee created ZEPPELIN-1599: -- Summary: Remove support on some old versions of Spark. Key: ZEPPELIN-1599 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1599 Project: Zeppelin Issue Type: New Feature Reporter: Jongyoul Lee Assignee: Jongyoul Lee Spark deprecated some old version. I think we don't need to support it by Zeppelin itself. I'll remove the versions from 1.1.x to 1.3.x including test and pom -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1594) Personalized mode
Jongyoul Lee created ZEPPELIN-1594: -- Summary: Personalized mode Key: ZEPPELIN-1594 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1594 Project: Zeppelin Issue Type: New Feature Reporter: Jongyoul Lee Assignee: Jongyoul Lee This enables two different users to change the view of the same paragraph's result with different view even owner change paragraph and run it again. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1572) Let SparkInterpreter use Credentials
Jongyoul Lee created ZEPPELIN-1572: -- Summary: Let SparkInterpreter use Credentials Key: ZEPPELIN-1572 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1572 Project: Zeppelin Issue Type: Improvement Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1520) Using local mode of Apache Spark while testing Zeppelin via travis.
Jongyoul Lee created ZEPPELIN-1520: -- Summary: Using local mode of Apache Spark while testing Zeppelin via travis. Key: ZEPPELIN-1520 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1520 Project: Zeppelin Issue Type: Improvement Components: zeppelin-server Reporter: Jongyoul Lee Assignee: Jongyoul Lee For now, travis of Apache Zeppelin downloads Apache Spark and running it. But it's enough to test Zeppelin with Spark's local mode and it will returns the same. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1366) Remove legacy alias feature for JDBC
Jongyoul Lee created ZEPPELIN-1366: -- Summary: Remove legacy alias feature for JDBC Key: ZEPPELIN-1366 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1366 Project: Zeppelin Issue Type: Bug Components: zeppelin-server Affects Versions: 0.6.1, 0.6.2 Reporter: Jongyoul Lee Assignee: Jongyoul Lee Fix For: 0.7.0 ZEPPELIN-999 enables users to use JDBC with it's own prefix. But ZEPPELIN-1012 finished, it makes Zeppelin support general way to use aliases for all interpreters. Thus JDBC sugar is not useful anymore and it also contains a small bug. It should be removed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1210) Run interpreter per user
Jongyoul Lee created ZEPPELIN-1210: -- Summary: Run interpreter per user Key: ZEPPELIN-1210 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1210 Project: Zeppelin Issue Type: New Feature Components: zeppelin-zengine Affects Versions: 0.6.0 Reporter: Jongyoul Lee Assignee: Jongyoul Lee It helps users to use their own interpreters -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1191) Support running paragraph with interpreterSetting.group in case that interpreterSetting doesn't have it
Jongyoul Lee created ZEPPELIN-1191:
--
Summary: Support running paragraph with interpreterSetting.group
in case that interpreterSetting doesn't have it
Key: ZEPPELIN-1191
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1191
Project: Zeppelin
Issue Type: New Feature
Components: zeppelin-zengine
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
Fix For: 0.7.0
For backward compatibility, we should support in case that users run a
paragraph with legacy way like using {{%interpreterSetting.group}}. For
example, if users' settings' name are {{spark-prod}} and {{spark-dev}}, user
can run with {{%spark}} with selecting one of interpreterSetting, but in a new
version, user cannot run a paragraph with {{%spark}} even though they bind all
of spark interpreter including {{spark-prod}} and {{spark-dev}}. It is proper
behaviour for new one, but we need to support old way in order to move user
experience smoothly from old to new.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1099) Build and run Spark without spark-dependencies
Jongyoul Lee created ZEPPELIN-1099: -- Summary: Build and run Spark without spark-dependencies Key: ZEPPELIN-1099 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1099 Project: Zeppelin Issue Type: New Feature Components: zeppelin-interpreter Reporter: Jongyoul Lee Assignee: Jongyoul Lee Due to ZEPPELIN-804, we can initialize Spark without spark-dependencies. This is the next step. Users don't want to have a spark-dependencies if they use SPARK_HOME. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1075) Move the functionality of NoteInterpreterLoader into InterpreterFactory
Jongyoul Lee created ZEPPELIN-1075:
--
Summary: Move the functionality of NoteInterpreterLoader into
InterpreterFactory
Key: ZEPPELIN-1075
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1075
Project: Zeppelin
Issue Type: Task
Components: zeppelin-zengine
Reporter: Jongyoul Lee
{{NoteInterpreterLoader}} stores {{noteId}} only, and is used by {{Note}} and
{{Paragraph}}. Those classes, however, already have a {{noteId}} by themselves.
Furthermore {{NoteInterpreterLoader}}'s method are same or similar mapper of
{{InterpreterFactory}}. Thus there's no reason to keep
{{NoteInterpreterLoader}} and it would be better move those functions into
{{InterpreterFactory}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1067) Change scheme of InterpreterGroup and DefaultInterpreter
Jongyoul Lee created ZEPPELIN-1067: -- Summary: Change scheme of InterpreterGroup and DefaultInterpreter Key: ZEPPELIN-1067 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1067 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee It's useful to set the order of interpreters. we, however, add class name into setting files. I think it's better way to set the list of Interpreter groups and set the default interpreter of each group. I don't believe that we only add SparkInterpreter without PySparkInterpreter through custom build option. Thus It will be enough to set the order of groups and the default interpreter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1030) Add example settings for Hive, Phoenix, Tajo
Jongyoul Lee created ZEPPELIN-1030: -- Summary: Add example settings for Hive, Phoenix, Tajo Key: ZEPPELIN-1030 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1030 Project: Zeppelin Issue Type: Sub-task Components: zeppelin-interpreter Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1012) Support alias for interpreter
Jongyoul Lee created ZEPPELIN-1012:
--
Summary: Support alias for interpreter
Key: ZEPPELIN-1012
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1012
Project: Zeppelin
Issue Type: New Feature
Components: zeppelin-interpreter
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
Enable user set multiple interpreter settings with an interpreter. For example,
user use {{%spark}} and {{%spark-dev}} with different settings.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-999) Support alias for JDBC properties
Jongyoul Lee created ZEPPELIN-999:
-
Summary: Support alias for JDBC properties
Key: ZEPPELIN-999
URL: https://issues.apache.org/jira/browse/ZEPPELIN-999
Project: Zeppelin
Issue Type: Improvement
Components: zeppelin-interpreter
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
It supports alias for JDBC. For example, user uses {{%psql}} in order to use
{{%jdbc(psql)}}. This feature is only for JdbcInterpreter now.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-994) Merge PostgresqlInterpreter into JDBCInterpreter
Jongyoul Lee created ZEPPELIN-994: - Summary: Merge PostgresqlInterpreter into JDBCInterpreter Key: ZEPPELIN-994 URL: https://issues.apache.org/jira/browse/ZEPPELIN-994 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-992) Moving some logic of InterpreterFactoryTest.testBasic to LazyOpenInterpreterTest
Jongyoul Lee created ZEPPELIN-992: - Summary: Moving some logic of InterpreterFactoryTest.testBasic to LazyOpenInterpreterTest Key: ZEPPELIN-992 URL: https://issues.apache.org/jira/browse/ZEPPELIN-992 Project: Zeppelin Issue Type: Bug Components: zeppelin-interpreter, zeppelin-zengine Affects Versions: 0.5.6 Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-974) Merge TajoInterpreter into JDBCInterpreter
Jongyoul Lee created ZEPPELIN-974: - Summary: Merge TajoInterpreter into JDBCInterpreter Key: ZEPPELIN-974 URL: https://issues.apache.org/jira/browse/ZEPPELIN-974 Project: Zeppelin Issue Type: Sub-task Components: Interpreters Affects Versions: 0.5.6 Reporter: Jongyoul Lee Assignee: Jongyoul Lee This is one of the interpreters which uses JDBC connection. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-932) Move InterpreterFactory under zeppelin-interpreter package
Jongyoul Lee created ZEPPELIN-932: - Summary: Move InterpreterFactory under zeppelin-interpreter package Key: ZEPPELIN-932 URL: https://issues.apache.org/jira/browse/ZEPPELIN-932 Project: Zeppelin Issue Type: Task Affects Versions: 0.5.6 Reporter: Jongyoul Lee Assignee: Jongyoul Lee Almost classes of org.apache.zeppelin.interpreter package in zeppelin-zengine is used by itself, and zeppelin-zengine already depend on zeppelin-interpreter. I think it's better to move that package into zeppelin-interpreter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-925) Merge HiveInterpreter into JDBCInterpreter
Jongyoul Lee created ZEPPELIN-925:
-
Summary: Merge HiveInterpreter into JDBCInterpreter
Key: ZEPPELIN-925
URL: https://issues.apache.org/jira/browse/ZEPPELIN-925
Project: Zeppelin
Issue Type: Task
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
Two interpreters are based same codes and JDBCInterpreter is more generic then
HiveInterpreter. I think we just support a new profile for Hive in
JDBCInterpreter like {{-pjdbc-hive}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-924) Apply new mechanism to TajoInterpreter
Jongyoul Lee created ZEPPELIN-924: - Summary: Apply new mechanism to TajoInterpreter Key: ZEPPELIN-924 URL: https://issues.apache.org/jira/browse/ZEPPELIN-924 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-922) Apply new mechanism to ScaldingInterpreter
Jongyoul Lee created ZEPPELIN-922: - Summary: Apply new mechanism to ScaldingInterpreter Key: ZEPPELIN-922 URL: https://issues.apache.org/jira/browse/ZEPPELIN-922 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-921) Apply new mechanism to KnitR and RRepl
Jongyoul Lee created ZEPPELIN-921: - Summary: Apply new mechanism to KnitR and RRepl Key: ZEPPELIN-921 URL: https://issues.apache.org/jira/browse/ZEPPELIN-921 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-919) Apply new mechanism to Markdown
Jongyoul Lee created ZEPPELIN-919: - Summary: Apply new mechanism to Markdown Key: ZEPPELIN-919 URL: https://issues.apache.org/jira/browse/ZEPPELIN-919 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-918) Apply new mechanism to Livy*Interpreter
Jongyoul Lee created ZEPPELIN-918: - Summary: Apply new mechanism to Livy*Interpreter Key: ZEPPELIN-918 URL: https://issues.apache.org/jira/browse/ZEPPELIN-918 Project: Zeppelin Issue Type: Sub-task Reporter: Jongyoul Lee -- This message was sent by Atlassian JIRA (v6.3.4#6332)
