[jira] [Created] (ZEPPELIN-1247) JdbcInterpreter is always chosen as the default interpreter.
Jeff Zhang created ZEPPELIN-1247: Summary: JdbcInterpreter is always chosen as the default interpreter. Key: ZEPPELIN-1247 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1247 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1242) Should set property SPARK_YARN_MODE before creating SparkILoop
Jeff Zhang created ZEPPELIN-1242: Summary: Should set property SPARK_YARN_MODE before creating SparkILoop Key: ZEPPELIN-1242 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1242 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1267) PySparkInterpreter doesn't work in spark 2.0
Jeff Zhang created ZEPPELIN-1267: Summary: PySparkInterpreter doesn't work in spark 2.0 Key: ZEPPELIN-1267 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1267 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang py4j is not distributed to executors. {noformat} Error from python worker: /usr/bin/python: No module named pyspark PYTHONPATH was: /Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/filecache/27/__spark_libs__3944184934921201174.zip/spark-core_2.11-2.0.0.jar {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1270) Remove getting SQLContext from SparkSession.wrapped()
Jeff Zhang created ZEPPELIN-1270: Summary: Remove getting SQLContext from SparkSession.wrapped() Key: ZEPPELIN-1270 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1270 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor SparkSession.wrapped is only for spark 2.0 preview, it is not supported in spark 2.0 release. So I think we can remove that piece of code. Otherwise we will get the following error in log which might be a little confusing. {noformat} 08:05:44,946 - Thread(pool-2-thread-3) - (Utils.java:40) - org.apache.spark.sql.SparkSession.wrapped() java.lang.NoSuchMethodException: org.apache.spark.sql.SparkSession.wrapped() at java.lang.Class.getMethod(Class.java:1786) at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38) at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33) at org.apache.zeppelin.spark.SparkInterpreter.getSQLContext_2(SparkInterpreter.java:241) at org.apache.zeppelin.spark.SparkInterpreter.getSQLContext(SparkInterpreter.java:229) at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:744) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69) at org.apache.zeppelin.spark.SparkRInterpreter.getSparkInterpreter(SparkRInterpreter.java:188) at org.apache.zeppelin.spark.SparkRInterpreter.open(SparkRInterpreter.java:72) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1275) Comment code of PySparkInterpreter is not highlighted
Jeff Zhang created ZEPPELIN-1275: Summary: Comment code of PySparkInterpreter is not highlighted Key: ZEPPELIN-1275 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1275 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.0 Reporter: Jeff Zhang Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1263) Should specify zeppelin's spark configuration through --conf arguments of spark-submit
Jeff Zhang created ZEPPELIN-1263: Summary: Should specify zeppelin's spark configuration through --conf arguments of spark-submit Key: ZEPPELIN-1263 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1263 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang Assignee: Jeff Zhang For now, we load zeppelin's spark configuration at runtime in the RemoteInterpreter Process rather than loading them before starting the process (through --conf of spark-submit). It is fine for most of spark configuration, but for some configuration, it would introduce some weird issues. Like ZEPPELIN-1242, and if you specify spark.master as yarn-client in spark-defaults.conf but specify spark.master as local in zeppelin side, you will see the spark interpreter fail to start due to this inconsistency. So I propose to specify zeppelin's spark configuration through --conf arguments of spark-submit -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1287) No need to call print to display output in PythonInterpreter
Jeff Zhang created ZEPPELIN-1287: Summary: No need to call print to display output in PythonInterpreter Key: ZEPPELIN-1287 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1287 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1172) NPE in ResourcePoolUtils when creating remote interepter
Jeff Zhang created ZEPPELIN-1172: Summary: NPE in ResourcePoolUtils when creating remote interepter Key: ZEPPELIN-1172 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1172 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang Although eventually, the remote interpreter will be created, seem no function is affected. But this kind of log is very confusing and scaring. {format} INFO [2016-07-14 11:25:18,047] ({pool-2-thread-2} RemoteInterpreterManagedProcess.java[start]:114) - Run interpreter process [/Users/jzhang/github/zeppelin/bin/interpreter.sh, -d, /Users/jzhang/github/zeppelin/interpreter/spark, -p, 54477, -l, /Users/jzhang/github/zeppelin/local-repo/2B92N2SP5] ERROR [2016-07-14 11:25:18,068] ({qtp1458849419-16} ResourcePoolUtils.java[getAllResourcesExcept]:64) - java.lang.NullPointerException at org.apache.zeppelin.resource.ResourcePoolUtils.getAllResourcesExcept(ResourcePoolUtils.java:58) at org.apache.zeppelin.resource.ResourcePoolUtils.getAllResources(ResourcePoolUtils.java:36) at org.apache.zeppelin.helium.Helium.suggestApp(Helium.java:153) at org.apache.zeppelin.rest.HeliumRestApi.suggest(HeliumRestApi.java:83) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:100) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:57) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:93) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:222) at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:153) at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:167) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:286) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:211) at javax.servlet.http.HttpServlet.service(HttpServlet.java:575) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:262) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108) ... {format} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1175) AM log is not available for yarn-client mode
Jeff Zhang created ZEPPELIN-1175: Summary: AM log is not available for yarn-client mode Key: ZEPPELIN-1175 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1175 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.6.0 Reporter: Jeff Zhang Zeppelin's log4j.properties is propagated to AM, so that the AM can not initialize log4j properly. Because zeppelin's log4j.properties will use ${zeppelin.log.file} which is only for zeppelin server. Here's the error message in AM {code} log4j:ERROR setFile(null,true) call failed. java.io.FileNotFoundException: (No such file or directory) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.(FileOutputStream.java:213) at java.io.FileOutputStream.(FileOutputStream.java:133) at org.apache.log4j.FileAppender.setFile(FileAppender.java:294) at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165) at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223) at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307) at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172) at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104) at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842) at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768) at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648) at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514) at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580) at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526) at org.apache.log4j.LogManager.(LogManager.java:127) at org.apache.spark.Logging$class.initializeLogging(Logging.scala:121) at org.apache.spark.Logging$class.initializeIfNecessary(Logging.scala:106) at org.apache.spark.Logging$class.log(Logging.scala:50) at org.apache.spark.executor.CoarseGrainedExecutorBackend$.log(CoarseGrainedExecutorBackend.scala:138) at org.apache.spark.executor.CoarseGrainedExecutorBackend$.run(CoarseGrainedExecutorBackend.scala:149) at org.apache.spark.executor.CoarseGrainedExecutorBackend$.main(CoarseGrainedExecutorBackend.scala:253) at org.apache.spark.executor.CoarseGrainedExecutorBackend.main(CoarseGrainedExecutorBackend.scala) log4j:ERROR Either File or DatePattern options are not set for appender [dailyfile]. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/grid/0/hadoop/yarn/local/filecache/27/spark-hdp-assembly.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/grid/0/hdp/2.5.0.0-965/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1222) ClassNotFoundException of SparkJLineCompletion in Spark Interpreter
Jeff Zhang created ZEPPELIN-1222: Summary: ClassNotFoundException of SparkJLineCompletion in Spark Interpreter Key: ZEPPELIN-1222 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1222 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang {code} INFO [2016-07-21 10:58:02,654] ({pool-2-thread-2} Logging.scala[logInfo]:58) - Successfully started service 'HTTP class server' on port 54947. ERROR [2016-07-21 10:58:04,312] ({pool-2-thread-2} Utils.java[instantiateClass]:74) - SparkJLineCompletion java.lang.ClassNotFoundException: SparkJLineCompletion at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.zeppelin.spark.Utils.instantiateClass(Utils.java:70) at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:579) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) INFO [2016-07-21 10:58:04,314] ({pool-2-thread-2} SparkInterpreter.java[createSparkContext]:254) - -- Create new SparkContext yarn-client --- INFO [2016-07-21 10:58:04,330] ({pool-2-thread-2} Logging.scala[logInfo]:58) - Running Spark version 1.6.1 INFO [2016-07-21 10:58:04,345] ({pool-2-thread-2} Logging.scala[logInfo]:58) - Spark configuration: args= master=yarn-client {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1197) Should print output directly without invoking function print in pyspark interpreter.
Jeff Zhang created ZEPPELIN-1197: Summary: Should print output directly without invoking function print in pyspark interpreter. Key: ZEPPELIN-1197 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1197 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.6.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1215) Need to login using keytab and principal before creating SparkContext in secured cluster
Jeff Zhang created ZEPPELIN-1215: Summary: Need to login using keytab and principal before creating SparkContext in secured cluster Key: ZEPPELIN-1215 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1215 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1217) Can not see the whole configuration table in install page
Jeff Zhang created ZEPPELIN-1217: Summary: Can not see the whole configuration table in install page Key: ZEPPELIN-1217 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1217 Project: Zeppelin Issue Type: Bug Components: documentation Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor In the install page, I can not see the whole configuration, I have to move the scroll bar under the table to see the description section. This is very inconvenient for me. \cc [~Ahyoung] https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/install.html#apache-zeppelin-configuration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1218) HeliumApplicationFactoryTest fails
Jeff Zhang created ZEPPELIN-1218: Summary: HeliumApplicationFactoryTest fails Key: ZEPPELIN-1218 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1218 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Not sure why it succeeded on github travis-ci, are these tests ignored on travis-ci ? \cc [~moon] {noformat} Tests run: 5, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 120.363 sec <<< FAILURE! - in org.apache.zeppelin.helium.HeliumApplicationFactoryTest testUnloadOnInterpreterUnbind(org.apache.zeppelin.helium.HeliumApplicationFactoryTest) Time elapsed: 30.147 sec <<< ERROR! java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.zeppelin.interpreter.InterpreterResult at org.apache.zeppelin.notebook.Paragraph.getResult(Paragraph.java:232) at org.apache.zeppelin.helium.HeliumApplicationFactoryTest.testUnloadOnInterpreterUnbind(HeliumApplicationFactoryTest.java:224) testLoadRunUnloadApplication(org.apache.zeppelin.helium.HeliumApplicationFactoryTest) Time elapsed: 30.054 sec <<< ERROR! java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.zeppelin.interpreter.InterpreterResult at org.apache.zeppelin.notebook.Paragraph.getResult(Paragraph.java:232) at org.apache.zeppelin.helium.HeliumApplicationFactoryTest.testLoadRunUnloadApplication(HeliumApplicationFactoryTest.java:142) testUnloadOnInterpreterRestart(org.apache.zeppelin.helium.HeliumApplicationFactoryTest) Time elapsed: 30.071 sec <<< ERROR! java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.zeppelin.interpreter.InterpreterResult at org.apache.zeppelin.notebook.Paragraph.getResult(Paragraph.java:232) at org.apache.zeppelin.helium.HeliumApplicationFactoryTest.testUnloadOnInterpreterRestart(HeliumApplicationFactoryTest.java:290) testUnloadOnParagraphRemove(org.apache.zeppelin.helium.HeliumApplicationFactoryTest) Time elapsed: 30.062 sec <<< ERROR! java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.zeppelin.interpreter.InterpreterResult at org.apache.zeppelin.notebook.Paragraph.getResult(Paragraph.java:232) at org.apache.zeppelin.helium.HeliumApplicationFactoryTest.testUnloadOnParagraphRemove(HeliumApplicationFactoryTest.java:186) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1185) ZEPPELIN_INTP_JAVA_OPTS should not use ZEPPELIN_JAVA_OPTS as default value
Jeff Zhang created ZEPPELIN-1185: Summary: ZEPPELIN_INTP_JAVA_OPTS should not use ZEPPELIN_JAVA_OPTS as default value Key: ZEPPELIN-1185 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1185 Project: Zeppelin Issue Type: Improvement Components: Core Affects Versions: 0.6.0 Reporter: Jeff Zhang Priority: Minor For now, if ZEPPELIN_INTP_JAVA_OPTS is not defined it would use ZEPPELIN_JAVA_OPTS. I don't think it make sense to do that implicitly as it may not be the user intend to do. If user want to specify custom java opts for interpreter process, then let them do it by himself. Besides this introduce some unexpected behavior, e.g. I set ZEPPELIN_JAVA_OPTS as following to remote debug, but this setting will also apply to the remote interpreter process which cause it hang there. {code} export ZEPPELIN_JAVA_OPTS="-agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=5005" {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1187) Redirect output of the process running interpreter.sh to log4j
Jeff Zhang created ZEPPELIN-1187: Summary: Redirect output of the process running interpreter.sh to log4j Key: ZEPPELIN-1187 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1187 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.6.0 Reporter: Jeff Zhang Priority: Minor For now the output of process running interpter.sh is lost, it would be nice to redirect it to log4j for debugging, especially debugging related with interpreter.sh -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1311) Typo in ZEPPELIN-1197
Jeff Zhang created ZEPPELIN-1311: Summary: Typo in ZEPPELIN-1197 Key: ZEPPELIN-1311 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1311 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1, 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Attachments: 2016-08-09_1528.png My bad, it should be "Exception" rather than "Execution" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1334) Environment variable defined in interpreter setting doesn't take effect
Jeff Zhang created ZEPPELIN-1334: Summary: Environment variable defined in interpreter setting doesn't take effect Key: ZEPPELIN-1334 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1334 Project: Zeppelin Issue Type: Bug Components: zeppelin-interpreter Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1338) User level interpreter setting
Jeff Zhang created ZEPPELIN-1338: Summary: User level interpreter setting Key: ZEPPELIN-1338 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1338 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang Assignee: Jeff Zhang For now the interpreter setting is global applied. That means if user A change interpreter setting of spark, it would apply to others, this is a pretty bad user experience. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1337) Umbrella for multiple user support for zeppelin
Jeff Zhang created ZEPPELIN-1337: Summary: Umbrella for multiple user support for zeppelin Key: ZEPPELIN-1337 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1337 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.6.1 Reporter: Jeff Zhang I create this umbrella ticket for multiple user support for zeppelin. And I create/move some following subtask. Please add any subtask that I miss here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1339) Note management per user
Jeff Zhang created ZEPPELIN-1339: Summary: Note management per user Key: ZEPPELIN-1339 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1339 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang For now, there’s no concept like workspace for user. Each user can see all the notes, it’s pretty hard to manage and organize that. I think there should be a module for managing and organizing the notes per user. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1340) Impersonation for interpreter
Jeff Zhang created ZEPPELIN-1340: Summary: Impersonation for interpreter Key: ZEPPELIN-1340 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1340 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang In the kerberized environment, all the interpreter use the same keytab/principal, this is pretty dangerous. E.g. User A can use shell interpreter which run as user B to delete all the files owned by user B. Although some interpreter has implement its kerbosed usage, I just feel we might need to make a general impersonation framework for all the interpreter (If not possible for all interpreter, but at least this framework should cover most of the interpreter). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1341) Build with profile scala-2.11 fails
Jeff Zhang created ZEPPELIN-1341: Summary: Build with profile scala-2.11 fails Key: ZEPPELIN-1341 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1341 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Assignee: Jeff Zhang {noformat} [ERROR] Failed to execute goal on project zeppelin-spark_2.10: Could not resolve dependencies for project org.apache.zeppelin:zeppelin-spark_2.10:jar:0.7.0-SNAPSHOT: Failure to find org.apache.zeppelin:zeppelin-display_2.11:jar:0.7.0-SNAPSHOT in http://nexus-private.hortonworks.com/nexus/content/groups/public was cached in the local repository, resolution will not be reattempted until the update interval of public has elapsed or updates are forced -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :zeppelin-spark_2.10 {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2046) The final output is a little inconsistent with the streaming output
Jeff Zhang created ZEPPELIN-2046: Summary: The final output is a little inconsistent with the streaming output Key: ZEPPELIN-2046 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2046 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor Fix For: 0.7.1 As the attachment screenshot shows, the final output is not consistent with the streaming output. The final output has one extra blank lines between outputs. I believe the previous behavior is not like this. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2045) Pass interpreter properties with "spark." as prefix to SparkConf
Jeff Zhang created ZEPPELIN-2045: Summary: Pass interpreter properties with "spark." as prefix to SparkConf Key: ZEPPELIN-2045 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2045 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.1 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2079) Upgrade livy to 0.3 in livy interpreter
Jeff Zhang created ZEPPELIN-2079: Summary: Upgrade livy to 0.3 in livy interpreter Key: ZEPPELIN-2079 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2079 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2077) Add docs link to the latest version of zeppelin
Jeff Zhang created ZEPPELIN-2077: Summary: Add docs link to the latest version of zeppelin Key: ZEPPELIN-2077 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2077 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Currently, the doc link of zeppelin always has the version number. This is not convenient for other site that want to link to the zeppelin doc. It is a good practise to always has the latest version link for zeppelin. e.g. Here's the latest version doc link for spark http://spark.apache.org/docs/latest/ \cc [~Ahyoung] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2015) Improve parse logic of livy sql output
Jeff Zhang created ZEPPELIN-2015: Summary: Improve parse logic of livy sql output Key: ZEPPELIN-2015 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2015 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2151) Add integration test for livy cancel api
Jeff Zhang created ZEPPELIN-2151: Summary: Add integration test for livy cancel api Key: ZEPPELIN-2151 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2151 Project: Zeppelin Issue Type: Test Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2155) Flaky test: NotebookTest
Jeff Zhang created ZEPPELIN-2155: Summary: Flaky test: NotebookTest Key: ZEPPELIN-2155 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2155 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang https://travis-ci.org/zjffdu/zeppelin/jobs/204447551 {noformat} Failed tests: NotebookTest.testPublicPrivateNewNote:1173 expected:<2C[B7YJQ16]> but was:<2C[A45Z6X7]> NotebookTest.testAuthorizationRoles:759 expected: but was: {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-1985) Remove user from pig tutorial note
Jeff Zhang created ZEPPELIN-1985: Summary: Remove user from pig tutorial note Key: ZEPPELIN-1985 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1985 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Priority: Minor Should remove the user from pig tutorial note, otherwise it can not be seen in anonymous mode. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2195) Use PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON over zeppelin.pyspark.python
Jeff Zhang created ZEPPELIN-2195: Summary: Use PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON over zeppelin.pyspark.python Key: ZEPPELIN-2195 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2195 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2186) Screenshot for text input form is not used correctly
Jeff Zhang created ZEPPELIN-2186: Summary: Screenshot for text input form is not used correctly Key: ZEPPELIN-2186 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2186 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor Attachments: 2017-02-27_1142.png The screenshot is supposed to be example of text input form without default value, but it is the same as the screenshot of the text input form with default value. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2188) The default value in dropdown list is not selected by dfeault
Jeff Zhang created ZEPPELIN-2188: Summary: The default value in dropdown list is not selected by dfeault Key: ZEPPELIN-2188 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2188 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor Use the following code to reproduce it. the default value 'jeff' is not selected in the dropdown list. {code} %sh echo -e "hello, ${name=jeff, jeff|andy|jerry}" {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2185) No tooltip displayed on chart type button
Jeff Zhang created ZEPPELIN-2185: Summary: No tooltip displayed on chart type button Key: ZEPPELIN-2185 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2185 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang It would be nice to display tooltip on the chart type when user hover on it especially when more helium plugins are introduced. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2189) The order of dynamic forms is messed up
Jeff Zhang created ZEPPELIN-2189: Summary: The order of dynamic forms is messed up Key: ZEPPELIN-2189 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2189 Project: Zeppelin Issue Type: Improvement Components: front-end Affects Versions: 0.7.0 Reporter: Jeff Zhang Use the following code to reproduce it. {code} %spark println(z.input("my_input", "default_name")) println(z.select("my_select","select_2", Seq(("1", "select_1"), ("2", "select_2" println(z.checkbox("my_checkbox", Seq("check_1"), Seq(("1", "check_1"), ("2", "check_2" {code} The dynamic forms order is checkbox, input text and dropdown list which is not the order in which I define them in the code -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-1368) interpreter-setting.json may be loaded mutliple times
Jeff Zhang created ZEPPELIN-1368: Summary: interpreter-setting.json may be loaded mutliple times Key: ZEPPELIN-1368 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1368 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang There're several ways to load interpreter-setting.json, but for now we will load it multiple times. It is supposed to load only one. Here's the order to register interpreter * load from /conf//interpreter-setting.json * load from interpreter process classpath * register interpreter using the old way of Interpreter.register() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1403) Should maintain the using port list
Jeff Zhang created ZEPPELIN-1403: Summary: Should maintain the using port list Key: ZEPPELIN-1403 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1403 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor Fix For: 0.7.0 For now, in RemoteInterpreterManagedProcess we will first find one available port and then use this port in the interpreter process. But it is possible that 2 interpreters use the same port. Here's the scenarios. 1. Thread1 (Interpreter A) find available port 3000 2. Thread2 (Interpreter B) find available port 3000 3. Process for Interpreter A starts 4. Process for Interpreter B starts -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1401) Can not delete the last paragraph
Jeff Zhang created ZEPPELIN-1401: Summary: Can not delete the last paragraph Key: ZEPPELIN-1401 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1401 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Priority: Minor As the screenshot shows, I can not delete the last paragraph. Not sure whether it is expected or it is just because there's no space to display the 'Remove' command. \cc [~Mina Lee] [~Ahyoung] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1425) sparkr.zip is not distributed to executors
Jeff Zhang created ZEPPELIN-1425: Summary: sparkr.zip is not distributed to executors Key: ZEPPELIN-1425 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1425 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang So if R daemon is required in executor, the R script will fail. How to reproduce it {code} df <- createDataFrame(sqlContext, mtcars) showDF(df) {code} Exception in executor side: {noformat} 10:16:20,024 INFO org.apache.spark.storage.memory.MemoryStore:54 - Block broadcast_1 stored as values in memory (estimated size 14.2 KB, free 366.3 MB) 10:16:21,018 INFO org.apache.spark.api.r.BufferedStreamThread:54 - Fatal error: cannot open file '/Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/appcache/application_1473129941656_0037/container_1473129941656_0037_01_02/sparkr/SparkR/worker/daemon.R': No such file or directory 10:16:31,023 ERROR org.apache.spark.executor.Executor:91 - Exception in task 0.2 in stage 1.0 (TID 3) java.net.SocketTimeoutException: Accept timed out at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:404) at java.net.ServerSocket.implAccept(ServerSocket.java:545) at java.net.ServerSocket.accept(ServerSocket.java:513) at org.apache.spark.api.r.RRunner$.createRWorker(RRunner.scala:367) at org.apache.spark.api.r.RRunner.compute(RRunner.scala:69) at org.apache.spark.api.r.BaseRRDD.compute(RRDD.scala:49) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1431) Improvments for LivyInterpreter
Jeff Zhang created ZEPPELIN-1431: Summary: Improvments for LivyInterpreter Key: ZEPPELIN-1431 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1431 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang Create this umbrella ticket for LivyInterpreter improvements. \cc [~prabhjyotsi...@apache.com] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1432) Support cancellation of paragraph execution
Jeff Zhang created ZEPPELIN-1432: Summary: Support cancellation of paragraph execution Key: ZEPPELIN-1432 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1432 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang Assignee: Jeff Zhang Although the cancel api of LivyInterpreter is implemented, but it just cancel to poll the result, didn't cancel the real execution in livy side. So it would better to cancel the execution on livy side as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1430) Display appId and webui link in LivyInterpreter's output
Jeff Zhang created ZEPPELIN-1430: Summary: Display appId and webui link in LivyInterpreter's output Key: ZEPPELIN-1430 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1430 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang For now, it is hard to figure out what the yarn application of the livy session represent, it would be better to display the appId and webui link in the output of LivyInterpreter for diagnosing purpose. It can also be applied to the native SparkInterpreter, but could be done in another ticket. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1477) Add Integration Test for LivyInterpreter
Jeff Zhang created ZEPPELIN-1477: Summary: Add Integration Test for LivyInterpreter Key: ZEPPELIN-1477 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1477 Project: Zeppelin Issue Type: Sub-task Components: Interpreters Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 Currently the unit test for LivyInterpreter is not sufficient, it can not cover many of things. I create this ticket to add Integration test for LivyInterpreter, so that we can don't need to manually verify LivyInterpreter for any following change. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1455) Flaky test: AbstractAngularElemTest
Jeff Zhang created ZEPPELIN-1455: Summary: Flaky test: AbstractAngularElemTest Key: ZEPPELIN-1455 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1455 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1 Reporter: Jeff Zhang https://travis-ci.org/apache/zeppelin/jobs/160932534 {code} [32mAngularElem[0m [31m- should provide onclick method *** FAILED ***[0m [31m The code passed to eventually never returned normally. Attempted 1 times over 2.155594141 seconds. Last failure message: 0 was not equal to 1. (AbstractAngularElemTest.scala:72)[0m {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1456) Flaky Test: AuthenticationIT
Jeff Zhang created ZEPPELIN-1456: Summary: Flaky Test: AuthenticationIT Key: ZEPPELIN-1456 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1456 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1 Reporter: Jeff Zhang https://travis-ci.org/apache/zeppelin/jobs/160932541 {code} Tests in error: AuthenticationIT.testGroupPermission:179->AbstractZeppelinIT.pollingWait:96 » Timeout Tests run: 15, Failures: 0, Errors: 1, Skipped: 0 {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1377) Run remote interpreter process in remote machine
Jeff Zhang created ZEPPELIN-1377: Summary: Run remote interpreter process in remote machine Key: ZEPPELIN-1377 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1377 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang For now, all the remote interpreter process are running in the same host as zeppelin server, this is fine for single user. But after we support multiple users, there would be many remote interpreter process on the same host as each user would run its own interpreter process, I have concern about the scalability. So it would be better to run them on a remote host. One candidate solution is to run them as yarn application. This would be a big change, need design review before implementation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1374) Should prevent use dot in interpreter name
Jeff Zhang created ZEPPELIN-1374: Summary: Should prevent use dot in interpreter name Key: ZEPPELIN-1374 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1374 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.1 Reporter: Jeff Zhang Attachments: screenshot-1.png I create a new interpreter which I name it as "spark1_2.11" (I'd like to use multiple spark version for one zeppelin instance). But zeppelin didn't recognize it correctly as shown in the screenshot. The reason is that zeppelin use dot as the separator of interpreter group name and interpreter name. So here it takes "spark1_2" as the interpreter group name. So I believe we should prevent user to use dot in the interpreter name. We can pop up a error message box when user use dot in the interpreter name in the interpreter page. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1498) Flaky test: http://stackoverflow.com/questions/6121403/how-do-i-get-the-scala-version-from-within-scala-itself
Jeff Zhang created ZEPPELIN-1498: Summary: Flaky test: http://stackoverflow.com/questions/6121403/how-do-i-get-the-scala-version-from-within-scala-itself Key: ZEPPELIN-1498 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1498 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1 Reporter: Jeff Zhang https://travis-ci.org/apache/zeppelin/builds/163016648 https://s3.amazonaws.com/archive.travis-ci.org/jobs/163016652/log.txt {code} --- Running org.apache.zeppelin.jdbc.JDBCInterpreterTest Tests run: 8, Failures: 0, Errors: 8, Skipped: 0, Time elapsed: 0.199 sec <<< FAILURE! - in org.apache.zeppelin.jdbc.JDBCInterpreterTest testAutoCompletion(org.apache.zeppelin.jdbc.JDBCInterpreterTest) Time elapsed: 0.074 sec <<< ERROR! java.nio.file.NoSuchFileException: /home/travis/build/apache/zeppelin/jdbc/target/tmp/h2-test-1299779248643275151 at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:383) at java.nio.file.Files.createDirectory(Files.java:630) at java.nio.file.TempFileHelper.create(TempFileHelper.java:136) at java.nio.file.TempFileHelper.createTempDirectory(TempFileHelper.java:173) at java.nio.file.Files.createTempDirectory(Files.java:944) at org.apache.zeppelin.jdbc.JDBCInterpreterTest.getJdbcConnection(JDBCInterpreterTest.java:58) at org.apache.zeppelin.jdbc.JDBCInterpreterTest.setUp(JDBCInterpreterTest.java:80) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1529) Confusing Error Message for livy interpreter
Jeff Zhang created ZEPPELIN-1529: Summary: Confusing Error Message for livy interpreter Key: ZEPPELIN-1529 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1529 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1 Reporter: Jeff Zhang The following code in livy interpreter will get very confusing error message. {code} sc.parallelize(1 to 10). {code} {noformat} :29: error: value print is not a member of org.apache.spark.rdd.RDD[Int] possible cause: maybe a semicolon is missing before `value print'? print("") ^ {noformat} The cause is that we add print statement at the end of statement, not sure why we do that. {code} String[] lines = stringLines.split("\n"); String[] linesToRun = new String[lines.length + 1]; for (int i = 0; i < lines.length; i++) { linesToRun[i] = lines[i]; } linesToRun[lines.length] = "print(\"\")"; {code} \cc [~prabhjot] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1577) LivyInterpreter should not use FIFOScheduler
Jeff Zhang created ZEPPELIN-1577: Summary: LivyInterpreter should not use FIFOScheduler Key: ZEPPELIN-1577 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1577 Project: Zeppelin Issue Type: Sub-task Components: livy-interpreter Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Critical Fix For: 0.7.0 FIFOScheduler means there's only one thread to process client requests. So you will see that user1's job will block user2's job which doesn't make sense. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1574) Paragraph text should be trimmed
Jeff Zhang created ZEPPELIN-1574: Summary: Paragraph text should be trimmed Key: ZEPPELIN-1574 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1574 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1571) Support pig udf interpreter
Jeff Zhang created ZEPPELIN-1571: Summary: Support pig udf interpreter Key: ZEPPELIN-1571 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1571 Project: Zeppelin Issue Type: New Feature Components: Interpreters Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1707) Pass userName when creating interpreter through thrift
Jeff Zhang created ZEPPELIN-1707: Summary: Pass userName when creating interpreter through thrift Key: ZEPPELIN-1707 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1707 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang In ZEPPELIN-1607, I'd like refactor livy interpreter to scoped mode by default, this require username when open this interpreter. So I propose to pass username when creating interpreter through thrift. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1716) Error of interpreter not found is not propagated to frontend.
Jeff Zhang created ZEPPELIN-1716: Summary: Error of interpreter not found is not propagated to frontend. Key: ZEPPELIN-1716 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1716 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang It is introduced in ZEPPELIN-1399, we call InterpreterFactory.getInterpreter before calling Paragraph.jobRun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1717) Weird output for SparkR
Jeff Zhang created ZEPPELIN-1717: Summary: Weird output for SparkR Key: ZEPPELIN-1717 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1717 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang This is my source code and output {code} %spark.r df <- as.DataFrame(faithful) head(df) {code} Output {code} 1 function (x, df1, df2, ncp, log = FALSE) 2 { 3 if (missing(ncp)) 4 .Call(C_df, x, df1, df2, log) 5 else .Call(C_dnf, x, df1, df2, ncp, log) 6 } {code} The output in spark-shell is {code} > head(df) eruptions waiting 1 3.600 79 2 1.800 54 3 3.333 74 4 2.283 62 5 4.533 85 6 2.883 55 {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1595) Make ZeppelinContext extensible
Jeff Zhang created ZEPPELIN-1595: Summary: Make ZeppelinContext extensible Key: ZEPPELIN-1595 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1595 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 For now, ZeppelinContext only support Spark Interpreter. I'd like to make it extensible, so that it can support other interpreters as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1616) Interpreter open happens in jobRun
Jeff Zhang created ZEPPELIN-1616: Summary: Interpreter open happens in jobRun Key: ZEPPELIN-1616 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1616 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1613) PerUser scoped mode doesn't work
Jeff Zhang created ZEPPELIN-1613: Summary: PerUser scoped mode doesn't work Key: ZEPPELIN-1613 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1613 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Critical For perUser scoped mode, difference users still use the same interpreter instance which is incorrect. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1770) Restart only the client user's interpreter when restarting interpreter setting
Jeff Zhang created ZEPPELIN-1770: Summary: Restart only the client user's interpreter when restarting interpreter setting Key: ZEPPELIN-1770 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1770 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.7.0 Reporter: Jeff Zhang ZEPPELIN-1306 implement the feature to restart the interpreter associated with the notes, this ticket is to implement to restart the interpreter associated with the user if user click to restart in the interpreter setting page. Actually I think in future multiple user would be the major use case for zeppelin, so we should take user as the first dimension/parameter for any operation as opposed before we take noteId as the first dimension/parameter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1769) Support cancel job in SparkRInterpereter
Jeff Zhang created ZEPPELIN-1769: Summary: Support cancel job in SparkRInterpereter Key: ZEPPELIN-1769 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1769 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang cancel is not support for SparkR now, This ticket is trying to add cancel support for SparkRInterpreter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1778) Potential security issue for passing user credential to interpreter process
Jeff Zhang created ZEPPELIN-1778: Summary: Potential security issue for passing user credential to interpreter process Key: ZEPPELIN-1778 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1778 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.2, 0.7.0 Reporter: Jeff Zhang Priority: Critical Currently zeppelin-server will pass user credential info to interpreter process through thrift. This would cause potential security issue as I think the thrift protocol we used for now is not secured. One solution is to enable SSL for thrift. Besides, there're 2 other problems: * credential info will be save in conf/credentials.json in plain text. * credential info be passed to all the interpreters no matter whether this interpreter need this. \cc [~moon] [~vinayshu...@gmail.com] [~prasadwagle] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1785) Clarify where to pick up ZeppelinConfiguration
Jeff Zhang created ZEPPELIN-1785: Summary: Clarify where to pick up ZeppelinConfiguration Key: ZEPPELIN-1785 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1785 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang The current issue I found is that zeppelin.notebook.dir defined in zeppelin-site.xml doesn't take effect. Because we define it in https://github.com/apache/zeppelin/blob/master/bin/common.sh#L52 and ZeppelinConfiguration will pick up configugration through enviroment variable by first. I think some other conf like zeppelin.interpreter.dir are the same. There're 2 solutions for it. * Remove them in common.sh * Preferer property in zeppelin-site.xml over enviroment variable. Personally, I prefer the second solution. As I think property is easier to understand, and we should use zeppelin-site as central place for all the configurations. This is also the approach what spark use. \cc [~moon] [~luciano resende] [~anthonycorbacho] [~jongyoul] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1786) Refactor LivyHelper
Jeff Zhang created ZEPPELIN-1786: Summary: Refactor LivyHelper Key: ZEPPELIN-1786 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1786 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1794) Flaky test: InterpreterIT
Jeff Zhang created ZEPPELIN-1794: Summary: Flaky test: InterpreterIT Key: ZEPPELIN-1794 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1794 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang https://api.travis-ci.org/jobs/183237658/log.txt?deansi=true {noformat} 13:12:21,028 INFO org.apache.zeppelin.integration.ZeppelinIT:189 - testCreateNotebook Test executed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 217.56 sec - in org.apache.zeppelin.integration.ZeppelinIT Results : Tests in error: InterpreterIT.testShowDescriptionOnInterpreterCreate:69 » ElementNotVisible El... {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1816) Implement getProgress in SparkRInterpreter
Jeff Zhang created ZEPPELIN-1816: Summary: Implement getProgress in SparkRInterpreter Key: ZEPPELIN-1816 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1816 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 Since I add jobGroup in ZEPPELIN-1769, it is easy to implement getProgress as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1773) Remove method destroy() in Interpreter
Jeff Zhang created ZEPPELIN-1773: Summary: Remove method destroy() in Interpreter Key: ZEPPELIN-1773 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1773 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor IMHO destroy is a little functional duplicated with close. And it seems currently only cassandra use destroy and it just calls close() https://github.com/apache/zeppelin/blob/master/cassandra/src/main/java/org/apache/zeppelin/cassandra/CassandraInterpreter.java#L231. So IMO, we could delete destroy method, also we can delete the destroy method in InterpreterGroup. \cc [~moon] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1746) Flaky test: PySparkInterpreterTest
Jeff Zhang created ZEPPELIN-1746: Summary: Flaky test: PySparkInterpreterTest Key: ZEPPELIN-1746 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1746 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang {noformat} import org.apache.spark.sql.functions._ 16/12/03 11:25:07 INFO PySparkInterpreter: File /tmp/zeppelin_pyspark-6720028130103128200.py created 16/12/03 11:25:07 INFO SparkInterpreter: Sending metainfos to Zeppelin server: {url=http://172.17.0.3:4040} Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 51.398 sec <<< FAILURE! - in org.apache.zeppelin.spark.PySparkInterpreterTest testBasicIntp(org.apache.zeppelin.spark.PySparkInterpreterTest) Time elapsed: 49.033 sec <<< FAILURE! java.lang.AssertionError: expected: but was: at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.zeppelin.spark.PySparkInterpreterTest.testBasicIntp(PySparkInterpreterTest.java:128) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1892) Display label vertically or horizontally smartly
Jeff Zhang created ZEPPELIN-1892: Summary: Display label vertically or horizontally smartly Key: ZEPPELIN-1892 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1892 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang Sometimes, the label would be a little long. In this case, it would be better to display label vertically. Attach one sample where the x axis is date. There's much overlap between labels, so it is better to display label vertically in this case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1903) ZeppelinContext can not display pandas DataFrame in PySparkInterpreter
Jeff Zhang created ZEPPELIN-1903: Summary: ZeppelinContext can not display pandas DataFrame in PySparkInterpreter Key: ZEPPELIN-1903 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1903 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1899) Fail to plot in pyspark interpreter
Jeff Zhang created ZEPPELIN-1899: Summary: Fail to plot in pyspark interpreter Key: ZEPPELIN-1899 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1899 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Here's 2 paraphrase I use to reproduce this issue, you can also see the attachment. Paragraph_1 {code} %spark.pyspark import pandas as pd import numpy as np import matplotlib.pyplot as plt dateparse = lambda dates: pd.datetime.strptime(dates, '%Y-%m') data = pd.read_csv("/Users/jzhang/AirPassengers.csv", parse_dates='Month', index_col='Month', date_parser=dateparse) print(data.head()) print("\n Data Types:") print(data.dtypes) {code} Paragraph_2 {code} data.index ts = data['#Passengers'] plt.plot(ts) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1882) Some chart doesn't work in dynamic form of dropdown list
Jeff Zhang created ZEPPELIN-1882: Summary: Some chart doesn't work in dynamic form of dropdown list Key: ZEPPELIN-1882 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1882 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Attachments: Pig Tutorial.gif Attach the screenshot, not sure whether it relate with dropdown list. It works in textbox but doens't work in dropdown list, very weird. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1881) Some chart doesn't work in dynamic form of dropdown list
Jeff Zhang created ZEPPELIN-1881: Summary: Some chart doesn't work in dynamic form of dropdown list Key: ZEPPELIN-1881 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1881 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Attach the screenshot, not sure whether it relate with dropdown list. It works in textbox but doens't work in dropdown list, very weird. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1893) Extra non-necessary info is output in python interpreter when using matplotlib
Jeff Zhang created ZEPPELIN-1893: Summary: Extra non-necessary info is output in python interpreter when using matplotlib Key: ZEPPELIN-1893 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1893 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Please see the attached screenshot. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1894) Matplotlib is very slow in python interpreter
Jeff Zhang created ZEPPELIN-1894: Summary: Matplotlib is very slow in python interpreter Key: ZEPPELIN-1894 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1894 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang The following code takes 20 seconds in zeppelin python interpreter. But it only take 1 second in jupyter. {code} import matplotlib.pyplot as plt import numpy as np x = np.random.normal(0,1,1024) y = np.random.normal(0,1,1024) plt.scatter(x,y, s=25) plt.xlim((-2,2)) plt.ylim((-2,2)) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1898) White spaces in the beginning is stripped in pyspark interpreter
Jeff Zhang created ZEPPELIN-1898: Summary: White spaces in the beginning is stripped in pyspark interpreter Key: ZEPPELIN-1898 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1898 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Here's the code to reproduce this issue. {code} %spark.pyspark import pandas as pd import numpy as np import matplotlib.pyplot as plt dateparse = lambda dates: pd.datetime.strptime(dates, '%Y-%m') data = pd.read_csv("/Users/jzhang/AirPassengers.csv", parse_dates='Month', index_col='Month', date_parser=dateparse) print(data.head()) print("\n Data Types:") print(data.dtypes) {code} And attach the screenshot I see in zeppelin and jupyter -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1900) Paragraph's top right area overlap with markdown output
Jeff Zhang created ZEPPELIN-1900: Summary: Paragraph's top right area overlap with markdown output Key: ZEPPELIN-1900 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1900 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Please see the screenshot attached. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1891) Allow to display percentage in pie chart
Jeff Zhang created ZEPPELIN-1891: Summary: Allow to display percentage in pie chart Key: ZEPPELIN-1891 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1891 Project: Zeppelin Issue Type: Improvement Components: front-end Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor Currently, the pie chart display absolute number, but usually it make more sense to display percentage for pie chart. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1890) Groups in pie chart is a little misleading
Jeff Zhang created ZEPPELIN-1890: Summary: Groups in pie chart is a little misleading Key: ZEPPELIN-1890 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1890 Project: Zeppelin Issue Type: Bug Components: front-end Affects Versions: 0.7.0 Reporter: Jeff Zhang Attachments: zeppelin_pie.gif When I add fields to Groups for pie chart. The pie chart changes, I don't know how that happens. If the pie chart needs to be updated, it should split further for the new fields in Groups, but what I see is the proportion of each part changes. This is a little misleading for me. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1901) Output schema might be null for PigQueryInterpreter
Jeff Zhang created ZEPPELIN-1901: Summary: Output schema might be null for PigQueryInterpreter Key: ZEPPELIN-1901 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1901 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1889) Multiple groups in chart doesn't work
Jeff Zhang created ZEPPELIN-1889: Summary: Multiple groups in chart doesn't work Key: ZEPPELIN-1889 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1889 Project: Zeppelin Issue Type: Bug Components: front-end Affects Versions: 0.7.0 Reporter: Jeff Zhang Attachments: zeppelin_ui.gif Attach the screenshot to illustrate the issue. * Step 1, I choose 2 fields as group, the chart doesn't change, but the legend changes. * Step 2, I rerun the paragraph, the chart disappear. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1918) SPARK_VER doesn't take effect in travis
Jeff Zhang created ZEPPELIN-1918: Summary: SPARK_VER doesn't take effect in travis Key: ZEPPELIN-1918 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1918 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Blocker @ejono found that zeppelin could not build with spark 2.1.0. And the root cause is that SPARK_VER doesn't take effect in travis. Not sure when this issue come up. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1933) Add queue configuration in pig interpreter
Jeff Zhang created ZEPPELIN-1933: Summary: Add queue configuration in pig interpreter Key: ZEPPELIN-1933 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1933 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1852) Use multiple InterpreterResult for displaying appInfo
Jeff Zhang created ZEPPELIN-1852: Summary: Use multiple InterpreterResult for displaying appInfo Key: ZEPPELIN-1852 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1852 Project: Zeppelin Issue Type: Sub-task Components: livy-interpreter Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1853) Add README for livy interpreter
Jeff Zhang created ZEPPELIN-1853: Summary: Add README for livy interpreter Key: ZEPPELIN-1853 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1853 Project: Zeppelin Issue Type: Improvement Components: livy-interpreter Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1851) LazyOpenInterpreter would open interpreter multiple times when open fails
Jeff Zhang created ZEPPELIN-1851: Summary: LazyOpenInterpreter would open interpreter multiple times when open fails Key: ZEPPELIN-1851 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1851 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1866) No meaningful exception for pig interpreter under tez engine
Jeff Zhang created ZEPPELIN-1866: Summary: No meaningful exception for pig interpreter under tez engine Key: ZEPPELIN-1866 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1866 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1867) Update document for pig interpreter and add one sample note
Jeff Zhang created ZEPPELIN-1867: Summary: Update document for pig interpreter and add one sample note Key: ZEPPELIN-1867 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1867 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2327) Add option to dynamic form to control whether running paragraph automatically
Jeff Zhang created ZEPPELIN-2327: Summary: Add option to dynamic form to control whether running paragraph automatically Key: ZEPPELIN-2327 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2327 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Currently, paragraph will be rerun automatically after I change the value of dynamic form. This is good for single control, but if I have multiple controls in the frontend. Usually, I want to create a button myself to trigger the rerun. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2324) Add property zeppelin.spark.unSupportedVersionCheck for trying new spark version
Jeff Zhang created ZEPPELIN-2324: Summary: Add property zeppelin.spark.unSupportedVersionCheck for trying new spark version Key: ZEPPELIN-2324 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2324 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang For now, every time when I want to try new spark version, I have to change file SparkVersion and rebuild it. It is not so convenient, so I'd like to add property zeppelin.spark.unSupportedVersionCheck for spark interpreter. So that I can try new spark version by setting this property as false, of course it is only for zeppelin developer. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2317) Add import note in the dropdown list of Notebook menu
Jeff Zhang created ZEPPELIN-2317: Summary: Add import note in the dropdown list of Notebook menu Key: ZEPPELIN-2317 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2317 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang Actually it take around 1-2 minutes to find out where can I import a note. I think it would be also better to add that in the dropdown list of Notebook menu -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2270) Kill livy session when creating session timeout
Jeff Zhang created ZEPPELIN-2270: Summary: Kill livy session when creating session timeout Key: ZEPPELIN-2270 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2270 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2293) Remove envName from interpreter-setting.json
Jeff Zhang created ZEPPELIN-2293: Summary: Remove envName from interpreter-setting.json Key: ZEPPELIN-2293 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2293 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 Environmental variable is only used in ZeppelinConfiguration. But Interpreter use properties to access interpreter setting instead of ZeppelinConfiguration, so we should remove envName from interpreter-setting.json, otherwise it would confuse users. \cc [~moon] [~jongyoul] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2294) Interpreter fail exception is not propagated to frontend
Jeff Zhang created ZEPPELIN-2294: Summary: Interpreter fail exception is not propagated to frontend Key: ZEPPELIN-2294 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2294 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2261) Support to connect with livy through https
Jeff Zhang created ZEPPELIN-2261: Summary: Support to connect with livy through https Key: ZEPPELIN-2261 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2261 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2352) merge_zeppelin_pr.py doesn't work for python 3
Jeff Zhang created ZEPPELIN-2352: Summary: merge_zeppelin_pr.py doesn't work for python 3 Key: ZEPPELIN-2352 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2352 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1 Reporter: Jeff Zhang Assignee: Jeff Zhang {code} File "dev/merge_zeppelin_pr.py", line 65 print "Unable to fetch URL, exiting: %s" % url ^ SyntaxError: Missing parentheses in call to 'print' {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2397) Add toJson and fromJson method for serializable objects
Jeff Zhang created ZEPPELIN-2397: Summary: Add toJson and fromJson method for serializable objects Key: ZEPPELIN-2397 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2397 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.1 Reporter: Jeff Zhang Assignee: Jeff Zhang Instead of do serialize/deserialize out of these objects. These object should just provide wrap serialize/deserialize in itself, provide toJson and fromJson method instead. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2372) Flaky Test: ZeppelinIT & ParagraphActionsIT
Jeff Zhang created ZEPPELIN-2372: Summary: Flaky Test: ZeppelinIT & ParagraphActionsIT Key: ZEPPELIN-2372 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2372 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1 Reporter: Jeff Zhang Priority: Minor https://travis-ci.org/zjffdu/zeppelin/jobs/219575644 {code} Tests in error: ZeppelinIT.testSparkInterpreterDependencyLoading:234->AbstractZeppelinIT.waitForParagraph:68->AbstractZeppelinIT.pollingWait:94 » Timeout ParagraphActionsIT.testRunOnSelectionChange:306 » NoSuchElement Unable to loca... {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2379) Make the height of paragraph changeable
Jeff Zhang created ZEPPELIN-2379: Summary: Make the height of paragraph changeable Key: ZEPPELIN-2379 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2379 Project: Zeppelin Issue Type: New Feature Components: front-end Affects Versions: 0.7.1 Reporter: Jeff Zhang I notice that the width of paragraph can be changed, but height is not changeable. This would make the layout difficult sometimes. Attachment illustrate what I want but I can not make it due to the height of paragraph can not be changed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2384) Add configuration for not storing angularObject in note.json
Jeff Zhang created ZEPPELIN-2384: Summary: Add configuration for not storing angularObject in note.json Key: ZEPPELIN-2384 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2384 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.7.1 Reporter: Jeff Zhang AngularObject may contain some credential information of backend, user may not want to store it in note.json via plain text format. -- This message was sent by Atlassian JIRA (v6.3.15#6346)