[jira] [Created] (ZEPPELIN-1247) JdbcInterpreter is always chosen as the default interpreter.
Jeff Zhang created ZEPPELIN-1247: Summary: JdbcInterpreter is always chosen as the default interpreter. Key: ZEPPELIN-1247 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1247 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1242) Should set property SPARK_YARN_MODE before creating SparkILoop
Jeff Zhang created ZEPPELIN-1242: Summary: Should set property SPARK_YARN_MODE before creating SparkILoop Key: ZEPPELIN-1242 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1242 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1267) PySparkInterpreter doesn't work in spark 2.0
Jeff Zhang created ZEPPELIN-1267:
Summary: PySparkInterpreter doesn't work in spark 2.0
Key: ZEPPELIN-1267
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1267
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Assignee: Jeff Zhang
py4j is not distributed to executors.
{noformat}
Error from python worker:
/usr/bin/python: No module named pyspark
PYTHONPATH was:
/Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/filecache/27/__spark_libs__3944184934921201174.zip/spark-core_2.11-2.0.0.jar
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1270) Remove getting SQLContext from SparkSession.wrapped()
Jeff Zhang created ZEPPELIN-1270:
Summary: Remove getting SQLContext from SparkSession.wrapped()
Key: ZEPPELIN-1270
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1270
Project: Zeppelin
Issue Type: Improvement
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Assignee: Jeff Zhang
Priority: Minor
SparkSession.wrapped is only for spark 2.0 preview, it is not supported in
spark 2.0 release. So I think we can remove that piece of code. Otherwise we
will get the following error in log which might be a little confusing.
{noformat}
08:05:44,946 - Thread(pool-2-thread-3) - (Utils.java:40) -
org.apache.spark.sql.SparkSession.wrapped()
java.lang.NoSuchMethodException: org.apache.spark.sql.SparkSession.wrapped()
at java.lang.Class.getMethod(Class.java:1786)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at
org.apache.zeppelin.spark.SparkInterpreter.getSQLContext_2(SparkInterpreter.java:241)
at
org.apache.zeppelin.spark.SparkInterpreter.getSQLContext(SparkInterpreter.java:229)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:744)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.spark.SparkRInterpreter.getSparkInterpreter(SparkRInterpreter.java:188)
at
org.apache.zeppelin.spark.SparkRInterpreter.open(SparkRInterpreter.java:72)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1275) Comment code of PySparkInterpreter is not highlighted
Jeff Zhang created ZEPPELIN-1275: Summary: Comment code of PySparkInterpreter is not highlighted Key: ZEPPELIN-1275 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1275 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.0 Reporter: Jeff Zhang Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1263) Should specify zeppelin's spark configuration through --conf arguments of spark-submit
Jeff Zhang created ZEPPELIN-1263: Summary: Should specify zeppelin's spark configuration through --conf arguments of spark-submit Key: ZEPPELIN-1263 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1263 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang Assignee: Jeff Zhang For now, we load zeppelin's spark configuration at runtime in the RemoteInterpreter Process rather than loading them before starting the process (through --conf of spark-submit). It is fine for most of spark configuration, but for some configuration, it would introduce some weird issues. Like ZEPPELIN-1242, and if you specify spark.master as yarn-client in spark-defaults.conf but specify spark.master as local in zeppelin side, you will see the spark interpreter fail to start due to this inconsistency. So I propose to specify zeppelin's spark configuration through --conf arguments of spark-submit -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1287) No need to call print to display output in PythonInterpreter
Jeff Zhang created ZEPPELIN-1287: Summary: No need to call print to display output in PythonInterpreter Key: ZEPPELIN-1287 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1287 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1172) NPE in ResourcePoolUtils when creating remote interepter
Jeff Zhang created ZEPPELIN-1172:
Summary: NPE in ResourcePoolUtils when creating remote interepter
Key: ZEPPELIN-1172
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1172
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.6.0
Reporter: Jeff Zhang
Although eventually, the remote interpreter will be created, seem no function
is affected. But this kind of log is very confusing and scaring.
{format}
INFO [2016-07-14 11:25:18,047] ({pool-2-thread-2}
RemoteInterpreterManagedProcess.java[start]:114) - Run interpreter process
[/Users/jzhang/github/zeppelin/bin/interpreter.sh, -d,
/Users/jzhang/github/zeppelin/interpreter/spark, -p, 54477, -l,
/Users/jzhang/github/zeppelin/local-repo/2B92N2SP5]
ERROR [2016-07-14 11:25:18,068] ({qtp1458849419-16}
ResourcePoolUtils.java[getAllResourcesExcept]:64) -
java.lang.NullPointerException
at
org.apache.zeppelin.resource.ResourcePoolUtils.getAllResourcesExcept(ResourcePoolUtils.java:58)
at
org.apache.zeppelin.resource.ResourcePoolUtils.getAllResources(ResourcePoolUtils.java:36)
at org.apache.zeppelin.helium.Helium.suggestApp(Helium.java:153)
at org.apache.zeppelin.rest.HeliumRestApi.suggest(HeliumRestApi.java:83)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180)
at
org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:100)
at
org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:57)
at
org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:93)
at
org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272)
at
org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
at
org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
at
org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:222)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:153)
at
org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:167)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:286)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:211)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:575)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:262)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669)
at
org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
at
org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
...
{format}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1175) AM log is not available for yarn-client mode
Jeff Zhang created ZEPPELIN-1175:
Summary: AM log is not available for yarn-client mode
Key: ZEPPELIN-1175
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1175
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.6.0
Reporter: Jeff Zhang
Zeppelin's log4j.properties is propagated to AM, so that the AM can not
initialize log4j properly. Because zeppelin's log4j.properties will use
${zeppelin.log.file} which is only for zeppelin server.
Here's the error message in AM
{code}
log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: (No such file or directory)
at java.io.FileOutputStream.open0(Native Method)
at java.io.FileOutputStream.open(FileOutputStream.java:270)
at java.io.FileOutputStream.(FileOutputStream.java:213)
at java.io.FileOutputStream.(FileOutputStream.java:133)
at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
at
org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
at
org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
at
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
at
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
at
org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
at
org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
at
org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
at
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
at
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
at
org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
at org.apache.log4j.LogManager.(LogManager.java:127)
at org.apache.spark.Logging$class.initializeLogging(Logging.scala:121)
at
org.apache.spark.Logging$class.initializeIfNecessary(Logging.scala:106)
at org.apache.spark.Logging$class.log(Logging.scala:50)
at
org.apache.spark.executor.CoarseGrainedExecutorBackend$.log(CoarseGrainedExecutorBackend.scala:138)
at
org.apache.spark.executor.CoarseGrainedExecutorBackend$.run(CoarseGrainedExecutorBackend.scala:149)
at
org.apache.spark.executor.CoarseGrainedExecutorBackend$.main(CoarseGrainedExecutorBackend.scala:253)
at
org.apache.spark.executor.CoarseGrainedExecutorBackend.main(CoarseGrainedExecutorBackend.scala)
log4j:ERROR Either File or DatePattern options are not set for appender
[dailyfile].
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/grid/0/hadoop/yarn/local/filecache/27/spark-hdp-assembly.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/grid/0/hdp/2.5.0.0-965/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1222) ClassNotFoundException of SparkJLineCompletion in Spark Interpreter
Jeff Zhang created ZEPPELIN-1222:
Summary: ClassNotFoundException of SparkJLineCompletion in Spark
Interpreter
Key: ZEPPELIN-1222
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1222
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Assignee: Jeff Zhang
{code}
INFO [2016-07-21 10:58:02,654] ({pool-2-thread-2} Logging.scala[logInfo]:58) -
Successfully started service 'HTTP class server' on port 54947.
ERROR [2016-07-21 10:58:04,312] ({pool-2-thread-2}
Utils.java[instantiateClass]:74) - SparkJLineCompletion
java.lang.ClassNotFoundException: SparkJLineCompletion
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.zeppelin.spark.Utils.instantiateClass(Utils.java:70)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:579)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
INFO [2016-07-21 10:58:04,314] ({pool-2-thread-2}
SparkInterpreter.java[createSparkContext]:254) - -- Create new SparkContext
yarn-client ---
INFO [2016-07-21 10:58:04,330] ({pool-2-thread-2} Logging.scala[logInfo]:58) -
Running Spark version 1.6.1
INFO [2016-07-21 10:58:04,345] ({pool-2-thread-2} Logging.scala[logInfo]:58) -
Spark configuration:
args=
master=yarn-client
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1197) Should print output directly without invoking function print in pyspark interpreter.
Jeff Zhang created ZEPPELIN-1197: Summary: Should print output directly without invoking function print in pyspark interpreter. Key: ZEPPELIN-1197 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1197 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.6.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1215) Need to login using keytab and principal before creating SparkContext in secured cluster
Jeff Zhang created ZEPPELIN-1215: Summary: Need to login using keytab and principal before creating SparkContext in secured cluster Key: ZEPPELIN-1215 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1215 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1217) Can not see the whole configuration table in install page
Jeff Zhang created ZEPPELIN-1217: Summary: Can not see the whole configuration table in install page Key: ZEPPELIN-1217 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1217 Project: Zeppelin Issue Type: Bug Components: documentation Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor In the install page, I can not see the whole configuration, I have to move the scroll bar under the table to see the description section. This is very inconvenient for me. \cc [~Ahyoung] https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/install.html#apache-zeppelin-configuration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1218) HeliumApplicationFactoryTest fails
Jeff Zhang created ZEPPELIN-1218:
Summary: HeliumApplicationFactoryTest fails
Key: ZEPPELIN-1218
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1218
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Not sure why it succeeded on github travis-ci, are these tests ignored on
travis-ci ? \cc [~moon]
{noformat}
Tests run: 5, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 120.363 sec <<<
FAILURE! - in org.apache.zeppelin.helium.HeliumApplicationFactoryTest
testUnloadOnInterpreterUnbind(org.apache.zeppelin.helium.HeliumApplicationFactoryTest)
Time elapsed: 30.147 sec <<< ERROR!
java.lang.ClassCastException: java.lang.String cannot be cast to
org.apache.zeppelin.interpreter.InterpreterResult
at org.apache.zeppelin.notebook.Paragraph.getResult(Paragraph.java:232)
at
org.apache.zeppelin.helium.HeliumApplicationFactoryTest.testUnloadOnInterpreterUnbind(HeliumApplicationFactoryTest.java:224)
testLoadRunUnloadApplication(org.apache.zeppelin.helium.HeliumApplicationFactoryTest)
Time elapsed: 30.054 sec <<< ERROR!
java.lang.ClassCastException: java.lang.String cannot be cast to
org.apache.zeppelin.interpreter.InterpreterResult
at org.apache.zeppelin.notebook.Paragraph.getResult(Paragraph.java:232)
at
org.apache.zeppelin.helium.HeliumApplicationFactoryTest.testLoadRunUnloadApplication(HeliumApplicationFactoryTest.java:142)
testUnloadOnInterpreterRestart(org.apache.zeppelin.helium.HeliumApplicationFactoryTest)
Time elapsed: 30.071 sec <<< ERROR!
java.lang.ClassCastException: java.lang.String cannot be cast to
org.apache.zeppelin.interpreter.InterpreterResult
at org.apache.zeppelin.notebook.Paragraph.getResult(Paragraph.java:232)
at
org.apache.zeppelin.helium.HeliumApplicationFactoryTest.testUnloadOnInterpreterRestart(HeliumApplicationFactoryTest.java:290)
testUnloadOnParagraphRemove(org.apache.zeppelin.helium.HeliumApplicationFactoryTest)
Time elapsed: 30.062 sec <<< ERROR!
java.lang.ClassCastException: java.lang.String cannot be cast to
org.apache.zeppelin.interpreter.InterpreterResult
at org.apache.zeppelin.notebook.Paragraph.getResult(Paragraph.java:232)
at
org.apache.zeppelin.helium.HeliumApplicationFactoryTest.testUnloadOnParagraphRemove(HeliumApplicationFactoryTest.java:186)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1185) ZEPPELIN_INTP_JAVA_OPTS should not use ZEPPELIN_JAVA_OPTS as default value
Jeff Zhang created ZEPPELIN-1185:
Summary: ZEPPELIN_INTP_JAVA_OPTS should not use ZEPPELIN_JAVA_OPTS
as default value
Key: ZEPPELIN-1185
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1185
Project: Zeppelin
Issue Type: Improvement
Components: Core
Affects Versions: 0.6.0
Reporter: Jeff Zhang
Priority: Minor
For now, if ZEPPELIN_INTP_JAVA_OPTS is not defined it would use
ZEPPELIN_JAVA_OPTS. I don't think it make sense to do that implicitly as it may
not be the user intend to do. If user want to specify custom java opts for
interpreter process, then let them do it by himself.
Besides this introduce some unexpected behavior, e.g. I set ZEPPELIN_JAVA_OPTS
as following to remote debug, but this setting will also apply to the remote
interpreter process which cause it hang there.
{code}
export
ZEPPELIN_JAVA_OPTS="-agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=5005"
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1187) Redirect output of the process running interpreter.sh to log4j
Jeff Zhang created ZEPPELIN-1187: Summary: Redirect output of the process running interpreter.sh to log4j Key: ZEPPELIN-1187 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1187 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.6.0 Reporter: Jeff Zhang Priority: Minor For now the output of process running interpter.sh is lost, it would be nice to redirect it to log4j for debugging, especially debugging related with interpreter.sh -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1311) Typo in ZEPPELIN-1197
Jeff Zhang created ZEPPELIN-1311: Summary: Typo in ZEPPELIN-1197 Key: ZEPPELIN-1311 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1311 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1, 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Attachments: 2016-08-09_1528.png My bad, it should be "Exception" rather than "Execution" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1334) Environment variable defined in interpreter setting doesn't take effect
Jeff Zhang created ZEPPELIN-1334: Summary: Environment variable defined in interpreter setting doesn't take effect Key: ZEPPELIN-1334 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1334 Project: Zeppelin Issue Type: Bug Components: zeppelin-interpreter Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1338) User level interpreter setting
Jeff Zhang created ZEPPELIN-1338: Summary: User level interpreter setting Key: ZEPPELIN-1338 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1338 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang Assignee: Jeff Zhang For now the interpreter setting is global applied. That means if user A change interpreter setting of spark, it would apply to others, this is a pretty bad user experience. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1337) Umbrella for multiple user support for zeppelin
Jeff Zhang created ZEPPELIN-1337: Summary: Umbrella for multiple user support for zeppelin Key: ZEPPELIN-1337 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1337 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.6.1 Reporter: Jeff Zhang I create this umbrella ticket for multiple user support for zeppelin. And I create/move some following subtask. Please add any subtask that I miss here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1339) Note management per user
Jeff Zhang created ZEPPELIN-1339: Summary: Note management per user Key: ZEPPELIN-1339 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1339 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang For now, there’s no concept like workspace for user. Each user can see all the notes, it’s pretty hard to manage and organize that. I think there should be a module for managing and organizing the notes per user. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1340) Impersonation for interpreter
Jeff Zhang created ZEPPELIN-1340: Summary: Impersonation for interpreter Key: ZEPPELIN-1340 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1340 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang In the kerberized environment, all the interpreter use the same keytab/principal, this is pretty dangerous. E.g. User A can use shell interpreter which run as user B to delete all the files owned by user B. Although some interpreter has implement its kerbosed usage, I just feel we might need to make a general impersonation framework for all the interpreter (If not possible for all interpreter, but at least this framework should cover most of the interpreter). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1341) Build with profile scala-2.11 fails
Jeff Zhang created ZEPPELIN-1341:
Summary: Build with profile scala-2.11 fails
Key: ZEPPELIN-1341
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1341
Project: Zeppelin
Issue Type: Bug
Reporter: Jeff Zhang
Assignee: Jeff Zhang
{noformat}
[ERROR] Failed to execute goal on project zeppelin-spark_2.10: Could not
resolve dependencies for project
org.apache.zeppelin:zeppelin-spark_2.10:jar:0.7.0-SNAPSHOT: Failure to find
org.apache.zeppelin:zeppelin-display_2.11:jar:0.7.0-SNAPSHOT in
http://nexus-private.hortonworks.com/nexus/content/groups/public was cached in
the local repository, resolution will not be reattempted until the update
interval of public has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :zeppelin-spark_2.10
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2046) The final output is a little inconsistent with the streaming output
Jeff Zhang created ZEPPELIN-2046: Summary: The final output is a little inconsistent with the streaming output Key: ZEPPELIN-2046 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2046 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor Fix For: 0.7.1 As the attachment screenshot shows, the final output is not consistent with the streaming output. The final output has one extra blank lines between outputs. I believe the previous behavior is not like this. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2045) Pass interpreter properties with "spark." as prefix to SparkConf
Jeff Zhang created ZEPPELIN-2045: Summary: Pass interpreter properties with "spark." as prefix to SparkConf Key: ZEPPELIN-2045 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2045 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.1 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2079) Upgrade livy to 0.3 in livy interpreter
Jeff Zhang created ZEPPELIN-2079: Summary: Upgrade livy to 0.3 in livy interpreter Key: ZEPPELIN-2079 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2079 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2077) Add docs link to the latest version of zeppelin
Jeff Zhang created ZEPPELIN-2077: Summary: Add docs link to the latest version of zeppelin Key: ZEPPELIN-2077 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2077 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Currently, the doc link of zeppelin always has the version number. This is not convenient for other site that want to link to the zeppelin doc. It is a good practise to always has the latest version link for zeppelin. e.g. Here's the latest version doc link for spark http://spark.apache.org/docs/latest/ \cc [~Ahyoung] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2015) Improve parse logic of livy sql output
Jeff Zhang created ZEPPELIN-2015: Summary: Improve parse logic of livy sql output Key: ZEPPELIN-2015 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2015 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2151) Add integration test for livy cancel api
Jeff Zhang created ZEPPELIN-2151: Summary: Add integration test for livy cancel api Key: ZEPPELIN-2151 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2151 Project: Zeppelin Issue Type: Test Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2155) Flaky test: NotebookTest
Jeff Zhang created ZEPPELIN-2155:
Summary: Flaky test: NotebookTest
Key: ZEPPELIN-2155
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2155
Project: Zeppelin
Issue Type: Bug
Reporter: Jeff Zhang
https://travis-ci.org/zjffdu/zeppelin/jobs/204447551
{noformat}
Failed tests:
NotebookTest.testPublicPrivateNewNote:1173 expected:<2C[B7YJQ16]> but
was:<2C[A45Z6X7]>
NotebookTest.testAuthorizationRoles:759 expected: but was:
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-1985) Remove user from pig tutorial note
Jeff Zhang created ZEPPELIN-1985: Summary: Remove user from pig tutorial note Key: ZEPPELIN-1985 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1985 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Priority: Minor Should remove the user from pig tutorial note, otherwise it can not be seen in anonymous mode. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2195) Use PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON over zeppelin.pyspark.python
Jeff Zhang created ZEPPELIN-2195: Summary: Use PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON over zeppelin.pyspark.python Key: ZEPPELIN-2195 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2195 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2186) Screenshot for text input form is not used correctly
Jeff Zhang created ZEPPELIN-2186: Summary: Screenshot for text input form is not used correctly Key: ZEPPELIN-2186 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2186 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor Attachments: 2017-02-27_1142.png The screenshot is supposed to be example of text input form without default value, but it is the same as the screenshot of the text input form with default value. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2188) The default value in dropdown list is not selected by dfeault
Jeff Zhang created ZEPPELIN-2188:
Summary: The default value in dropdown list is not selected by
dfeault
Key: ZEPPELIN-2188
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2188
Project: Zeppelin
Issue Type: Improvement
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Priority: Minor
Use the following code to reproduce it. the default value 'jeff' is not
selected in the dropdown list.
{code}
%sh
echo -e "hello, ${name=jeff, jeff|andy|jerry}"
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2185) No tooltip displayed on chart type button
Jeff Zhang created ZEPPELIN-2185: Summary: No tooltip displayed on chart type button Key: ZEPPELIN-2185 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2185 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang It would be nice to display tooltip on the chart type when user hover on it especially when more helium plugins are introduced. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2189) The order of dynamic forms is messed up
Jeff Zhang created ZEPPELIN-2189:
Summary: The order of dynamic forms is messed up
Key: ZEPPELIN-2189
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2189
Project: Zeppelin
Issue Type: Improvement
Components: front-end
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Use the following code to reproduce it.
{code}
%spark
println(z.input("my_input", "default_name"))
println(z.select("my_select","select_2", Seq(("1", "select_1"), ("2",
"select_2"
println(z.checkbox("my_checkbox", Seq("check_1"), Seq(("1", "check_1"), ("2",
"check_2"
{code}
The dynamic forms order is checkbox, input text and dropdown list which is not
the order in which I define them in the code
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-1368) interpreter-setting.json may be loaded mutliple times
Jeff Zhang created ZEPPELIN-1368: Summary: interpreter-setting.json may be loaded mutliple times Key: ZEPPELIN-1368 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1368 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang There're several ways to load interpreter-setting.json, but for now we will load it multiple times. It is supposed to load only one. Here's the order to register interpreter * load from /conf//interpreter-setting.json * load from interpreter process classpath * register interpreter using the old way of Interpreter.register() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1403) Should maintain the using port list
Jeff Zhang created ZEPPELIN-1403: Summary: Should maintain the using port list Key: ZEPPELIN-1403 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1403 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor Fix For: 0.7.0 For now, in RemoteInterpreterManagedProcess we will first find one available port and then use this port in the interpreter process. But it is possible that 2 interpreters use the same port. Here's the scenarios. 1. Thread1 (Interpreter A) find available port 3000 2. Thread2 (Interpreter B) find available port 3000 3. Process for Interpreter A starts 4. Process for Interpreter B starts -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1401) Can not delete the last paragraph
Jeff Zhang created ZEPPELIN-1401: Summary: Can not delete the last paragraph Key: ZEPPELIN-1401 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1401 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Priority: Minor As the screenshot shows, I can not delete the last paragraph. Not sure whether it is expected or it is just because there's no space to display the 'Remove' command. \cc [~Mina Lee] [~Ahyoung] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1425) sparkr.zip is not distributed to executors
Jeff Zhang created ZEPPELIN-1425:
Summary: sparkr.zip is not distributed to executors
Key: ZEPPELIN-1425
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1425
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.6.1
Reporter: Jeff Zhang
Assignee: Jeff Zhang
So if R daemon is required in executor, the R script will fail.
How to reproduce it
{code}
df <- createDataFrame(sqlContext, mtcars)
showDF(df)
{code}
Exception in executor side:
{noformat}
10:16:20,024 INFO org.apache.spark.storage.memory.MemoryStore:54 - Block
broadcast_1 stored as values in memory (estimated size 14.2 KB, free 366.3 MB)
10:16:21,018 INFO org.apache.spark.api.r.BufferedStreamThread:54 - Fatal
error: cannot open file
'/Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/appcache/application_1473129941656_0037/container_1473129941656_0037_01_02/sparkr/SparkR/worker/daemon.R':
No such file or directory
10:16:31,023 ERROR org.apache.spark.executor.Executor:91 - Exception in task
0.2 in stage 1.0 (TID 3)
java.net.SocketTimeoutException: Accept timed out
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:404)
at java.net.ServerSocket.implAccept(ServerSocket.java:545)
at java.net.ServerSocket.accept(ServerSocket.java:513)
at org.apache.spark.api.r.RRunner$.createRWorker(RRunner.scala:367)
at org.apache.spark.api.r.RRunner.compute(RRunner.scala:69)
at org.apache.spark.api.r.BaseRRDD.compute(RRDD.scala:49)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1431) Improvments for LivyInterpreter
Jeff Zhang created ZEPPELIN-1431: Summary: Improvments for LivyInterpreter Key: ZEPPELIN-1431 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1431 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang Create this umbrella ticket for LivyInterpreter improvements. \cc [~prabhjyotsi...@apache.com] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1432) Support cancellation of paragraph execution
Jeff Zhang created ZEPPELIN-1432: Summary: Support cancellation of paragraph execution Key: ZEPPELIN-1432 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1432 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang Assignee: Jeff Zhang Although the cancel api of LivyInterpreter is implemented, but it just cancel to poll the result, didn't cancel the real execution in livy side. So it would better to cancel the execution on livy side as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1430) Display appId and webui link in LivyInterpreter's output
Jeff Zhang created ZEPPELIN-1430: Summary: Display appId and webui link in LivyInterpreter's output Key: ZEPPELIN-1430 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1430 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang For now, it is hard to figure out what the yarn application of the livy session represent, it would be better to display the appId and webui link in the output of LivyInterpreter for diagnosing purpose. It can also be applied to the native SparkInterpreter, but could be done in another ticket. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1477) Add Integration Test for LivyInterpreter
Jeff Zhang created ZEPPELIN-1477: Summary: Add Integration Test for LivyInterpreter Key: ZEPPELIN-1477 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1477 Project: Zeppelin Issue Type: Sub-task Components: Interpreters Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 Currently the unit test for LivyInterpreter is not sufficient, it can not cover many of things. I create this ticket to add Integration test for LivyInterpreter, so that we can don't need to manually verify LivyInterpreter for any following change. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1455) Flaky test: AbstractAngularElemTest
Jeff Zhang created ZEPPELIN-1455:
Summary: Flaky test: AbstractAngularElemTest
Key: ZEPPELIN-1455
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1455
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.6.1
Reporter: Jeff Zhang
https://travis-ci.org/apache/zeppelin/jobs/160932534
{code}
[32mAngularElem[0m
[31m- should provide onclick method *** FAILED ***[0m
[31m The code passed to eventually never returned normally. Attempted 1 times
over 2.155594141 seconds. Last failure message: 0 was not equal to 1.
(AbstractAngularElemTest.scala:72)[0m
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1456) Flaky Test: AuthenticationIT
Jeff Zhang created ZEPPELIN-1456:
Summary: Flaky Test: AuthenticationIT
Key: ZEPPELIN-1456
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1456
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.6.1
Reporter: Jeff Zhang
https://travis-ci.org/apache/zeppelin/jobs/160932541
{code}
Tests in error:
AuthenticationIT.testGroupPermission:179->AbstractZeppelinIT.pollingWait:96
» Timeout
Tests run: 15, Failures: 0, Errors: 1, Skipped: 0
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1377) Run remote interpreter process in remote machine
Jeff Zhang created ZEPPELIN-1377: Summary: Run remote interpreter process in remote machine Key: ZEPPELIN-1377 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1377 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.6.1 Reporter: Jeff Zhang Assignee: Jeff Zhang For now, all the remote interpreter process are running in the same host as zeppelin server, this is fine for single user. But after we support multiple users, there would be many remote interpreter process on the same host as each user would run its own interpreter process, I have concern about the scalability. So it would be better to run them on a remote host. One candidate solution is to run them as yarn application. This would be a big change, need design review before implementation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1374) Should prevent use dot in interpreter name
Jeff Zhang created ZEPPELIN-1374: Summary: Should prevent use dot in interpreter name Key: ZEPPELIN-1374 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1374 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.1 Reporter: Jeff Zhang Attachments: screenshot-1.png I create a new interpreter which I name it as "spark1_2.11" (I'd like to use multiple spark version for one zeppelin instance). But zeppelin didn't recognize it correctly as shown in the screenshot. The reason is that zeppelin use dot as the separator of interpreter group name and interpreter name. So here it takes "spark1_2" as the interpreter group name. So I believe we should prevent user to use dot in the interpreter name. We can pop up a error message box when user use dot in the interpreter name in the interpreter page. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1498) Flaky test: http://stackoverflow.com/questions/6121403/how-do-i-get-the-scala-version-from-within-scala-itself
Jeff Zhang created ZEPPELIN-1498:
Summary: Flaky test:
http://stackoverflow.com/questions/6121403/how-do-i-get-the-scala-version-from-within-scala-itself
Key: ZEPPELIN-1498
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1498
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.6.1
Reporter: Jeff Zhang
https://travis-ci.org/apache/zeppelin/builds/163016648
https://s3.amazonaws.com/archive.travis-ci.org/jobs/163016652/log.txt
{code}
---
Running org.apache.zeppelin.jdbc.JDBCInterpreterTest
Tests run: 8, Failures: 0, Errors: 8, Skipped: 0, Time elapsed: 0.199 sec <<<
FAILURE! - in org.apache.zeppelin.jdbc.JDBCInterpreterTest
testAutoCompletion(org.apache.zeppelin.jdbc.JDBCInterpreterTest) Time elapsed:
0.074 sec <<< ERROR!
java.nio.file.NoSuchFileException:
/home/travis/build/apache/zeppelin/jdbc/target/tmp/h2-test-1299779248643275151
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at
sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:383)
at java.nio.file.Files.createDirectory(Files.java:630)
at java.nio.file.TempFileHelper.create(TempFileHelper.java:136)
at java.nio.file.TempFileHelper.createTempDirectory(TempFileHelper.java:173)
at java.nio.file.Files.createTempDirectory(Files.java:944)
at
org.apache.zeppelin.jdbc.JDBCInterpreterTest.getJdbcConnection(JDBCInterpreterTest.java:58)
at
org.apache.zeppelin.jdbc.JDBCInterpreterTest.setUp(JDBCInterpreterTest.java:80)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1529) Confusing Error Message for livy interpreter
Jeff Zhang created ZEPPELIN-1529:
Summary: Confusing Error Message for livy interpreter
Key: ZEPPELIN-1529
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1529
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.6.1
Reporter: Jeff Zhang
The following code in livy interpreter will get very confusing error message.
{code}
sc.parallelize(1 to 10).
{code}
{noformat}
:29: error: value print is not a member of
org.apache.spark.rdd.RDD[Int]
possible cause: maybe a semicolon is missing before `value print'?
print("")
^
{noformat}
The cause is that we add print statement at the end of statement, not sure why
we do that.
{code}
String[] lines = stringLines.split("\n");
String[] linesToRun = new String[lines.length + 1];
for (int i = 0; i < lines.length; i++) {
linesToRun[i] = lines[i];
}
linesToRun[lines.length] = "print(\"\")";
{code}
\cc [~prabhjot]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1577) LivyInterpreter should not use FIFOScheduler
Jeff Zhang created ZEPPELIN-1577: Summary: LivyInterpreter should not use FIFOScheduler Key: ZEPPELIN-1577 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1577 Project: Zeppelin Issue Type: Sub-task Components: livy-interpreter Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Critical Fix For: 0.7.0 FIFOScheduler means there's only one thread to process client requests. So you will see that user1's job will block user2's job which doesn't make sense. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1574) Paragraph text should be trimmed
Jeff Zhang created ZEPPELIN-1574: Summary: Paragraph text should be trimmed Key: ZEPPELIN-1574 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1574 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1571) Support pig udf interpreter
Jeff Zhang created ZEPPELIN-1571: Summary: Support pig udf interpreter Key: ZEPPELIN-1571 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1571 Project: Zeppelin Issue Type: New Feature Components: Interpreters Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1707) Pass userName when creating interpreter through thrift
Jeff Zhang created ZEPPELIN-1707: Summary: Pass userName when creating interpreter through thrift Key: ZEPPELIN-1707 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1707 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang In ZEPPELIN-1607, I'd like refactor livy interpreter to scoped mode by default, this require username when open this interpreter. So I propose to pass username when creating interpreter through thrift. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1716) Error of interpreter not found is not propagated to frontend.
Jeff Zhang created ZEPPELIN-1716: Summary: Error of interpreter not found is not propagated to frontend. Key: ZEPPELIN-1716 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1716 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang It is introduced in ZEPPELIN-1399, we call InterpreterFactory.getInterpreter before calling Paragraph.jobRun -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1717) Weird output for SparkR
Jeff Zhang created ZEPPELIN-1717:
Summary: Weird output for SparkR
Key: ZEPPELIN-1717
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1717
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Jeff Zhang
This is my source code and output
{code}
%spark.r
df <- as.DataFrame(faithful)
head(df)
{code}
Output
{code}
1 function (x, df1, df2, ncp, log = FALSE)
2 {
3 if (missing(ncp))
4 .Call(C_df, x, df1, df2, log)
5 else .Call(C_dnf, x, df1, df2, ncp, log)
6 }
{code}
The output in spark-shell is
{code}
> head(df)
eruptions waiting
1 3.600 79
2 1.800 54
3 3.333 74
4 2.283 62
5 4.533 85
6 2.883 55
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1595) Make ZeppelinContext extensible
Jeff Zhang created ZEPPELIN-1595: Summary: Make ZeppelinContext extensible Key: ZEPPELIN-1595 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1595 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.6.2 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 For now, ZeppelinContext only support Spark Interpreter. I'd like to make it extensible, so that it can support other interpreters as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1616) Interpreter open happens in jobRun
Jeff Zhang created ZEPPELIN-1616: Summary: Interpreter open happens in jobRun Key: ZEPPELIN-1616 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1616 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1613) PerUser scoped mode doesn't work
Jeff Zhang created ZEPPELIN-1613: Summary: PerUser scoped mode doesn't work Key: ZEPPELIN-1613 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1613 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Critical For perUser scoped mode, difference users still use the same interpreter instance which is incorrect. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1770) Restart only the client user's interpreter when restarting interpreter setting
Jeff Zhang created ZEPPELIN-1770: Summary: Restart only the client user's interpreter when restarting interpreter setting Key: ZEPPELIN-1770 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1770 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.7.0 Reporter: Jeff Zhang ZEPPELIN-1306 implement the feature to restart the interpreter associated with the notes, this ticket is to implement to restart the interpreter associated with the user if user click to restart in the interpreter setting page. Actually I think in future multiple user would be the major use case for zeppelin, so we should take user as the first dimension/parameter for any operation as opposed before we take noteId as the first dimension/parameter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1769) Support cancel job in SparkRInterpereter
Jeff Zhang created ZEPPELIN-1769: Summary: Support cancel job in SparkRInterpereter Key: ZEPPELIN-1769 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1769 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang cancel is not support for SparkR now, This ticket is trying to add cancel support for SparkRInterpreter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1778) Potential security issue for passing user credential to interpreter process
Jeff Zhang created ZEPPELIN-1778: Summary: Potential security issue for passing user credential to interpreter process Key: ZEPPELIN-1778 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1778 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.2, 0.7.0 Reporter: Jeff Zhang Priority: Critical Currently zeppelin-server will pass user credential info to interpreter process through thrift. This would cause potential security issue as I think the thrift protocol we used for now is not secured. One solution is to enable SSL for thrift. Besides, there're 2 other problems: * credential info will be save in conf/credentials.json in plain text. * credential info be passed to all the interpreters no matter whether this interpreter need this. \cc [~moon] [~vinayshu...@gmail.com] [~prasadwagle] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1785) Clarify where to pick up ZeppelinConfiguration
Jeff Zhang created ZEPPELIN-1785: Summary: Clarify where to pick up ZeppelinConfiguration Key: ZEPPELIN-1785 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1785 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang The current issue I found is that zeppelin.notebook.dir defined in zeppelin-site.xml doesn't take effect. Because we define it in https://github.com/apache/zeppelin/blob/master/bin/common.sh#L52 and ZeppelinConfiguration will pick up configugration through enviroment variable by first. I think some other conf like zeppelin.interpreter.dir are the same. There're 2 solutions for it. * Remove them in common.sh * Preferer property in zeppelin-site.xml over enviroment variable. Personally, I prefer the second solution. As I think property is easier to understand, and we should use zeppelin-site as central place for all the configurations. This is also the approach what spark use. \cc [~moon] [~luciano resende] [~anthonycorbacho] [~jongyoul] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1786) Refactor LivyHelper
Jeff Zhang created ZEPPELIN-1786: Summary: Refactor LivyHelper Key: ZEPPELIN-1786 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1786 Project: Zeppelin Issue Type: Sub-task Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1794) Flaky test: InterpreterIT
Jeff Zhang created ZEPPELIN-1794:
Summary: Flaky test: InterpreterIT
Key: ZEPPELIN-1794
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1794
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Jeff Zhang
https://api.travis-ci.org/jobs/183237658/log.txt?deansi=true
{noformat}
13:12:21,028 INFO org.apache.zeppelin.integration.ZeppelinIT:189 -
testCreateNotebook Test executed
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 217.56 sec - in
org.apache.zeppelin.integration.ZeppelinIT
Results :
Tests in error:
InterpreterIT.testShowDescriptionOnInterpreterCreate:69 » ElementNotVisible
El...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1816) Implement getProgress in SparkRInterpreter
Jeff Zhang created ZEPPELIN-1816: Summary: Implement getProgress in SparkRInterpreter Key: ZEPPELIN-1816 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1816 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 Since I add jobGroup in ZEPPELIN-1769, it is easy to implement getProgress as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1773) Remove method destroy() in Interpreter
Jeff Zhang created ZEPPELIN-1773: Summary: Remove method destroy() in Interpreter Key: ZEPPELIN-1773 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1773 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor IMHO destroy is a little functional duplicated with close. And it seems currently only cassandra use destroy and it just calls close() https://github.com/apache/zeppelin/blob/master/cassandra/src/main/java/org/apache/zeppelin/cassandra/CassandraInterpreter.java#L231. So IMO, we could delete destroy method, also we can delete the destroy method in InterpreterGroup. \cc [~moon] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1746) Flaky test: PySparkInterpreterTest
Jeff Zhang created ZEPPELIN-1746:
Summary: Flaky test: PySparkInterpreterTest
Key: ZEPPELIN-1746
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1746
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Jeff Zhang
{noformat}
import org.apache.spark.sql.functions._
16/12/03 11:25:07 INFO PySparkInterpreter: File
/tmp/zeppelin_pyspark-6720028130103128200.py created
16/12/03 11:25:07 INFO SparkInterpreter: Sending metainfos to Zeppelin server:
{url=http://172.17.0.3:4040}
Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 51.398 sec <<<
FAILURE! - in org.apache.zeppelin.spark.PySparkInterpreterTest
testBasicIntp(org.apache.zeppelin.spark.PySparkInterpreterTest) Time elapsed:
49.033 sec <<< FAILURE!
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.zeppelin.spark.PySparkInterpreterTest.testBasicIntp(PySparkInterpreterTest.java:128)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1892) Display label vertically or horizontally smartly
Jeff Zhang created ZEPPELIN-1892: Summary: Display label vertically or horizontally smartly Key: ZEPPELIN-1892 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1892 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang Sometimes, the label would be a little long. In this case, it would be better to display label vertically. Attach one sample where the x axis is date. There's much overlap between labels, so it is better to display label vertically in this case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1903) ZeppelinContext can not display pandas DataFrame in PySparkInterpreter
Jeff Zhang created ZEPPELIN-1903: Summary: ZeppelinContext can not display pandas DataFrame in PySparkInterpreter Key: ZEPPELIN-1903 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1903 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1899) Fail to plot in pyspark interpreter
Jeff Zhang created ZEPPELIN-1899:
Summary: Fail to plot in pyspark interpreter
Key: ZEPPELIN-1899
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1899
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Here's 2 paraphrase I use to reproduce this issue, you can also see the
attachment.
Paragraph_1
{code}
%spark.pyspark
import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
dateparse = lambda dates: pd.datetime.strptime(dates, '%Y-%m')
data = pd.read_csv("/Users/jzhang/AirPassengers.csv", parse_dates='Month',
index_col='Month', date_parser=dateparse)
print(data.head())
print("\n Data Types:")
print(data.dtypes)
{code}
Paragraph_2
{code}
data.index
ts = data['#Passengers']
plt.plot(ts)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1882) Some chart doesn't work in dynamic form of dropdown list
Jeff Zhang created ZEPPELIN-1882: Summary: Some chart doesn't work in dynamic form of dropdown list Key: ZEPPELIN-1882 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1882 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Attachments: Pig Tutorial.gif Attach the screenshot, not sure whether it relate with dropdown list. It works in textbox but doens't work in dropdown list, very weird. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1881) Some chart doesn't work in dynamic form of dropdown list
Jeff Zhang created ZEPPELIN-1881: Summary: Some chart doesn't work in dynamic form of dropdown list Key: ZEPPELIN-1881 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1881 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Attach the screenshot, not sure whether it relate with dropdown list. It works in textbox but doens't work in dropdown list, very weird. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1893) Extra non-necessary info is output in python interpreter when using matplotlib
Jeff Zhang created ZEPPELIN-1893: Summary: Extra non-necessary info is output in python interpreter when using matplotlib Key: ZEPPELIN-1893 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1893 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Please see the attached screenshot. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1894) Matplotlib is very slow in python interpreter
Jeff Zhang created ZEPPELIN-1894:
Summary: Matplotlib is very slow in python interpreter
Key: ZEPPELIN-1894
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1894
Project: Zeppelin
Issue Type: Improvement
Affects Versions: 0.7.0
Reporter: Jeff Zhang
The following code takes 20 seconds in zeppelin python interpreter. But it only
take 1 second in jupyter.
{code}
import matplotlib.pyplot as plt
import numpy as np
x = np.random.normal(0,1,1024)
y = np.random.normal(0,1,1024)
plt.scatter(x,y, s=25)
plt.xlim((-2,2))
plt.ylim((-2,2))
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1898) White spaces in the beginning is stripped in pyspark interpreter
Jeff Zhang created ZEPPELIN-1898:
Summary: White spaces in the beginning is stripped in pyspark
interpreter
Key: ZEPPELIN-1898
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1898
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Here's the code to reproduce this issue.
{code}
%spark.pyspark
import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
dateparse = lambda dates: pd.datetime.strptime(dates, '%Y-%m')
data = pd.read_csv("/Users/jzhang/AirPassengers.csv", parse_dates='Month',
index_col='Month', date_parser=dateparse)
print(data.head())
print("\n Data Types:")
print(data.dtypes)
{code}
And attach the screenshot I see in zeppelin and jupyter
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1900) Paragraph's top right area overlap with markdown output
Jeff Zhang created ZEPPELIN-1900: Summary: Paragraph's top right area overlap with markdown output Key: ZEPPELIN-1900 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1900 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Please see the screenshot attached. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1891) Allow to display percentage in pie chart
Jeff Zhang created ZEPPELIN-1891: Summary: Allow to display percentage in pie chart Key: ZEPPELIN-1891 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1891 Project: Zeppelin Issue Type: Improvement Components: front-end Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Minor Currently, the pie chart display absolute number, but usually it make more sense to display percentage for pie chart. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1890) Groups in pie chart is a little misleading
Jeff Zhang created ZEPPELIN-1890: Summary: Groups in pie chart is a little misleading Key: ZEPPELIN-1890 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1890 Project: Zeppelin Issue Type: Bug Components: front-end Affects Versions: 0.7.0 Reporter: Jeff Zhang Attachments: zeppelin_pie.gif When I add fields to Groups for pie chart. The pie chart changes, I don't know how that happens. If the pie chart needs to be updated, it should split further for the new fields in Groups, but what I see is the proportion of each part changes. This is a little misleading for me. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1901) Output schema might be null for PigQueryInterpreter
Jeff Zhang created ZEPPELIN-1901: Summary: Output schema might be null for PigQueryInterpreter Key: ZEPPELIN-1901 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1901 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1889) Multiple groups in chart doesn't work
Jeff Zhang created ZEPPELIN-1889: Summary: Multiple groups in chart doesn't work Key: ZEPPELIN-1889 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1889 Project: Zeppelin Issue Type: Bug Components: front-end Affects Versions: 0.7.0 Reporter: Jeff Zhang Attachments: zeppelin_ui.gif Attach the screenshot to illustrate the issue. * Step 1, I choose 2 fields as group, the chart doesn't change, but the legend changes. * Step 2, I rerun the paragraph, the chart disappear. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1918) SPARK_VER doesn't take effect in travis
Jeff Zhang created ZEPPELIN-1918: Summary: SPARK_VER doesn't take effect in travis Key: ZEPPELIN-1918 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1918 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Priority: Blocker @ejono found that zeppelin could not build with spark 2.1.0. And the root cause is that SPARK_VER doesn't take effect in travis. Not sure when this issue come up. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1933) Add queue configuration in pig interpreter
Jeff Zhang created ZEPPELIN-1933: Summary: Add queue configuration in pig interpreter Key: ZEPPELIN-1933 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1933 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1852) Use multiple InterpreterResult for displaying appInfo
Jeff Zhang created ZEPPELIN-1852: Summary: Use multiple InterpreterResult for displaying appInfo Key: ZEPPELIN-1852 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1852 Project: Zeppelin Issue Type: Sub-task Components: livy-interpreter Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1853) Add README for livy interpreter
Jeff Zhang created ZEPPELIN-1853: Summary: Add README for livy interpreter Key: ZEPPELIN-1853 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1853 Project: Zeppelin Issue Type: Improvement Components: livy-interpreter Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1851) LazyOpenInterpreter would open interpreter multiple times when open fails
Jeff Zhang created ZEPPELIN-1851: Summary: LazyOpenInterpreter would open interpreter multiple times when open fails Key: ZEPPELIN-1851 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1851 Project: Zeppelin Issue Type: Bug Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1866) No meaningful exception for pig interpreter under tez engine
Jeff Zhang created ZEPPELIN-1866: Summary: No meaningful exception for pig interpreter under tez engine Key: ZEPPELIN-1866 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1866 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1867) Update document for pig interpreter and add one sample note
Jeff Zhang created ZEPPELIN-1867: Summary: Update document for pig interpreter and add one sample note Key: ZEPPELIN-1867 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1867 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.7.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2327) Add option to dynamic form to control whether running paragraph automatically
Jeff Zhang created ZEPPELIN-2327: Summary: Add option to dynamic form to control whether running paragraph automatically Key: ZEPPELIN-2327 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2327 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Currently, paragraph will be rerun automatically after I change the value of dynamic form. This is good for single control, but if I have multiple controls in the frontend. Usually, I want to create a button myself to trigger the rerun. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2324) Add property zeppelin.spark.unSupportedVersionCheck for trying new spark version
Jeff Zhang created ZEPPELIN-2324: Summary: Add property zeppelin.spark.unSupportedVersionCheck for trying new spark version Key: ZEPPELIN-2324 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2324 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang For now, every time when I want to try new spark version, I have to change file SparkVersion and rebuild it. It is not so convenient, so I'd like to add property zeppelin.spark.unSupportedVersionCheck for spark interpreter. So that I can try new spark version by setting this property as false, of course it is only for zeppelin developer. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2317) Add import note in the dropdown list of Notebook menu
Jeff Zhang created ZEPPELIN-2317: Summary: Add import note in the dropdown list of Notebook menu Key: ZEPPELIN-2317 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2317 Project: Zeppelin Issue Type: Improvement Reporter: Jeff Zhang Actually it take around 1-2 minutes to find out where can I import a note. I think it would be also better to add that in the dropdown list of Notebook menu -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2270) Kill livy session when creating session timeout
Jeff Zhang created ZEPPELIN-2270: Summary: Kill livy session when creating session timeout Key: ZEPPELIN-2270 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2270 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2293) Remove envName from interpreter-setting.json
Jeff Zhang created ZEPPELIN-2293: Summary: Remove envName from interpreter-setting.json Key: ZEPPELIN-2293 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2293 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 Environmental variable is only used in ZeppelinConfiguration. But Interpreter use properties to access interpreter setting instead of ZeppelinConfiguration, so we should remove envName from interpreter-setting.json, otherwise it would confuse users. \cc [~moon] [~jongyoul] -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2294) Interpreter fail exception is not propagated to frontend
Jeff Zhang created ZEPPELIN-2294: Summary: Interpreter fail exception is not propagated to frontend Key: ZEPPELIN-2294 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2294 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2261) Support to connect with livy through https
Jeff Zhang created ZEPPELIN-2261: Summary: Support to connect with livy through https Key: ZEPPELIN-2261 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2261 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2352) merge_zeppelin_pr.py doesn't work for python 3
Jeff Zhang created ZEPPELIN-2352:
Summary: merge_zeppelin_pr.py doesn't work for python 3
Key: ZEPPELIN-2352
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2352
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.1
Reporter: Jeff Zhang
Assignee: Jeff Zhang
{code}
File "dev/merge_zeppelin_pr.py", line 65
print "Unable to fetch URL, exiting: %s" % url
^
SyntaxError: Missing parentheses in call to 'print'
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2397) Add toJson and fromJson method for serializable objects
Jeff Zhang created ZEPPELIN-2397: Summary: Add toJson and fromJson method for serializable objects Key: ZEPPELIN-2397 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2397 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.1 Reporter: Jeff Zhang Assignee: Jeff Zhang Instead of do serialize/deserialize out of these objects. These object should just provide wrap serialize/deserialize in itself, provide toJson and fromJson method instead. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2372) Flaky Test: ZeppelinIT & ParagraphActionsIT
Jeff Zhang created ZEPPELIN-2372:
Summary: Flaky Test: ZeppelinIT & ParagraphActionsIT
Key: ZEPPELIN-2372
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2372
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.1
Reporter: Jeff Zhang
Priority: Minor
https://travis-ci.org/zjffdu/zeppelin/jobs/219575644
{code}
Tests in error:
ZeppelinIT.testSparkInterpreterDependencyLoading:234->AbstractZeppelinIT.waitForParagraph:68->AbstractZeppelinIT.pollingWait:94
» Timeout
ParagraphActionsIT.testRunOnSelectionChange:306 » NoSuchElement Unable to
loca...
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2379) Make the height of paragraph changeable
Jeff Zhang created ZEPPELIN-2379: Summary: Make the height of paragraph changeable Key: ZEPPELIN-2379 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2379 Project: Zeppelin Issue Type: New Feature Components: front-end Affects Versions: 0.7.1 Reporter: Jeff Zhang I notice that the width of paragraph can be changed, but height is not changeable. This would make the layout difficult sometimes. Attachment illustrate what I want but I can not make it due to the height of paragraph can not be changed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2384) Add configuration for not storing angularObject in note.json
Jeff Zhang created ZEPPELIN-2384: Summary: Add configuration for not storing angularObject in note.json Key: ZEPPELIN-2384 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2384 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.7.1 Reporter: Jeff Zhang AngularObject may contain some credential information of backend, user may not want to store it in note.json via plain text format. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
