[jira] [Created] (ZEPPELIN-6020) Remove TestUtils class in zeppelin-server
Philipp Dallig created ZEPPELIN-6020: Summary: Remove TestUtils class in zeppelin-server Key: ZEPPELIN-6020 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6020 Project: Zeppelin Issue Type: Task Reporter: Philipp Dallig Assignee: Philipp Dallig At the moment we have the TestUtils class in the Zeppelin server modules. The class is badly named and is not in the main folder. With https://github.com/apache/zeppelin/pull/4726 it is possible to remove this class completely. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6019) Remove submarine
Jongyoul Lee created ZEPPELIN-6019: -- Summary: Remove submarine Key: ZEPPELIN-6019 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6019 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee https://lists.apache.org/thread/lzh28tn4psfbtp8ooc4ftw3rc9m949cn -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6018) Update grpc version in pom.xml for successful Apache Zeppelin build on s390x architecture
Aditi Sharma created ZEPPELIN-6018: -- Summary: Update grpc version in pom.xml for successful Apache Zeppelin build on s390x architecture Key: ZEPPELIN-6018 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6018 Project: Zeppelin Issue Type: Bug Components: build Affects Versions: 0.11.1, 0.11.0 Environment: s390x Reporter: Aditi Sharma This update changes the grpc-java dependency version in the pom.xml file from 1.51.0 to 1.62.2. This change ensures compatibility and resolves build issues encountered on the s390x architecture. After implementing this change, the Apache Zeppelin package now builds successfully on the s390x architecture. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6017) Revert changes about ZEPPELIN_IDENT_STRING
Manhua Jiang created ZEPPELIN-6017:
--
Summary: Revert changes about ZEPPELIN_IDENT_STRING
Key: ZEPPELIN-6017
URL: https://issues.apache.org/jira/browse/ZEPPELIN-6017
Project: Zeppelin
Issue Type: Improvement
Reporter: Manhua Jiang
#5421 delete the definition check about ZEPPELIN_IDENT_STRING in case of
surefire version upgrade but it will make the log file names become:
zeppelin--SERVER.log
zeppelin--SERVER.out
zeppelin-interpreter-jdbc-shared_process–SERVER.log
in the defintion of:
zeppelin-${ZEPPELIN_IDENT_STRING}-${HOSTNAME}.log
zeppelin-${ZEPPELIN_IDENT_STRING}-${HOSTNAME}.out
zeppelin-interpreter-%INTERPRETER_ID%-%ZEPPELIN_IDENT_STRING%-%HOSTNAME%.log
so, we revert changes about ZEPPELIN_IDENT_STRING
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6016) Rewrite and enable Livy integration tests
Cheng Pan created ZEPPELIN-6016: --- Summary: Rewrite and enable Livy integration tests Key: ZEPPELIN-6016 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6016 Project: Zeppelin Issue Type: Test Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6015) Update GitHub-Actions
Philipp Dallig created ZEPPELIN-6015: Summary: Update GitHub-Actions Key: ZEPPELIN-6015 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6015 Project: Zeppelin Issue Type: Improvement Reporter: Philipp Dallig The GitHub actions used should be updated to the latest version, as the underlying NodeJS is end of life. https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6014) The Docker image apache/zeppelin:0.11.1 contains macOS metadata for jar files. This leads to a java.util.zip.ZipException: zip END header not found error.
Antonin Fischer created ZEPPELIN-6014:
-
Summary: The Docker image apache/zeppelin:0.11.1 contains macOS
metadata for jar files. This leads to a java.util.zip.ZipException: zip END
header not found error.
Key: ZEPPELIN-6014
URL: https://issues.apache.org/jira/browse/ZEPPELIN-6014
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-integration
Affects Versions: 0.11.1
Reporter: Antonin Fischer
The Docker image {{apache/zeppelin:0.11.1}} contains macOS metadata for jar
files. This leads to a {{java.util.zip.ZipException: zip END header not found}}
error in the Spark interpreter due to the inclusion of macOS {{._}} metadata
files.
Exception:
{code:java}
ERROR [2024-04-12 22:50:08,356] (
{FIFOScheduler-interpreter_1585837962-Worker-1}
SparkInterpreter.java[open]:139) - Fail to open SparkInterpreter
scala.reflect.internal.FatalError: Error accessing
/mnt/disk2/yarn/local/usercache/ondrej.cerny/appcache/application_1711465088664_2677/container_e30_1711465088664_2677_01_01/._spark-scala-2.12-0.11.1.jar
at
scala.tools.nsc.classpath.AggregateClassPath.$anonfun$list$3(AggregateClassPath.scala:113)
at scala.collection.Iterator.foreach(Iterator.scala:943)
at scala.collection.Iterator.foreach$(Iterator.scala:943)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
at scala.collection.IterableLike.foreach(IterableLike.scala:74)
at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
at
scala.tools.nsc.classpath.AggregateClassPath.list(AggregateClassPath.scala:101)
at scala.tools.nsc.util.ClassPath.list(ClassPath.scala:36)
at scala.tools.nsc.util.ClassPath.list$(ClassPath.scala:36)
at
scala.tools.nsc.classpath.AggregateClassPath.list(AggregateClassPath.scala:30)
at
scala.tools.nsc.symtab.SymbolLoaders$PackageLoader.doComplete(SymbolLoaders.scala:298)
at
scala.tools.nsc.symtab.SymbolLoaders$SymbolLoader.complete(SymbolLoaders.scala:250)
at scala.reflect.internal.Symbols$Symbol.completeInfo(Symbols.scala:1542)
at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1514)
at scala.reflect.internal.Mirrors$RootsBase.init(Mirrors.scala:258)
at scala.tools.nsc.Global.rootMirror$lzycompute(Global.scala:74)
at scala.tools.nsc.Global.rootMirror(Global.scala:72)
at scala.tools.nsc.Global.rootMirror(Global.scala:44)
at
scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass$lzycompute(Definitions.scala:294)
at
scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass(Definitions.scala:294)
at
scala.reflect.internal.Definitions$DefinitionsClass.init(Definitions.scala:1504)
at scala.tools.nsc.Global$Run.(Global.scala:1213)
at scala.tools.nsc.interpreter.IMain._initialize(IMain.scala:124)
at scala.tools.nsc.interpreter.IMain.initializeSynchronous(IMain.scala:146)
at
org.apache.zeppelin.spark.SparkScala212Interpreter.createSparkILoop(SparkScala212Interpreter.scala:195)
at
org.apache.zeppelin.spark.AbstractSparkScalaInterpreter.open(AbstractSparkScalaInterpreter.java:116)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:124)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:861)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:769)
at org.apache.zeppelin.scheduler.Job.run(Job.java:186)
at
org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:135)
at
org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:42)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.io.IOException: Error accessing
/mnt/disk2/yarn/local/usercache/ondrej.cerny/appcache/application_1711465088664_2677/container_e30_1711465088664_2677_01_01/._spark-scala-2.12-0.11.1.jar
at
scala.reflect.io.FileZipArchive.scala$reflect$io$FileZipArchive$$openZipFile(ZipArchive.scala:182)
at scala.reflect.io.FileZipArchive.root$lzycompute(ZipArchive.scala:230)
at scala.reflect.io.FileZipArchive.root(ZipArchive.scala:227)
at scala.reflect.io.FileZipArchive.allDirs$lzycompute(ZipArchive.scala:264)
at scala.reflect.io.FileZipArchive.allDirs(ZipArchive.scala:264)
at
scala.tools.nsc.classpath.ZipArchiveFileLookup.findDirEntry(ZipArchiveFileLookup.scala:76)
at
scala.tools.nsc.classpath.ZipArchiveFileLookup.list(ZipArchiveFileLookup.scala:63)
at
scala.tools.nsc.classpath.ZipArchiveFileLookup.list$(ZipArchiveFileLookup.scala:62)
at
scala.tools.nsc.classpath.ZipAndJarClassPathFactory$ZipArchiveClassPath.list
[jira] [Created] (ZEPPELIN-6013) Bump some Apache Common Libraries
Philipp Dallig created ZEPPELIN-6013: Summary: Bump some Apache Common Libraries Key: ZEPPELIN-6013 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6013 Project: Zeppelin Issue Type: Improvement Reporter: Philipp Dallig Assignee: Philipp Dallig While working on ZEPPELIN-6006 I realized that some libraries of Apache commons are outdated. We should update them. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6012) Rest API call to /api/notebook/job/{jobId} throws NullPointerException
Shefali Singh created ZEPPELIN-6012:
---
Summary: Rest API call to /api/notebook/job/{jobId} throws
NullPointerException
Key: ZEPPELIN-6012
URL: https://issues.apache.org/jira/browse/ZEPPELIN-6012
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.11.0
Reporter: Shefali Singh
Attachments: image-2024-04-12-15-18-31-283.png
A post request to /api/notebook/job/\{jobId} throws NPE when anything in
request body is passed, only works when body is empty.
Request body: {}
Response:
java.lang.NullPointerException
at java.util.HashMap.putMapEntries(HashMap.java:502)
at java.util.HashMap.putAll(HashMap.java:786)
at
org.apache.zeppelin.rest.NotebookRestApi.runNoteJobs(NotebookRestApi.java:829)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
at
org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:176)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:475)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:397)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
at
org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
Does passing a request body to this endpoint not supported in 0.11.0? Doesn't
throw any error in 0.10.1
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6011) Update JAVA_HOME environment variable to openjdk11
Gayle Tan created ZEPPELIN-6011: --- Summary: Update JAVA_HOME environment variable to openjdk11 Key: ZEPPELIN-6011 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6011 Project: Zeppelin Issue Type: Bug Reporter: Gayle Tan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6010) Compilation error from source code package version zeppelin-0.11.1
Yu Hou created ZEPPELIN-6010:
Summary: Compilation error from source code package version
zeppelin-0.11.1
Key: ZEPPELIN-6010
URL: https://issues.apache.org/jira/browse/ZEPPELIN-6010
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.11.1
Environment: centos7-x86_64
zeppelin-0.11.1
Reporter: Yu Hou
Attachments: image-2024-04-08-09-35-55-685.png,
image-2024-04-08-09-36-19-574.png
When I compile from
{code:java}https://archive.apache.org/dist/zeppelin/zeppelin-0.11.1/zeppelin-0.11.1.tgz
{code} The following error occurred while downloading the source code package,
!image-2024-04-08-09-35-55-685.png!
and when I used it
{code:java} https://github.com/apache/zeppelin/tree/v0.11.1 {code}
There was no such error during compilation, so I suspect there may be an issue
with the source code package of the distribution.
!image-2024-04-08-09-36-19-574.png!
Please help me take a look at this issue.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6009) Remove Shell interpreter and its tests
Jongyoul Lee created ZEPPELIN-6009: -- Summary: Remove Shell interpreter and its tests Key: ZEPPELIN-6009 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6009 Project: Zeppelin Issue Type: Task Components: Interpreters, shell Reporter: Jongyoul Lee Assignee: Jongyoul Lee -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6008) Pin plotly 5.19.0
Cheng Pan created ZEPPELIN-6008: --- Summary: Pin plotly 5.19.0 Key: ZEPPELIN-6008 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6008 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6007) Enhance release scripts for tar shasum commands detection
Cheng Pan created ZEPPELIN-6007: --- Summary: Enhance release scripts for tar shasum commands detection Key: ZEPPELIN-6007 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6007 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6006) Reducing command line applications
Philipp Dallig created ZEPPELIN-6006: Summary: Reducing command line applications Key: ZEPPELIN-6006 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6006 Project: Zeppelin Issue Type: Improvement Reporter: Philipp Dallig Assignee: Philipp Dallig Some time ago, I had tried to build and test Zeppelin in a minimal OS container. I noticed dependencies to command line applications. We should keep these to a minimum and let the JVM carry out the tasks. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6005) Update Kyuubi JDBC docs
Cheng Pan created ZEPPELIN-6005: --- Summary: Update Kyuubi JDBC docs Key: ZEPPELIN-6005 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6005 Project: Zeppelin Issue Type: Improvement Components: JdbcInterpreter Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6004) ConcurrentModificationException in zeppelin-client UpdateStreamSqlJob buildResult
zhengyuan created ZEPPELIN-6004:
---
Summary: ConcurrentModificationException in zeppelin-client
UpdateStreamSqlJob buildResult
Key: ZEPPELIN-6004
URL: https://issues.apache.org/jira/browse/ZEPPELIN-6004
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-client
Affects Versions: 0.11.0
Reporter: zhengyuan
{code:java}
//代码占位符
String paragraphId = zClient.addParagraph(noteId, "the first paragraph",
this.getTestSql());
zClient.submitNote(noteId);
NoteResult noteResult = zClient.waitUntilNoteFinished(noteId);
System.out.println("Submit note and the note result: " + noteResult); {code}
detail logs:
Submit note and the note result: NoteResult{noteId='2JTW2E269',
isRunning=false,
paragraphResultList=[ParagraphResult{paragraphId='paragraph_1710750700587_868085398',
status=ERROR, results=Result{type='TEXT', data='Fail to run sql command:
select * from v_meta_attr_processing_3
java.lang.RuntimeException: Fail to run update type stream job
at
org.apache.zeppelin.flink.FlinkStreamSqlInterpreter.callInnerSelect(FlinkStreamSqlInterpreter.java:93)
at
org.apache.zeppelin.flink.FlinkStreamSqlInterpreter.lambda$open$0(FlinkStreamSqlInterpreter.java:48)
at
org.apache.zeppelin.flink.Flink116SqlInterpreter.callStreamInnerSelect(Flink116SqlInterpreter.java:446)
at
org.apache.zeppelin.flink.Flink116SqlInterpreter.callSelect(Flink116SqlInterpreter.java:430)
at
org.apache.zeppelin.flink.Flink116SqlInterpreter.callOperation(Flink116SqlInterpreter.java:290)
at
org.apache.zeppelin.flink.Flink116SqlInterpreter.runSqlList(Flink116SqlInterpreter.java:236)
at
org.apache.zeppelin.flink.Flink116Shims.runSqlList(Flink116Shims.java:394)
at
org.apache.zeppelin.flink.FlinkStreamSqlInterpreter.runSqlList(FlinkStreamSqlInterpreter.java:102)
at
org.apache.zeppelin.flink.FlinkSqlInterpreter.internalInterpret(FlinkSqlInterpreter.java:58)
at
org.apache.zeppelin.interpreter.AbstractInterpreter.interpret(AbstractInterpreter.java:55)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:108)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:877)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:769)
at org.apache.zeppelin.scheduler.Job.run(Job.java:186)
at
org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:135)
at
org.apache.zeppelin.scheduler.ParallelScheduler.lambda$runJobInScheduler$0(ParallelScheduler.java:46)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Fail to run stream sql job
at
org.apache.zeppelin.flink.sql.AbstractStreamSqlJob.run(AbstractStreamSqlJob.java:165)
at
org.apache.zeppelin.flink.sql.AbstractStreamSqlJob.run(AbstractStreamSqlJob.java:109)
at
org.apache.zeppelin.flink.FlinkStreamSqlInterpreter.callInnerSelect(FlinkStreamSqlInterpreter.java:91)
... 18 more
Caused by: java.util.ConcurrentModificationException
at java.util.ArrayList.sort(ArrayList.java:1466)
at
org.apache.zeppelin.flink.sql.UpdateStreamSqlJob.buildResult(UpdateStreamSqlJob.java:91)
at
org.apache.zeppelin.flink.sql.UpdateStreamSqlJob.refresh(UpdateStreamSqlJob.java:105)
at
org.apache.zeppelin.flink.sql.AbstractStreamSqlJob.run(AbstractStreamSqlJob.java:159)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6003) Log detail info of SQL in JDBCInterpreter
Manhua Jiang created ZEPPELIN-6003: -- Summary: Log detail info of SQL in JDBCInterpreter Key: ZEPPELIN-6003 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6003 Project: Zeppelin Issue Type: Improvement Reporter: Manhua Jiang Currently we can monitor running SQL in JDBCInterpreter but unable to know who/which note fire the SQL, especially a couple of users using zeppelin at the same time. Bond the SQL with additional info, we can inform the user with user/noteid/paragragh info if needed -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6002) Fix completer NPE
Manhua Jiang created ZEPPELIN-6002:
--
Summary: Fix completer NPE
Key: ZEPPELIN-6002
URL: https://issues.apache.org/jira/browse/ZEPPELIN-6002
Project: Zeppelin
Issue Type: Bug
Reporter: Manhua Jiang
NPE occur when adding the driver specific SQL completions. Some
driver(hive-jdbc-uber-2.6.5.0-292.jar in my case) does not implement method
{{DatabaseMetaData.getDriverName()}} well and cause exception , then fail to
initialize {{{}keywordCompleter{}}}.
Since it is optional, we should avoid such driver interfere the default one,
and log it for the profession
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6001) Update Dockerfile after Release
Philipp Dallig created ZEPPELIN-6001: Summary: Update Dockerfile after Release Key: ZEPPELIN-6001 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6001 Project: Zeppelin Issue Type: Improvement Reporter: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-6000) Polish zengine tests
Philipp Dallig created ZEPPELIN-6000: Summary: Polish zengine tests Key: ZEPPELIN-6000 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6000 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5999) Remove instance Objects out of Zeppelin
Philipp Dallig created ZEPPELIN-5999: Summary: Remove instance Objects out of Zeppelin Key: ZEPPELIN-5999 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5999 Project: Zeppelin Issue Type: Task Reporter: Philipp Dallig Assignee: Philipp Dallig Currently Zeppelin has some static instance objects (PluginManager, ZeppelinConfiguration, ConfigStorage) which can lead to strange behavior when we change the objects during tests. Zeppelin has some workarounds: - ZeppelinConfiguration.reset(); - PluginManager.reset(); But these workarounds are not thread-safe and we cannot start multiple ZeppelinServers at once. We should also not use `System.setProperty(..., ...)` to change the configuration during the test runtime. This has an effect on other tests -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5998) Verify executables
Jongyoul Lee created ZEPPELIN-5998: -- Summary: Verify executables Key: ZEPPELIN-5998 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5998 Project: Zeppelin Issue Type: Task Reporter: Jongyoul Lee Zeppelin uses pre-installed executables when running it. It would be good to check if executables are not infected. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5997) Upgrade to Java 11 as the minimum version
PJ Fanning created ZEPPELIN-5997: Summary: Upgrade to Java 11 as the minimum version Key: ZEPPELIN-5997 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5997 Project: Zeppelin Issue Type: Task Reporter: PJ Fanning Zeppelin is an application so you have more leeway to upgrade than lib maintainers do. Some of the dependencies that Zeppelin uses have already abandoned Java 8 support. There is even an argument to go for Java 17. Spring has already abandoned Java 11. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5996) Zeppelin bundles json-20180813.jar but this has a Category X license
PJ Fanning created ZEPPELIN-5996: Summary: Zeppelin bundles json-20180813.jar but this has a Category X license Key: ZEPPELIN-5996 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5996 Project: Zeppelin Issue Type: Task Reporter: PJ Fanning https://www.apache.org/legal/resolved.html lists this as nonsensical and not allowed in ASF projects. JSON License - links to https://www.json.org/license.html Prevents the jar being used for evil. In theory, we can force an upgrade to a version that uses Public Domain and gets rid of the good vs evil nonsense. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5995) Update K8s-Library
Philipp Dallig created ZEPPELIN-5995: Summary: Update K8s-Library Key: ZEPPELIN-5995 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5995 Project: Zeppelin Issue Type: Task Reporter: Philipp Dallig Assignee: Philipp Dallig I am hoping for a more stable test environment with the update -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5994) Fix cron tests for ZeppelinRestApiTest
Jongyoul Lee created ZEPPELIN-5994: -- Summary: Fix cron tests for ZeppelinRestApiTest Key: ZEPPELIN-5994 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5994 Project: Zeppelin Issue Type: Task Affects Versions: 0.11.1 Reporter: Jongyoul Lee For security, the cron feature will be disabled in anonymous mode. it tests in ZeppelinRestApiTest without authentication mode. I disabled them first and will fix them -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5993) Enable GCS Notebookrepo Tests
Philipp Dallig created ZEPPELIN-5993: Summary: Enable GCS Notebookrepo Tests Key: ZEPPELIN-5993 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5993 Project: Zeppelin Issue Type: Bug Reporter: Philipp Dallig Assignee: Philipp Dallig We should enable the JUnit tests for gcs -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5992) Can't work with data after cron execution
Yaroslav Dolin created ZEPPELIN-5992: Summary: Can't work with data after cron execution Key: ZEPPELIN-5992 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5992 Project: Zeppelin Issue Type: Task Components: docker, Interpreters, python-interpreter Affects Versions: 0.10.1 Reporter: Yaroslav Dolin Attachments: Screenshot 2024-02-08 at 11.47.54.png, log.txt I can't work with data after cron execution with python interpreter !Screenshot 2024-02-08 at 11.47.54.png! I didn't find information in documentation. Also i don't have an option "After execution stop the interpreter". It's only in new interface, and cron configure doesn't work from new interface. I attached logs. How i can fix it? -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5991) Add support for DocumentDb and Mongo Atlas for Mongo Interpreter
Mithun Mandal created ZEPPELIN-5991: --- Summary: Add support for DocumentDb and Mongo Atlas for Mongo Interpreter Key: ZEPPELIN-5991 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5991 Project: Zeppelin Issue Type: Improvement Components: interpreter-setting Affects Versions: 0.10.2 Reporter: Mithun Mandal Fix For: 0.10.2 Currently Mongo interpreter has basic connection params which does not include any SSL / TSL. also mongo protocol is fixed. DocumentDB: it required SSL / TSL connection. Mongo Atlas: required different protocol mongodb+srv Configuration: mongo.server.protocol for protocol specification mongo.server.api.version for API version specification SSL / TSL config mongo.server.ssl.enabled mongo.server.tls.enabled mongo.server.ca.file mongo.server.allowInvalid AWS specific additional configuration mongo.server.aws.fle.awsAccessKeyId mongo.server.aws.fle.awsSecretAccessKey mongo.server.aws.fle.awsSessionToken mongo.server.aws.fle.keyVaultNamespace -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5990) Disable sesitive configuration for JDBC url
Jongyoul Lee created ZEPPELIN-5990: -- Summary: Disable sesitive configuration for JDBC url Key: ZEPPELIN-5990 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5990 Project: Zeppelin Issue Type: Task Affects Versions: 0.10.1, 0.11.0 Reporter: Jongyoul Lee Assignee: Jongyoul Lee Fix For: 0.11.1, 0.12.0 Some JDBC configurations may make potential security issues so I want to disable the configurations. ref. https://github.com/apache/dolphinscheduler/blob/dev/dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-mysql/src/main/java/org/apache/dolphinscheduler/plugin/datasource/mysql/param/MySQLDataSourceProcessor.java -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5989) Default notebook path resolving failed on windows
Guorong Xu created ZEPPELIN-5989: Summary: Default notebook path resolving failed on windows Key: ZEPPELIN-5989 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5989 Project: Zeppelin Issue Type: Bug Components: zeppelin-server Environment: sys: windows 10 IDE: IDEA branch: master Reporter: Guorong Xu I'm trying to start the zeppelin without configuration file in my IDE on windows, and i get error as below: ```bash java.io.IOException: java.net.URISyntaxException: Illegal character in path at index 2: ./\notebook at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.setNotebookDirectory(VFSNotebookRepo.java:76) at org.apache.zeppelin.notebook.repo.GitNotebookRepo.init(GitNotebookRepo.java:74) at org.apache.zeppelin.notebook.repo.NotebookRepoSync.init(NotebookRepoSync.java:83) at org.apache.zeppelin.notebook.repo.NotebookRepoSync.(NotebookRepoSync.java:62) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.glassfish.hk2.utilities.reflection.ReflectionHelper.makeMe(ReflectionHelper.java:1356) at org.jvnet.hk2.internal.ClazzCreator.createMe(ClazzCreator.java:248) at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:342) at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463) at org.glassfish.hk2.utilities.ImmediateContext.findOrCreate(ImmediateContext.java:111) at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102) at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93) at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:679) at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:54) at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:188) at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:205) at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:334) at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463) at org.jvnet.hk2.internal.SingletonContext$1.compute(SingletonContext.java:59) at org.jvnet.hk2.internal.SingletonContext$1.compute(SingletonContext.java:47) at org.glassfish.hk2.utilities.cache.Cache$OriginThreadAwareFuture$1.call(Cache.java:74) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.glassfish.hk2.utilities.cache.Cache$OriginThreadAwareFuture.run(Cache.java:131) at org.glassfish.hk2.utilities.cache.Cache.compute(Cache.java:176) at org.jvnet.hk2.internal.SingletonContext.findOrCreate(SingletonContext.java:98) at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102) at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93) at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:679) at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:54) at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:188) at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:205) at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:334) at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463) at org.jvnet.hk2.internal.SingletonContext$1.compute(SingletonContext.java:59) at org.jvnet.hk2.internal.SingletonContext$1.compute(SingletonContext.java:47) at org.glassfish.hk2.utilities.cache.Cache$OriginThreadAwareFuture$1.call(Cache.java:74) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.glassfish.hk2.utilities.cache.Cache$OriginThreadAwareFuture.run(Cache.java:131) at org.glassfish.hk2.utilities.cache.Cache.compute(Cache.java:176) at org.jvnet.hk2.internal.SingletonContext.findOrCreate(SingletonContext.java:98) at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102) at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93) at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:679) at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:54) at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:188) at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:205) at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:334) at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463) at org.jvnet.hk2.internal.SingletonContext$1
[jira] [Created] (ZEPPELIN-5988) Bokeh output in IPySpark is not in correct format
Axel Van Damme created ZEPPELIN-5988: Summary: Bokeh output in IPySpark is not in correct format Key: ZEPPELIN-5988 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5988 Project: Zeppelin Issue Type: Bug Components: pySpark Affects Versions: 0.10.1 Environment: Latest Apache Zeppelin compiled from sources Reporter: Axel Van Damme I'm using the latest Zeppelin version compile from the source code (Version 0.11.0-SNAPSHOT) I'm facing the issue explained in https://issues.apache.org/jira/browse/ZEPPELIN-4771 It means that when running a simple Bokeh code with %ipyspark (or even with %python.ipython)interpreter, the text output is not correctly formatted. You can try for example with this example where I did a on purpose typo: %ipyspark import numpy as np from bokeh.plotting import figure, show, output_notebook output_notebook() x = np.linspace(-6, 6, 500) y = 8*np.sin(x)*np.sinc(x) p = figure(width=800, height=300, title="", tools="", toolbar_location=None, match_aspect=True) p.line(x, ey, color="navy", alpha=0.4, line_width=4) show(p) then the output is scrabbled like this: Loading BokehJS ... [0;31m---[0m [0;31mNameError[0m Traceback (most recent call last) Cell [0;32mIn[40], line 12[0m [1;32m 7[0m y [38;5;241m=[39m [38;5;241m8[39m[38;5;241m*[39mnp[38;5;241m.[39msin(x)[38;5;241m*[39mnp[38;5;241m.[39msinc(x) [1;32m 9[0m p [38;5;241m=[39m figure(width[38;5;241m=[39m[38;5;241m800[39m, height[38;5;241m=[39m[38;5;241m300[39m, title[38;5;241m=[39m[38;5;124m"[39m[38;5;124m"[39m, tools[38;5;241m=[39m[38;5;124m"[39m[38;5;124m"[39m, [1;32m 10[0m toolbar_location[38;5;241m=[39m[38;5;28;01mNone[39;00m, match_aspect[38;5;241m=[39m[38;5;28;01mTrue[39;00m) [0;32m---> 12[0m p[38;5;241m.[39mline(x, [43mey[49m, color[38;5;241m=[39m[38;5;124m"[39m[38;5;124mnavy[39m[38;5;124m"[39m, alpha[38;5;241m=[39m[38;5;241m0.4[39m, line_width[38;5;241m=[39m[38;5;241m4[39m) [1;32m 14[0m show(p) [0;31mNameError[0m: name 'ey' is not defined -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5987) release notes missing for last few releases
PJ Fanning created ZEPPELIN-5987: Summary: release notes missing for last few releases Key: ZEPPELIN-5987 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5987 Project: Zeppelin Issue Type: Improvement Reporter: PJ Fanning https://zeppelin.apache.org/download.html has a link for the 0.10.1 release but it is broken. Likewise - 0.10.0 https://zeppelin.apache.org/releases/ - 0.9.0 is the last release with release notes. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5986) Re-enable Junit 5 integration tests by upgrading maven plugins
Cheng Pan created ZEPPELIN-5986: --- Summary: Re-enable Junit 5 integration tests by upgrading maven plugins Key: ZEPPELIN-5986 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5986 Project: Zeppelin Issue Type: Test Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5985) Remove global scala-* profiles
Cheng Pan created ZEPPELIN-5985: --- Summary: Remove global scala-* profiles Key: ZEPPELIN-5985 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5985 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5984) Upgrade scalatest to 3.2.15 in Cassandra module
Cheng Pan created ZEPPELIN-5984: --- Summary: Upgrade scalatest to 3.2.15 in Cassandra module Key: ZEPPELIN-5984 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5984 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5983) Upgrade to Node 16
Cheng Pan created ZEPPELIN-5983: --- Summary: Upgrade to Node 16 Key: ZEPPELIN-5983 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5983 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5982) Merge flink-scala-parent module into flink-scala-2.12
Cheng Pan created ZEPPELIN-5982: --- Summary: Merge flink-scala-parent module into flink-scala-2.12 Key: ZEPPELIN-5982 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5982 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5981) Cannot cancel paragraph
Yunseong Hwang created ZEPPELIN-5981: Summary: Cannot cancel paragraph Key: ZEPPELIN-5981 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5981 Project: Zeppelin Issue Type: Bug Affects Versions: 0.11.0 Reporter: Yunseong Hwang Inside an open zeppelin notebook, after running a paragraph by clicking the play icon button, canceling the running paragraph by clicking the pause icon button (or the Ctrl+Option+C shortcut) does not interrupt the running process and cancel the paragraph. I've checked that CANCEL_PARAGRAPH message gets well passed through the websocket connection but server was somehow completely ignoring the message. After some more investigation, I've found that the reason for that was the Paragraph's jobAbort() method, which does nothing due to the null interpreter member. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5980) Merge zeppelin-display into spark-interperter
Cheng Pan created ZEPPELIN-5980: --- Summary: Merge zeppelin-display into spark-interperter Key: ZEPPELIN-5980 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5980 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5979) Support and use Python 3.9 in default
Cheng Pan created ZEPPELIN-5979: --- Summary: Support and use Python 3.9 in default Key: ZEPPELIN-5979 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5979 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5978) Remove support for old Flink versions
Cheng Pan created ZEPPELIN-5978: --- Summary: Remove support for old Flink versions Key: ZEPPELIN-5978 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5978 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5977) The "Import New Note" window unexpectedly closes in multi-user env
Ivan Dzikovsky created ZEPPELIN-5977:
Summary: The "Import New Note" window unexpectedly closes in
multi-user env
Key: ZEPPELIN-5977
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5977
Project: Zeppelin
Issue Type: Bug
Components: front-end
Affects Versions: 0.10.1
Reporter: Ivan Dzikovsky
*Steps to reproduce*
# Open Zeppelin UI and click on "Import note" link in start page. You should
see "Import New Note" popup.
# Open another instance of Zeppelin and try to import another note at the same
time, rename folder or another note or create new note.
*Expected result*
In the first tab nothing should happen.
*Actual result*
Expected result
"Import New Note" window in the first Zeppelin tab get closed without any
reason.
*Business justification*
This is not a big deal when Zeppelin used by one user, but it became a problem
when there are a lot of users who try to use Zeppelin at the same time.
*Root cause*
It seems like workflow for that popup was designed in the following way:
# User opens popup
# User drags notebook file into popup
# Notebook file gets uploaded to Zeppelin backend
# On success, backend respond with "{{NOTES_INFO}}" message with updated
information about list of available notebooks
# Message of "{{NOTES_INFO}}" type triggers closing of that popup (this
happens in
[note-import.controller.js|https://github.com/apache/zeppelin/blob/579074e/zeppelin-web/src/components/note-import/note-import.controller.js#L149]
and
[websocket-event.factory.js|https://github.com/apache/zeppelin/blob/579074e/zeppelin-web/src/components/websocket/websocket-event.factory.js#L76]).
And the flaw of this design is that there are a lot of events which can trigger
"{{NOTES_INFO}}" message to do the update of an info about available notes, so
it happens not only after notebook was successfully uploaded through "Import
New Note" popup.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5976) Support Flink 1.18
Cheng Pan created ZEPPELIN-5976: --- Summary: Support Flink 1.18 Key: ZEPPELIN-5976 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5976 Project: Zeppelin Issue Type: New Feature Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5975) Python: z.show should work with subtypes of DataFrame
Matthias Koch created ZEPPELIN-5975: --- Summary: Python: z.show should work with subtypes of DataFrame Key: ZEPPELIN-5975 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5975 Project: Zeppelin Issue Type: Improvement Components: python Affects Versions: 0.10.1 Reporter: Matthias Koch Using "z.show()" only data frames are displayed as tables when the passed parameter is of type DataFrame. Subtypes are not taken into account. However, this would be useful for a number of use cases. A prominent example would be GeoPandasFrames, but there are also other examples in the open source community. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5974) Broken link - BigQuery interpreter documentation
Sukumar Subudhi created ZEPPELIN-5974: - Summary: Broken link - BigQuery interpreter documentation Key: ZEPPELIN-5974 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5974 Project: Zeppelin Issue Type: Bug Components: documentation Affects Versions: 0.10.1, 0.10.0 Reporter: Sukumar Subudhi Attachments: image-2023-10-18-11-32-22-848.png Have observed that the link for [Zeppelin Google Cloud Storage|https://zeppelin.apache.org/docs/latest/storage/storage.html#notebook-storage-in-gcs] is broken in the source page for Zeppelin BigQuery documentation. Source page: [https://zeppelin.apache.org/docs/latest/interpreter/bigquery.html#provide-application-default-credentials] Current link: [https://zeppelin.apache.org/docs/latest/storage/storage.html#notebook-storage-in-gcs] Suggested link: [https://zeppelin.apache.org/docs/latest/setup/storage/storage.html#notebook-storage-in-gcs] Current link error: !image-2023-10-18-11-32-22-848.png! P.S: Further, I did check in the GitHub page: [https://github.com/apache/zeppelin/blob/master/docs/interpreter/bigquery.md#provide-application-default-credentials] It is indeed pointing to the appropriate link. I could not figure out where I can fix the same. Hence raising an issue -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5973) Bump Livy 0.8.0-incubating
Cheng Pan created ZEPPELIN-5973: --- Summary: Bump Livy 0.8.0-incubating Key: ZEPPELIN-5973 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5973 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5972) Support Flink 1.17
Cheng Pan created ZEPPELIN-5972: --- Summary: Support Flink 1.17 Key: ZEPPELIN-5972 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5972 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5971) tableWithUTFCharacters throws error when loading data with arrays
Levi Makee created ZEPPELIN-5971: Summary: tableWithUTFCharacters throws error when loading data with arrays Key: ZEPPELIN-5971 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5971 Project: Zeppelin Issue Type: Bug Reporter: Levi Makee Attachments: fix2.PNG, image001 - Copy-1.png, image001 - Copy.png The error occurs when you try to *select* table that has columns with array values !image001 - Copy-1.png! !fix2.PNG! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5970) tableWithUTFCharacters throws IndexOutOfBoundsException when INSERT/CREATE statement is executed
Levi Makee created ZEPPELIN-5970: Summary: tableWithUTFCharacters throws IndexOutOfBoundsException when INSERT/CREATE statement is executed Key: ZEPPELIN-5970 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5970 Project: Zeppelin Issue Type: Bug Reporter: Levi Makee ref. https://github.com/apache/zeppelin/commit/0fc1d7ba2081ebeed5c45d87c27ca57727f54099 * The error occurs in *parseSQLJsonOutput (line 180)* as it always expects *rowsOutput* to have at least 2 values. * When INSERT/CREATE statement is executed, the *rowsOutput* is empty, the app throws *IndexOutOfBoundsException* -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5969) Remove hadoop 2
Philipp Dallig created ZEPPELIN-5969: Summary: Remove hadoop 2 Key: ZEPPELIN-5969 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5969 Project: Zeppelin Issue Type: Task Reporter: Philipp Dallig Hadoop2 does not have Java 11 support we should therefore remove the dependency and focus on Hadoop 3. https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Java+Versions -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5968) Upgrade Jetty 9.4.52.v20230823
Cheng Pan created ZEPPELIN-5968: --- Summary: Upgrade Jetty 9.4.52.v20230823 Key: ZEPPELIN-5968 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5968 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5967) Remove support for deb packaging
Cheng Pan created ZEPPELIN-5967: --- Summary: Remove support for deb packaging Key: ZEPPELIN-5967 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5967 Project: Zeppelin Issue Type: Task Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5966) Support Spark 3.5
Cheng Pan created ZEPPELIN-5966: --- Summary: Support Spark 3.5 Key: ZEPPELIN-5966 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5966 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5965) Remove Kotlin Interpreter
Cheng Pan created ZEPPELIN-5965: --- Summary: Remove Kotlin Interpreter Key: ZEPPELIN-5965 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5965 Project: Zeppelin Issue Type: Improvement Reporter: Cheng Pan Kotlin Interpreter lacks maintenance and blocks Spark upgrading, see details at https://github.com/apache/zeppelin/pull/4652#issuecomment-1714897661 https://github.com/apache/zeppelin/pull/3840#issuecomment-1715421916 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5964) Renaming and executing a note results in it being duplicated.
Matthias Koch created ZEPPELIN-5964:
---
Summary: Renaming and executing a note results in it being
duplicated.
Key: ZEPPELIN-5964
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5964
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-zengine
Affects Versions: 0.10.1
Reporter: Matthias Koch
If a note is renamed by changing only the capitalization, the note is copied at
the file system level when it is executed again.
h3. Preconditions:
A note, for example, named "{_}note"{_}
h3. Steps to reproduce:
* Rename the note "{_}note"{_} to "{_}Note"{_}
* Open and execute the note
h3. Expected result:
There is only one file _Note_ in the file system
h3. Observed result:
There are two files in the file system: _Note_ and _note_
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5963) Migrate all Flink test to JUnit5
Philipp Dallig created ZEPPELIN-5963: Summary: Migrate all Flink test to JUnit5 Key: ZEPPELIN-5963 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5963 Project: Zeppelin Issue Type: Task Components: flink Affects Versions: 0.10.1 Reporter: Philipp Dallig Currently the [FlinkSqlInterpreterTest|https://github.com/apache/zeppelin/blob/11f6aa6f295b4d11f43f4ad6e9dc8200f8f9081f/flink/flink-scala-parent/src/test/java/org/apache/zeppelin/flink/FlinkSqlInterpreterTest.java#L71] is still written with JUnit4. I am not able to migrate this. After Migration remove the [vintage-engine|https://github.com/apache/zeppelin/blob/11f6aa6f295b4d11f43f4ad6e9dc8200f8f9081f/flink/flink-scala-parent/pom.xml#L576-L581] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5962) LivyInterpreter support more parameter when create session
Moran created ZEPPELIN-5962: --- Summary: LivyInterpreter support more parameter when create session Key: ZEPPELIN-5962 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5962 Project: Zeppelin Issue Type: Improvement Components: livy-interpreter Reporter: Moran Attachments: 1694521540159.jpg Livy session creation supports many parameters, such as name, queue, heartbeat TimeoutInSecond, etc。Maybe we can add more parameters to CreateSessionRequest or use a map to dynamically support these parameters。 !1694521540159.jpg! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5961) [JUnit 5 Migration] Module: markdown
Philipp Dallig created ZEPPELIN-5961: Summary: [JUnit 5 Migration] Module: markdown Key: ZEPPELIN-5961 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5961 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5960) [JUnit 5 Migration] Module: submarine
Philipp Dallig created ZEPPELIN-5960: Summary: [JUnit 5 Migration] Module: submarine Key: ZEPPELIN-5960 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5960 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5959) [JUnit 5 Migration] Module: livy
Philipp Dallig created ZEPPELIN-5959: Summary: [JUnit 5 Migration] Module: livy Key: ZEPPELIN-5959 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5959 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5958) [JUnit 5 Migration] Module: shell
Philipp Dallig created ZEPPELIN-5958: Summary: [JUnit 5 Migration] Module: shell Key: ZEPPELIN-5958 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5958 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5957) Move gh-pages branch to zeppelin-site repository
Jongyoul Lee created ZEPPELIN-5957: -- Summary: Move gh-pages branch to zeppelin-site repository Key: ZEPPELIN-5957 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5957 Project: Zeppelin Issue Type: Task Components: zeppelin-site-repo Reporter: Jongyoul Lee https://github.com/apache/zeppelin-site -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5956) Separate cluster manager to extra profile
Jongyoul Lee created ZEPPELIN-5956: -- Summary: Separate cluster manager to extra profile Key: ZEPPELIN-5956 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5956 Project: Zeppelin Issue Type: Task Components: Interpreters, zeppelin-server Affects Versions: 0.10.1 Reporter: Jongyoul Lee Deactivate cluster manager by default because it's not managed well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5955) [JUnit 5 Migration] Module: cassandra
Philipp Dallig created ZEPPELIN-5955: Summary: [JUnit 5 Migration] Module: cassandra Key: ZEPPELIN-5955 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5955 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5954) [JUnit 5 Migration] Module: elasticsearch
Philipp Dallig created ZEPPELIN-5954: Summary: [JUnit 5 Migration] Module: elasticsearch Key: ZEPPELIN-5954 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5954 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5953) [JUnit 5 Migration] Module: influxdb
Philipp Dallig created ZEPPELIN-5953: Summary: [JUnit 5 Migration] Module: influxdb Key: ZEPPELIN-5953 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5953 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5952) [JUnit 5 Migration] Module: mongodb
Philipp Dallig created ZEPPELIN-5952: Summary: [JUnit 5 Migration] Module: mongodb Key: ZEPPELIN-5952 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5952 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5951) [JUnit 5 Migration] Module: bigquery
Philipp Dallig created ZEPPELIN-5951: Summary: [JUnit 5 Migration] Module: bigquery Key: ZEPPELIN-5951 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5951 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5950) [JUnit 5 Migration] Module: sparql
Philipp Dallig created ZEPPELIN-5950: Summary: [JUnit 5 Migration] Module: sparql Key: ZEPPELIN-5950 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5950 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5949) [JUnit 5 Migration] Module: neo4j
Philipp Dallig created ZEPPELIN-5949: Summary: [JUnit 5 Migration] Module: neo4j Key: ZEPPELIN-5949 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5949 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5948) Update shiro version from 1.10.0 to 1.12.0 due to CVE-2023-34478
youngjin.yang created ZEPPELIN-5948: --- Summary: Update shiro version from 1.10.0 to 1.12.0 due to CVE-2023-34478 Key: ZEPPELIN-5948 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5948 Project: Zeppelin Issue Type: Improvement Components: security Reporter: youngjin.yang Zeppelin is now using shiro 1.10.0 version. [https://github.com/apache/zeppelin/blob/master/pom.xml#L138] But Apache Shiro said "Apache Shiro, before 1.12.0 or 2.0.0-alpha-3, may be susceptible to a path traversal attack that results in an authentication bypass when used together with APIs or other web frameworks that route requests based on non-normalized requests." [https://shiro.apache.org/blog/2023/07/18/apache-shiro-1120-released.html] So I request you to update the shiro version for latest Zeppelin. I saw one PR is already opened, so I don't create new issue. [https://github.com/apache/zeppelin/pull/4636] Can you share the plan for updating this version of shiro? -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5947) Increasing WebSocket idle connections timeout
Sebastien B. created ZEPPELIN-5947:
--
Summary: Increasing WebSocket idle connections timeout
Key: ZEPPELIN-5947
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5947
Project: Zeppelin
Issue Type: Bug
Components: conf, GUI, zeppelin-server, zeppelin-web
Affects Versions: 0.10.1
Reporter: Sebastien B.
Hi, after 5 minutes of inactivity, WebSocket connections get disconnected. Is
it possible to increase this timeout?
To reproduce:
# Run a Docker container:
{code:java}
docker run --rm -p 8080:8080 apache/zeppelin:0.10.1{code}
# Open a WebSocket connection:
{code:java}
wscat -c 'ws://localhost:8080/ws' {code}
# Do nothing for 5 minutes.
This error appears:
{code:java}
Disconnected (code: 1001, reason: "java.util.concurrent.TimeoutException: Idle
timeout expired: 30/30 ms"){code}
The same behavior can be observed with the UI. If I stop working for more than
5 minutes on my notebook, but I keep it open in my browser, it refreshes and I
lose my outputs.
Some kind of keepalive mechanism would actually be ideal, instead of increasing
the timeout. What do you think?
Thank you.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5946) Drop Spark 2.4 Support
Philipp Dallig created ZEPPELIN-5946: Summary: Drop Spark 2.4 Support Key: ZEPPELIN-5946 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5946 Project: Zeppelin Issue Type: Task Affects Versions: 0.10.1 Reporter: Philipp Dallig Assignee: Philipp Dallig Fix For: 0.11.0 Spark 2.4 is now quite outdated. In addition, Spark 2.4 does not support JDK 11, which is necessary for the further development of Zeppelin. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5945) JDK11 - Update Dockerfiles
Philipp Dallig created ZEPPELIN-5945: Summary: JDK11 - Update Dockerfiles Key: ZEPPELIN-5945 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5945 Project: Zeppelin Issue Type: Sub-task Reporter: Philipp Dallig Assignee: Philipp Dallig Zeppelin compiles and runs successfully with JDK 11. We should update the Dockerfiles. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5944) allow YarnInterpreterLauncher to run with proxy user in isolated mode
Johannes Schillinger created ZEPPELIN-5944: -- Summary: allow YarnInterpreterLauncher to run with proxy user in isolated mode Key: ZEPPELIN-5944 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5944 Project: Zeppelin Issue Type: Improvement Components: interpreter-launcher Affects Versions: 0.10.1 Reporter: Johannes Schillinger Currently it is possible to run python and R in a Yarn container using YarnInterpreterLauncher. But this launcher does not work the same way the spark context works, especially regarding the isolation and usage of --proxy-user on yarn application start. Please add the ability to run isolated Yarn applications per user in python/r interpreter when run with zeppelin.interpreter.launcher = yarn Or if this ability already exists, please update the documentation to explain how to set it up. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5943) Upgrade jackson version to 2.12.7.1 in zeppelin-server due to CVEs
Shefali Singh created ZEPPELIN-5943: --- Summary: Upgrade jackson version to 2.12.7.1 in zeppelin-server due to CVEs Key: ZEPPELIN-5943 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5943 Project: Zeppelin Issue Type: Improvement Reporter: Shefali Singh [CVE - CVE-2022-42003 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-42003] [CVE - CVE-2022-42004 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-42004] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5942) Missing null check in InterpreterLauncher
ConfX created ZEPPELIN-5942:
---
Summary: Missing null check in InterpreterLauncher
Key: ZEPPELIN-5942
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5942
Project: Zeppelin
Issue Type: Bug
Reporter: ConfX
Attachments: reproduce.sh
h2. What happened:
Got NullPointerException when launching an interpreter in Mapreduce.
h2. Where's the bug:
In {{InterpreterLauncher}} there is an attempt to recover the interpreter in
{{{}launch{}}}:
{noformat}
// try to recover it first
if (zConf.isRecoveryEnabled()) {
InterpreterClient recoveredClient =
recoveryStorage.getInterpreterClient(context.getInterpreterGroupId());
if (recoveredClient != null) {{noformat}
The problem with this is that {{recoveryStorage}} might be null, causing the
code to throw a NPE without any message.
h2. StackTrace:
{noformat}
java.lang.NullPointerException: null
at
org.apache.zeppelin.interpreter.launcher.InterpreterLauncher.launch(InterpreterLauncher.java:95)
at
org.apache.zeppelin.interpreter.launcher.StandardInterpreterLauncherTest.testLauncher(StandardInterpreterLauncherTest.java:50){noformat}
h2. How to reproduce:
(1) Set {{zeppelin.recovery.storage.class}} to
{{org.apache.zeppelin.interpreter.recovery.FileSystemRecoveryStorage }}
(2) Run test:
{{org.apache.zeppelin.interpreter.launcher.StandardInterpreterLauncherTest#testLauncher}}
For an easy reproduction, run the reproduce.sh in the attachment.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5941) Missing null check in Notebook
ConfX created ZEPPELIN-5941:
---
Summary: Missing null check in Notebook
Key: ZEPPELIN-5941
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5941
Project: Zeppelin
Issue Type: Bug
Reporter: ConfX
Attachments: reproduce.sh
h2. What happened:
Got NullPointerException when initializing a Notebook.
h2. Where's the bug:
At the end of the constructor of {{Notebook}} a rebuild takes place:
{noformat}
if (conf.isIndexRebuild()) {
noteSearchService.startRebuildIndex(getNoteStream());
}{noformat}
The problem with this is that if {{noteSearchService}} is null, the code would
throw an NPE out of nowhere with no message.
h2. StackTrace:
{noformat}
java.lang.NullPointerException,
at org.apache.zeppelin.notebook.Notebook.(Notebook.java:112),
at org.apache.zeppelin.notebook.Notebook.(Notebook.java:165),
at
org.apache.zeppelin.notebook.NotebookTest.testRevisionSupported(NotebookTest.java:124),{noformat}
h2. How to reproduce:
(1) Set {{zeppelin.search.index.rebuild }} to {{true }}
(2) Run test: {{org.apache.zeppelin.notebook.NotebookTest#testRevisionSupported
}}
For an easy reproduction, run the reproduce.sh in the attachment.
We are happy to provide a patch if this issue is confirmed.
{{}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5940) Restart Interpreter with Status
Shreyas created ZEPPELIN-5940: - Summary: Restart Interpreter with Status Key: ZEPPELIN-5940 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5940 Project: Zeppelin Issue Type: Improvement Components: spark Reporter: Shreyas Hi, The current REST API for restarting the Spark interpreter marks the corresponding Yarn application to "SUCCESS". Can the API be updated to receive a status from the user (say FAILED), and update Yarn accordingly. By default if no status is provided, the current behavior is good. This will be very useful for marking the Yarn applications with appropriate status, especially if something has failed. Thanks! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5939) Upgrade hadoop version from 2.7 to 3.2.3 due to CVE-2022-26612
Shefali Singh created ZEPPELIN-5939: --- Summary: Upgrade hadoop version from 2.7 to 3.2.3 due to CVE-2022-26612 Key: ZEPPELIN-5939 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5939 Project: Zeppelin Issue Type: Improvement Reporter: Shefali Singh [CVE - CVE-2022-26612 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-26612] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5938) Update contributors page's Continuous Integration section to remove Travis CI
Bill Brooks created ZEPPELIN-5938:
-
Summary: Update contributors page's Continuous Integration section
to remove Travis CI
Key: ZEPPELIN-5938
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5938
Project: Zeppelin
Issue Type: Bug
Components: documentation
Reporter: Bill Brooks
{{Several months ago we had a very brief chat on the #zeppelin slack channel
about the Contributors page:}}
{{[https://zeppelin.apache.org/contribution/contributions.html]}}
The section entitled *Continuous Integration* says that potential contributors
to the project "...should setup travis-ci for the fork before making a
pullrequest."
Jeff said in that thread that this section is outdated and folks can create a
PR directly now because Zeppelin uses github actions now.
This ticket is so we can keep track of the fact that the contributors page
needs to be updated to reflect the fact that travis-ci is no longer necessary.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5937) Upgrade elasticsearch from 2.4.3 to 5.6.15 due to CVE-2019-7611
Shefali Singh created ZEPPELIN-5937: --- Summary: Upgrade elasticsearch from 2.4.3 to 5.6.15 due to CVE-2019-7611 Key: ZEPPELIN-5937 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5937 Project: Zeppelin Issue Type: Improvement Reporter: Shefali Singh [CVE - CVE-2019-7611 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2019-7611] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5936) Update Jetty Version
Philipp Dallig created ZEPPELIN-5936: Summary: Update Jetty Version Key: ZEPPELIN-5936 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5936 Project: Zeppelin Issue Type: Improvement Reporter: Philipp Dallig Assignee: Philipp Dallig Update to the latest version of Jetty 9.4.x to close security vulnerabilities and fix other bugs. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5935) Upgrade jsoup from 1.13.1 to 1.14.2 due to CVE-2021-37714
Shefali Singh created ZEPPELIN-5935: --- Summary: Upgrade jsoup from 1.13.1 to 1.14.2 due to CVE-2021-37714 Key: ZEPPELIN-5935 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5935 Project: Zeppelin Issue Type: Improvement Reporter: Shefali Singh [CVE - CVE-2021-37714 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-37714] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5934) Check notebook folder permissions before allowing to rename, remove or restore folder
Ivan Dzikovsky created ZEPPELIN-5934: Summary: Check notebook folder permissions before allowing to rename, remove or restore folder Key: ZEPPELIN-5934 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5934 Project: Zeppelin Issue Type: Improvement Components: zeppelin-server, zeppelin-zengine Affects Versions: 0.10.1 Reporter: Ivan Dzikovsky Users who are able to see notes in some directory can rename, move to trash, restore and remove from trash that directory without being owner or having write permissions for notes in that directory. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5933) Polish Jetty configuration
Philipp Dallig created ZEPPELIN-5933: Summary: Polish Jetty configuration Key: ZEPPELIN-5933 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5933 Project: Zeppelin Issue Type: Bug Components: zeppelin-server Affects Versions: 0.10.1 Reporter: Philipp Dallig Assignee: Philipp Dallig Referring to the following comment, we should improve some Jetty configurations in our current setup and polish the configuration. https://github.com/eclipse/jetty.project/issues/6592#issuecomment-897877018 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5932) Upgrade h2 from 2.0.206 to 2.1.210 due to CVE-2022-23221
Shefali Singh created ZEPPELIN-5932: --- Summary: Upgrade h2 from 2.0.206 to 2.1.210 due to CVE-2022-23221 Key: ZEPPELIN-5932 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5932 Project: Zeppelin Issue Type: Improvement Reporter: Shefali Singh [CVE - CVE-2022-23221 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-23221] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5931) Upgrade shiro from 1.9.1 to 1.10.0 due to CVE-2022-40664
Shefali Singh created ZEPPELIN-5931: --- Summary: Upgrade shiro from 1.9.1 to 1.10.0 due to CVE-2022-40664 Key: ZEPPELIN-5931 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5931 Project: Zeppelin Issue Type: Improvement Reporter: Shefali Singh [CVE - CVE-2022-40664 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-40664] Dependabot has opened: [Bump shiro-core from 1.9.1 to 1.10.0 by dependabot[bot] · Pull Request #4481 · apache/zeppelin (github.com)|https://github.com/apache/zeppelin/pull/4481] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5930) Upgrade ivy from 2.4.0 to 2.5.1 due to CVE-2022-37865, CVE-2022-37866
Shefali Singh created ZEPPELIN-5930: --- Summary: Upgrade ivy from 2.4.0 to 2.5.1 due to CVE-2022-37865, CVE-2022-37866 Key: ZEPPELIN-5930 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5930 Project: Zeppelin Issue Type: Improvement Reporter: Shefali Singh [CVE - CVE-2022-37865 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-37865] [CVE - CVE-2022-37866 (mitre.org)|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-37866] Dependabot has opened: [Bump ivy from 2.4.0 to 2.5.1 in /flink/flink-scala-parent by dependabot[bot] · Pull Request #4508 · apache/zeppelin (github.com)|https://github.com/apache/zeppelin/pull/4508] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5929) Spark Basic Feature Tutorial notebook data link is broken
Zoltan Holoda created ZEPPELIN-5929:
---
Summary: Spark Basic Feature Tutorial notebook data link is broken
Key: ZEPPELIN-5929
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5929
Project: Zeppelin
Issue Type: Bug
Reporter: Zoltan Holoda
Spark Tutorial > 2. Spark Basic Features notebook > Load data into table
section load bank data link is broken. It look like, it is not available
anymore.
{code:java}
// load bank data
val bankText = sc.parallelize(
IOUtils.toString(
new
URL("https://s3.amazonaws.com/apache-zeppelin/tutorial/bank/bank.csv;),
Charset.forName("utf8")).split("\n"))
{code}
{noformat}
java.io.IOException: Server returned HTTP response code: 403 for URL:
https://s3.amazonaws.com/apache-zeppelin/tutorial/bank/bank.csv
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5928) Spark Interpreter fails with "has no attribute '_wrapped'" in Kubernetes with Zeppelin
Rose Aysina created ZEPPELIN-5928:
-
Summary: Spark Interpreter fails with "has no attribute
'_wrapped'" in Kubernetes with Zeppelin
Key: ZEPPELIN-5928
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5928
Project: Zeppelin
Issue Type: Bug
Components: Kubernetes, pySpark, spark
Affects Versions: 0.10.1
Reporter: Rose Aysina
Fix For: 0.11.0
Attachments: Dockerfile, Screenshot 2023-06-09 at 11.39.01 AM.png,
Screenshot 2023-06-09 at 11.39.34 AM.png, log.txt
Hola!
We discovered bug while deploying Zeppelin on Kubernetes with Spark Interpreter
also in Kubernetes mode (also attached full log to this issue):
{noformat}
INFO [2023-06-09 07:59:49,053] ({FIFOScheduler-interpreter_537057292-Worker-1}
PythonInterpreter.java[bootstrapInterpreter]:562) - Bootstrap interpreter via
python/zeppelin_pyspark.py
ERROR [2023-06-09 07:59:50,416] ({FIFOScheduler-interpreter_537057292-Worker-1}
PySparkInterpreter.java[open]:104) - Fail to bootstrap pyspark
java.io.IOException: Fail to run bootstrap script: python/zeppelin_pyspark.py
%text Fail to execute line 54: sqlc = __zSqlc__ = __zSpark__._wrapped
Traceback (most recent call last):
File "/tmp/python129188975973677791/zeppelin_python.py", line 162, in
exec(code, _zcUserQueryNameSpace)
File "", line 54, in
AttributeError: 'SparkSession' object has no attribute '_wrapped'
at
org.apache.zeppelin.python.PythonInterpreter.bootstrapInterpreter(PythonInterpreter.java:579)
at
org.apache.zeppelin.spark.PySparkInterpreter.open(PySparkInterpreter.java:102)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:844)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:752)
at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
at
org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:132)
at
org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:42)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
INFO [2023-06-09 07:59:50,418] ({FIFOScheduler-interpreter_537057292-Worker-1}
PySparkInterpreter.java[close]:112) - Close PySparkInterpreter
INFO [2023-06-09 07:59:50,418] ({FIFOScheduler-interpreter_537057292-Worker-1}
PythonInterpreter.java[close]:259) - Kill python process
INFO [2023-06-09 07:59:50,423] ({FIFOScheduler-interpreter_537057292-Worker-1}
AbstractScheduler.java[runJob]:154) - Job 20230605-095507_490419065 finished by
scheduler interpreter_537057292 with status ERROR
WARN [2023-06-09 07:59:50,425] ({Exec Default Executor}
ProcessLauncher.java[onProcessFailed]:134) - Process with cmd [python,
/tmp/python129188975973677791/zeppelin_python.py, 10.165.178.231, 41565] is
failed due to
org.apache.commons.exec.ExecuteException: Process exited with an error: 143
(Exit value: 143)
at
org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)
at
org.apache.commons.exec.DefaultExecutor.access$200(DefaultExecutor.java:48)
at
org.apache.commons.exec.DefaultExecutor$1.run(DefaultExecutor.java:200)
at java.lang.Thread.run(Thread.java:750)
INFO [2023-06-09 07:59:50,426] ({Exec Default Executor}
ProcessLauncher.java[transition]:109) - Process state is transitioned to
TERMINATED
{noformat}
!Screenshot 2023-06-09 at 11.39.01 AM.png|width=383,height=209!
**
*Exact problem on Stack Overflow from another user:*
[https://stackoverflow.com/q/75949679]
How I configure Spark in the notebook in Zeppelin Server (also see screenshots):
{code:java}
%spark.conf
spark.executor.instances 5
spark.kubernetes.container.image.pullSecrets docker-registry
spark.app.name
SparkTESTSparkTESTSparkTESTSparkTESTSparkTESTSparkTESTSparkTESTSparkTESTSparkTEST
spark.jars.ivy /tmp
{code}
Then Spark Interpreter starts, then it starts spark Executors (all of them in
K8S), then raises the error above.
Executors don't fail after the error, it's just Zeppelin Server can't connect
to Interpreter and prints the same error in the notebook cell.
!Screenshot 2023-06-09 at 11.39.34 AM.png|width=383,height=209!
*Environment:*
* Zeppelin version: *0.10.1*
* Spark version: *3.4.0*
* Python version: *3.11*
* Dockerfile for Zeppelin Interpreter is attached.
*What do we do now:* we use version *0.11.0-SNAPSHOT* and build docker images
from Zeppelin sources on latest master in GitHub. {color:#de350b}In the newest
versi
[jira] [Created] (ZEPPELIN-5927) Solve the concurrency calls to `saveNoteAuth`
yousj created ZEPPELIN-5927:
---
Summary: Solve the concurrency calls to `saveNoteAuth`
Key: ZEPPELIN-5927
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5927
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-zengine
Affects Versions: 0.10.1, 0.10.0, 0.9.0
Reporter: yousj
Fix For: 0.10.1, 0.10.0, 0.9.0
I have problems the concurrency calls to `saveNoteAuth`.
[related pull request |[https://github.com/apache/zeppelin/pull/4563],] this
pull request migrates solve the concurrency problem caused by multiple
concurrent calls to
`org.apache.zeppelin.notebook.AuthorizationService#saveNoteAuth`, but this can
result in concurrent modifications to `notebook authorization.json`, then throw
java.nio.file.NoSuchFileException.
{code:java}
Caused by: java.nio.file.NoSuchFileException:
/usr/local/zeppelin-0.10.1-bin-all/conf/notebook-authorization.json
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:447)
at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
at java.nio.file.Files.move(Files.java:1395)
at org.apache.zeppelin.util.FileUtils.atomicWriteToFile(FileUtils.java:60)
at org.apache.zeppelin.util.FileUtils.atomicWriteToFile(FileUtils.java:71)
at
org.apache.zeppelin.storage.LocalConfigStorage.save(LocalConfigStorage.java:71)
at
org.apache.zeppelin.notebook.AuthorizationService.saveNoteAuth(AuthorizationService.java:109)
at org.apache.zeppelin.notebook.Notebook.createNote(Notebook.java:258)
at
org.apache.zeppelin.service.NotebookService.createNote(NotebookService.java:168)
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5926) zeppelin_user_sockets and zeppelin_note_sockets are not decreased
Philipp Dallig created ZEPPELIN-5926: Summary: zeppelin_user_sockets and zeppelin_note_sockets are not decreased Key: ZEPPELIN-5926 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5926 Project: Zeppelin Issue Type: Bug Affects Versions: 0.10.1 Reporter: Philipp Dallig Assignee: Philipp Dallig Attachments: image-2023-06-07-14-20-42-696.png While searching for a memory leak I came across the metrics `zeppelin_note_sockets` and `zeppelin_user_sockets` which only drops back to 0 after a reboot. !image-2023-06-07-14-20-42-696.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5925) Unable to login to Zepplin
Malaya Kumar Swain created ZEPPELIN-5925: Summary: Unable to login to Zepplin Key: ZEPPELIN-5925 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5925 Project: Zeppelin Issue Type: Bug Reporter: Malaya Kumar Swain Hi Team, Earlier I was able to login to zepplin with user "swainm1". But now I am unablw to login. Can you please look into it. Its impacting my day to day work. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5924) improve query efficiency—data cache
duanxiaoqiu created ZEPPELIN-5924: - Summary: improve query efficiency—data cache Key: ZEPPELIN-5924 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5924 Project: Zeppelin Issue Type: Sub-task Reporter: duanxiaoqiu -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5923) improve query efficiency—deal complex sql
duanxiaoqiu created ZEPPELIN-5923: - Summary: improve query efficiency—deal complex sql Key: ZEPPELIN-5923 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5923 Project: Zeppelin Issue Type: Sub-task Reporter: duanxiaoqiu -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5922) improve query efficiency:deal complex sql
duanxiaoqiu created ZEPPELIN-5922: - Summary: improve query efficiency:deal complex sql Key: ZEPPELIN-5922 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5922 Project: Zeppelin Issue Type: New Feature Reporter: duanxiaoqiu -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ZEPPELIN-5921) GithubNotebookRepo does not sync moved and deleted notes to remote
Matthias Koch created ZEPPELIN-5921: --- Summary: GithubNotebookRepo does not sync moved and deleted notes to remote Key: ZEPPELIN-5921 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5921 Project: Zeppelin Issue Type: Bug Components: zeppelin-zengine Affects Versions: 0.10.1 Reporter: Matthias Koch If you use the plugin GithubNotebookRepo to sync the notes with a remote git repository, moved and deleted notes are not synced. *Observed result:* * Moving a note produces an empty commit * Deletion of a note produces no commit *Expected result:* * Moving and deletion of notes are synced with the remote repository. -- This message was sent by Atlassian Jira (v8.20.10#820010)
