[GitHub] zeppelin pull request #3162: ZEPPELIN-3745. Disable CRC check of hadoop File...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/3162 ---
[GitHub] zeppelin issue #3163: [WIP] ZEPPELIN-2619. Save note in [Title].zpln instead...
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/3163 I have a very simple request about a format of `.zpln`. Could you please add version number of note format? e.g. `"version": "0"`. It would help to parse `.zpln` in the future ---
[GitHub] zeppelin pull request #3166: ZEPPELIN-3749. New Spark interpreter has to be ...
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/3166 ZEPPELIN-3749. New Spark interpreter has to be restarted two times inorder to work fine for different users ### What is this PR for? This PR fix the issue of scoped mode for new spark interpreter. It will only close SparkContext when there's no other live sessions. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3749 ### How should this be tested? * Unit test is added ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3749 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/3166.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3166 commit a8d7cd8f1d169d17ef849fd6245a8b68bb2b1ea9 Author: Jeff Zhang Date: 2018-08-30T02:14:42Z ZEPPELIN-3749. New Spark interpreter has to be restarted two times in order to work fine for different users ---
[jira] [Created] (ZEPPELIN-3749) New Spark interpreter has to be restarted two times in order to work fine for different users
Jhon Cardenas created ZEPPELIN-3749:
---
Summary: New Spark interpreter has to be restarted two times in
order to work fine for different users
Key: ZEPPELIN-3749
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3749
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.8.0, 0.8.1
Environment: *Spark interpreter property to reproduce:*
zeppelin.spark.useNew -> true
*Spark interpreter instantiation mode*:
per user - scoped
*Zeppelin version:*
branch-0.8 (Until july 23)
Reporter: Jhon Cardenas
Attachments: first_error.txt, second_error.txt
New Spark interpreter has to be restarted two times in order to work fine for
different users.
To reproduce this you have to configure zeppelin to use the new interpreter:
zeppelin.spark.useNew -> true
And the instantiation mode: per user - scoped
*Steps to reproduce:*
1. User A login to zeppelin and runs some spark paragraph. It should works fine.
2. User B login to zeppelin and runs some spark paragraph, for example
{code:java}
%spark
println(sc.version)
println(scala.util.Properties.versionString)
{code}
3. This error appears (see entire log trace [^first_error.txt] ):
{\{java.lang.IllegalStateException: Cannot call methods on a stopped
SparkContext. This stopped SparkContext was created at: .}}
4. The user B restart the spark interpreter from notebook page, and executes
now a paragraph that throws a job, for example:
{code:java}
import sqlContext.implicits._
import org.apache.commons.io.IOUtils
import java.net.URL
import java.nio.charset.Charset
// Zeppelin creates and injects sc (SparkContext) and sqlContext (HiveContext
or SqlContext)
// So you don't need create them manually
// load bank data
val bankText = sc.parallelize(
IOUtils.toString(
new
URL("https://s3.amazonaws.com/apache-zeppelin/tutorial/bank/bank.csv;),
Charset.forName("utf8")).split("\n"))
sc.parallelize(1 to 100).foreach(n => print((java.lang.Math.random() *
100) + n))
case class Bank(age: Integer, job: String, marital: String, education: String,
balance: Integer)
val bank = bankText.map(s => s.split(";")).filter(s => s(0) != "\"age\"").map(
s => Bank(s(0).toInt,
s(1).replaceAll("\"", ""),
s(2).replaceAll("\"", ""),
s(3).replaceAll("\"", ""),
s(5).replaceAll("\"", "").toInt
)
).toDF()
bank.registerTempTable("bank")
{code}
5. This error appears (see entire log trace [^second_error.txt] ):
{\{org.apache.spark.SparkException: Job aborted due to stage failure: Task 6 in
stage 0.0 failed 4 times, most recent failure: Lost task 6.3 in stage 0.0 (TID
36, 100.96.85.172, executor 2): java.lang.ClassNotFoundException: $anonfun$1 at
org.apache.spark.repl.ExecutorClassLoader.findClass(ExecutorClassLoader.scala:82)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at
java.lang.ClassLoader.loadClass(ClassLoader.java:357) at
java.lang.Class.forName0(Native Method) at
java.lang.Class.forName(Class.java:348) at
org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67)
.}}
6. User B restart spark interpreter from notebook page and now it works.
*Actual Behavior:*
The user B has to restart two times spark interpreter so it can works.
*Expected Behavior:*
Spark should works fine for another users without any restarting.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3748) Auto-saving note hangs Zeppelin GUI
Abou Haydar Elias created ZEPPELIN-3748:
---
Summary: Auto-saving note hangs Zeppelin GUI
Key: ZEPPELIN-3748
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3748
Project: Zeppelin
Issue Type: Bug
Components: GUI
Affects Versions: 0.8.0
Reporter: Abou Haydar Elias
I'm getting stuck in a place where the Zeppelin GUI hangs and when I've
reviewed the logs, I've noticed that the saving process is going into some kind
of loop.
The following is just an excerpt :
{code:java}
INFO [2018-08-29 11:37:22,793] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:22,803] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:22,813] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:22,823] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:22,834] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:22,844] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:22,854] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:22,865] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,855] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,865] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,876] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,887] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,897] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,908] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,918] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,928] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,938] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,948] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,959] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,972] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,983] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:29,994] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,004] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,014] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,025] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,036] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,045] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,057] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,067] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,077] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,088] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,098] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,108] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,119] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,129] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,139] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,150] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,161] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,170] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29 11:37:30,181] ({qtp2059904228-45}
VFSNotebookRepo.java[save]:196) - Saving note:2DQPQTHWG
INFO [2018-08-29
[GitHub] zeppelin issue #3019: [ZEPPELIN-3540] Show Spark inline UI in Non-Secure mod...
Github user shahsank3t commented on the issue: https://github.com/apache/zeppelin/pull/3019 @r-kamath - addressed your review comments. Please have a look again. Thanks in advance. ---
[GitHub] zeppelin pull request #3158: [ZEPPELIN-3740] Adopt `google-java-format` and ...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/3158 ---
[GitHub] zeppelin pull request #3164: [MINOR] Add `fmt:check` to check style
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/3164 ---
[GitHub] zeppelin issue #3164: [MINOR] Add `fmt:check` to check style
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/3164 New travis profile has been passed. https://travis-ci.org/jongyoul/zeppelin/builds/421893674 Will merge it ---
