[jira] [Resolved] (TOREE-508) Reply errors to iopub.error instead of iopub.exec_result
[ https://issues.apache.org/jira/browse/TOREE-508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende resolved TOREE-508. --- Fix Version/s: 0.4.0 Assignee: Fabiano V. Santos Resolution: Fixed > Reply errors to iopub.error instead of iopub.exec_result > > > Key: TOREE-508 > URL: https://issues.apache.org/jira/browse/TOREE-508 > Project: TOREE > Issue Type: Bug >Reporter: Fabiano V. Santos >Assignee: Fabiano V. Santos >Priority: Major > Fix For: 0.4.0 > > > Errors of any kind (compilation, exceptions, etc) returns as normal results > instead of using iopub.error, so jupyter interpret the cell execution as > success which lead to problems if you use tools like papermill to schedule > notebooks, as you never know if the notebook execution was successfully or > not. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (TOREE-518) File Path for toree-0.2.0 devl.tar.gz is broken
[
https://issues.apache.org/jira/browse/TOREE-518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luciano Resende closed TOREE-518.
-
Fix Version/s: Not Applicable
Assignee: Luciano Resende
Resolution: Invalid
Releases are now available directly from pypi.
> File Path for toree-0.2.0 devl.tar.gz is broken
> ---
>
> Key: TOREE-518
> URL: https://issues.apache.org/jira/browse/TOREE-518
> Project: TOREE
> Issue Type: Bug
>Reporter: Ajana Chandiruthil Sathian
>Assignee: Luciano Resende
>Priority: Major
> Fix For: Not Applicable
>
> Attachments: apapche_toree_exception.png
>
>
> The file path in the README.md documentation is broken.
> Executing this command as per the documentation is giving an 404 excepiton.
>
> {{pip install
> [https://dist.apache.org/repos/dist/dev/incubator/toree/0.2.0/snapshots/dev1/toree-pip/toree-0.2.0.dev1.tar.gz]}}
> {{}}
> {{So please update the document or put the gz file on that location.}}
> {{}}
> {{Any kind of help is greatly appreciated!}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (TOREE-505) Travis CI builds are failing due to issues installing JDK8
[ https://issues.apache.org/jira/browse/TOREE-505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende resolved TOREE-505. --- Fix Version/s: 0.4.0 Resolution: Fixed > Travis CI builds are failing due to issues installing JDK8 > -- > > Key: TOREE-505 > URL: https://issues.apache.org/jira/browse/TOREE-505 > Project: TOREE > Issue Type: Bug > Components: Build >Reporter: Luciano Resende >Assignee: Luciano Resende >Priority: Critical > Fix For: 0.4.0 > > > $ ~/bin/install-jdk.sh --target "/home/travis/oraclejdk8" --workspace > "/home/travis/.cache/install-jdk" --feature "8" --license "BCL" > Ignoring license option: BCL -- using GPLv2+CE by default > install-jdk.sh 2019-10-16 > Expected feature release number in range of 9 to 14, but got: 8 > The command "~/bin/install-jdk.sh --target "/home/travis/oraclejdk8" > --workspace "/home/travis/.cache/install-jdk" --feature "8" --license "BCL"" > failed and exited with 3 during . > Details on the following build log: > https://travis-ci.org/apache/incubator-toree?utm_medium=notification&utm_source=email -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (TOREE-516) Kerberos error while working with Toree Kernel
[
https://issues.apache.org/jira/browse/TOREE-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luciano Resende closed TOREE-516.
-
Fix Version/s: Not Applicable
Assignee: Luciano Resende
Resolution: Workaround
Suggested using Jupyter Enterprise Gateway to provide the end-to-end requested
flow.
> Kerberos error while working with Toree Kernel
> --
>
> Key: TOREE-516
> URL: https://issues.apache.org/jira/browse/TOREE-516
> Project: TOREE
> Issue Type: Bug
> Components: Kernel
>Affects Versions: 0.3.0
> Environment: RHEL 7.7, HDP 3 , Spark 2.3.2
>Reporter: Bharath
>Assignee: Luciano Resende
>Priority: Critical
> Labels: security
> Fix For: Not Applicable
>
>
> We have a Kerberied HDP 3.1.0 cluster, configured Jupyter/Toree - It throws
> Keberos error, we have a valid kerberos ticket in place. Here is the
> kernel.json
> {
> "argv": [
> "/opt/jupyterhub/share/jupyter/kernels/apache_toree_scala/bin/run.sh",
> "--profile",
> "\{connection_file}"
> ],
> "env": {
> "DEFAULT_INTERPRETER": "Scala",
> "TOREE_SPARK_OPTS": "--master yarn --deploy-mode cluster",
> "TOREE_OPTS": "",
> "HADOOP_CONF_DIR": "/etc/hadoop/conf",
> "SPARK_HOME": "/usr/hdp/3.1.0.0-78/spark2",
> "PYTHONPATH":
> "/opt/jupyterhub/bin/python:/opt/anaconda3/bin/python:/usr/hdp/3.1.0.0-78/spark2/python/lib/py4j-0.10.7-src.zip:/usr/hdp/3.1.0.0-78/spark2/python:/usr/hdp/3.1.0.0-78/spark2/python/lib",
> "PYTHON_EXEC": "python",
> "HBASE_CONF_DIR": "/etc/hbase/conf",
> "HBASE_HOME": "/usr/hdp/current/hbase-client",
> "JAVA_HOME": "/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64"
> },
> "display_name": "Toree - Scala-kernel",
> "language": "scala",
> "interrupt_mode": "signal",
> "metadata": {}
> }
> Error Message:
> 20/03/26 18:32:28 INFO RpcRetryingCallerImpl: Call exception, tries=8,
> retries=36, started=18874 ms ago, cancelled=false, msg=Call to
> compute-4.datalake.ntt/xxx.xxx.xx.xxx:16020 failed on local exception:
> javax.security.sasl.SaslException: GSS initiate failed [Caused by
> GSSException: No valid credentials provided (Mechanism level: Failed to find
> any Kerberos tgt)], details=row 'name_data:exchg_yearly,,99' on
> table 'hbase:meta' at region=hbase:meta,,1.1588230740,
> hostname=compute-4.datalake.ntt
> With above configuration, kernel dies sometimes.
> Please suggest if the way we are passing configs in Kernel.Json is the right
> way ?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Closed] (TOREE-499) K8: Not be able to submit Job in k8
[ https://issues.apache.org/jira/browse/TOREE-499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende closed TOREE-499. - Fix Version/s: Not Applicable Assignee: Kevin Bates Resolution: Workaround Workaround provided. Please reopen if this is still an issue. > K8: Not be able to submit Job in k8 > --- > > Key: TOREE-499 > URL: https://issues.apache.org/jira/browse/TOREE-499 > Project: TOREE > Issue Type: Bug >Reporter: Leonardo Barrientos C. >Assignee: Kevin Bates >Priority: Blocker > Fix For: Not Applicable > > > Hello, i can't submit jobs to k8, the assembly jar resides in the local > folder directory, so the Driver and executors in K8 cannot get the .jar; it > is possible? Please help. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (TOREE-426) Spark 2.2.0 and scala 2.12.1
[ https://issues.apache.org/jira/browse/TOREE-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende closed TOREE-426. - Fix Version/s: 0.4.0 Resolution: Not A Problem Works after building with the proper scala version > Spark 2.2.0 and scala 2.12.1 > > > Key: TOREE-426 > URL: https://issues.apache.org/jira/browse/TOREE-426 > Project: TOREE > Issue Type: Bug > Components: Kernel >Affects Versions: 0.2.0 > Environment: MAC OS 10.12.5 >Reporter: Manish Ranjan >Priority: Major > Fix For: 0.4.0 > > > on running command `jupyter notebook` > greeted with > Starting Spark Kernel with > SPARK_HOME=/Users/manish.ranjan/Spark/Installer/spark-2.2/ > log4j:WARN No appenders could be found for logger > (org.apache.toree.Main$$anon$1). > log4j:WARN Please initialize the log4j system properly. > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more > info. > Exception in thread "main" java.lang.NoSuchMethodError: > scala.collection.immutable.HashSet$.empty()Lscala/collection/immutable/HashSet; > at akka.actor.ActorCell$.(ActorCell.scala:336) > at akka.actor.ActorCell$.(ActorCell.scala) > at akka.actor.RootActorPath.$div(ActorPath.scala:185) > at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:465) > at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:453) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$2.apply(DynamicAccess.scala:78) > at scala.util.Try$.apply(Try.scala:192) > at > akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:73) > at > akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$3.apply(DynamicAccess.scala:84) > at > akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$3.apply(DynamicAccess.scala:84) > at scala.util.Success.flatMap(Try.scala:231) > at > akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:84) > at akka.actor.ActorSystemImpl.liftedTree1$1(ActorSystem.scala:585) > at akka.actor.ActorSystemImpl.(ActorSystem.scala:578) > at akka.actor.ActorSystem$.apply(ActorSystem.scala:142) > at akka.actor.ActorSystem$.apply(ActorSystem.scala:109) > at > org.apache.toree.boot.layer.StandardBareInitialization$class.createActorSystem(BareInitialization.scala:71) > at org.apache.toree.Main$$anon$1.createActorSystem(Main.scala:34) > at > org.apache.toree.boot.layer.StandardBareInitialization$class.initializeBare(BareInitialization.scala:60) > at org.apache.toree.Main$$anon$1.initializeBare(Main.scala:34) > at > org.apache.toree.boot.KernelBootstrap.initialize(KernelBootstrap.scala:70) > at org.apache.toree.Main$delayedInit$body.apply(Main.scala:39) > at scala.Function0$class.apply$mcV$sp(Function0.scala:34) > at > scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12) > at scala.App$$anonfun$main$1.apply(App.scala:76) > at scala.App$$anonfun$main$1.apply(App.scala:76) > at scala.collection.immutable.List.foreach(List.scala:381) > at > scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:35) > at scala.App$class.main(App.scala:76) > at org.apache.toree.Main$.main(Main.scala:23) > at org.apache.toree.Main.main(Main.scala) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755) > at > org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180) > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > [W 23:39:20.049 NotebookApp] Timeout waiting for kernel_info reply from > 282ebec0-b01a-405e-b002-f4569179a43d -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (TOREE-519) Toree 0.5.0 Release (Spark 3.0 support)
[ https://issues.apache.org/jira/browse/TOREE-519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende updated TOREE-519: -- Component/s: Build Fix Version/s: 0.5.0 > Toree 0.5.0 Release (Spark 3.0 support) > --- > > Key: TOREE-519 > URL: https://issues.apache.org/jira/browse/TOREE-519 > Project: TOREE > Issue Type: Bug > Components: Build >Reporter: Luciano Resende >Assignee: Luciano Resende >Priority: Major > Fix For: 0.5.0 > > > We need to merge the Scala 2.12 change and publish a Toree release that > supports Spark 3.0 right after toree release 0.4.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (TOREE-519) Toree 0.5.0 Release (Spark 3.0 support)
[ https://issues.apache.org/jira/browse/TOREE-519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende reassigned TOREE-519: - Assignee: Luciano Resende > Toree 0.5.0 Release (Spark 3.0 support) > --- > > Key: TOREE-519 > URL: https://issues.apache.org/jira/browse/TOREE-519 > Project: TOREE > Issue Type: Bug >Reporter: Luciano Resende >Assignee: Luciano Resende >Priority: Major > > We need to merge the Scala 2.12 change and publish a Toree release that > supports Spark 3.0 right after toree release 0.4.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (TOREE-519) Toree 0.5.0 Release (Spark 3.0 support)
Luciano Resende created TOREE-519: - Summary: Toree 0.5.0 Release (Spark 3.0 support) Key: TOREE-519 URL: https://issues.apache.org/jira/browse/TOREE-519 Project: TOREE Issue Type: Bug Reporter: Luciano Resende We need to merge the Scala 2.12 change and publish a Toree release that supports Spark 3.0 right after toree release 0.4.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (TOREE-510) Toree 0.4.0 Release
[ https://issues.apache.org/jira/browse/TOREE-510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159418#comment-17159418 ] Luciano Resende commented on TOREE-510: --- Sorry it took a long time, the release vote is up on the mailing list https://lists.apache.org/thread.html/re7030486dd143fbbcdbb53166b222fb04f0ae536be64b2a751722697%40%3Cdev.toree.apache.org%3E > Toree 0.4.0 Release > --- > > Key: TOREE-510 > URL: https://issues.apache.org/jira/browse/TOREE-510 > Project: TOREE > Issue Type: Wish >Affects Versions: 0.4.0 >Reporter: Andrés >Assignee: Luciano Resende >Priority: Minor > > Hello, > I'd like to know if there is an estimated release date for Toree 0.4.0. > > Greetings, > Andrés Doncel -- This message was sent by Atlassian Jira (v8.3.4#803005)
[VOTE] Apache Toree 0.4.0 RC1
Please vote to approve the release of Apache Toree 0.4.0-incubating (RC1). Tag: v0.4.0-incubating-rc1 (b2374e28ce66ae28079703d725b7c0db4d4a) https://github.com/apache/incubator-toree/tree/v0.4.0-incubating-rc1 All distribution packages, including signatures, digests, etc. can be found at: https://dist.apache.org/repos/dist/dev/incubator/toree/0.4.0-incubating-rc1/ Staging artifacts can be found at: https://repository.apache.org/content/repositories/orgapachetoree-1016 ## Testing Instructions The fastest way to get up and running is to using Jupyter. 1. Install Jupyter if you haven't already (http://jupyter.org/install.html) 2. Install Apache Toree via `pip install https://dist.apache.org/repos/dist/dev/incubator/toree/0.4.0-incubating-rc1/toree-pip/toree-0.4.0.tar.gz` followed by `jupyter toree install` - You need to set a valid Apache Spark 2.x home, which can be done via `jupyter toree install --spark_home=/usr/local/spark` - You may need to run with `sudo` for installation permission - For all installation options, run `jupyter toree install --help-all` 4. Run a Jupyter notebook server via `jupyter notebook` - If the notebook portion of Jupyter is not installed but Jupyter is, you can install via `pip install notebook` 5. Create a notebook using "Apache Toree - Scala" from the dropdown under new dev 6. Run Scala/Spark commands such as `sc.parallelize(1 to 100).sum()` in the notebook ## Voting Instructions The vote is open for at least 72 hours and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Toree 0.4.0-incubating [ ] -1 Do not release this package because ... -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/
