[incubator-livy] tag v0.6.0-incubating created (now 28be98c)

2019-04-01 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to tag v0.6.0-incubating in repository https://gitbox.apache.org/repos/asf/incubator-livy.git. at 28be98c (commit) No new revisions were added by this update.

Re: List of Projects that went straight to Top Level Projects

2019-04-01 Thread Marcelo Vanzin
On Mon, Apr 1, 2019 at 1:08 PM Lars Francke wrote: > > Straight to TLP: > > Bahir, DRAT, Kibble, Orc, Serf, STeVe, Whimsy, Zest > > ORC was spun out of Hive as far as I remember. In that sense Bahir was also spun out of Spark, although it added a lot of things after that. -- Marcelo

[incubator-livy] branch master updated: [DOCS] Fix Javadoc 8 errors.

2019-04-01 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/master by this push: new d5b27dd [DOCS] Fix Javadoc 8 errors

svn commit: r33383 - /dev/incubator/livy/0.6.0-incubating-rc1/

2019-04-01 Thread vanzin
Author: vanzin Date: Mon Apr 1 18:04:27 2019 New Revision: 33383 Log: Removing stale Livy release packages. Removed: dev/incubator/livy/0.6.0-incubating-rc1/

svn commit: r33382 - /release/incubator/livy/KEYS

2019-04-01 Thread vanzin
Author: vanzin Date: Mon Apr 1 18:04:03 2019 New Revision: 33382 Log: Update Livy release KEYS. Modified: release/incubator/livy/KEYS Modified: release/incubator/livy/KEYS == --- release/incubator/livy/KEYS

svn commit: r33381 - /dev/incubator/livy/0.6.0-incubating-rc2/ /release/incubator/livy/0.6.0-incubating/

2019-04-01 Thread vanzin
Author: vanzin Date: Mon Apr 1 18:02:33 2019 New Revision: 33381 Log: Release Apache Livy (incubating) 0.6.0. Added: release/incubator/livy/0.6.0-incubating/ - copied from r33380, dev/incubator/livy/0.6.0-incubating-rc2/ Removed: dev/incubator/livy/0.6.0-incubating-rc2/

[VOTE][RESULT] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-04-01 Thread Marcelo Vanzin
Thanks for everybody who voted on the podling and general threads. Vote passes with the following votes (* = binding): - Justin Mclean (*) - Luciano Resende (*) - Felix Cheung (*) Vote thread: https://lists.apache.org/thread.html/c51ca324c1df14f986dcdf541c8dc976462bfc00fb4a9aba5259f2fc@%3Cgenera

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-04-01 Thread Marcelo Vanzin
On Fri, Mar 29, 2019 at 10:41 PM Felix Cheung wrote: > I switched to another environment, found out I needed to manually pip > install configparser just to build (skipTest) There are probably things that could be better documented. Or maybe could be handled better by the build scripts. But thes

[jira] [Created] (LIVY-580) Python 3 fails unicode test written for Python 2

2019-03-28 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created LIVY-580: --- Summary: Python 3 fails unicode test written for Python 2 Key: LIVY-580 URL: https://issues.apache.org/jira/browse/LIVY-580 Project: Livy Issue Type: Bug

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-28 Thread Marcelo Vanzin
On Thu, Mar 28, 2019 at 3:57 PM Felix Cheung wrote: > I have LANG=“en_US.UTF-8” > I tried a couple of things finally it passed when I use virtualenv - my > python is Python 3, forcing that to Python 2 passed the test. Hmmm, that tells me that the python 3 path in the fake shell might not be as

Re: [VOTE] Release Apache Spark 2.4.1 (RC9)

2019-03-28 Thread Marcelo Vanzin
(Anybody knows what's the deal with all the .invalid e-mail addresses?) Anyway. ASF has voting rules, and some things like releases follow specific rules: https://www.apache.org/foundation/voting.html#ReleaseVotes So, for releases, ultimately, the only votes that "count" towards the final tally a

[jira] [Updated] (LIVY-579) Python 2 unicode support does not work if OS encoding is not UTF-8

2019-03-28 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated LIVY-579: Priority: Minor (was: Major) > Python 2 unicode support does not work if OS encoding is not UT

[jira] [Created] (LIVY-579) Python 2 unicode support does not work if OS encoding is not UTF-8

2019-03-28 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created LIVY-579: --- Summary: Python 2 unicode support does not work if OS encoding is not UTF-8 Key: LIVY-579 URL: https://issues.apache.org/jira/browse/LIVY-579 Project: Livy

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-28 Thread Marcelo Vanzin
lease. On Thu, Mar 28, 2019 at 11:24 AM sebb wrote: > On Thu, 28 Mar 2019 at 17:02, Marcelo Vanzin > wrote: > > > Are you using a different encoding that UTF-8 in your environment? > > > > The source file contains unicode escapes, so that shouldn't be the > prob

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-28 Thread Marcelo Vanzin
Also is that failing when running the Python2 or the Python3 version of that test? Maybe it doesn't work as expected in some newer version of Python3... On Thu, Mar 28, 2019 at 10:02 AM Marcelo Vanzin wrote: > Are you using a different encoding that UTF-8 in your environment? > &

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-28 Thread Marcelo Vanzin
t((text/plain,JString(☺) > (PythonInterpreterSpec.scala:272) > > > On Tue, Mar 26, 2019 at 1:36 PM Marcelo Vanzin > > wrote: > > > The Livy PPMC has voted to release Livy 0.6.0 RC2 as the next Livy > release. > > > > Livy enables programmatic, fault-to

[jira] [Updated] (LIVY-577) Flaky test: Session Manager "batch session should not be gc-ed"

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated LIVY-577: Issue Type: Bug (was: Improvement) > Flaky test: Session Manager "batch session should not

[jira] [Updated] (LIVY-577) Flaky test: Session Manager "batch session should not be gc-ed"

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated LIVY-577: Component/s: Tests > Flaky test: Session Manager "batch session should not

[jira] [Created] (LIVY-577) Flaky test: Session Manager "batch session should not be gc-ed"

2019-03-26 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created LIVY-577: --- Summary: Flaky test: Session Manager "batch session should not be gc-ed" Key: LIVY-577 URL: https://issues.apache.org/jira/browse/LIVY-577 Pro

[jira] [Assigned] (LIVY-513) Flaky test: SessionHeartbeatWatchdog

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned LIVY-513: --- Assignee: Gyorgy Gal > Flaky test: SessionHeartbeatWatch

[jira] [Assigned] (LIVY-517) NPE in session manager cleanup thread

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned LIVY-517: --- Assignee: Gyorgy Gal > NPE in session manager cleanup thr

[jira] [Resolved] (LIVY-513) Flaky test: SessionHeartbeatWatchdog

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved LIVY-513. - Resolution: Fixed Fix Version/s: 0.7.0 Issue resolved by pull request 163 [https

[incubator-livy] branch master updated: [LIVY-513][LIVY-517][TEST] Fix SessionHeartbeatSpec flakiness, occasional NPE

2019-03-26 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/master by this push: new 8c7f03b [LIVY-513][LIVY-517][TEST] Fix

[jira] [Resolved] (LIVY-517) NPE in session manager cleanup thread

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved LIVY-517. - Resolution: Fixed Fix Version/s: 0.7.0 Issue resolved by pull request 163 [https

[jira] [Resolved] (LIVY-572) Log operations fails because of dependencies on Spark

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved LIVY-572. - Resolution: Fixed Fix Version/s: 0.7.0 Issue resolved by pull request 162 [https

[incubator-livy] branch master updated: [LIVY-572] Avoid usage of spark classes in ColumnBuffer

2019-03-26 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/master by this push: new 1c914a1 [LIVY-572] Avoid usage of

Re: spark.submit.deployMode: cluster

2019-03-26 Thread Marcelo Vanzin
If you're not using spark-submit, then that option does nothing. If by "context creation API" you mean "new SparkContext()" or an equivalent, then you're explicitly creating the driver inside your application. On Tue, Mar 26, 2019 at 1:56 PM Pat Ferrel wrote: > > I have a server that starts a Sp

Re: [VOTE] Release Livy 0.6.0 based on RC2

2019-03-26 Thread Marcelo Vanzin
Ok, we have 3 binding +1, no 0s or -1s. Vote passes, I'll follow up on the general@ list. On Tue, Mar 19, 2019 at 2:58 PM Marcelo Vanzin wrote: > > Err. Should have read "based on RC2". Too fast on the send button! > > Anyway, here's my +1. > > Note this bui

[VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

2019-03-26 Thread Marcelo Vanzin
The Livy PPMC has voted to release Livy 0.6.0 RC2 as the next Livy release. Livy enables programmatic, fault-tolerant, multi-tenant submission of Spark jobs from web/mobile apps (no Spark client needed). So, multiple users can interact with your Spark cluster concurrently and reliably. Vote threa

[VOTE RESULT] Release Livy 0.6.0 based on RC2

2019-03-26 Thread Marcelo Vanzin
Vote passes. Thanks for all who helped with the release! +1 votes (* = binding): Jeff Zhang (*) Marco Gaido (*) Marcelo Vanzin (*) No 0 or -1 votes were cast. -- Marcelo

[jira] [Assigned] (SPARK-24793) Make spark-submit more useful with k8s

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24793: -- Assignee: Stavros Kontopoulos > Make spark-submit more useful with

[jira] [Resolved] (SPARK-24793) Make spark-submit more useful with k8s

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24793. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23599 [https

[spark] branch master updated: [SPARK-24793][K8S] Enhance spark-submit for app management

2019-03-26 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 05168e7 [SPARK-24793][K8S] Enhance spark-submit

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: Marcelo Vanzin > Add support for dynamic resource allocat

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

2019-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: (was: Marcelo Vanzin) > Add support for dynamic resource allocat

Re: RPC timeout error for AES based encryption between driver and executor

2019-03-26 Thread Marcelo Vanzin
I don't think "spark.authenticate" works properly with k8s in 2.4 (which would make it impossible to enable encryption since it requires authentication). I'm pretty sure I fixed it in master, though. On Tue, Mar 26, 2019 at 2:29 AM Sinha, Breeta (Nokia - IN/Bangalore) wrote: > > Hi All, > > > > W

[spark] branch branch-2.4 updated: Revert "[SPARK-26606][CORE] Handle driver options properly when submitting to standalone cluster mode via legacy Client"

2019-03-23 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 3fc626d Revert "[SPARK-26606]

[jira] [Assigned] (SPARK-26606) parameters passed in extraJavaOptions are not being picked up

2019-03-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26606: -- Assignee: Jungtaek Lim > parameters passed in extraJavaOptions are not being pic

[jira] [Resolved] (SPARK-26606) parameters passed in extraJavaOptions are not being picked up

2019-03-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26606. Resolution: Fixed Fix Version/s: 2.3.4 2.4.2

[spark] branch branch-2.3 updated: [SPARK-26606][CORE] Handle driver options properly when submitting to standalone cluster mode via legacy Client

2019-03-22 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 978b68a [SPARK-26606][CORE] Handle

[spark] branch branch-2.4 updated: [SPARK-26606][CORE] Handle driver options properly when submitting to standalone cluster mode via legacy Client

2019-03-22 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 6f1a8d8 [SPARK-26606][CORE] Handle

[spark] branch master updated: [SPARK-26606][CORE] Handle driver options properly when submitting to standalone cluster mode via legacy Client

2019-03-22 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8a9eb05 [SPARK-26606][CORE] Handle driver

[jira] [Resolved] (SPARK-26729) Spark on Kubernetes tooling hardcodes default image names

2019-03-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26729. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23846 [https

[jira] [Assigned] (SPARK-26729) Spark on Kubernetes tooling hardcodes default image names

2019-03-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26729: -- Assignee: Rob Vesse > Spark on Kubernetes tooling hardcodes default image na

[spark] branch master updated: [SPARK-26729][K8S] Make image names under test configurable

2019-03-20 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 61d9946 [SPARK-26729][K8S] Make image names

[jira] [Resolved] (SPARK-27215) Correct the kryo configurations

2019-03-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27215. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24156 [https

[spark] branch master updated: [SPARK-27215][CORE] Correct the kryo configurations

2019-03-20 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 93c6d2a [SPARK-27215][CORE] Correct the kryo

[jira] [Assigned] (SPARK-27215) Correct the kryo configurations

2019-03-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27215: -- Assignee: Lantao Jin > Correct the kryo configurati

[jira] [Resolved] (SPARK-27094) Thread interrupt being swallowed while launching executors in YarnAllocator

2019-03-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27094. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24017 [https

[jira] [Assigned] (SPARK-27094) Thread interrupt being swallowed while launching executors in YarnAllocator

2019-03-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27094: -- Assignee: Marcelo Vanzin > Thread interrupt being swallowed while launch

[spark] branch master updated: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

2019-03-20 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ec5e342 [SPARK-27094][YARN] Work around

[jira] [Resolved] (LIVY-564) Support to check the batch job running progress

2019-03-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved LIVY-564. - Resolution: Won't Fix Spark doesn't publish this information to YARN, so there's n

Re: [VOTE] Release Livy 0.6.0 based on RC2

2019-03-20 Thread Marcelo Vanzin
oblems in my local environment though, > since the tests on Travis are passing. May someone else try if they face > the same issue anyway? In the config I just enabled the thriftserver with > the proper config. > Thanks, > Marco > > Il giorno mar 19 mar 2019 alle ore 22:58 Ma

[jira] [Created] (SPARK-27219) Misleading exceptions in transport code's SASL fallback path

2019-03-20 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-27219: -- Summary: Misleading exceptions in transport code's SASL fallback path Key: SPARK-27219 URL: https://issues.apache.org/jira/browse/SPARK-27219 Project:

[jira] [Assigned] (SPARK-21097) Dynamic allocation will preserve cached data

2019-03-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21097: -- Assignee: (was: Marcelo Vanzin) > Dynamic allocation will preserve cached d

[jira] [Assigned] (SPARK-21097) Dynamic allocation will preserve cached data

2019-03-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21097: -- Assignee: Marcelo Vanzin > Dynamic allocation will preserve cached d

[jira] [Updated] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2019-03-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-27194: --- Description: When a container fails for some reason (for example when killed by yarn for

Re: [VOTE] Release Livy 0.6.0 based on RC2

2019-03-19 Thread Marcelo Vanzin
Err. Should have read "based on RC2". Too fast on the send button! Anyway, here's my +1. Note this build does includes the pre-compiled jars for the thrift server. On Tue, Mar 19, 2019 at 2:56 PM Marcelo Vanzin wrote: > > This vote is for releasing Livy 0.6.0 based on RC2.

[VOTE] Release Livy 0.6.0 based on RC1

2019-03-19 Thread Marcelo Vanzin
This vote is for releasing Livy 0.6.0 based on RC2. The vote will be open at least 72 hours until Friday March 21st, 22:00 UTC and will pass with a minimum of 3 +1 binding votes and a majority of positive votes. [+1] This release is ready to send to the Incubator PMC for approval [-1] This relea

Re: [VOTE] Release Livy 0.6.0 based on RC1

2019-03-19 Thread Marcelo Vanzin
FYI I'm cancelling this vote in favor of rc2. On Mon, Mar 18, 2019 at 2:01 PM Marcelo Vanzin wrote: > > This vote is for releasing Livy 0.6.0 based on RC1. > > The vote will be open at least 72 hours until Thursday March 21st, 21:00 UTC > and > will pass with a minimum of

svn commit: r33080 - /dev/incubator/livy/0.6.0-incubating-rc2/

2019-03-19 Thread vanzin
Author: vanzin Date: Tue Mar 19 21:44:20 2019 New Revision: 33080 Log: Apache Livy 0.6.0-incubating-rc2 Added: dev/incubator/livy/0.6.0-incubating-rc2/ dev/incubator/livy/0.6.0-incubating-rc2/apache-livy-0.6.0-incubating-bin.zip (with props) dev/incubator/livy/0.6.0-incubating

[incubator-livy] tag v0.6.0-incubating-rc2 created (now 28be98c)

2019-03-19 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to tag v0.6.0-incubating-rc2 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git. at 28be98c (commit) No new revisions were added by this update.

[incubator-livy] 02/02: [BUILD] Update version for development version 0.6.1-incubating-SNAPSHOT.

2019-03-19 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git commit 022ef284b0f5d9d82f26f3f3a3733bfa95702fe2 Author: Marcelo Vanzin AuthorDate: Tue Mar 19 14:36:28 2019 -0700

[incubator-livy] branch branch-0.6 updated (9436f17 -> 022ef28)

2019-03-19 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git. from 9436f17 [BUILD] Add "apache" prefix to release archives. new 28be98c [BUILD] Update v

[incubator-livy] 01/02: [BUILD] Update version for 0.6.0-incubating rc2.

2019-03-19 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git commit 28be98cabc53b0858e8174a8e1fcfe216e53f8c2 Author: Marcelo Vanzin AuthorDate: Tue Mar 19 14:36:23 2019 -0700

[incubator-livy] branch branch-0.6 updated: [BUILD] Add "apache" prefix to release archives.

2019-03-19 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/branch-0.6 by this push: new 9436f17 [BUILD] Add "a

[incubator-livy] branch master updated: [BUILD] Add "apache" prefix to release archives.

2019-03-19 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/master by this push: new 07d216d [BUILD] Add "apache"

Re: [VOTE] Release Livy 0.6.0 based on RC1

2019-03-18 Thread Marcelo Vanzin
ed in Livy because Hadoop libraries use it). So I'm not sure there's much we can do unless someone wants to start manually maintaining this stuff. I'm not signing up for that. On Mon, Mar 18, 2019 at 6:27 PM Marcelo Vanzin wrote: > > I'll double check tomorrow, but I checked 3

Re: [VOTE] Release Livy 0.6.0 based on RC1

2019-03-18 Thread Marcelo Vanzin
I'll double check tomorrow, but I checked 3 or 4 of the ones you listed and they're all dual licensed, one of them being the *GPL license and the other being an ASF-friendly one. On Mon, Mar 18, 2019 at 5:45 PM Luciano Resende wrote: > > On Mon, Mar 18, 2019 at 4:03 PM Marcelo

[jira] [Resolved] (SPARK-27178) k8s test failing due to missing nss library in dockerfile

2019-03-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27178. Resolution: Fixed Fix Version/s: 3.0.0 2.4.2 > k8s test fail

[spark] branch branch-2.4 updated: [SPARK-27178][K8S][BRANCH-2.4] adding nss package to fix tests

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 342e91f [SPARK-27178][K8S][BRANCH-2.4

[jira] [Assigned] (LIVY-570) Replace test jar file in source repo with auto-generated file

2019-03-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned LIVY-570: --- Assignee: Marcelo Vanzin > Replace test jar file in source repo with auto-generated f

[jira] [Resolved] (LIVY-570) Replace test jar file in source repo with auto-generated file

2019-03-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved LIVY-570. - Resolution: Fixed Fix Version/s: 0.6.0 Issue resolved by pull request 159 [https

[incubator-livy] branch master updated: [LIVY-570] Replace test archives with auto-generated files.

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/master by this push: new eebf378 [LIVY-570] Replace test

[incubator-livy] branch branch-0.6 updated: [LIVY-570] Replace test archives with auto-generated files.

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/branch-0.6 by this push: new 316c869 [LIVY-570] Replace

Re: [VOTE] Release Livy 0.6.0 based on RC1

2019-03-18 Thread Marcelo Vanzin
On Mon, Mar 18, 2019 at 2:23 PM Luciano Resende wrote: > Also, there are lots of version mismatching between the included jars > and the third-party license file Could you be a little more explicit about this one? I don't even see a 3rd party license file. What exactly is the expectation here? -

[jira] [Created] (LIVY-570) Replace test jar file in source repo with auto-generated file

2019-03-18 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created LIVY-570: --- Summary: Replace test jar file in source repo with auto-generated file Key: LIVY-570 URL: https://issues.apache.org/jira/browse/LIVY-570 Project: Livy Issue

Re: [VOTE] Release Livy 0.6.0 based on RC1

2019-03-18 Thread Marcelo Vanzin
Ok, I can take a look at replacing that empty jar. Since it's empty it should be easy, hopefully. On Mon, Mar 18, 2019 at 2:44 PM Luciano Resende wrote: > > On Mon, Mar 18, 2019 at 14:29 Marcelo Vanzin > wrote: > > > On Mon, Mar 18, 2019 at 2:23 PM Luciano Resende >

Re: [VOTE] Release Livy 0.6.0 based on RC1

2019-03-18 Thread Marcelo Vanzin
On Mon, Mar 18, 2019 at 2:23 PM Luciano Resende wrote: > There has been a lot of discussion around this, but at the moment it's > not acceptable to have binary jars in a source release. Can you clarify this? There are two ways to interpret that: - no jars files in the source archive. There is a

[jira] [Updated] (LIVY-530) should livy return jobids for statment

2019-03-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated LIVY-530: Fix Version/s: (was: 0.6.0) > should livy return jobids for statm

[jira] [Updated] (LIVY-550) Batch Session will stay in state starting when some error happened in spark-submit process

2019-03-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated LIVY-550: Fix Version/s: (was: 0.6.0) > Batch Session will stay in state starting when some error happe

Re: [VOTE] Release Livy 0.6.0 based on RC1

2019-03-18 Thread Marcelo Vanzin
thought it was ok to send RC1 without it. If people feel strongly it should be in the binary package, I can create an RC2. On Mon, Mar 18, 2019 at 2:01 PM Marcelo Vanzin wrote: > > This vote is for releasing Livy 0.6.0 based on RC1. > > The vote will be open at least 72 hours until Thu

[VOTE] Release Livy 0.6.0 based on RC1

2019-03-18 Thread Marcelo Vanzin
This vote is for releasing Livy 0.6.0 based on RC1. The vote will be open at least 72 hours until Thursday March 21st, 21:00 UTC and will pass with a minimum of 3 +1 binding votes and a majority of positive votes. [+1] This release is ready to send to the Incubator PMC for approval [-1] This rel

svn commit: r33054 - in /dev/incubator/livy/0.6.0-incubating-rc1: livy-0.6.0-incubating-bin.zip.md5 livy-0.6.0-incubating-src.zip.md5

2019-03-18 Thread vanzin
Author: vanzin Date: Mon Mar 18 20:22:02 2019 New Revision: 33054 Log: Remove MD5 checksums. Removed: dev/incubator/livy/0.6.0-incubating-rc1/livy-0.6.0-incubating-bin.zip.md5 dev/incubator/livy/0.6.0-incubating-rc1/livy-0.6.0-incubating-src.zip.md5

svn commit: r33053 - /dev/incubator/livy/KEYS

2019-03-18 Thread vanzin
Author: vanzin Date: Mon Mar 18 20:19:37 2019 New Revision: 33053 Log: Add Marcelo Vanzin's public key. Modified: dev/incubator/livy/KEYS Modified: dev/incubator/livy/KEYS == --- dev/incubator/livy/KEYS (ori

svn commit: r33052 - /dev/incubator/livy/0.6.0-incubating-rc1/

2019-03-18 Thread vanzin
Author: vanzin Date: Mon Mar 18 20:16:36 2019 New Revision: 33052 Log: Apache Livy 0.6.0-incubating-rc1 Added: dev/incubator/livy/0.6.0-incubating-rc1/ dev/incubator/livy/0.6.0-incubating-rc1/livy-0.6.0-incubating-bin.zip (with props) dev/incubator/livy/0.6.0-incubating-rc1/livy

[incubator-livy] tag v0.6.0-incubating-rc1 created (now b8861bb)

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to tag v0.6.0-incubating-rc1 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git. at b8861bb (commit) No new revisions were added by this update.

[incubator-livy] 01/02: [BUILD] Update version for 0.6.0-incubating rc1.

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git commit b8861bbc3ad9aa0b7069fe1d7ae4a390bd422cb3 Author: Marcelo Vanzin AuthorDate: Mon Mar 18 13:06:00 2019 -0700

[incubator-livy] 02/02: [BUILD] Update version for development version 0.6.1-incubating-SNAPSHOT.

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git commit 26d9b5c9212bc866032191c209694fe6298a1498 Author: Marcelo Vanzin AuthorDate: Mon Mar 18 13:06:04 2019 -0700

[incubator-livy] branch branch-0.6 updated (59972a8 -> 26d9b5c)

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git. from 59972a8 [LIVY-565] Ensure column buffer for string and binary returns all data. new b8861bb

[incubator-livy] branch master updated: [BUILD] Bump master version to 0.7.0.

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/master by this push: new 50e4efe [BUILD] Bump master version to

[incubator-livy] branch branch-0.6 created (now 59972a8)

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/incubator-livy.git. at 59972a8 [LIVY-565] Ensure column buffer for string and binary returns all data. No new revisions were

[jira] [Assigned] (LIVY-565) Fix the bug that sql query row count is less than the actual row count of the table

2019-03-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned LIVY-565: --- Assignee: Marcelo Vanzin > Fix the bug that sql query row count is less than the actual

[jira] [Resolved] (LIVY-565) Fix the bug that sql query row count is less than the actual row count of the table

2019-03-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved LIVY-565. - Resolution: Fixed Fix Version/s: 0.6.0 Issue resolved by pull request 155 [https

[incubator-livy] branch master updated: [LIVY-565] Ensure column buffer for string and binary returns all data.

2019-03-18 Thread vanzin
This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-livy.git The following commit(s) were added to refs/heads/master by this push: new 59972a8 [LIVY-565] Ensure column

[jira] [Commented] (SPARK-27038) Rack resolving takes a long time when initializing TaskSetManager

2019-03-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794002#comment-16794002 ] Marcelo Vanzin commented on SPARK-27038: I was looking for something comple

[jira] [Resolved] (SPARK-27038) Rack resolving takes a long time when initializing TaskSetManager

2019-03-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27038. Resolution: Duplicate > Rack resolving takes a long time when initializing TaskSetMana

[jira] [Resolved] (SPARK-26634) OutputCommitCoordinator may allow task of FetchFailureStage commit again

2019-03-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26634. Resolution: Duplicate > OutputCommitCoordinator may allow task of FetchFailureSt

[jira] [Assigned] (LIVY-566) When cancel a sql job through livy, actually the sparkjob still running

2019-03-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned LIVY-566: --- Assignee: Marcelo Vanzin > When cancel a sql job through livy, actually the sparkjob st

[jira] [Resolved] (LIVY-566) When cancel a sql job through livy, actually the sparkjob still running

2019-03-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved LIVY-566. - Resolution: Fixed Fix Version/s: 0.6.0 Issue resolved by pull request 156 [https

<    1   2   3   4   5   6   7   8   9   10   >