Re: [ANNOUNCE] Apache Livy 0.6.0-incubating released

[Marcelo Vanzin]

(Apologies to all, this is the same announcement as previously, but
including the missing disclaimer.)

The Apache Livy team is proud to announce the release of Apache Livy
0.6.0-incubating.

Livy is web service that exposes a REST interface for managing long
running Apache Spark contexts in your cluster. Livy enables
programmatic, fault-tolerant, multi-tenant submission of Spark jobs
from web/mobile apps (no Spark client needed). So, multiple users can
interact with your Spark cluster concurrently and reliably.

Download Apache Livy 0.6.0-incubating:
http://livy.incubator.apache.org/download/

Release Notes:
http://livy.incubator.apache.org/history/

For more about Livy check our website:
http://livy.incubator.apache.org/

We would like to thank the contributors that made the release possible!

=
*Disclaimer*

Apache Livy (incubating) is an effort undergoing incubation at The
Apache Software Foundation (ASF), sponsored by the name of Apache
Incubator PMC. Incubation is required of all newly accepted projects
until a further review indicates that the infrastructure,
communications, and decision making process have
stabilized in a manner consistent with other successful ASF projects.
While incubation status is not necessarily a reflection of the
completeness or stability of the code, it does indicate that the
project has yet to be fully endorsed by the ASF.

-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

[ANNOUNCE] Apache Livy 0.6.0-incubating released

[Marcelo Vanzin]

The Apache Livy team is proud to announce the release of Apache Livy
0.6.0-incubating.

Livy is web service that exposes a REST interface for managing long
running Apache Spark contexts in your cluster. Livy enables
programmatic, fault-tolerant, multi-tenant submission of Spark jobs
from web/mobile apps (no Spark client needed). So, multiple users can
interact with your Spark cluster concurrently and reliably.

Download Apache Livy 0.6.0-incubating:
http://livy.incubator.apache.org/download/

Release Notes:
http://livy.incubator.apache.org/history/

For more about Livy check our website:
http://livy.incubator.apache.org/

We would like to thank the contributors that made the release possible!


-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

Re: List of Projects that went straight to Top Level Projects

[Marcelo Vanzin]

On Mon, Apr 1, 2019 at 1:08 PM Lars Francke  wrote:
> > Straight to TLP:
> >   Bahir, DRAT, Kibble, Orc, Serf, STeVe, Whimsy, Zest
>
> ORC was spun out of Hive as far as I remember.

In that sense Bahir was also spun out of Spark, although it added a
lot of things after that.

-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

[VOTE][RESULT] Release Apache Livy 0.6.0 (incubating) based on RC2

[Marcelo Vanzin]

Thanks for everybody who voted on the podling and general threads.

Vote passes with the following votes (* = binding):

- Justin Mclean (*)
- Luciano Resende (*)
- Felix Cheung (*)

Vote thread:
https://lists.apache.org/thread.html/c51ca324c1df14f986dcdf541c8dc976462bfc00fb4a9aba5259f2fc@%3Cgeneral.incubator.apache.org%3E

-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

[Marcelo Vanzin]

On Fri, Mar 29, 2019 at 10:41 PM Felix Cheung  wrote:
> I switched to another environment, found out I needed to manually  pip
> install configparser  just to build (skipTest)

There are probably things that could be better documented. Or maybe
could be handled better by the build scripts. But these should be
reported to the project (on jira), since it seems clear that those
working on the project are not running into these problems or have
long forgotten about it (after they fixed their local builds).

> And then without skipTest it failed even earlier on rsc  tests

Yes there are a few known flaky tests.

> Quite a number of binary resources in the src release, ttf, svg etc
> also this looks like standard bootstrap script, does it have to be in the
> src release (vs to include in binary release)?
> docs/assets/themes/apache/bootstrap/css/bootstrap.css

This is the way I've seen most ASF projects handling these kinds of
artifacts. e.g. I see multiple copies of bootstrap in the Hadoop repo.
Same in Spark.

And you can't get rid of all binaries in a source release... e.g.
images and fonts. Fonts could come from 3rd party places and
downloaded when building the sources, but is that worth the extra cost
(everyone downloading this thing from the net all the time)? Is there
any maven plugin or something like that for aiding with this sort of
thing?

Images will in many cases be project-specific.

Not saying that the current state is optimal but you're not really
providing an alternative here.

-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

[Marcelo Vanzin]

On Thu, Mar 28, 2019 at 3:57 PM Felix Cheung  wrote:

> I have LANG=“en_US.UTF-8”
> I tried a couple of things finally it passed when I use virtualenv - my
> python is Python 3, forcing that to Python 2 passed the test.


Hmmm, that tells me that the python 3 path in the fake shell might not be
as unicode-safe as it seems, and that this test should also be running
against python 3...

As a separate issue, things could be enhanced so that they force use of
"python2" when running the python 2 tests.

But in the spirit of "these are not regressions, just bugs", I'd rather not
block the release for that. (I filed a but for the ASCII thing already,
I'll file others for the above.)


> However, now
> another test failed (maybe connection blocked by firewall?)
>

That seems likely, if you have a local firewall? (8998 is Livy's default
port. Or maybe you have something running on that port and the tests should
be trying an ephemeral one...)


> error_msg = "Connection refused by Responses: POST
> http://machine:8998/sessions/ doesn't match Responses Mock"
> response = ConnectionError(u"Connection refused by Responses: POST
> http://machine:8998/sessions/doesn't match Responses Mock",)
>


-- 
Marcelo

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

[Marcelo Vanzin]

I can reproduce it with this:

 LC_ALL=en_US.ASCII mvn -Pspark-2.4 -Pthriftserver test -pl :livy-repl_2.11
-Dsuites=*.Python2*

Seems that Livy's fake python shell expects UTF-8 when running on Python 2.
This is not a new bug, so while we should fix it, not sure we need to fix
it in this release.


On Thu, Mar 28, 2019 at 11:24 AM sebb  wrote:

> On Thu, 28 Mar 2019 at 17:02, Marcelo Vanzin 
> wrote:
>
> > Are you using a different encoding that UTF-8 in your environment?
> >
> > The source file contains unicode escapes, so that shouldn't be the
> problem.
> > It may be the test is expecting the output of child processes (in this
> case
> > the python interpreter) to be UTF-8.
> >
> >
> If that is the case, then the test case ought to be fixed...
>
>
> > On Wed, Mar 27, 2019 at 10:25 PM Felix Cheung 
> > wrote:
> >
> > > This test is consistently failing when I build, any idea what’s wrong
> in
> > my
> > > setup?
> > >
> > > - should print unicode correctly *** FAILED *** (101 milliseconds)
> > > ExecuteSuccess(JObject(List((text/plain,JString(☺) did not equal
> > > ExecuteSuccess(JObject(List((text/plain,JString(☺)
> > > (PythonInterpreterSpec.scala:272)
> > >
> > >
> > > On Tue, Mar 26, 2019 at 1:36 PM Marcelo Vanzin
> >  > > >
> > > wrote:
> > >
> > > > The Livy PPMC has voted to release Livy 0.6.0 RC2 as the next Livy
> > > release.
> > > >
> > > > Livy enables programmatic, fault-tolerant, multi-tenant submission of
> > > > Spark jobs from web/mobile apps (no Spark client needed). So,
> multiple
> > > > users can interact with your Spark cluster concurrently and reliably.
> > > >
> > > > Vote thread:
> > > >
> > > >
> > >
> >
> https://lists.apache.org/thread.html/24c6c184f33c611aa83ec5d1c9948c96610b36df503b5e7f100ff4a2@%3Cdev.livy.apache.org%3E
> > > >
> > > > (Note I messed up the subject on the first e-mail, that thread is for
> > > > the RC2 vote.)
> > > >
> > > > Result thread:
> > > >
> > > >
> > >
> >
> https://lists.apache.org/thread.html/70c715f6394f06f0a49f76671b0f57cd1cdca35f7862a9ad2cf87fd7@%3Cdev.livy.apache.org%3E
> > > >
> > > > The RC is based on tag v0.6.0-incubating-rc2:
> > > > https://github.com/apache/incubator-livy/commit/28be98cabc
> > > >
> > > > The release files can be found here:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/incubator/livy/0.6.0-incubating-rc2/
> > > >
> > > > The staged maven artifacts can be found here:
> > > >
> https://repository.apache.org/content/repositories/orgapachelivy-1008
> > > >
> > > > The list of resolved JIRAs in this release can be found here:
> > > > https://issues.apache.org/jira/projects/LIVY/versions/12342736
> > > >
> > > > Vote will be open for at least 72 hours. Thanks!
> > > >
> > > > --
> > > > Marcelo
> > > >
> > > > -
> > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > > > For additional commands, e-mail: general-h...@incubator.apache.org
> > > >
> > > >
> > >
> >
> >
> > --
> > Marcelo
> >
>


-- 
Marcelo

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

[Marcelo Vanzin]

Also is that failing when running the Python2 or the Python3 version of
that test? Maybe it doesn't work as expected in some newer version of
Python3...

On Thu, Mar 28, 2019 at 10:02 AM Marcelo Vanzin  wrote:

> Are you using a different encoding that UTF-8 in your environment?
>
> The source file contains unicode escapes, so that shouldn't be the
> problem. It may be the test is expecting the output of child processes (in
> this case the python interpreter) to be UTF-8.
>
> On Wed, Mar 27, 2019 at 10:25 PM Felix Cheung 
> wrote:
>
>> This test is consistently failing when I build, any idea what’s wrong in
>> my
>> setup?
>>
>> - should print unicode correctly *** FAILED *** (101 milliseconds)
>> ExecuteSuccess(JObject(List((text/plain,JString(☺) did not equal
>> ExecuteSuccess(JObject(List((text/plain,JString(☺)
>> (PythonInterpreterSpec.scala:272)
>>
>>
>> On Tue, Mar 26, 2019 at 1:36 PM Marcelo Vanzin
>> 
>> wrote:
>>
>> > The Livy PPMC has voted to release Livy 0.6.0 RC2 as the next Livy
>> release.
>> >
>> > Livy enables programmatic, fault-tolerant, multi-tenant submission of
>> > Spark jobs from web/mobile apps (no Spark client needed). So, multiple
>> > users can interact with your Spark cluster concurrently and reliably.
>> >
>> > Vote thread:
>> >
>> >
>> https://lists.apache.org/thread.html/24c6c184f33c611aa83ec5d1c9948c96610b36df503b5e7f100ff4a2@%3Cdev.livy.apache.org%3E
>> >
>> > (Note I messed up the subject on the first e-mail, that thread is for
>> > the RC2 vote.)
>> >
>> > Result thread:
>> >
>> >
>> https://lists.apache.org/thread.html/70c715f6394f06f0a49f76671b0f57cd1cdca35f7862a9ad2cf87fd7@%3Cdev.livy.apache.org%3E
>> >
>> > The RC is based on tag v0.6.0-incubating-rc2:
>> > https://github.com/apache/incubator-livy/commit/28be98cabc
>> >
>> > The release files can be found here:
>> >
>> https://dist.apache.org/repos/dist/dev/incubator/livy/0.6.0-incubating-rc2/
>> >
>> > The staged maven artifacts can be found here:
>> > https://repository.apache.org/content/repositories/orgapachelivy-1008
>> >
>> > The list of resolved JIRAs in this release can be found here:
>> > https://issues.apache.org/jira/projects/LIVY/versions/12342736
>> >
>> > Vote will be open for at least 72 hours. Thanks!
>> >
>> > --
>> > Marcelo
>> >
>> > -
>> > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
>> > For additional commands, e-mail: general-h...@incubator.apache.org
>> >
>> >
>>
>
>
> --
> Marcelo
>


-- 
Marcelo

Re: [VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

[Marcelo Vanzin]

Are you using a different encoding that UTF-8 in your environment?

The source file contains unicode escapes, so that shouldn't be the problem.
It may be the test is expecting the output of child processes (in this case
the python interpreter) to be UTF-8.

On Wed, Mar 27, 2019 at 10:25 PM Felix Cheung 
wrote:

> This test is consistently failing when I build, any idea what’s wrong in my
> setup?
>
> - should print unicode correctly *** FAILED *** (101 milliseconds)
> ExecuteSuccess(JObject(List((text/plain,JString(☺) did not equal
> ExecuteSuccess(JObject(List((text/plain,JString(☺)
> (PythonInterpreterSpec.scala:272)
>
>
> On Tue, Mar 26, 2019 at 1:36 PM Marcelo Vanzin  >
> wrote:
>
> > The Livy PPMC has voted to release Livy 0.6.0 RC2 as the next Livy
> release.
> >
> > Livy enables programmatic, fault-tolerant, multi-tenant submission of
> > Spark jobs from web/mobile apps (no Spark client needed). So, multiple
> > users can interact with your Spark cluster concurrently and reliably.
> >
> > Vote thread:
> >
> >
> https://lists.apache.org/thread.html/24c6c184f33c611aa83ec5d1c9948c96610b36df503b5e7f100ff4a2@%3Cdev.livy.apache.org%3E
> >
> > (Note I messed up the subject on the first e-mail, that thread is for
> > the RC2 vote.)
> >
> > Result thread:
> >
> >
> https://lists.apache.org/thread.html/70c715f6394f06f0a49f76671b0f57cd1cdca35f7862a9ad2cf87fd7@%3Cdev.livy.apache.org%3E
> >
> > The RC is based on tag v0.6.0-incubating-rc2:
> > https://github.com/apache/incubator-livy/commit/28be98cabc
> >
> > The release files can be found here:
> >
> https://dist.apache.org/repos/dist/dev/incubator/livy/0.6.0-incubating-rc2/
> >
> > The staged maven artifacts can be found here:
> > https://repository.apache.org/content/repositories/orgapachelivy-1008
> >
> > The list of resolved JIRAs in this release can be found here:
> > https://issues.apache.org/jira/projects/LIVY/versions/12342736
> >
> > Vote will be open for at least 72 hours. Thanks!
> >
> > --
> > Marcelo
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > For additional commands, e-mail: general-h...@incubator.apache.org
> >
> >
>


-- 
Marcelo

[VOTE] Release Apache Livy 0.6.0 (incubating) based on RC2

[Marcelo Vanzin]

The Livy PPMC has voted to release Livy 0.6.0 RC2 as the next Livy release.

Livy enables programmatic, fault-tolerant, multi-tenant submission of
Spark jobs from web/mobile apps (no Spark client needed). So, multiple
users can interact with your Spark cluster concurrently and reliably.

Vote thread:
https://lists.apache.org/thread.html/24c6c184f33c611aa83ec5d1c9948c96610b36df503b5e7f100ff4a2@%3Cdev.livy.apache.org%3E

(Note I messed up the subject on the first e-mail, that thread is for
the RC2 vote.)

Result thread:
https://lists.apache.org/thread.html/70c715f6394f06f0a49f76671b0f57cd1cdca35f7862a9ad2cf87fd7@%3Cdev.livy.apache.org%3E

The RC is based on tag v0.6.0-incubating-rc2:
https://github.com/apache/incubator-livy/commit/28be98cabc

The release files can be found here:
https://dist.apache.org/repos/dist/dev/incubator/livy/0.6.0-incubating-rc2/

The staged maven artifacts can be found here:
https://repository.apache.org/content/repositories/orgapachelivy-1008

The list of resolved JIRAs in this release can be found here:
https://issues.apache.org/jira/projects/LIVY/versions/12342736

Vote will be open for at least 72 hours. Thanks!

-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

Incubator wiki write access

[Marcelo Vanzin]

Could I get write access so I can update the podling report page? User
name is MarceloVanzin.

Thanks!


-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

[jira] [Commented] (INCUBATOR-210) Servicecomb当前性能统计不支持时延分布的统计，这个对于业务有重要意义

[Marcelo Vanzin (JIRA)]

[ 
https://issues.apache.org/jira/browse/INCUBATOR-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378974#comment-16378974
 ] 

Marcelo Vanzin commented on INCUBATOR-210:
--

I thought so at first, but Google Translate says:

{quote}
Servicecomb current performance statistics do not support the statistics of 
delay distribution, which is of great importance to the service, that is, the 
statistics of delay distribution like [0,200] and [200,400). The average delay 
may cover some problems in the system, for example, part High latency, but 
masked by normal average
{quote}


> Servicecomb当前性能统计不支持时延分布的统计，这个对于业务有重要意义
> ---
>
> Key: INCUBATOR-210
> URL: https://issues.apache.org/jira/browse/INCUBATOR-210
> Project: Incubator
>  Issue Type: Task
>Reporter: renyingxin
>Priority: Major
>
> Servicecomb当前性能统计不支持时延分布的统计，这个对于业务有重要意义,也就是类似[0,200),[200,400）这种时延分布的统计，平均时延可能会掩盖系统的部分问题，比如部分高延时，但是被正常平均值掩盖了



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

Re: [VOTE] Release Livy 0.4.0-incubating based on Livy 0.4.0 RC2

[Marcelo Vanzin]

Just echoing my +1 from the Livy list.

On Tue, Aug 22, 2017 at 12:33 AM, Jerry Shao  wrote:
> Hello Incubator PMC’ers,
>
> The Apache Livy community has decided to release Apache Livy
> 0.4.0-incubating based on 0.4.0-incubating Release Candidate 2. We now
> kindly request the Incubator PMC members to review and vote on this incubator
> release.
>
> Livy is web service that exposes a REST interface for managing long running
> Apache Spark contexts in your cluster. With Livy, new applications can be
> built on top of Apache Spark that require fine grained interaction with
> many Spark contexts.
>
> Artifacts are available at
> https://dist.apache.org/repos/dist/dev/incubator/livy/, public keys are
> available at https://dist.apache.org/repos/dist/dev/incubator/livy/KEYS.
>
> livy-0.4.0-incubating-src.zip <
> https://dist.apache.org/repos/dist/dev/incubator/livy/0.4.0-incubating/livy-0.4.0-incubating-src-RC2.zip
>> is a source release. Along with it, for convenience, please find the
> binary release as livy-0.4.0-incubating-bin-RC2.zip <
> https://dist.apache.org/repos/dist/dev/incubator/livy/0.4.0-incubating/livy-0.4.0-incubating-bin-RC2.zip
>>.
>
>
> Git tag:
> *https://github.com/apache/incubator-livy/releases/tag/v0.4.0-incubating-rc2
> *
>
> The vote will be open for at least 72 hours or until necessary number of
> votes are reached.
>
> Members please be sure to indicate "(Binding)" with your vote which will
> help in tallying the vote(s).
>
> * Here is my +1 (non-binding) *
>
> Cheers,
> Jerry



-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

Re: [VOTE] Livy to enter Apache Incubator

[Marcelo Vanzin]

> redirect.
>
> = External Dependencies =
>
> The list below covers the non-Apache dependencies of the project and their
> licenses.
>
>  * Jetty: Apache 2.0
>  * Dropwizard Metrics: Apache 2.0
>  * FasterXML Jackson: Apache 2.0
>  * Netty: Apache 2.0
>  * Scala: BSD
>  * Py4J: BSD
>  * Scalatra: BSD
>
> Build/test-only dependencies:
>
>  * Mockito: MIT
>  * JUnit: Eclipse
>
> = Required Resources =
>
> == Mailing Lists ==
>
>  * priv...@livy.incubator.apache.org (PPMC)
>  * d...@livy.incubator.apache.org (dev mailing list)
>  * u...@livy.incubator.apache.org (User questions)
>  * comm...@livy.incubator.apache.org (subscribers shouldn’t be able to post)
>  * iss...@livy.incubator.apache.org (subscribers shouldn’t be able to post)
>
> == Git Repository ==
>
> git://git.apache.org/incubator-livy
>
> == Issue Tracking ==
>
> We would like to import our current JIRA project into the ASF JIRA, such
> that our historical commit message and code comments continue to reference
> the appropriate bug numbers.
>
> = Initial Committers =
>
>  * Marcelo Vanzin (van...@cloudera.com)
>  * Alex Man (alex@alexman.space)
>  * Jeff Zhang (zjf...@gmail.com)
>  * Saisai Shao (ss...@hortonworks.com)
>  * Kostas Sakellis (kos...@cloudera.com)
>
> = Affiliations =
>
> The initial set of committers includes people employed by Cloudera and
> Hortonworks as well as one currently independent contributor.
>
> = Additional Interested Contributors =
>
> Those interested in getting involved with the project as we enter incubation
> are encouraged to list themselves here.
>
>   * Ismaël Mejía (ieme...@apache.org)
>
> = Sponsors =
>
> == Champion ==
>
> Sean Busbey (bus...@apache.org)
>
> == Nominated Mentors ==
>
>  * Bikas Saha (bi...@apache.org)
>  * Brock Noland (br...@phdata.io)
>  * Luciano Resende (lrese...@apache.org)
>
> == Sponsoring Entity ==
>
> We ask that the Incubator PMC sponsor this proposal.
>
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>



-- 
Marcelo

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org