Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

: - To: dev@openwhisk.apache.org From: Rodric Rabbah Date: 11/07/2018 02:31PM Subject: Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk) Thank you Adobe Inc and the Adobe team for the donation and making it possible to have infra for the project! And thanks

Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

Thank you Adobe Inc and the Adobe team for the donation and making it possible to have infra for the project! And thanks Carlos for also pushing this forward. -r > On Nov 7, 2018, at 2:25 PM, Carlos Santana wrote: > > We got the 3 VMs Woot !! > it only took 6 months > > The INFRA ticket [1]

Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

We got the 3 VMs Woot !! it only took 6 months The INFRA ticket [1] that I opened back in June I was able to close today. I ran a quick test from a Jenkins job to check the 3 VMs, I added the information in our Wiki page [2] On behave of the Apache OpenWhisk (Incubating) community I want to

Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

Thanks Michael for securing some funding to get us started with this. With the recent work from Chettam in refactoring our gradle testing tasks, and using Travis stages to build in parallel and over come the 50 minute limit we used to hit, By adding an additional stage we should be able to run

Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

A quick update on this: Carlos (and others) has been working on the mechanics of getting distributed tests to run on hardware that is managed by Infra. For this purpose we should have a couple of Infra-managed VMs that are dedicated to OpenWhisk. Bertrand has gotten me in touch with the ASF

Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

On Sun, Apr 8, 2018 at 3:36 AM, Carlos Santana wrote: > ...Michael could you direct the inquiries on the infra list?... I think it makes sense to keep this thread here for now and dig deeper on the (type of) solution that Luciano has been explaining. Note that

Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

dentials to committers > >> > >> I am mainly interested to learn if there are other ASF projects (e.g. in > >> the Big Data/Hadoop ecosystem) that do something similar. Or if there > is an > >> ASF-recommended way to do this. Or else, where I could ask

Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

o: "dev@openwhisk.apache.org" <dev@openwhisk.apache.org> Subject: Re: Performance tests for OpenWhisk Markus, Quick update: sent the below to users@infra. So far no reaction. The archive is here [1] but Bertrand tells me only ASF member have access - f

Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)

doop ecosystem) that do something similar. Or if there is an > ASF-recommended way to do this. Or else, where I could ask this question? > > Thanks! > Michael > > From: Michael Marth <mma...@adobe.com> > Date: Wednesday 3 May 2017 20:57 > To: "dev@openwhisk.apache.org&qu

Re: Performance tests of OpenWhisk

Agreed that we can’t yet everything but perhaps these may be sensible. 1. Latency regression because of a cold start related bug (might need at least two invokers and controllers) 2. For a single invoker (non black box), some expected l/sustained throughout range (rps) 3. If we disable the

Re: Performance tests of OpenWhisk

As I said, we only have a very small travis machine. But I think it's at least worth a try, if we get consistent performance numbers in travis, to set a threshold and fail if it's below this threshold. Greetings Christian March 19, 2018 12:03 PM, "Rodric Rabbah" wrote: >

Re: Performance tests of OpenWhisk

Great - are you considering also a Travis CI matrix? -r

Re: Performance tests for OpenWhisk

/adobe-apiplatform/openwhisk-performance-tests [3] - http://tsung.erlang-projects.org/ On Thu, Aug 3, 2017 at 1:04 AM Carlos Santana <csantan...@gmail.com> wrote: > Following up here I requested a new repo incubator-openwhisk-performance > INFRA ticket here: https://issues.apache.org

Re: Performance tests for OpenWhisk

.com>> > Reply-To: "dev@openwhisk.apache.org<mailto:dev@openwhisk.apache.org>" < > dev@openwhisk.apache.org<mailto:dev@openwhisk.apache.org>> > Date: Wednesday 26 April 2017 12:59 > To: "dev@openwhisk.apache.org<mailto:dev@openwhisk.apache.org&g

Re: Performance tests for OpenWhisk

.org<mailto:dev@openwhisk.apache.org>> Date: Wednesday 26 April 2017 12:59 To: "dev@openwhisk.apache.org<mailto:dev@openwhisk.apache.org>" <dev@openwhisk.apache.org<mailto:dev@openwhisk.apache.org>> Subject: Re: Performance tests for OpenWhisk Hi Michael, yeah that so

Re: Performance tests for OpenWhisk

Hi Michael, yeah that sounds pretty much spot on. I'd like to have at least 2 VMs with 4+ cores and 8GB memory. One VM would host the management stack while one would be dedicated to an Invoker only. That way we could assert single-invoker performance the easiest. Thanks for helping!

Re: Performance tests for OpenWhisk

Markus, Does what I describe reflect what you are looking for? If yes, I am happy to ask on infra. Let me know Michael On 26/04/17 07:52, "Bertrand Delacretaz" wrote: >Hi Michael, > >On Tue, Apr 25, 2017 at 6:52 PM, Michael Marth wrote: >> ...Maybe

Performance tests for OpenWhisk

Hi all, Since many have asked I today started an effort to bring a comprehensive performance test suite for OpenWhisk out in the open. Without much talking, here's the repository:  https://github.com/markusthoemmes/openwhisk-performance My initial idea was to have the tests run on Travis to