Go SDK integration tests

Hi everyone, I'm currently tinkering with adding integration tests for Go (BEAM-3827) and wrote down a small proposal to that end: https://docs.google.com/document/d/1jy6EE7D4RjgfNV0FhD3rMsT1YKhnUfcHRZMAlC6ygXw/edit?usp=sharing Similarly to other SDKs, the proposal is to add self-validating

Build failed in Jenkins: beam_SeedJob #1652

See Changes: [github] Explictly delcare globals defined elsewhere [mairbek] Introduced SpannerWriteResult that [mairbek] Addressed comments [mairbek] Happy checkstyle [github] Adding a microbenchmark for side

Re: Graal instead of docker?

There are indeed lots of possibilities for interesting docker alternatives with different tradeoffs and capabilities, but in generally both the runner as well as the SDK must support them for it to work. As mentioned, docker (as used in the container contract) is meant as a flexible main option

Re: [PROPOSAL] Preparing 2.5.0 release next week

Thanks for the update JB. Please open JIRA's for any Gradle release blockers with as much context as you have. On Tue, May 8, 2018 at 12:32 PM Jean-Baptiste Onofré wrote: > Hi guys, > > new update on the 2.5.0 release preparation. > > I tested the artifacts published by

Re: Graal instead of docker?

On Sat, May 5, 2018 at 3:58 PM, Robert Bradshaw wrote: > > I would welcome changes to > https://github.com/apache/beam/blob/v2.4.0/model/ > pipeline/src/main/proto/beam_runner_api.proto#L730 > that would provide alternatives to docker (one of which comes to mind is "I >

Re: Graal instead of docker?

On Tue, May 8, 2018 at 3:52 AM Romain Manni-Bucau wrote: > > > Le mar. 8 mai 2018 10:16, Robert Bradshaw a écrit : > >> On Sun, May 6, 2018 at 1:30 AM Romain Manni-Bucau >> wrote: >> >> > Wow, this mail should be on the website

Re: Jenkins Post Commit Status to Github

Yep, mess with the groovy scripts appears to be the answer. We use different jenkins libraries to handle PRs vs pushes to master but I think I finally figured it out. Change is here: https://github.com/apache/beam/pull/5305 Andrew On Mon, May 7, 2018 at 12:40 PM Kenneth Knowles

Re: [PROPOSAL] Preparing 2.5.0 release next week

Hi guys, new update on the 2.5.0 release preparation. I tested the artifacts published by gradle (using gradlew publishToLocalMaven) in "my" beam-samples (which still use the mvn). Unfortuntaly beam-samples project doesn't build as some artifacts seem to miss in the local repository. I'm

Re: Performance Testing - request for comments

A few thoughts: 1. Gradle can intelligently build only the dependencies necessary for a task, so it shouldn't build all of Python if the test suite, if you only specify the task you're interested in. I'm not sure of the command for "build all of the dependencies of my tests but don't run my

Performance Testing - request for comments

Hi Beam Devs, currently PerfkitBenchmarker (a tool used to invoke performance tests) has two phases that run gradle commands: - Pre-build phase: this is where all the beam repo is build. This phase is to prepare the necessary artifacts so that it doesn't happen when executing tests.

Re: [DISCUSS] State of the project: Culture and governance

On Tue, Jan 23, 2018 at 8:44 AM Ismaël Mejía wrote: > - Clear guidelines for the criteria to earn commitership/PMC status. > The PMC discussed this quite a bit and we have now added this to the web site: https://beam.apache.org/contribute/become-a-committer/ Kenn

Re: Apache Beam - jenkins question

Hi, Jason Sorry for late response I was on vacations. I would like to send messages automatically to slack with Performance Analysis Daily Reports as described in this https://github.com/apache/beam/pull/5180: example report could be found on old apache beam slack

Re: Graal instead of docker?

It sounds reasonable to me and makes more sense. Regards JB Le 8 mai 2018 à 12:53, à 12:53, Romain Manni-Bucau a écrit: >Le mar. 8 mai 2018 10:16, Robert Bradshaw a écrit >: > >> On Sun, May 6, 2018 at 1:30 AM Romain Manni-Bucau

Re: Graal instead of docker?

Le mar. 8 mai 2018 10:16, Robert Bradshaw a écrit : > On Sun, May 6, 2018 at 1:30 AM Romain Manni-Bucau > wrote: > > > Wow, this mail should be on the website Robert, thanks for it > > > I still have a point to try to understand better: my view is

Re: Graal instead of docker?

On Sun, May 6, 2018 at 1:30 AM Romain Manni-Bucau wrote: > Wow, this mail should be on the website Robert, thanks for it > I still have a point to try to understand better: my view is that once submitted the only perf related point is when you hit a flow of data. So a

Build failed in Jenkins: beam_Release_Gradle_NightlySnapshot #32

See Changes: [thw] [BEAM-4246] Remove Maven build directory dependency in Apex runner. [thw] Upgrade Apex version to 3.7.0 to get rid of poisened netlet 1.3.0 [daniel.o.programmer] Change to