Re: Save state on tear down

2019-09-03 Thread Lukasz Cwik
On Fri, Aug 30, 2019 at 6:52 PM Chad Dombrova wrote: > +dev > > I read the document on Drain, and it sounds very promising. I have a few > questions, starting with this statement from the doc: > >"This document proposes a new pipeline action called Drain. Drain can > be implemented by

Re: [VOTE] Vendored Dependencies Release

2019-09-03 Thread Lukasz Cwik
+1 On Tue, Sep 3, 2019 at 1:22 PM Kenneth Knowles wrote: > +1 > > On Tue, Sep 3, 2019 at 11:00 AM Ahmet Altay wrote: > >> +1 >> >> On Tue, Sep 3, 2019 at 10:52 AM Andrew Pilloud >> wrote: >> >>> +1 >>> >>> Inspected the jar it looked reasonable. >>> >>> Andrew >>> >>> On Tue, Sep 3, 2019 at

Re: [VOTE] Vendored Dependencies Release

2019-09-03 Thread Kenneth Knowles
+1 On Tue, Sep 3, 2019 at 11:00 AM Ahmet Altay wrote: > +1 > > On Tue, Sep 3, 2019 at 10:52 AM Andrew Pilloud > wrote: > >> +1 >> >> Inspected the jar it looked reasonable. >> >> Andrew >> >> On Tue, Sep 3, 2019 at 9:06 AM Rui Wang wrote: >> >>> Friendly ping. >>> >>> >>> -Rui >>> >>> On Thu,

Re: Stop publishing unneeded Java artifacts

2019-09-03 Thread Kenneth Knowles
I know that the Nemo project had tested the Nexmark pipelines. They may only need the main code, not the tests themselves. But the tests check that the runner's output matches a straight-line Java model of the query. So that is actually a pretty good runner test. I think any test suite that uses

Re: Hackathon @BeamSummit @ApacheCon

2019-09-03 Thread Brian Hulette
I will be around all week as well and would love to help with a Beam hackathon in any way :) On Thu, Aug 29, 2019 at 9:46 AM Maximilian Michels wrote: > Hey, > > I'm in as well! Austin and I recently talked about how we could organize > the hackathon. Likely it will be an hour per day for

Re: [VOTE] Vendored Dependencies Release

2019-09-03 Thread Ahmet Altay
+1 On Tue, Sep 3, 2019 at 10:52 AM Andrew Pilloud wrote: > +1 > > Inspected the jar it looked reasonable. > > Andrew > > On Tue, Sep 3, 2019 at 9:06 AM Rui Wang wrote: > >> Friendly ping. >> >> >> -Rui >> >> On Thu, Aug 29, 2019 at 9:50 AM Rui Wang wrote: >> >>> Thanks Kai and Andrew. Now

Re: [VOTE] Vendored Dependencies Release

2019-09-03 Thread Andrew Pilloud
+1 Inspected the jar it looked reasonable. Andrew On Tue, Sep 3, 2019 at 9:06 AM Rui Wang wrote: > Friendly ping. > > > -Rui > > On Thu, Aug 29, 2019 at 9:50 AM Rui Wang wrote: > >> Thanks Kai and Andrew. Now prgapachebeam-1083 is publicly exposed. >> >> I also found a useful link[1] to

Re: Stop publishing unneeded Java artifacts

2019-09-03 Thread Robert Bradshaw
:sdks:java:testing:expansion-service could be useful to publish for testing as well. On Fri, Aug 30, 2019 at 3:13 PM Lukasz Cwik wrote: > > Google internally relies on being able to get the POM files generated for: > :sdks:java:testing:nexmark > :sdks:java:testing:test-utils > > Generating the

Re: [ANNOUNCE] New committer: Valentyn Tymofieiev

2019-09-03 Thread Connell O'Callaghan
Congratulations Valentyn!!! - Connell On Tue, Sep 3, 2019 at 9:34 AM David Cavazos wrote: > Congratulations Valentyn!  > > On Mon, Sep 2, 2019 at 7:12 PM jincheng sun > wrote: > >> Congrats Valentyn ! >> >> Cheers, >> Jincheng >> >> Katarzyna Kucharczyk 于2019年9月2日周一 下午5:20写道: >> >>>

Re: [DISCUSS] Portability representation of schemas

2019-09-03 Thread Gleb Kanterov
Thanks, Brian. It makes sense, it wasn't entirely clear from commit messages, that's why I wanted to double check. On Tue, Sep 3, 2019 at 5:43 PM Brian Hulette wrote: > Hey Gleb, thanks for bringing this up. The PR that was reverted (8853) is > the same one that I referred to earlier in this

Re: [ANNOUNCE] New committer: Valentyn Tymofieiev

2019-09-03 Thread David Cavazos
Congratulations Valentyn!  On Mon, Sep 2, 2019 at 7:12 PM jincheng sun wrote: > Congrats Valentyn ! > > Cheers, > Jincheng > > Katarzyna Kucharczyk 于2019年9月2日周一 下午5:20写道: > >> Congratulations Valentyn!  >> >> On Wed, Aug 28, 2019 at 3:49 PM Frederik Bode >> wrote: >> >>> Congrats

Re: [VOTE] Vendored Dependencies Release

2019-09-03 Thread Rui Wang
Friendly ping. -Rui On Thu, Aug 29, 2019 at 9:50 AM Rui Wang wrote: > Thanks Kai and Andrew. Now prgapachebeam-1083 is publicly exposed. > > I also found a useful link[1] to explain staging repos in Apache Nexus > > > [1]: >

Re: unsubscribe

2019-09-03 Thread Rui Wang
Hi Alexander, You can send to dev-unsubscr...@beam.apache.org to unsubscribe. -Rui On Tue, Sep 3, 2019 at 2:43 AM Alexander Kolchin wrote: > unsubscribe > > -- > Alexander Kolchin > akolc...@gmail.com > >

Re: [DISCUSS] Portability representation of schemas

2019-09-03 Thread Brian Hulette
Hey Gleb, thanks for bringing this up. The PR that was reverted (8853) is the same one that I referred to earlier in this thread. It modified the existing portable schema representation to match what we settled on here - and yes it removed support for logical types like fixed bytes. I (foolishly)

Re: [DISCUSS] Portability representation of schemas

2019-09-03 Thread Gleb Kanterov
Recently there was a pull request (that was reverted) for adding portable representation of schemas. It's great to see things moving forward, I'm worried that it doesn't support any logical types, especially fixed bytes. That makes runners using portable schemas unusable, for instance, when

Re: Cassandra flaky on Jenkins?

2019-09-03 Thread Jean-Baptiste Onofré
Hi Max, yup, I'm starting the investigation. I keep you posted. Regards JB On 03/09/2019 15:34, Maximilian Michels wrote: > The newest incarnation of this is here: > https://jira.apache.org/jira/browse/BEAM-8025 > > Would be good if you could take a look JB. > > Thanks, > Max > > On

Re: Cassandra flaky on Jenkins?

2019-09-03 Thread Maximilian Michels
The newest incarnation of this is here: https://jira.apache.org/jira/browse/BEAM-8025 Would be good if you could take a look JB. Thanks, Max On 03.09.19 15:32, David Morávek wrote: yes, that looks similar. example: https://github.com/apache/beam/pull/9464 D. On 3 Sep 2019, at 15:18,

Re: Cassandra flaky on Jenkins?

2019-09-03 Thread David Morávek
yes, that looks similar. example: https://github.com/apache/beam/pull/9464 D. > On 3 Sep 2019, at 15:18, Jean-Baptiste Onofré wrote: > > Thanks David, > > the build is running on my machine to see if I can reproduce locally. > > It sounds like https://issues.apache.org/jira/browse/BEAM-7355

Re: Cassandra flaky on Jenkins?

2019-09-03 Thread Jean-Baptiste Onofré
Thanks David, the build is running on my machine to see if I can reproduce locally. It sounds like https://issues.apache.org/jira/browse/BEAM-7355 right ? Regards JB On 03/09/2019 15:11, David Morávek wrote: > I’m running into these failures too > > D. > > Sent from my iPhone > >> On 3 Sep

Re: Cassandra flaky on Jenkins?

2019-09-03 Thread David Morávek
I’m running into these failures too D. Sent from my iPhone > On 3 Sep 2019, at 14:34, Jean-Baptiste Onofré wrote: > > Hi, > > Let me take a look. Do you always have this issue on Jenkins or randomly ? > > Regards > JB > >> On 03/09/2019 14:19, Alex Van Boxel wrote: >> Hi, is it only me

Re: Cassandra flaky on Jenkins?

2019-09-03 Thread Jean-Baptiste Onofré
Hi, Let me take a look. Do you always have this issue on Jenkins or randomly ? Regards JB On 03/09/2019 14:19, Alex Van Boxel wrote: > Hi, is it only me that are bumping on the flaky Cassandra on Jenkins? I > like to get my PR approved but I can't get past the Cassandra error... > > *

Re: Cassandra flaky on Jenkins?

2019-09-03 Thread Jan Lukavský
Hi Alex, I have seen it too. Jan On 9/3/19 2:19 PM, Alex Van Boxel wrote: Hi, is it only me that are bumping on the flaky Cassandra on Jenkins? I like to get my PR approved but I can't get past the Cassandra error... * org.apache.beam.sdk.io.cassandra.CassandraIOTest.classMethod

Cassandra flaky on Jenkins?

2019-09-03 Thread Alex Van Boxel
Hi, is it only me that are bumping on the flaky Cassandra on Jenkins? I like to get my PR approved but I can't get past the Cassandra error... - org.apache.beam.sdk.io.cassandra.CassandraIOTest.classMethod

unsubscribe

2019-09-03 Thread Alexander Kolchin
unsubscribe -- Alexander Kolchin akolc...@gmail.com