A question about windowed values

My instinct tells me that if a value does not belong to a specific window (in time) it's a part of a global window, but if so, what's the role of the "empty window". When should an element be a "value in an empty window" ?

Re: PROPOSAL: Apache Beam (virtual) meeting: 05/11/2016 08:00 - 11:00 Pacific time

Either works for me. On Tue, 12 Apr 2016 at 22:29 Kenneth Knowles wrote: > Either works for me. Thanks James! > > On Tue, Apr 12, 2016 at 11:31 AM, Amit Sela wrote: > > > Anytime works for me. > > > > On Tue, Apr 12, 2016, 21:24 Jean-Baptiste

Re: Massive package renaming coming

Great work guys ! A big step forward. Thanks Regards JB On 04/14/2016 07:43 AM, Davor Bonaci wrote: I've just merged a pull request that includes this project-wide renaming of Java packages. (Long live Beam!) At this point, pending pull requests may need to be rebased. We'll try to fix the

Re: Massive package renaming coming

I've just merged a pull request that includes this project-wide renaming of Java packages. (Long live Beam!) At this point, pending pull requests may need to be rebased. We'll try to fix the Cloud Dataflow runner as soon as possible, but it might take a little bit to complete that. There's still

Re: A question about windowed values

As Thomas says, the fact that we ever produce values in "no window" is an implementation quirk that should probably be fixed. (IIRC, it's used for the output of a GBK before we've done the group-also-by-windows to figure out what window it really should be in, so "value in unknown windows" would

Re: TextIO.Read.Bound vs Create

This seems wrong. They should both be in the global window. I think your trouble is https://github.com/apache/incubator-beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/translation/TransformTranslator.java#L472 On Tue, Apr 12, 2016 at 9:43 PM, Amit Sela

Re: PROPOSAL: Apache Beam (virtual) meeting: 05/11/2016 08:00 - 11:00 Pacific time

Either works for me. On Wed, Apr 13, 2016 at 9:21 AM, Milindu Sanoj Kumarage < agentmili...@gmail.com> wrote: > Hi, > > 5/4/2016 works for me > > Regards, > Milindu > On 13 Apr 2016 1:43 p.m., "Aljoscha Krettek" wrote: > > > Either works for me. > > > > On Tue, 12 Apr 2016

Re: PROPOSAL: Apache Beam (virtual) meeting: 05/11/2016 08:00 - 11:00 Pacific time

Sounds like we have broad consensus on the following: Date: 5/4/2016 Time: 8:00 - 11:00 AM Pacific time Location: Virtual I will submit a PR to update the website ( http://beam.incubator.apache.org/public-meetings/) later today. Best, James On Wed, Apr 13, 2016 at 9:21 AM, Milindu

Re: A question about windowed values

First of all, Thanks for the detailed explanation! I can say that from my point of view (as a runner developer) this is definitely confusing, especially discovering that an element in an empty window can be dropped at anytime, so +1 for Robert's comment on not having this public API, and

Re: TextIO.Read.Bound vs Create

Yep. And I got a good answer for this one as well. Thanks! On Wed, Apr 13, 2016, 19:00 Kenneth Knowles wrote: > This seems wrong. They should both be in the global window. I think your > trouble is > >

Re: A question about windowed values

Good thread. Filed as https://issues.apache.org/jira/browse/BEAM-191. On Wed, Apr 13, 2016 at 10:08 AM, Amit Sela wrote: > First of all, Thanks for the detailed explanation! > > I can say that from my point of view (as a runner developer) this is > definitely confusing,

Re: PROPOSAL: Apache Beam (virtual) meeting: 05/11/2016 08:00 - 11:00 Pacific time

Should work for me as well! On Wed, Apr 13, 2016 at 7:04 PM, James Malone < jamesmal...@google.com.invalid> wrote: > Sounds like we have broad consensus on the following: > > Date: 5/4/2016 > Time: 8:00 - 11:00 AM Pacific time > Location: Virtual > > I will submit a PR to update the

Re: [jira] [Commented] (BEAM-190) Dead-letter drop for bad BigQuery records

I thought that we were under the impression that rather than losing data it's likely better to update your pipeline to handle these? On Wed, Apr 13, 2016 at 10:59 AM, Luke Cwik (JIRA) wrote: > > [ >