Re: Event-time based in-window trigger

2016-12-08 Thread Manu Zhang
ase do open a JIRA ticket in the > beam-model component. Feel free to assign to me or leave unassigned. > > On Thu, Dec 8, 2016 at 5:30 PM, Manu Zhang <owenzhang1...@gmail.com> > wrote: > > @Kenn and @Tyler, > > Given the use case is defined (hope I've explained it c

Re: Event-time based in-window trigger

2016-12-08 Thread Manu Zhang
@Kenn and @Tyler, Given the use case is defined (hope I've explained it clearly), do we have plans/jiras to add the new functionality ? Thanks, Manu On Fri, Dec 2, 2016 at 12:21 PM Manu Zhang <owenzhang1...@gmail.com> wrote: > @Kenn, > > 1. when the watermark jumps from 0 to

Re: Event-time based in-window trigger

2016-12-01 Thread Manu Zhang
es relatively > smoothly)? What if we're talking differences of event times of > milliseconds? Is one pane per millisecond what you want? > > -Tyler > > On Fri, Dec 2, 2016 at 10:41 AM Kenneth Knowles <k...@google.com> wrote: > > Thanks for laying out some details. > >

Re: Event-time based in-window trigger

2016-12-01 Thread Manu Zhang
lement in the current > pane? You could them presumably wrap this in a repeat to get the overall > desired semantics, right? > > -Tyler > > > On Fri, Dec 2, 2016 at 7:32 AM Manu Zhang <owenzhang1...@gmail.com> wrote: > > My use case is to track user trajectory based on pa

Re: Event-time based in-window trigger

2016-12-01 Thread Manu Zhang
to solve with > some examples showing input and the expected output? > > > > > On Wed, Nov 30, 2016 at 11:08 PM, Manu Zhang <owenzhang1...@gmail.com> > wrote: > > Hi, > > Recently I’m addressing a problem where users want to trigger after > watermark past each e

Re: Why does `Combine.perKey(SerializableFunction)` require same input and output type

2016-10-31 Thread Manu Zhang
s > from, had an explicit init rather than addInput and that turned out to > be a drawback when implementing CombineFns. > > > - With `compact` we allow multiple physical representations of the same > > semantic accumulator, and a hook to switch between them > > - A

Re: Why does `Combine.perKey(SerializableFunction)` require same input and output type

2016-10-31 Thread Manu Zhang
and then discarding the key and extracting the single > output. > PerKeyCombineFn is shorthand for doing accumulation where the key doesn't > modify the accumulation in anyway. > > On Fri, Oct 28, 2016 at 6:09 PM, Manu Zhang <owenzhang1...@gmail.com> > wrote: > >

Re: Why does `Combine.perKey(SerializableFunction)` require same input and output type

2016-10-27 Thread Manu Zhang
that runners provide and for almost > all cases is not a good idea. > > On Wed, Oct 26, 2016 at 6:23 PM, Manu Zhang <owenzhang1...@gmail.com> > wrote: > > > Hi all, > > > > I'm wondering why `Combine.perKey(SerializableFunction)` requires input > > and > > output to be of the same type while `Combine.PerKey` doesn't have this > > restriction. > > > > Thanks, > > Manu > > >

Introduction to Apache Beam at Shanghai Big Data Streaming 3rd Meetup

2016-07-02 Thread Manu Zhang
copied from those by Frances and Tyler. Hope I've shown credits in the right way. People are asking whether Apache Beam has been used in production (with Spark) and whether there is SQL support. Some Chinese Internet companies are investigating in using Beam. Thanks, Manu Zhang

[no subject]

2016-04-21 Thread Manu Zhang