Re: delayed emit (timer) in py-beam?

2018-08-30 Thread Charles Chen
FYI: the reference DirectRunner implementation of the Python user state and timers API is out for review: https://github.com/apache/beam/pull/6304 On Mon, Jul 30, 2018 at 3:57 PM Austin Bennett wrote: > Fantastic; thanks, Charles! > > > > On Mon, Jul 30, 2018 at 3:49 PM, Charles Chen wrote: >

Re: delayed emit (timer) in py-beam?

2018-07-30 Thread Austin Bennett
Fantastic; thanks, Charles! On Mon, Jul 30, 2018 at 3:49 PM, Charles Chen wrote: > Hey Austin, > > This API is not yet implemented in the Python SDK. I am working on this > feature: the next step from my end is to finish a reference implementation > in the local DirectRunner. As you note,

Re: delayed emit (timer) in py-beam?

2018-07-30 Thread Charles Chen
Hey Austin, This API is not yet implemented in the Python SDK. I am working on this feature: the next step from my end is to finish a reference implementation in the local DirectRunner. As you note, the doc at https://s.apache.org/beam-python-user-state-and-timers describes the design. You

delayed emit (timer) in py-beam?

2018-07-30 Thread Austin Bennett
What's going on with timers and python? Am looking at building a pipeline (assuming another group in my company will grant access to the Kafka topic): Kafka -> beam -> have beam wait 24 hours -> do transform(s) and emit a record. If I read things correctly that's not currently possible in