Re: Using watermarks with bounded sources

2017-04-24 Thread Lukasz Cwik
BoundedSource is able to report the timestamp[1] for records. It is just that runners know that it is a fixed dataset so they have a trivial optimization where the watermark goes from negative infinity to positive infinity once all the data is read. For bounded splittable DoFns, its likely that

Slack Channel Invite

2017-04-24 Thread Paulo Bittencourt
Hello, Could I please have an invite to the Slack Channel? We're testing out running Beam on Google Dataflow. Would love to be able to share experience and ask for help/insight. Thanks, Paulo

Apache: Big Data North America 2017 conference

2017-04-24 Thread Davor Bonaci
Apache Beam will be prominently featured at the upcoming Apache: Big Data North America 2017 conference in Miami, FL [1]. Scheduled talks: * Using Apache Beam for Batch, Streaming, and Everything in Between Speakers: Frances Perry, and Dan Halperin * Apache Beam: Integrating the Big Data