Slack invite request

2017-08-08 Thread Steve Anderson
Hi there, can i please get an invite to the beam slack channel? Thanks! - Steve -- Steven Anderson Software Developer Mobile: 650.455.6530 Email: st...@maestro.io Website: http://www.maestro.io

Question re: Session Windows and Late Data

2017-08-21 Thread Steve Anderson
Has anyone used allowed late data with a session window? Every time I've tried to use it in production it seems like the time stamp gets stuck after 3-5 hours. The pipeline keeps ingesting events but the watermark freezes. Context: user sends a beacon at intervals, when the beacon stops coming f

Re: Metrics with stackdriver

2017-08-25 Thread Steve Anderson
I just added metrics to our dataflow pipeline. They now work with the latest release that came out a few days ago, try upgrading your dependencies, make sure to use the the apache package, not the dataflow package. On Fri, Aug 25, 2017 at 3:07 PM, Eric Fang wrote: > Hi, > > I am running beam on

Re: pause step until another step completes

2017-09-05 Thread Steve Anderson
If you do a groupByKey followed by a fan out right before you're write steps, you'll prevent the write steps from starting until all the data has been grouped. I'd recommend reading up about fusion: https://cloud.google.com/dataflow/service/dataflow-service-desc#preventing-fusion Sent from my

Re: [Proposal] Beam Newsletter

2017-09-22 Thread Steve Anderson
+1 would love this. Our team (maestro.io, we do livestreams for brands like the Grammys and Playstation and use dataflow to collect massive amounts of data) checks the beam blog and the google bigdata blog daily for new features and bug fixes. Would love to see something more regular! Some of us on

Re: [VOTE] [DISCUSSION] Remove support for Java 7

2017-10-17 Thread Steve Anderson
+1 Sent from my iPhone > On Oct 17, 2017, at 09:31, Aleksandr wrote: > > +1 > > 17. okt 2017 7:17 PM kirjutas kuupäeval "Ismaël Mejía" : > We have discussed recently in the developer mailing list about the > idea of removing support for Java 7 on Beam. There are multiple > reasons for this: >