Re: IllegalStateException when combining 3 streams?

2017-11-04 Thread Ben Chambers
Can you share the program using global windows and make sure the exception is the same? Basically, this kind of problem has to do with whether you have applied a grouping operation already. The triggering (and sometimes windowing) before a grouping operation is different than after. So, if you are

Re: IllegalStateException when combining 3 streams?

2017-11-04 Thread Artur Mrozowski
And the error message: Exception in thread "main" java.lang.IllegalStateException: Inputs to Flatten had incompatible triggers: Repeatedly.forever(AfterProcessingTime.pastFirstElementInPane().plusDelayOf(10 seconds)), AfterProcessingTime.pastFirstElementInPane().plusDelayOf(10 seconds) at

Re: IllegalStateException when combining 3 streams?

2017-11-04 Thread Artur Mrozowski
Sure, here is the url to my repo https://github.com/afuyo/beamStuff/blob/master/src/main/java/com/tryg/beam/kafka/poc/impl/CustomerStreamPipelineGlobal.java It is fairly simple and I do no grouping before. Just read from Kafka and then join. I followed your advice and the 3 way join works for

Re: IllegalStateException when combining 3 streams?

2017-11-04 Thread Artur Mrozowski
Yes, indeed. It works just fine with equally define triggers in global window. Sorry about that and thank you so much. I can now leav the valley of despair and continue on my learning path;) Best Regards /Artur On Sat, Nov 4, 2017 at 10:40 PM, Aleksandr wrote: >

Re: Beam Slack Channel Invitation Request

2017-11-04 Thread Mingmin Xu
sent, welcome! On Sat, Nov 4, 2017 at 4:42 PM, Tristan Shephard wrote: > Hello, > > Can someone please add me to the Beam slack channel? > > Thanks in advance, > Tristan > -- Mingmin

Re: Request to add to Beam Slack Channel

2017-11-04 Thread Mingmin Xu
sent, welcome to Beam. On Sat, Nov 4, 2017 at 7:44 PM, Ananth G wrote: > Hello, > > Could someone please add me to the Beam slack channel? > > Regards, > Ananth > -- Mingmin

Re: IllegalStateException when combining 3 streams?

2017-11-04 Thread Artur Mrozowski
Hej Ben, thank you for your answer. I think I forgot to mention that the join class already implements CoGroupByKey and comes from sdk extensions. I haven now modified it slightly to do 3 way join(see below). It works for 3 PCollections with fixed windows and provides the output this time, even

Re: PipelineTest with TestStreams: unable to serialize

2017-11-04 Thread Matthias Baetens
Hi Aleksandr, Awesome. That did the trick. Did bump in to this relevant SO answer , but overlooked those TupleTags, good spot! @Eugene: thanks a lot for the tip. Will give it a try soon ;) Cheers, Matthias On Fri, Nov 3, 2017 at 9:00 PM, Eugene

Beam Slack Channel Invitation Request

2017-11-04 Thread Tristan Shephard
Hello, Can someone please add me to the Beam slack channel? Thanks in advance, Tristan