[Community] Second User Empathy Workshop tomorrow 2/10 in Mexico City
Hi Folks, Tomorrow February 10th, Pablo Estrada, Thomas Grogh, Hector Paredes and Mariann Nagy will deliver a second Apache Beam user empathy workshop[1], this time in Mexico City. This workshop will be also sponsored by Wizeline Academy & Google. As you might remember, we ran a first edition[2] back on December 2nd in Guadalajara. The purpose of these workshops is to let us study and understand the adoption barriers of Apache Beam. We'll be consolidating findings from both workshops and sharing insights with the mailing list after this session. If you're in Mexico and want to say hi to our team, feel free to stop by. If you're interested in running similar efforts reach out to me and I'll be happy to share resources and connect with you. Happy Friday! G [1] https://academy.wizeline.com/apache-beam/ [2] https://lists.apache.org/list.html?*@beam.apache.org:lte=1y:workshop
Re: IllegalStateException when changing allowed lateness?
Cool, let me know if you need anything else to nail down this issue. On Thu, Feb 8, 2018 at 3:45 PM Kenneth Knowleswrote: > Hi Carlos, > > You are surely correct. Good diagnosis. Filing a bug. > > Kenn > > On Thu, Feb 8, 2018 at 6:23 AM, Carlos Alonso > wrote: > >> Hi everyone!! >> >> I've just seen a new IllegalStateException: received state cleanup timer >> for window... that is before the appropriate cleanup time... >> >> The full stack trace is here: https://pastebin.com/J8Vuq9xz >> >> And I think it could be because I updated a running job with an increased >> allowed lateness. Can anyone please confirm it or point me in the right >> direction? >> >> Thanks! >> > >
Re: CoGroupByKey question
Hi Eugene, that seemed to be the problem! Thanks a lot! Patrick Eugene Kirpichov wrote: You typically get this compile error when you have a raw type (e.g. PCollection instead of PCollection) sneaking somewhere. Perhaps tempPCollection or humPCollection is declared as a PCollection without a type? On Thu, Feb 8, 2018 at 2:53 AM Steiner Patrick> wrote: Hi all, I'm trying to combine two PCollections > via CoGroupByKey When adapting the sample code final TupleTag t1 = new TupleTag<>(); final TupleTag t2 = new TupleTag<>(); PCollection > coGbkResultCollection = KeyedPCollectionTuple.of(t1, pt1) .and(t2, pt2) .apply(CoGroupByKey.create()); I do get final TupleTag tempTuple = new TupleTag<>(); final TupleTag humTuple = new TupleTag<>(); PCollection > coGbkResultCollection = KeyedPCollectionTuple.of(tempTuple, tempPCollection) .and(humTuple, humPCollection) .apply(CoGroupByKey.create()); which results in Type mismatch: cannot convert from POutput to PCollection > I guess it's a simple, stupid thing I'm either missing or not understanding, when combining my two PCollections to one. Any advice is appreciated Patrick