Hi,
Trying something simple here: Global view of all GroupByKey values
. Looking to get a cumulative GroupBy of a field and I like my Window
trigger to fire with all the values seen so far. However what I get is seem
to be new values. Basically almost feels like what I should expect from
discardingFiredPanes. Am I missing something?
PCollection<KV<String,Double>> pubSubMessages = pipeline
.apply("ReadFromPubSub", PubsubIO.readStrings().fromTopic("xxxxxxx"))
.apply("TransformToEvent", ParDo.of(new EmitEvent()))
.apply("GetV1",ParDo.of(new ExtractV1Field()))
.apply("Window",Window.<KV<String,Double>>into(new GlobalWindows())
.triggering(Repeatedly.forever(AfterProcessingTime.pastFirstElementInPane()))
.accumulatingFiredPanes().withAllowedLateness(Duration.standardDays(30)))
.apply("SUM",Sum.doublesPerKey());
Thanks,
Parviz