Hi!
I have a side input with streaming updates in a global window. I have tried
to approach this several ways but can’t figure out how to do it. What I
really need is a side-input Map that should be updated when streaming input
change (i.e keys are updated).
I have tried to implement this with a V
Hi Vilhelm,
This is a known issue in the Beam model. Trigger firings should
automatically update downstream results, but instead they are treated as
new elements. The design for retractions will alleviate this problem. But
you can work around it yourself in specific cases like this.
You can use V
Ok thanks! Ill give it a shot.
Btw. Maybe that part of the docs should be removed until retractions are in
place then? It made me really sure it should work for multiple firings.
Again, thanks for the help!
// Vilhelm
On Mon, 16 Apr 2018, 19:10 Kenneth Knowles, wrote:
> Hi Vilhelm,
>
> This i
Hi Folks,
are there any systems that can help manage Beam pipelines? I'm looking for
something that can tell me what pipelines are running, stop/restart a
pipeline, modify a pipeline (e.g. to derive additional results from the
same inputs).
If nothing of the sort exists for Beam, how about for s
There's actually been a rename since that notion of CombiningState. It used
to be BagState (just blind writes) and CombiningValueState (uses a
CombineFn) were both instances of CombiningState (any automatically
mergeable thing).
Now the names are BagState (blind writes) and CombiningState (uses a
If you are mutating accumulators, perhaps you might blind write the inputs
and have the system manage the combining. I'd have to see the body of
@ProcessElement to say more.
Kenn
On Mon, Apr 16, 2018 at 3:33 PM Kenneth Knowles wrote:
> There's actually been a rename since that notion of Combini
