If the map/set can fit in memory then you can use a value state containing a Java Map/Set.
On Thu, Feb 13, 2020 at 5:05 AM Ziyad Muhammed <[email protected]> wrote: > Hi All > > I'm developing a beam pipeline to be run on dataflow. > > I see that MapState and SetState are both not supported by Dataflow runner > yet. For my use case, I need to have a state per UserID that can hold > multiple events, which I would like to organize by an eventID or a > timestamp or a combination of both. > > What is the best way to achieve this per user state holding multiple > events that I can lookup by a second ID? Is there a better way than using a > BagState and iterating each time? > > > Best > Ziyad >
