Hi. Currently, I'm building a real time pipeline to process user interactions, I have to filter interactions based on a black-list. I used a side input to to store the list. The problem is that I'm required to fetch new elements for the black list every day.
I don't want to restart the pipe to re-create the side input. My second option was to move black-list to a Redis and fetch table using the StartBundle annotation, but I think as batches are going to be small, I'm going to be doing thousands off calls to Redis, and it is going to get harder as table size increases. What other options do I have? Thanks.
