On Fri, Jun 19, 2020 at 9:51 AM Jaya Johnson <[email protected]> wrote:
> I am trying to set up a pipeline that does the following. > For a window of n seconds I want to pack messages received in that window > (messages are strings) to a single string with "\n" as delimiter and push. > I am trying to use the following for this: > apply fixed window to the input pcollections. > to the windowed pcollections - apply Combine.globally and write a custom > function to concat the interable strings to a single string. > > Does this seem like the right approach? Are there built in custom > transformations I could use for this? > > Also if I want to do custom sizing of the packed messages to say a zipped > format or limit by # of bytes can I add this to the window itself or would > I need a custom transformation for this. > > Thank you! > >
