Re: Single side input to multiple transforms

2022-11-07 Thread Binh Nguyen Van
Hi, No, it is a Java job. This is an example code that causes the duplicate side input tag log entries PCollectionView sideInput = sideCollection.apply(View.asSingleton()); inputCollection .apply(ParDo.of(new MyFn1()).withSideInputs(sideInput)) .apply(ParDo.of(new

Re: Single side input to multiple transforms

2022-11-07 Thread Reuven Lax via user
Is this a Python job? On Mon, Nov 7, 2022 at 12:38 AM Binh Nguyen Van wrote: > Hi, > > I am writing a pipeline where I have one singleton side input that I want > to use in multiple different transforms. When I run the pipeline in Google > Dataflow I see multiple entries in the logs that have a

Single side input to multiple transforms

2022-11-07 Thread Binh Nguyen Van
Hi, I am writing a pipeline where I have one singleton side input that I want to use in multiple different transforms. When I run the pipeline in Google Dataflow I see multiple entries in the logs that have a message like this Deduplicating side input tags, found non-unique side input key