Hi, Just wanted to follow up on an earlier e-mail on Dataflow failing pipeline validation when using a splittable DoFn (both unbounded and bounded). The triggering condition seems to be an upstream DoFn with a side input from FileIO.match -> readMatches.
The same pipeline(s) run fin on the direct runner. I have attached a pipeline that triggers the error. Any help would be greatly appreciated. We use file based side inputs quite a lot (to feed the pipeline with config settings) and we are unable to move forward with implementing our new readers until we figure out how to get around it. Best; Kjetil -- *Kjetil Halvorsen* Chief Architect, Enterprise Integration +47 48 01 13 75 | [email protected] www.cognite.com | LIBERATE YOUR DATA™
TsPointsStreamingFail.java
Description: Binary data
