Yes, this is a bug in SimplerDoFnRunner (or maybe some clarity on whether or not it owns this) not the Spark runner. FWIW the test is definitely correct, and runners-core has had this bug for a while. It is https://issues.apache.org/jira/browse/BEAM-1149 and I'm on it.
On Wed, Dec 14, 2016 at 11:03 AM, Amit Sela <amitsel...@gmail.com> wrote: > Hi all, > > Yesterday a new test was added to ParDoTest suite: > "testSideInputsWithMultipleWindows". > To the best of my understanding, it's meant to test sideInputs for elements > in multiple windows (unexploded). > > The Spark runner uses the DoFnRunner (Simple) to process DoFns, and it will > explode compressed elements only if it's "tagged" as "Observes Window". > > Should it also explode if it has sideInputs ? > > Thanks, > Amit >
