scwhittle commented on issue #34419: URL: https://github.com/apache/beam/issues/34419#issuecomment-3269430694
I think that perhaps we could introduce this before beam3 behind a pipeline option and then change the option default for beam 3. Currently `output` method from a dofn is wired up to the next dofn process element method via PCollectionConsumerRegistry [here](https://github.com/apache/beam/blob/master/sdks/java/harness/src/main/java/org/apache/beam/fn/harness/data/PCollectionConsumerRegistry.java#L198). I think that we could just modify where it currently logs and rethrows [here](https://github.com/apache/beam/blob/master/sdks/java/harness/src/main/java/org/apache/beam/fn/harness/data/PCollectionConsumerRegistry.java#L249) to additionally save the exception, not delegate future outputs and prevent the bundle from finishing successfully. If it has a way to truncate the input so the bundle fails faster that would also be good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
