je-ik commented on issue #21897: URL: https://github.com/apache/beam/issues/21897#issuecomment-1177221561
Generally this is problem of Java serialization. Beam could (and should) pay more attention to not breaking it, but it nevertheless can happen from time to time. Moreover, the PTransform expansion can change and a lot of other things can go wrong, so - currently - the ability to recreate the pipeline into meaningful state from scratch is vital. I *think* it could be theoretically possible to create a runner and beam-version (into some extent) agnostic snapshot of a pipeline, which could then be used to overcome such restrictions and even port a (running) pipeline between runners. But that would be a large project so even if something like this will come into existence in the future it cannot be expected soon. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
