JozoVilcek commented on issue #33965: URL: https://github.com/apache/beam/issues/33965#issuecomment-2669176487
> will my PR https://github.com/apache/beam/pull/34007 fix the issue you have? I closed this since I thought https://github.com/apache/beam/pull/34007#issuecomment-2666854778 could resolve your problem. Reopen this. @liferoad yes, something like that would fix the problem > This class is used by Spark/Flink/Samza/Jet runners. A fix could be move to use registerFileSystemsOnce() in SerializablePipelineOptions. @Abacn That fix works for my specific use case, but the underlying issue remains for anyone using `setDefaultPipelineOptions()`. The root cause is that the method does not update revisions and schemas simultaneously, making it susceptible to race conditions in a multi-threaded environment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
