DanielLeens commented on issue #12457: URL: https://github.com/apache/seatunnel/issues/12457#issuecomment-5951993049
Thanks for raising the staging cost; it is a valid operational concern for a large distribution. The current #12460 contract deliberately accepts a local `yarn.distribution` archive and documents one read-only archive localized by YARN for the ApplicationMaster and workers. Reusing a pre-staged HDFS archive or individual cached JARs is not a small upload optimization: it needs an immutable content/version identity, integrity verification, HDFS permission and Kerberos handling, cache lifecycle/eviction, and explicit connector/classloader upgrade semantics. Please keep that work out of #12460. A separate STIP follow-up can evaluate a versioned shared-artifact option, including how a connector update is rolled out without mixing jars from two SeaTunnel distributions. The current application-mode PR should retain one self-contained archive per submission. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
