steveloughran commented on pull request #30141: URL: https://github.com/apache/spark/pull/30141#issuecomment-715380385
Looking at this some more, the other place to set it would be org.apache.spark.internal.io.cloud.PathOutputCommitProtocol , where its set from the jobID there (which is also a UUID, just a different one, generated earlier). It would only be visible to committers created that way, but given that the classic file output formats don't use job ID values in any way, that should not be an issue. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
