stijndehaes commented on PR #37417: URL: https://github.com/apache/spark/pull/37417#issuecomment-1558629449
Maybe this is not the correct place to ask, but this PR had created some issues for our flow. Maybe our flow was not how things were intended to be used but it goes like this: We submit jobs on kubernetes by baking in the jar in the docker image, we copy the jar in the docker image on the workdir location. The result of this PR is that our jar is removed, because of the `Utils.deleteRecursively(dest)`. Now a quick fix is to copy the jar somewhere else, but if this sounds like unintended behavior to you guys, I am willing to open up a PR to fix it. I am however not sure what the intended behavior would be. Just remove this `Utils.deleteRecursively(dest)` sounds a bit too simple :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
