nchammas opened a new pull request, #57871: URL: https://github.com/apache/spark/pull/57871
### What changes were proposed in this pull request? Factor out repeated paths into a single list of install paths that is used throughout the PySpark Classic install script. Make the uninstall a bit more tolerant to partial installs by having it keep going if files are missing. I also changed the check to look at the actual filesystem object -- is it a symlink or not? -- rather than repeat the general check on OS capabilities. I preserved the order in which the paths are installed and uninstalled. ### Why are the changes needed? General code hygiene. We shouldn't have to manually touch multiple blocks of code that are supposed to always be in sync. If a file is missing during uninstall, I think it's a marginal improvement to have the uninstall just move on to the next one. Checking the file's type directly during cleanup is also more robust than checking a general capability. Maybe Spark was installed on Windows by an admin (with symlinks enabled), but is now being uninstalled by an unprivileged user (where the symlink capability check would fail)? ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? ```sh dev/make-distribution.sh --pip dev/run-pip-tests ``` ### Was this patch authored or co-authored using generative AI tooling? I wrote this with assistance from GitHub Copilot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
