viirya commented on PR #58978: URL: https://github.com/apache/spark/pull/58978#issuecomment-5925472905
Thanks for another pass, @dongjoon-hyun. Updated in 5d5eb370c24 with fixes for the four CI issues and the remaining inline comments. The concurrency and lifecycle changes are contained in the in-process implementation. Local validation passed: compilation and Hive-enabled packaging, 40 Scala tests, 42 Python runtime tests, and the in-process, ordinary UDF, and Arrow UDF suites. I ran the in-process suite without pyspark.zip, then restored the archive and separately ran the packaged-bootstrap test. Formatting, type checks, and a targeted Sphinx build with numpydoc, autosummary, and -W also passed. The full documentation site and real YARN/Kubernetes deployments were not tested. I have not reproduced the RocksDB SQL metrics failure or established whether it is a pre-existing flake. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
