viirya commented on PR #58978: URL: https://github.com/apache/spark/pull/58978#issuecomment-5827624614
Thanks for the detailed review. Addressed these comments in 39dcd5316e1. The changes cover Arrow schema compatibility, interpreter initialization and lifecycle errors, Connect rejection, traceback settings, timing metrics, and the Python wrapper API. I also fixed the benchmark setup and deployment examples, documented the executor-wide impact of hung calls, and removed the unused bridge module. Validation: Spark compilation and packaging succeeded; 53 Scala tests and 315 Python tests passed, along with Scalastyle, mypy, and Ruff. Six benchmark smoke cases passed across in-process, worker Arrow, and pandas UDFs. These were functional checks, not performance measurements. The YARN and Kubernetes examples have not been tested on a cluster. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
