srielau commented on PR #58549: URL: https://github.com/apache/spark/pull/58549#issuecomment-5825015810
Addressed the latest review in 732caa3f788. - Added authoritative JVM rejection for CHAR/VARCHAR hidden in Python UDF UDT storage. - Kept `DataFrame.__arrow_c_stream__` outside the support fence with recursive deterministic rejection. - Restored pre-PR `toPandas()` dtype correction behavior. - Updated the PR description to state the default flag-off behavior change accurately and refreshed the testing/scope sections. - Classified iterator UDF rebatching as a valid pre-existing issue outside SPARK-59275: the exact batch-size assertion and iterator eligibility both predate this PR and are unrelated to CHAR/VARCHAR. Verification: the focused `ExtractPythonUDFsSuite` JVM-boundary regression passed; Python syntax and whitespace checks pass. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
