Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21060
I guess the behaviour changes here is that a custom query execution
listener now can recognise the action `collect` in PySpark which other APIs
have detected. Mind explaining how it breaks external apps? If the callback
should not be called specifically `collect` but not other actions like `show`
in PySpark, I would say it should be to blame yours apps.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
