Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21573
I'll send one or more PRs to master for the following things
1. automatically release resource when task ends.
2. fix LIMIT whole-stage-codegen, stop consuming inputs after hitting the
limitation.
3. in whole-stage-codegen, provide a way to release resource of the parant
operator, and apply it in LIMIT
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
