Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/11012#issuecomment-178918227
@budde thanks for providing so much detail in the JIRA and fixing this
issue. I believe the latest changes are correct and seem more performant than
what you had earlier. It seems that this issue only happens if we have multiple
threads running the same task. In your case, this is the receiver task, though
in any case we shouldn't be getting -1 for `currentTaskAttemptId` unless we're
running the receiver on the driver (i.e. in local mode).
Have you had a chance to run your test against the latest changes to prove
that it fixes the leak? If so, I will go ahead and merge this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
