Github user uncleGen commented on the pull request:
https://github.com/apache/spark/pull/4135#issuecomment-78468550
@JoshRosen, thanks for your patience. It occurred to me that we may check
when to terminate the `receiver` in `ReceiverSupervisor`. Then the condition to
stop the `receiver` is satisfied when `TaskContext.isInterrupted()` or
`isReceiverStopped`. So I removed the `stopLatch` lock and just
`checkTermination()` once per 500ms. Well, a little ugly and any idea?
Now, we may just mark the task for interruption and trigger callback
processing inside of markTaskCompleted.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
