Github user koeninger commented on the issue:
https://github.com/apache/spark/pull/15387
You dont want poll consuming messages, its not just about offset
correctness, the driver shouldnt be spending time or bandwidth doing that.
What is the substantive concern with this solution, beyond the general
ugliness inherent in the consumer? The chance that anyone out there has a
custom consumerstrategy that will be impacted by this, and wont have the
sophistication to deal with it, is pretty much nil.
On Friday, October 7, 2016, Shixiong Zhu <[email protected]> wrote:
> @koeninger <https://github.com/koeninger> If poll(0) returns a non empty
> results, how about just subtract the offsets back using the result size?
> Then we don't need to count on poll(0) not updating the offsets.
>
> â
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/spark/pull/15387#issuecomment-252385606>, or
mute
> the thread
>
<https://github.com/notifications/unsubscribe-auth/AAGAB9ijyrxxmBt08QFVZkXPwukJH0Teks5qxtlngaJpZM4KQlB3>
> .
>
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
