gaborgsomogyi edited a comment on issue #24283: [SPARK-27355][SS] Make query execution more sensitive to epoch message late or lost URL: https://github.com/apache/spark/pull/24283#issuecomment-480209443 As Attila pointed out it contains unnecessary changes which maybe distracted me but at the first glance I don't see the main value. > There is no need to wait for such a long time before query fail if there maybe some message LATE/LOST. Not sure if I understand the main reasoning. If one Kafka partition have some problem because that specific server is slower than others after 10 epoch just kill the query? If it's an intermittent problem not sure it's the right thing to do.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
