tijoparacka opened a new pull request #9583: Kinesis ingestion is getting reset because of time out.#9582 URL: https://github.com/apache/druid/pull/9583 Kinesis ingestion is getting reset because of time out. After getting the new shard iterator the timeout is not updated. Because of this ingestion will fail . Fixes Task resting if there is no data coming to shard more that fetchSequenceNumberTimeout value. ### Description This issue will happen when there is no data coming to a shard for more than the timeout set in fetchSequenceNumberTimeout. AWS document mention that the timeout can be up to 5 min. The fix is to reset the timeout value after a new sharditerator is initialized ## Method modified KinesisRecordSupplier#getSequenceNumberInternal method is modified . Kinesis-ingestion.md This PR has: - [ x] been self-reviewed. - [ x] added documentation for new or modified features or behaviors. ##### Key changed/added classes in this PR * `KinesisRecordSupplier`
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
