[ https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414598&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414598 ]
ASF GitHub Bot logged work on BEAM-9476: ---------------------------------------- Author: ASF GitHub Bot Created on: 02/Apr/20 10:58 Start Date: 02/Apr/20 10:58 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476] KinesisIO retry LimitExceededException URL: https://github.com/apache/beam/pull/10973#issuecomment-607770866 @ameihm0912 Thanks, all is fine for me except that Spotless fails. Please, run `gradlew spotlessApply` (or more precise `./gradlew :sdks:java:io:kinesis:spotlessApply`) to fix these violations and `./gradlew :sdks:java:io:kinesis:check` before pushing to make sure that all tests and checks are passed. Once it's fixed, I think it will be ready to merge. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 414598) Time Spent: 2h 10m (was: 2h) > KinesisIO DescribeStream transient errors are not retried > --------------------------------------------------------- > > Key: BEAM-9476 > URL: https://issues.apache.org/jira/browse/BEAM-9476 > Project: Beam > Issue Type: Bug > Components: io-java-kinesis > Reporter: Aaron Meihm > Priority: Major > Time Spent: 2h 10m > Remaining Estimate: 0h > > During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}. > This API call has quota limits that can become problematic when attempting to > configure multiple Kinesis streams in the same AWS account. AWS currently > limits this call by default to 10 times per second for a given account. With > multiple streams, this can be hit and results in a {{RuntimeException}} being > thrown immediately upon the first error. > Ideally the rate limited call can be retried a number of times before giving > up instead of failing immediately. > I have a work in progress PR that resolves this issue at > https://github.com/apache/beam/pull/10973. -- This message was sent by Atlassian Jira (v8.3.4#803005)