[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=415405=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-415405
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 03/Apr/20 09:32
Start Date: 03/Apr/20 09:32
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on pull request #10973:
[BEAM-9476] KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 415405)
Time Spent: 5h (was: 4h 50m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 5h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=415378=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-415378
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 03/Apr/20 08:21
Start Date: 03/Apr/20 08:21
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-608299068
Run Java PreCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 415378)
Time Spent: 4h 50m (was: 4h 40m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 4h 50m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=415024=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-415024
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 21:02
Start Date: 02/Apr/20 21:02
Worklog Time Spent: 10m
Work Description: ameihm0912 commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-608079645
Looks like we still had a failure; if you'd like me to rebase this off
current master let me know, I'm not sure if maybe that might help?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 415024)
Time Spent: 4h 40m (was: 4.5h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 4h 40m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414795=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414795
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 16:13
Start Date: 02/Apr/20 16:13
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607943115
@ameihm0912 I think it's not related to your changes, so I just rerun this
tests
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414795)
Time Spent: 4.5h (was: 4h 20m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 4.5h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414794=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414794
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 16:12
Start Date: 02/Apr/20 16:12
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607942589
Run JavaPortabilityApi PreCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414794)
Time Spent: 4h 20m (was: 4h 10m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 4h 20m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414793=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414793
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 16:12
Start Date: 02/Apr/20 16:12
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607942435
Run Java PreCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414793)
Time Spent: 4h 10m (was: 4h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 4h 10m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414791=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414791
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 16:11
Start Date: 02/Apr/20 16:11
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607942113
Run Java PreCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414791)
Time Spent: 3h 50m (was: 3h 40m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414792=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414792
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 16:11
Start Date: 02/Apr/20 16:11
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607942241
Run JavaPortabilityApi PreCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414792)
Time Spent: 4h (was: 3h 50m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 4h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414789=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414789
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 16:08
Start Date: 02/Apr/20 16:08
Worklog Time Spent: 10m
Work Description: ameihm0912 commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607940181
@aromanenko-dev I'm not too sure why the tests are indicated as still
failing here, they seemed to pass for me locally. I had a look at the Jenkins
output as well and don't see anything obvious in there.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414789)
Time Spent: 3h 40m (was: 3.5h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 3h 40m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414739=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414739
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 14:45
Start Date: 02/Apr/20 14:45
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607750780
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414739)
Time Spent: 3h 10m (was: 3h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414740=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414740
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 14:45
Start Date: 02/Apr/20 14:45
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607889774
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414740)
Time Spent: 3h 20m (was: 3h 10m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414738=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414738
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 14:45
Start Date: 02/Apr/20 14:45
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607889567
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414738)
Time Spent: 3h (was: 2h 50m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 3h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414742=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414742
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 14:45
Start Date: 02/Apr/20 14:45
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607889947
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414742)
Time Spent: 3.5h (was: 3h 20m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 3.5h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414737=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414737
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 14:44
Start Date: 02/Apr/20 14:44
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607889947
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414737)
Time Spent: 2h 50m (was: 2h 40m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414735=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414735
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 14:44
Start Date: 02/Apr/20 14:44
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607889567
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414735)
Time Spent: 2.5h (was: 2h 20m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414736=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414736
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 14:44
Start Date: 02/Apr/20 14:44
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607889774
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414736)
Time Spent: 2h 40m (was: 2.5h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414732=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414732
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 14:40
Start Date: 02/Apr/20 14:40
Worklog Time Spent: 10m
Work Description: ameihm0912 commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607887680
@aromanenko-dev this should be fixed up now
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414732)
Time Spent: 2h 20m (was: 2h 10m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414598=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414598
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 10:58
Start Date: 02/Apr/20 10:58
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607770866
@ameihm0912 Thanks, all is fine for me except that Spotless fails. Please,
run `gradlew spotlessApply` (or more precise `./gradlew
:sdks:java:io:kinesis:spotlessApply`) to fix these violations and `./gradlew
:sdks:java:io:kinesis:check` before pushing to make sure that all tests and
checks are passed.
Once it's fixed, I think it will be ready to merge.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414598)
Time Spent: 2h 10m (was: 2h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414597=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414597
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 10:49
Start Date: 02/Apr/20 10:49
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607770866
@ameihm0912 Thanks, all is fine for me except that Spotless fails. Please,
run `gradlew spotlessApply` (or more precise `./gradlew
:sdks:java:io:kinesis:spotlessApply`) to fix these violations and `./gradlew
:sdks:java:io:kinesis:check` before pushing to make sure that all tests passed.
Once it will be fixed, I think we can merge it.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414597)
Time Spent: 2h (was: 1h 50m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 2h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414579=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414579
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 10:08
Start Date: 02/Apr/20 10:08
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607750780
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414579)
Time Spent: 1h 40m (was: 1.5h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414580=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414580
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 10:08
Start Date: 02/Apr/20 10:08
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607749600
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414580)
Time Spent: 1h 50m (was: 1h 40m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414578=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414578
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 02/Apr/20 10:06
Start Date: 02/Apr/20 10:06
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607749600
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414578)
Time Spent: 1.5h (was: 1h 20m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414304=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414304
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 01/Apr/20 21:46
Start Date: 01/Apr/20 21:46
Worklog Time Spent: 10m
Work Description: ameihm0912 commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607505936
@aromanenko-dev I have added a couple test cases to verify both the retry
behavior and the retry limit behavior to `KinesisMockReadTest`. When you have a
moment please let me know if that is OK.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414304)
Time Spent: 1h 20m (was: 1h 10m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=414054=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-414054
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 01/Apr/20 14:04
Start Date: 01/Apr/20 14:04
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-607269841
@ameihm0912 Not a problem, thank you for keep working on this!
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 414054)
Time Spent: 1h 10m (was: 1h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=413319=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-413319
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 31/Mar/20 16:22
Start Date: 31/Mar/20 16:22
Worklog Time Spent: 10m
Work Description: ameihm0912 commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-606731910
> @ameihm0912 kindly pinging to prevent this PR get staled
@aromanenko-dev apologies for the delay here, I'll try to get that test
added this week.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 413319)
Time Spent: 1h (was: 50m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 1h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=413091=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-413091
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 31/Mar/20 11:22
Start Date: 31/Mar/20 11:22
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-606566517
@ameihm0912 kindly pinging to prevent this PR get staled
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 413091)
Time Spent: 50m (was: 40m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=400778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-400778
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 10/Mar/20 15:40
Start Date: 10/Mar/20 15:40
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-597155440
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 400778)
Time Spent: 40m (was: 0.5h)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 40m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=400777=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-400777
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 10/Mar/20 15:40
Start Date: 10/Mar/20 15:40
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-597155751
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 400777)
Time Spent: 0.5h (was: 20m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=400776=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-400776
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 10/Mar/20 15:39
Start Date: 10/Mar/20 15:39
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-597155440
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 400776)
Time Spent: 20m (was: 10m)
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9476) KinesisIO DescribeStream transient errors are not retried
[
https://issues.apache.org/jira/browse/BEAM-9476?focusedWorklogId=400402=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-400402
]
ASF GitHub Bot logged work on BEAM-9476:
Author: ASF GitHub Bot
Created on: 09/Mar/20 22:19
Start Date: 09/Mar/20 22:19
Worklog Time Spent: 10m
Work Description: ameihm0912 commented on issue #10973: [BEAM-9476]
KinesisIO retry LimitExceededException
URL: https://github.com/apache/beam/pull/10973#issuecomment-596806642
@aromanenko-dev updated to use `FluentBackoff` and references to Jira issue
added
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 400402)
Remaining Estimate: 0h
Time Spent: 10m
> KinesisIO DescribeStream transient errors are not retried
> -
>
> Key: BEAM-9476
> URL: https://issues.apache.org/jira/browse/BEAM-9476
> Project: Beam
> Issue Type: Bug
> Components: io-java-kinesis
>Reporter: Aaron Meihm
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> During Kinesis stream setup {{DescribeStream}} is used in {{listShards}}.
> This API call has quota limits that can become problematic when attempting to
> configure multiple Kinesis streams in the same AWS account. AWS currently
> limits this call by default to 10 times per second for a given account. With
> multiple streams, this can be hit and results in a {{RuntimeException}} being
> thrown immediately upon the first error.
> Ideally the rate limited call can be retried a number of times before giving
> up instead of failing immediately.
> I have a work in progress PR that resolves this issue at
> https://github.com/apache/beam/pull/10973.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
