[
https://issues.apache.org/jira/browse/FLINK-35232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17840942#comment-17840942
]
Galen Warren commented on FLINK-35232:
--------------------------------------
Yes, that's using the RecoverableWriter.
The default retry settings are here: [Retry strategy | Cloud Storage |
Google Cloud|https://cloud.google.com/storage/docs/retry-strategy#java], so it
should be retrying 6 times for up to 50 seconds I believe, as is. Which
settings would you be looking to implement? And you're sure nothing else is
going on that's causing the failures (network connectivity, etc.)?
Full disclosure, I worked on RecoverableWriter but I'm not a committer, so I
can't really ok anything on my own. But being able to adjust these settings
seems reasonable to me.
> Support for retry settings on GCS connector
> -------------------------------------------
>
> Key: FLINK-35232
> URL: https://issues.apache.org/jira/browse/FLINK-35232
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / FileSystem
> Affects Versions: 1.15.3, 1.16.2, 1.17.1, 1.19.0, 1.18.1
> Reporter: Vikas M
> Assignee: Ravi Singh
> Priority: Major
>
> https://issues.apache.org/jira/browse/FLINK-32877 is tracking ability to
> specify transport options in GCS connector. While setting the params enabled
> here reduced read timeouts, we still see 503 errors leading to Flink job
> restarts.
> Thus, in this ticket, we want to specify additional retry settings as noted
> in
> [https://cloud.google.com/storage/docs/retry-strategy#customize-retries.|https://cloud.google.com/storage/docs/retry-strategy#customize-retries]
> We want
> [these|https://cloud.google.com/java/docs/reference/gax/latest/com.google.api.gax.retrying.RetrySettings#methods]
> methods available for Flink users so that they can customize their
> deployment.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
