[ 
https://issues.apache.org/jira/browse/BEAM-4650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684735#comment-16684735
 ] 

Tarush Grover commented on BEAM-4650:
-------------------------------------

[~chamikara] I see the retry filter in retry.py file : 
https://github.com/apache/beam/blob/master/sdks/python/apache_beam/utils/retry.py#L99.

We want to give user an interface so that user can customise the retry policy 
for big query like based on what of errors should be consider for retry etc. Is 
my current understanding correct?

> Add retry policy to Python BQ streaming sink
> --------------------------------------------
>
>                 Key: BEAM-4650
>                 URL: https://issues.apache.org/jira/browse/BEAM-4650
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py-core
>            Reporter: Chamikara Jayalath
>            Assignee: Tarush Grover
>            Priority: Major
>
> Java supports specifying a retry policy when performing streaming writes to 
> BQ: 
> [https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/InsertRetryPolicy.java]
>  
> We should update Python BQ streaming sink to support this as well.
> https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/bigquery.py#L1430



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to