[
https://issues.apache.org/jira/browse/BEAM-12482?focusedWorklogId=723453&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-723453
]
ASF GitHub Bot logged work on BEAM-12482:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Feb/22 05:43
Start Date: 09/Feb/22 05:43
Worklog Time Spent: 10m
Work Description: aaltay commented on pull request #16303:
URL: https://github.com/apache/beam/pull/16303#issuecomment-1033373165
> > @MiguelAnzoWizeline - could you please respond to open comments?
>
> Hi @aaltay! @MiguelAnzoWizeline is no longer in our team. We in the team
will be taking care of this and reply to the comments posted before. Thanks!
Ack. Thank you. Good luck @MiguelAnzoWizeline and thank you for everything :)
And we are all Beam contributors, you are all always welcome here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 723453)
Time Spent: 3h 40m (was: 3.5h)
> BigQueryIO failed to load data to temp table when withSchemaUpdateOptions is
> set.
> ---------------------------------------------------------------------------------
>
> Key: BEAM-12482
> URL: https://issues.apache.org/jira/browse/BEAM-12482
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Reporter: Siyuan Chen
> Assignee: Miguel Anzo
> Priority: P2
> Time Spent: 3h 40m
> Remaining Estimate: 0h
>
> `withSchemaUpdateOptions` is only supported with WRITE_APPEND or
> WRITE_TRUNCATE with paritioned table. This is noted in the documentation:
> [https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L1965]
> When the temp files are spilt to multiple load jobs, the write disposition is
> set to WRITE_TRUNCATE for the temporary tables in favor of retries.
> [https://github.com/apache/beam/blob/a8a8b3ab1292ff408940ba4430c95bc754341589/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L219]
> And the loading would fail with error
> "Schema update options should only be specified with WRITE_APPEND
> disposition, or with WRITE_TRUNCATE disposition on a table partition."
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
