[beam] branch master updated: Making the default BigQuery write disposition to be WRITE_APPEND (#25434)

[pabloem]

This is an automated email from the ASF dual-hosted git repository.

pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
     new 3a6259900e6 Making the default BigQuery write disposition to be 
WRITE_APPEND (#25434)
3a6259900e6 is described below

commit 3a6259900e6497eecec4b49d91aa5cd90c802a01
Author: nickuncaged1201 <56149585+nickuncaged1...@users.noreply.github.com>
AuthorDate: Tue Feb 21 14:35:06 2023 -0800

    Making the default BigQuery write disposition to be WRITE_APPEND (#25434)
    
    * Added element counter and error counter for BQ write schema transform
    
    * Fixied styling issues with naming
    
    * Combined two trivial counter class for brevity. Used finishbundle 
annotation to reduce the number of calls to counter.inc() for better 
performance.
    
    * fix formatting
    
    * change the default write disposition to write append instead of write 
empty
    
    ---------
    
    Co-authored-by: Nick Li <nick...@google.com>
---
 .../providers/BigQueryStorageWriteApiSchemaTransformProvider.java      | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
index 22e8abca35b..3391c7ae51b 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
@@ -316,7 +316,8 @@ public class BigQueryStorageWriteApiSchemaTransformProvider
               .to(configuration.getTable())
               .withMethod(writeMethod)
               .useBeamSchema()
-              .withFormatFunction(BigQueryUtils.toTableRow());
+              .withFormatFunction(BigQueryUtils.toTableRow())
+              .withWriteDisposition(WriteDisposition.WRITE_APPEND);
 
       if (!Strings.isNullOrEmpty(configuration.getCreateDisposition())) {
         CreateDisposition createDisposition =