[
https://issues.apache.org/jira/browse/BEAM-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482616#comment-17482616
] Chamikara Madhusanka Jayalath commented on BEAM-13747: ------------------------------------------------------ Example integration tests to follow, For batch, you can add a test to following test suites. https://ci-beam.apache.org/view/PostCommit/job/beam_PostCommit_Java_DataflowV1/1196/testReport/org.apache.beam.sdk.io.gcp.bigquery/ https://ci-beam.apache.org/view/PostCommit/job/beam_PostCommit_Java_DataflowV2/1197/testReport/org.apache.beam.sdk.io.gcp.bigquery/ For streaming, you can try to add it to following, https://ci-beam.apache.org/view/PostCommit/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Streaming/1816/testReport/ https://ci-beam.apache.org/view/PostCommit/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/lastCompletedBuild/testReport/ Here's an example test pipeline implementation: https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryToTableIT.java There's more information in adding Beam integration tests here: https://cwiki.apache.org/confluence/display/BEAM/Contribution+Testing+Guide > Add integration testing for BQ STORAGE_WRITE_API write mode > ------------------------------------------------------------ > > Key: BEAM-13747 > URL: https://issues.apache.org/jira/browse/BEAM-13747 > Project: Beam > Issue Type: Test > Components: io-java-gcp > Reporter: Chamikara Madhusanka Jayalath > Priority: P2 > > We added STORAGE_WRITE_API and STORAGE_API_AT_LEAST_ONCE BQ sink write modes > recently [1] but seems like this is not covered by integration testing today. > This could result in significant breakages that creep into Beam releases (for > example, https://github.com/apache/beam/pull/16599). > These write modes should be regularly integration tested using Jenkins for > batch/streaming. > > [1] > https://github.com/apache/beam/blob/41d585f82b10195f758d14e3a54076ea1f05aa75/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L1761 -- This message was sent by Atlassian Jira (v8.20.1#820001)
