This is an automated email from the ASF dual-hosted git repository.
scwhittle pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 462c8334903 Remove notes now that Dataflow v2 supports BQ autosharding
(#31561)
462c8334903 is described below
commit 462c8334903c82917897cbe4c34d7aa8fe2bd375
Author: Sam Whittle <[email protected]>
AuthorDate: Tue Jun 11 20:14:45 2024 +0200
Remove notes now that Dataflow v2 supports BQ autosharding (#31561)
---
.../www/site/content/en/documentation/io/built-in/google-bigquery.md | 4 ----
1 file changed, 4 deletions(-)
diff --git
a/website/www/site/content/en/documentation/io/built-in/google-bigquery.md
b/website/www/site/content/en/documentation/io/built-in/google-bigquery.md
index 50fd5b8258d..d49e9bac949 100644
--- a/website/www/site/content/en/documentation/io/built-in/google-bigquery.md
+++ b/website/www/site/content/en/documentation/io/built-in/google-bigquery.md
@@ -789,9 +789,6 @@ BigQuery Storage Write API for Python SDK currently has
some limitations on supp
{{< paragraph class="language-py" >}}
**Note:** If you want to run WriteToBigQuery with Storage Write API from the
source code, you need to run `./gradlew
:sdks:java:io:google-cloud-platform:expansion-service:build` to build the
expansion-service jar. If you are running from a released Beam SDK, the jar is
already included.
-
-**Note:** Auto sharding is not currently supported for Python's Storage Write
API exactly-once mode on DataflowRunner.
-
{{< /paragraph >}}
#### Exactly-once semantics
@@ -883,7 +880,6 @@ explicitly enable this using
[`withAutoSharding`](https://beam.apache.org/releas
`STORAGE_WRITE_API` defaults to dynamic sharding when
`numStorageWriteApiStreams` is set to 0 or is unspecified.
-***Note:*** Auto sharding with `STORAGE_WRITE_API` is supported by Dataflow,
but **not** on Runner v2.
{{< /paragraph >}}
When using `STORAGE_WRITE_API`, the `PCollection` returned by