This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new c357c2b8037 Publishing website 2023/09/19 00:29:00 at commit d79f537
c357c2b8037 is described below
commit c357c2b80370f8cd5fc0532c81cdf327a394d81f
Author: runner <runner@main-runner-fjfc7-wlncr>
AuthorDate: Tue Sep 19 00:29:01 2023 +0000
Publishing website 2023/09/19 00:29:00 at commit d79f537
---
.../documentation/io/built-in/google-bigquery/index.html | 4 ++--
.../documentation/sdks/python-dependencies/index.html | 2 +-
website/generated-content/sitemap.xml | 2 +-
3 files changed, 4 insertions(+), 4 deletions(-)
diff --git
a/website/generated-content/documentation/io/built-in/google-bigquery/index.html
b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
index 522b2569c3f..370a13c4a27 100644
---
a/website/generated-content/documentation/io/built-in/google-bigquery/index.html
+++
b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
@@ -641,7 +641,7 @@ be replaced.</p><div class='language-java snippet'><div
class="notebook-skip cod
You can either keep retrying, or return the failed records in a separate
<code>PCollection</code> using the <code>WriteResult.getFailedInserts()</code>
method.</p><h3 id=storage-write-api>Using the Storage Write API</h3><p>Starting
with version 2.36.0 of the Beam SDK for Java, you can use the
<a href=https://cloud.google.com/bigquery/docs/write-api>BigQuery Storage
Write API</a>
-from the BigQueryIO connector.</p><p>Also after version 2.47.0 of Beam SDK for
Python, SDK supports BigQuery Storage Write API.</p><p
class=language-py>BigQuery Storage Write API for Python SDK currently has some
limitations on supported data types. As this method makes use of cross-language
transforms, we are limited to the types supported at the cross-language
boundary. For example, <code>apache_beam.utils.timestamp.Timestamp</code> is
needed to write a <code>TIMESTAMP</code> BigQuery [...]
+from the BigQueryIO connector.</p><p>Also after version 2.47.0 of Beam SDK for
Python, SDK supports BigQuery Storage Write API.</p><p
class=language-py>BigQuery Storage Write API for Python SDK currently has some
limitations on supported data types. As this method makes use of cross-language
transforms, we are limited to the types supported at the cross-language
boundary. For example, <code>apache_beam.utils.timestamp.Timestamp</code> is
needed to write a <code>TIMESTAMP</code> BigQuery [...]
<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.Write.Method.html#STORAGE_WRITE_API><code>Method.STORAGE_WRITE_API</code></a>.
Here’s an example transform that writes to BigQuery using the Storage Write
API and exactly-once semantics:</p><p><div class='language-java snippet'><div
class="notebook-skip code-snippet"><a class=copy type=button
data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img
src=/images/copy-icon.svg></a><div class=highlight><pre tabindex=0
class=chroma><code class=language-java data-lang=java><span class=line><span
class=cl><span class=n>WriteResult</span> <span class= [...]
</span></span><span class=line><span class=cl><span
class=n>BigQueryIO</span><span class=o>.</span><span
class=na>writeTableRows</span><span class=o>()</span>
@@ -701,7 +701,7 @@ use case. Triggering frequency in single-digit seconds is a
good choice for most
pipelines.</p><span class=language-java><p>Similar to streaming inserts,
<code>STORAGE_WRITE_API</code> supports dynamically determining
the number of parallel streams to write to BigQuery (starting 2.42.0). You can
explicitly enable this using <a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.Write.html#withAutoSharding--><code>withAutoSharding</code></a>.</p><p><em><strong>Note:</strong></em>
<code>STORAGE_WRITE_API</code> will default to dynamic sharding when
-<code>numStorageWriteApiStreams</code> is set to 0 or is
unspecified.</p></span><p>When using <code>STORAGE_WRITE_API</code>, the
PCollection returned by
+<code>numStorageWriteApiStreams</code> is set to 0 or is
unspecified.</p><p><em><strong>Note:</strong></em> Auto sharding with
<code>STORAGE_WRITE_API</code> is supported on Dataflow’s legacy runner,
but <strong>not</strong> on Runner V2</p></span><p>When using
<code>STORAGE_WRITE_API</code>, the PCollection returned by
<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/gcp/bigquery/WriteResult.html#getFailedInserts--><code>WriteResult.getFailedInserts</code></a>
will not contain the failed rows. If there are data validation errors, the
transform will throw a <code>RuntimeException</code>.</p><h4
id=at-least-once-semantics>At-least-once semantics</h4><p>If your use case
allows for potential duplicate records in the target table, you
diff --git
a/website/generated-content/documentation/sdks/python-dependencies/index.html
b/website/generated-content/documentation/sdks/python-dependencies/index.html
index 21499d7f80e..aa3130d5bf5 100644
---
a/website/generated-content/documentation/sdks/python-dependencies/index.html
+++
b/website/generated-content/documentation/sdks/python-dependencies/index.html
@@ -41,7 +41,7 @@ import additional dependencies. Version collisions can result
in unexpected
behavior in the service. If you are using any of these packages in your code,
be
aware that some libraries are not forward-compatible and you may need to pin to
the listed versions that will be in scope during execution.</p><p>Dependencies
for your Beam SDK version are listed in <code>setup.py</code> in the Beam
repository. To view them, perform the following steps:</p><ol><li><p>Open
<code>setup.py</code>.</p><pre
tabindex=0><code>https://raw.githubusercontent.com/apache/beam/v<VERSION_NUMBER>/sdks/python/setup.py
-</code></pre><p class=paragraph-wrap>Replace `<VERSION_NUMBER>` with the
major.minor.patch version of the SDK. For example, <a
href=ttps://raw.githubusercontent.com/apache/beam/v2.50.0/sdks/python/setup.py
target=_blank rel="noopener
noreferrer">https://raw.githubusercontent.com/apache/beam/v2.50.0/sdks/python/setup.py</a>
will provide the dependencies for the 2.50.0 release.</p></li><li><p>Review
the core dependency list under
<code>REQUIRED_PACKAGES</code>.</p><p><strong>Note:</stro [...]
+</code></pre><p class=paragraph-wrap>Replace `<VERSION_NUMBER>` with the
major.minor.patch version of the SDK. For example, <a
href=https://raw.githubusercontent.com/apache/beam/v2.50.0/sdks/python/setup.py
target=_blank rel="noopener
noreferrer">https://raw.githubusercontent.com/apache/beam/v2.50.0/sdks/python/setup.py</a>
will provide the dependencies for the 2.50.0 release.</p></li><li><p>Review
the core dependency list under
<code>REQUIRED_PACKAGES</code>.</p><p><strong>Note:</str [...]
</code></pre></li><li><p><a
href=/get-started/quickstart-py/#download-and-install>Install the Beam Python
SDK</a>.</p></li><li><p>Retrieve the list of dependencies.</p><pre
tabindex=0><code>$ pip install pipdeptree && pipdeptree -p apache-beam
</code></pre></li></ol></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div class="footer__cols__col
footer__cols__col__logos"><div class=footer__cols__col__logo><img
src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div
class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg
class=footer__logo alt="Apache logo"></div></div><div class=footer-wrapper><div
class=wrapper-grid><div class=footer__cols__col><div class [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index c5ef63eb8fa..b25efde66bc 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.50.0/</loc><lastmod>2023-09-18T10:14:14-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-09-18T10:14:14-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-09-18T10:14:14-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-09-18T10:14:14-07:00</lastmod></url><url><loc>/catego
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.50.0/</loc><lastmod>2023-09-18T19:43:00-04:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-09-18T19:43:00-04:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-09-18T19:43:00-04:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-09-18T19:43:00-04:00</lastmod></url><url><loc>/catego
[...]
\ No newline at end of file
