This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 0d34c349806 Publishing website 2023/12/01 23:39:46 at commit 85d4fcf
0d34c349806 is described below
commit 0d34c34980699ac6f70dc23d373dce7f940132ae
Author: runner <runner@main-runner-zt478-qdp4m>
AuthorDate: Fri Dec 1 23:39:46 2023 +0000
Publishing website 2023/12/01 23:39:46 at commit 85d4fcf
---
website/generated-content/documentation/index.xml | 18 +++++++++---------
.../documentation/programming-guide/index.html | 6 +++---
website/generated-content/sitemap.xml | 2 +-
3 files changed, 13 insertions(+), 13 deletions(-)
diff --git a/website/generated-content/documentation/index.xml
b/website/generated-content/documentation/index.xml
index f98f299f477..e0bda081d60 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -15696,15 +15696,15 @@ service named <em>Transform service</em>.</p>
<p>The Transform service has several primary use cases.</p>
<h3 id="transform-service-usage-upgrade">15.1 Using the transform service
to upgrade transforms</h3>
<p>Transform service can be used to upgrade (or downgrade) the Beam SDK
versions of supported individual transforms used by Beam pipelines without
changing the Beam version of the pipelines.
-This feature is currently only available for Beam Java SDK 2.53.0 and later.
Currently following transforms are available for upgrading.</p>
+This feature is currently only available for Beam Java SDK 2.53.0 and later.
Currently, the following transforms are available for upgrading:</p>
<ul>
<li>BigQuery read transform (URN:
<em>beam:transform:org.apache.beam:bigquery_read:v1</em>)</li>
<li>BigQuery write transform (URN:
<em>beam:transform:org.apache.beam:bigquery_write:v1</em>)</li>
<li>Kafka read transform (URN:
<em>beam:transform:org.apache.beam:kafka_read_with_metadata:v2</em>)</li>
<li>Kafka write transform (URN:
<em>beam:transform:org.apache.beam:kafka_write:v2</em>)</li>
</ul>
-<p>To use this feature, you can simply execute a Java pipeline with
additional pipeline options that specifies the URNs of the transforms you would
like to upgrade and the Beam version you would like to upgrade the transforms
to. Alll transforms in the pipeline with matching URNs will be upgraded.</p>
-<p>For example, to upgrade the BigQuery read transform for a piepline run
using Beam <code>2.53.0</code> to a future Beam version
<code>2.xy.z</code>, you can specify following additional pipelines
options.</p>
+<p>To use this feature, you can simply execute a Java pipeline with
additional pipeline options that specify the URNs of the transforms you would
like to upgrade and the Beam version you would like to upgrade the transforms
to. All transforms in the pipeline with matching URNs will be upgraded.</p>
+<p>For example, to upgrade the BigQuery read transform for a pipeline run
using Beam <code>2.53.0</code> to a future Beam version
<code>2.xy.z</code>, you can specify the following additional pipelines
options.</p>
<div class='language-java snippet'>
<div class="notebook-skip code-snippet">
<a class="copy" type="button" data-bs-toggle="tooltip"
data-bs-placement="bottom" title="Copy to clipboard">
@@ -15729,13 +15729,13 @@ This feature is currently only available for Beam
Java SDK 2.53.0 and later. Cur
<div class="highlight"><pre tabindex="0" class="chroma"><code
class="language-go" data-lang="go"><span class="line"><span
class="cl"><span class="nx">This</span> <span
class="nx">feature</span> <span class="nx">is</span> <span
class="nx">currently</span> <span class="nx">not</span> <span
class="nx">available</span> <span class="k">for</span> <span
class="nx">Go</span> <span class="nx">SDK</span><span
class="p">.</ [...]
</div>
</div>
-<p>Note that the framework will automatically download the relavent Docker
containers and startup the transform service for you.</p>
+<p>Note that the framework will automatically download the relevant Docker
containers and startup the transform service for you.</p>
<p>Please see <a
href="https://cwiki.apache.org/confluence/display/BEAM/Transform+Service#TransformService-Upgradetransformswithoutupgradingthepipeline";>here</a>
for a full example that uses this feature to upgrade BigQuery read and write
transforms.</p>
<h3 id="transform-service-usage-multi-language">15.2 Using the Transform
service for multi-language pipelines</h3>
-<p>Transform service implements the Beam expansion API. This allows Beam
multi-language pipelines to use the transform service when expanding transforms
available withn the transform service.
+<p>Transform service implements the Beam expansion API. This allows Beam
multi-language pipelines to use the transform service when expanding transforms
available within the transform service.
The main advantage here is that multi-language pipelines will be able to
operate without installing support for additional language runtimes. For
example, Beam Python pipelines that use Java transforms such as
<code>KafkaIO</code> can operate without installing Java locally during
job submission as long as Docker is available in the system.</p>
-<p>In some cases, Apache Beam SDKs automatically start the Transform
service.</p>
+<p>In some cases, Apache Beam SDKs can automatically start the Transform
service.</p>
<ul>
<li>
<p>The Java <a
href="https://github.com/apache/beam/blob/master/sdks/java/extensions/python/src/main/java/org/apache/beam/sdk/extensions/python/PythonExternalTransform.java";><code>PythonExternalTransform</code>
API</a> automatically
@@ -15745,9 +15745,9 @@ starts the Transform service when a Python runtime
isn&rsquo;t available loc
<p>The Apache Beam Python multi-language wrappers might automatically start
the Transform service when you&rsquo;re using Java transforms, a Java
language runtime isn&rsquo;t available locally, and Docker is available
locally.</p>
</li>
</ul>
-<p>Beam users also have the option to <a
href="/documentation/programming-guide/#transform-service-usage-muanual">manually
start</a> a stransform service and use that as the expansion service used
by multi-language pipelines.</p>
+<p>Beam users also have the option to <a
href="/documentation/programming-guide/#transform-service-usage-muanual">manually
start</a> a transform service and use that as the expansion service used by
multi-language pipelines.</p>
<h3 id="transform-service-usage-muanual">15.3 Manually starting the
transform service</h3>
-<p>A Beam Transform service instance can be manually started by by using
utilities provided with Apache Beam SDKs.</p>
+<p>A Beam Transform service instance can be manually started by using
utilities provided with Apache Beam SDKs.</p>
<div class='language-java snippet'>
<div class="notebook-skip code-snippet">
<a class="copy" type="button" data-bs-toggle="tooltip"
data-bs-placement="bottom" title="Copy to clipboard">
@@ -15799,7 +15799,7 @@ starts the Transform service when a Python runtime
isn&rsquo;t available loc
</div>
<h3 id="transform-service-included-transforms">15.4 Portable transforms
included in the Transform service</h3>
<p>Beam Transform service includes a number of transforms implemented in
the Apache Beam Java and Python SDKs.</p>
-<p>Currently, following transforms are included in the Transform
service:</p>
+<p>Currently, the following transforms are included in the Transform
service:</p>
<ul>
<li>
<p>Java transforms: Google Cloud I/O connectors, the Kafka I/O connector,
and the JDBC I/O connector</p>
diff --git
a/website/generated-content/documentation/programming-guide/index.html
b/website/generated-content/documentation/programming-guide/index.html
index c8982ea6bae..fa32fcc3ac6 100644
--- a/website/generated-content/documentation/programming-guide/index.html
+++ b/website/generated-content/documentation/programming-guide/index.html
@@ -5658,10 +5658,10 @@ implementations. This information can be accessed by
using the conventional
</span></span><span class=line><span class=cl> <span class=k>def</span> <span
class=nf>infer_output_type</span><span class=p>(</span><span
class=bp>self</span><span class=p>,</span> <span class=n>input_type</span><span
class=p>):</span>
</span></span><span class=line><span class=cl> <span class=k>return</span>
<span class=n>input_type</span></span></span></code></pre></div></div></div><h2
id=transform-service>15 Transform service</h2><p>The Apache Beam SDK versions
2.49.0 and later include a <a href=https://docs.docker.com/compose/>Docker
Compose</a>
service named <em>Transform service</em>.</p><p>The following diagram
illustrates the basic architecture of the Transform service.</p><p><img
src=/images/transform_service.png alt="Diagram of the Transform service
architecture"></p><p>To use the Transform service, Docker must be available on
the machine that starts the service.</p><p>The Transform service has several
primary use cases.</p><h3 id=transform-service-usage-upgrade>15.1 Using the
transform service to upgrade transforms</h3><p [...]
-This feature is currently only available for Beam Java SDK 2.53.0 and later.
Currently following transforms are available for upgrading.</p><ul><li>BigQuery
read transform (URN:
<em>beam:transform:org.apache.beam:bigquery_read:v1</em>)</li><li>BigQuery
write transform (URN:
<em>beam:transform:org.apache.beam:bigquery_write:v1</em>)</li><li>Kafka read
transform (URN:
<em>beam:transform:org.apache.beam:kafka_read_with_metadata:v2</em>)</li><li>Kafka
write transform (URN: <em>beam:transform [...]
+This feature is currently only available for Beam Java SDK 2.53.0 and later.
Currently, the following transforms are available for
upgrading:</p><ul><li>BigQuery read transform (URN:
<em>beam:transform:org.apache.beam:bigquery_read:v1</em>)</li><li>BigQuery
write transform (URN:
<em>beam:transform:org.apache.beam:bigquery_write:v1</em>)</li><li>Kafka read
transform (URN:
<em>beam:transform:org.apache.beam:kafka_read_with_metadata:v2</em>)</li><li>Kafka
write transform (URN: <em>beam:tran [...]
The main advantage here is that multi-language pipelines will be able to
operate without installing support for additional language runtimes. For
example, Beam Python pipelines that use Java transforms such as
-<code>KafkaIO</code> can operate without installing Java locally during job
submission as long as Docker is available in the system.</p><p>In some cases,
Apache Beam SDKs automatically start the Transform service.</p><ul><li><p>The
Java <a
href=https://github.com/apache/beam/blob/master/sdks/java/extensions/python/src/main/java/org/apache/beam/sdk/extensions/python/PythonExternalTransform.java><code>PythonExternalTransform</code>
API</a> automatically
-starts the Transform service when a Python runtime isn’t available
locally, but Docker is.</p></li><li><p>The Apache Beam Python multi-language
wrappers might automatically start the Transform service when you’re
using Java transforms, a Java language runtime isn’t available locally,
and Docker is available locally.</p></li></ul><p>Beam users also have the
option to <a
href=/documentation/programming-guide/#transform-service-usage-muanual>manually
start</a> a stransform [...]
+<code>KafkaIO</code> can operate without installing Java locally during job
submission as long as Docker is available in the system.</p><p>In some cases,
Apache Beam SDKs can automatically start the Transform
service.</p><ul><li><p>The Java <a
href=https://github.com/apache/beam/blob/master/sdks/java/extensions/python/src/main/java/org/apache/beam/sdk/extensions/python/PythonExternalTransform.java><code>PythonExternalTransform</code>
API</a> automatically
+starts the Transform service when a Python runtime isn’t available
locally, but Docker is.</p></li><li><p>The Apache Beam Python multi-language
wrappers might automatically start the Transform service when you’re
using Java transforms, a Java language runtime isn’t available locally,
and Docker is available locally.</p></li></ul><p>Beam users also have the
option to <a
href=/documentation/programming-guide/#transform-service-usage-muanual>manually
start</a> a transform [...]
<a
href=/documentation/transforms/python/elementwise/runinference/>RunInference</a>
and
<a href=/documentation/dsls/dataframes/overview/>DataFrame</a>
transforms.</p></li></ul><p>For a more comprehensive list of available
transforms, see the
<a
href=https://cwiki.apache.org/confluence/display/BEAM/Transform+Service#TransformService-TransformsincludedintheTransformservice>Transform
service</a> developer guide.</p><div class=feedback><p class=update>Last
updated on 2023/12/01</p><h3>Have you found everything you were looking
for?</h3><p class=description>Was it all useful and clear? Is there anything
that you would like to change? Let us know!</p><button class=load-button><a
href="https://docs.google.com/forms/d/e/1FAIpQLSfID7 [...]
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index 28a52ff6d95..ab3579fa23f 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.52.0/</loc><lastmod>2023-12-01T10:40:42-08:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-12-01T10:40:42-08:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-12-01T10:40:42-08:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-12-01T10:40:42-08:00</lastmod></url><url><loc>/catego
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.52.0/</loc><lastmod>2023-12-01T12:58:43-08:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-12-01T12:58:43-08:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-12-01T12:58:43-08:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-12-01T12:58:43-08:00</lastmod></url><url><loc>/catego
[...]
\ No newline at end of file
