dependabot[bot] opened a new pull request, #19: URL: https://github.com/apache/beam-starter-go/pull/19
Bumps [github.com/apache/beam/sdks/v2](https://github.com/apache/beam) from 2.49.0 to 2.50.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>github.com/apache/beam/sdks/v2's releases</a>.</em></p> <blockquote> <h2>Beam 2.50.0 release</h2> <p>We are happy to present the new 2.50.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://beam.apache.org/get-started/downloads/#2500-2023-08-30";>download page</a> for this release.</p> <!-- raw HTML omitted --> <p>For more information on changes in 2.50.0, check out the <a href="https://github.com/apache/beam/milestone/14";>detailed release notes</a>.</p> <h2>Highlights</h2> <ul> <li>Spark 3.2.2 is used as default version for Spark runner (<a href="https://redirect.github.com/apache/beam/issues/23804";>#23804</a>).</li> <li>The Go SDK has a new default local runner, called Prism (<a href="https://redirect.github.com/apache/beam/issues/24789";>#24789</a>).</li> <li>All Beam released container images are now <a href="https://cloud.google.com/kubernetes-engine/docs/how-to/build-multi-arch-for-arm#what_is_a_multi-arch_image";>multi-arch images</a> that support both x86 and ARM CPU architectures.</li> </ul> <h2>I/Os</h2> <ul> <li>Java KafkaIO now supports picking up topics via topicPattern (<a href="https://redirect.github.com/apache/beam/pull/26948";>#26948</a>)</li> <li>Support for read from Cosmos DB Core SQL API (<a href="https://redirect.github.com/apache/beam/issues/23604";>#23604</a>)</li> <li>Upgraded to HBase 2.5.5 for HBaseIO. (Java) (<a href="https://redirect.github.com/apache/beam/issues/19554";>#27711</a>)</li> <li>Added support for GoogleAdsIO source (Java) (<a href="https://redirect.github.com/apache/beam/pull/27681";>#27681</a>).</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>The Go SDK now requires Go 1.20 to build. (<a href="https://redirect.github.com/apache/beam/issues/27558";>#27558</a>)</li> <li>The Go SDK has a new default local runner, Prism. (<a href="https://redirect.github.com/apache/beam/issues/24789";>#24789</a>). <ul> <li>Prism is a portable runner that executes each transform independantly, ensuring coders.</li> <li>At this point it supercedes the Go direct runner in functionality. The Go direct runner is now deprecated.</li> <li>See <a href="https://github.com/apache/beam/blob/master/sdks/go/pkg/beam/runners/prism/README.md";>https://github.com/apache/beam/blob/master/sdks/go/pkg/beam/runners/prism/README.md</a> for the goals and features of Prism.</li> </ul> </li> <li>Hugging Face Model Handler for RunInference added to Python SDK. (<a href="https://redirect.github.com/apache/beam/pull/26632";>#26632</a>)</li> <li>Hugging Face Pipelines support for RunInference added to Python SDK. (<a href="https://redirect.github.com/apache/beam/pull/27399";>#27399</a>)</li> <li>Vertex AI Model Handler for RunInference now supports private endpoints (<a href="https://redirect.github.com/apache/beam/pull/27696";>#27696</a>)</li> <li>MLTransform transform added with support for common ML pre/postprocessing operations (<a href="https://redirect.github.com/apache/beam/pull/26795";>#26795</a>)</li> <li>Upgraded the Kryo extension for the Java SDK to Kryo 5.5.0. This brings in bug fixes, performance improvements, and serialization of Java 14 records. (<a href="https://redirect.github.com/apache/beam/issues/27635";>#27635</a>)</li> <li>All Beam released container images are now <a href="https://cloud.google.com/kubernetes-engine/docs/how-to/build-multi-arch-for-arm#what_is_a_multi-arch_image";>multi-arch images</a> that support both x86 and ARM CPU architectures. (<a href="https://redirect.github.com/apache/beam/issues/27674";>#27674</a>). The multi-arch container images include: <ul> <li>All versions of Go, Python, Java and Typescript SDK containers.</li> <li>All versions of Flink job server containers.</li> <li>Java and Python expansion service containers.</li> <li>Transform service controller container.</li> <li>Spark3 job server container.</li> </ul> </li> <li>Added support for batched writes to AWS SQS for improved throughput (Java, AWS 2).(<a href="https://redirect.github.com/apache/beam/issues/21429";>#21429</a>)</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Python SDK: Legacy runner support removed from Dataflow, all pipelines must use runner v2.</li> <li>Python SDK: Dataflow Runner will no longer stage Beam SDK from PyPI in the <code>--staging_location</code> at pipeline submission. Custom container images that are not based on Beam's default image must include Apache Beam installation.(<a href="https://redirect.github.com/apache/beam/issues/26996";>#26996</a>)</li> </ul> <h2>Deprecations</h2> <ul> <li>The Go Direct Runner is now Deprecated. It remains available to reduce migration churn.</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>github.com/apache/beam/sdks/v2's changelog</a>.</em></p> <blockquote> <h1>[2.50.0] - 2023-08-30</h1> <h2>Highlights</h2> <ul> <li>Spark 3.2.2 is used as default version for Spark runner (<a href="https://redirect.github.com/apache/beam/issues/23804";>#23804</a>).</li> <li>The Go SDK has a new default local runner, called Prism (<a href="https://redirect.github.com/apache/beam/issues/24789";>#24789</a>).</li> <li>All Beam released container images are now <a href="https://cloud.google.com/kubernetes-engine/docs/how-to/build-multi-arch-for-arm#what_is_a_multi-arch_image";>multi-arch images</a> that support both x86 and ARM CPU architectures.</li> </ul> <h2>I/Os</h2> <ul> <li>Java KafkaIO now supports picking up topics via topicPattern (<a href="https://redirect.github.com/apache/beam/pull/26948";>#26948</a>)</li> <li>Support for read from Cosmos DB Core SQL API (<a href="https://redirect.github.com/apache/beam/issues/23604";>#23604</a>)</li> <li>Upgraded to HBase 2.5.5 for HBaseIO. (Java) (<a href="https://redirect.github.com/apache/beam/issues/19554";>#27711</a>)</li> <li>Added support for GoogleAdsIO source (Java) (<a href="https://redirect.github.com/apache/beam/pull/27681";>#27681</a>).</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>The Go SDK now requires Go 1.20 to build. (<a href="https://redirect.github.com/apache/beam/issues/27558";>#27558</a>)</li> <li>The Go SDK has a new default local runner, Prism. (<a href="https://redirect.github.com/apache/beam/issues/24789";>#24789</a>). <ul> <li>Prism is a portable runner that executes each transform independantly, ensuring coders.</li> <li>At this point it supercedes the Go direct runner in functionality. The Go direct runner is now deprecated.</li> <li>See <a href="https://github.com/apache/beam/blob/master/sdks/go/pkg/beam/runners/prism/README.md";>https://github.com/apache/beam/blob/master/sdks/go/pkg/beam/runners/prism/README.md</a> for the goals and features of Prism.</li> </ul> </li> <li>Hugging Face Model Handler for RunInference added to Python SDK. (<a href="https://redirect.github.com/apache/beam/pull/26632";>#26632</a>)</li> <li>Hugging Face Pipelines support for RunInference added to Python SDK. (<a href="https://redirect.github.com/apache/beam/pull/27399";>#27399</a>)</li> <li>Vertex AI Model Handler for RunInference now supports private endpoints (<a href="https://redirect.github.com/apache/beam/pull/27696";>#27696</a>)</li> <li>MLTransform transform added with support for common ML pre/postprocessing operations (<a href="https://redirect.github.com/apache/beam/pull/26795";>#26795</a>)</li> <li>Upgraded the Kryo extension for the Java SDK to Kryo 5.5.0. This brings in bug fixes, performance improvements, and serialization of Java 14 records. (<a href="https://redirect.github.com/apache/beam/issues/27635";>#27635</a>)</li> <li>All Beam released container images are now <a href="https://cloud.google.com/kubernetes-engine/docs/how-to/build-multi-arch-for-arm#what_is_a_multi-arch_image";>multi-arch images</a> that support both x86 and ARM CPU architectures. (<a href="https://redirect.github.com/apache/beam/issues/27674";>#27674</a>). The multi-arch container images include: <ul> <li>All versions of Go, Python, Java and Typescript SDK containers.</li> <li>All versions of Flink job server containers.</li> <li>Java and Python expansion service containers.</li> <li>Transform service controller container.</li> <li>Spark3 job server container.</li> </ul> </li> <li>Added support for batched writes to AWS SQS for improved throughput (Java, AWS 2).(<a href="https://redirect.github.com/apache/beam/issues/21429";>#21429</a>)</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Python SDK: Legacy runner support removed from Dataflow, all pipelines must use runner v2.</li> <li>Python SDK: Dataflow Runner will no longer stage Beam SDK from PyPI in the <code>--staging_location</code> at pipeline submission. Custom container images that are not based on Beam's default image must include Apache Beam installation.(<a href="https://redirect.github.com/apache/beam/issues/26996";>#26996</a>)</li> </ul> <h2>Deprecations</h2> <ul> <li>The Go Direct Runner is now Deprecated. It remains available to reduce migration churn. <ul> <li>Tests can be set back to the direct runner by overriding TestMain: <code>func TestMain(m *testing.M) { ptest.MainWithDefault(m, "direct") }</code></li> <li>It's recommended to fix issues seen in tests using Prism, as they can also happen on any portable runner.</li> <li>Use the generic register package for your pipeline DoFns to ensure pipelines function on portable runners, like prism.</li> <li>Do not rely on closures or using package globals for DoFn configuration. They don't function on portable runners.</li> </ul> </li> </ul> <h2>Bugfixes</h2> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/bb044f4863cd151214f61174ac3c097bea724098";><code>bb044f4</code></a> Set version for 2.50.0 RC2</li> <li><a href="https://github.com/apache/beam/commit/8f762e3f3b4b7a3fe5684c3e17adab2fe91b6f23";><code>8f762e3</code></a> Add back docker prune step between python container pushes (<a href="https://redirect.github.com/apache/beam/issues/28033";>#28033</a>) (<a href="https://redirect.github.com/apache/beam/issues/28101";>#28101</a>)</li> <li><a href="https://github.com/apache/beam/commit/28d20e4046981c0446a6bf43f69efdc3e1d4685d";><code>28d20e4</code></a> Loosen environment validation for RCs (<a href="https://redirect.github.com/apache/beam/issues/28110";>#28110</a>)</li> <li><a href="https://github.com/apache/beam/commit/b1d245d02f169c78fdb0e1b3bbf5cd688566cdd2";><code>b1d245d</code></a> Pin hugging face docs (<a href="https://redirect.github.com/apache/beam/issues/28106";>#28106</a>) (<a href="https://redirect.github.com/apache/beam/issues/28115";>#28115</a>)</li> <li><a href="https://github.com/apache/beam/commit/ff12f23bd24d07c3507ea83a220dd295f83d9e07";><code>ff12f23</code></a> [Cherry-pick <a href="https://redirect.github.com/apache/beam/issues/28036";>#28036</a>] Add libgeos-dev for ARM components of multi-arch Beam SD...</li> <li><a href="https://github.com/apache/beam/commit/8293bbd3def6589b03ff54e29d41bb653547c489";><code>8293bbd</code></a> [Cherry Pick <a href="https://redirect.github.com/apache/beam/issues/28083";>#28083</a>][prism] support single external env pipelines. (<a href="https://redirect.github.com/apache/beam/issues/28111";>#28111</a>)</li> <li><a href="https://github.com/apache/beam/commit/c42daeeab23b194529e5476b8e2843fbea8bb17c";><code>c42daee</code></a> Cherry pick <a href="https://redirect.github.com/apache/beam/issues/27842";>#27842</a> (<a href="https://redirect.github.com/apache/beam/issues/28015";>#28015</a>)</li> <li><a href="https://github.com/apache/beam/commit/50e2495ede3bb681cc0eebea5394795f9f6b57c0";><code>50e2495</code></a> Revert <a href="https://redirect.github.com/apache/beam/issues/27878";>#27878</a> (<a href="https://redirect.github.com/apache/beam/issues/27968";>#27968</a>) (<a href="https://redirect.github.com/apache/beam/issues/27970";>#27970</a>)</li> <li><a href="https://github.com/apache/beam/commit/8caa7ce7ac04807ef66006775b19bdf7d115b296";><code>8caa7ce</code></a> Set Dataflow container to release version.</li> <li><a href="https://github.com/apache/beam/commit/47e8de3aed0a2283c9951e411d6abb311755ba35";><code>47e8de3</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/27884";>#27884</a> Also use config pattern for yaml providers.</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.49.0...v2.50.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
