dependabot[bot] opened a new pull request, #33: URL: https://github.com/apache/beam-starter-python/pull/33
Bumps [apache-beam](https://github.com/apache/beam) from 2.56.0 to 2.57.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>apache-beam's releases</a>.</em></p> <blockquote> <h2>Beam 2.57.0 Release</h2> <p>We are happy to present the new 2.57.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://github.com/apache/beam/blob/HEAD/get-started/downloads/#2570-2024-06-25";>download page</a> for this release.</p> <p>For more information on changes in 2.57.0, check out the <a href="https://github.com/apache/beam/milestone/21";>detailed release notes</a>.</p> <h2>Highlights</h2> <ul> <li>Apache Beam adds Python 3.12 support (<a href="https://redirect.github.com/apache/beam/issues/29149";>#29149</a>).</li> <li>Added FlinkRunner for Flink 1.18 (<a href="https://redirect.github.com/apache/beam/issues/30789";>#30789</a>).</li> </ul> <h2>I/Os</h2> <ul> <li>Ensure that BigtableIO closes the reader streams (<a href="https://redirect.github.com/apache/beam/issues/31477";>#31477</a>).</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>Added Feast feature store handler for enrichment transform (Python) (<a href="https://redirect.github.com/apache/beam/issues/30964";>#30957</a>).</li> <li>BigQuery per-worker metrics are reported by default for Streaming Dataflow Jobs (Java) (<a href="https://redirect.github.com/apache/beam/pull/31015";>#31015</a>)</li> <li>Adds <code>inMemory()</code> variant of Java List and Map side inputs for more efficient lookups when the entire side input fits into memory.</li> <li>Beam YAML now supports the jinja templating syntax. Template variables can be passed with the (json-formatted) <code>--jinja_variables</code> flag.</li> <li>DataFrame API now supports pandas 2.1.x and adds 12 more string functions for Series.(<a href="https://redirect.github.com/apache/beam/pull/31185";>#31185</a>).</li> <li>Added BigQuery handler for enrichment transform (Python) (<a href="https://redirect.github.com/apache/beam/pull/31295";>#31295</a>)</li> <li>Disable soft delete policy when creating the default bucket for a project (Java) (<a href="https://redirect.github.com/apache/beam/pull/31324";>#31324</a>).</li> <li>Added <code>DoFn.SetupContextParam</code> and <code>DoFn.BundleContextParam</code> which can be used as a python <code>DoFn.process</code>, <code>Map</code>, or <code>FlatMap</code> parameter to invoke a context manager per DoFn setup or bundle (analogous to using <code>setup</code>/<code>teardown</code> or <code>start_bundle</code>/<code>finish_bundle</code> respectively.)</li> <li>Go SDK Prism Runner <ul> <li>Pre-built Prism binaries are now part of the release and are available via the Github release page. (<a href="https://redirect.github.com/apache/beam/issues/29697";>#29697</a>).</li> <li>Some pipelines will work on Java and Python, but this is in part to prepare for real runner wrappers in 2.58.0</li> <li>ProcessingTime is now handled synthetically with TestStream pipelines and Non-TestStream pipelines, for fast test pipeline execution by default. (<a href="https://redirect.github.com/apache/beam/issues/30083";>#30083</a>). <ul> <li>Prism does NOT yet support "real time" execution for this release.</li> </ul> </li> </ul> </li> <li>Improve processing for large elements to reduce the chances for exceeding 2GB protobuf limits (Python)([https://redirect.github.com/apache/beam/issues/31607]).</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Java's View.asList() side inputs are now optimized for iterating rather than indexing when in the global window. This new implementation still supports all (immutable) List methods as before, but some of the random access methods like get() and size() will be slower. To use the old implementation one can use View.asList().withRandomAccess().</li> <li>SchemaTransforms implemented with TypedSchemaTransformProvider now produce a configuration Schema with snake_case naming convention (<a href="https://redirect.github.com/apache/beam/pull/31374";>#31374</a>). This will make the following cases problematic: <ul> <li>Running a pre-2.57.0 remote SDK pipeline containing a 2.57.0+ Java SchemaTransform, and vice versa:</li> </ul> </li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>apache-beam's changelog</a>.</em></p> <blockquote> <h1>[2.57.0] - 2024-06-26</h1> <h2>Highlights</h2> <ul> <li>Apache Beam adds Python 3.12 support (<a href="https://redirect.github.com/apache/beam/issues/29149";>#29149</a>).</li> <li>Added FlinkRunner for Flink 1.18 (<a href="https://redirect.github.com/apache/beam/issues/30789";>#30789</a>).</li> </ul> <h2>I/Os</h2> <ul> <li>Ensure that BigtableIO closes the reader streams (<a href="https://redirect.github.com/apache/beam/issues/31477";>#31477</a>).</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>Added Feast feature store handler for enrichment transform (Python) (<a href="https://redirect.github.com/apache/beam/issues/30964";>#30957</a>).</li> <li>BigQuery per-worker metrics are reported by default for Streaming Dataflow Jobs (Java) (<a href="https://redirect.github.com/apache/beam/pull/31015";>#31015</a>)</li> <li>Adds <code>inMemory()</code> variant of Java List and Map side inputs for more efficient lookups when the entire side input fits into memory.</li> <li>Beam YAML now supports the jinja templating syntax. Template variables can be passed with the (json-formatted) <code>--jinja_variables</code> flag.</li> <li>DataFrame API now supports pandas 2.1.x and adds 12 more string functions for Series.(<a href="https://redirect.github.com/apache/beam/pull/31185";>#31185</a>).</li> <li>Added BigQuery handler for enrichment transform (Python) (<a href="https://redirect.github.com/apache/beam/pull/31295";>#31295</a>)</li> <li>Disable soft delete policy when creating the default bucket for a project (Java) (<a href="https://redirect.github.com/apache/beam/pull/31324";>#31324</a>).</li> <li>Added <code>DoFn.SetupContextParam</code> and <code>DoFn.BundleContextParam</code> which can be used as a python <code>DoFn.process</code>, <code>Map</code>, or <code>FlatMap</code> parameter to invoke a context manager per DoFn setup or bundle (analogous to using <code>setup</code>/<code>teardown</code> or <code>start_bundle</code>/<code>finish_bundle</code> respectively.)</li> <li>Go SDK Prism Runner <ul> <li>Pre-built Prism binaries are now part of the release and are available via the Github release page. (<a href="https://redirect.github.com/apache/beam/issues/29697";>#29697</a>).</li> <li>ProcessingTime is now handled synthetically with TestStream pipelines and Non-TestStream pipelines, for fast test pipeline execution by default. (<a href="https://redirect.github.com/apache/beam/issues/30083";>#30083</a>). <ul> <li>Prism does NOT yet support "real time" execution for this release.</li> </ul> </li> </ul> </li> <li>Improve processing for large elements to reduce the chances for exceeding 2GB protobuf limits (Python)([https://redirect.github.com/apache/beam/issues/31607]).</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Java's View.asList() side inputs are now optimized for iterating rather than indexing when in the global window. This new implementation still supports all (immutable) List methods as before, but some of the random access methods like get() and size() will be slower. To use the old implementation one can use View.asList().withRandomAccess().</li> <li>SchemaTransforms implemented with TypedSchemaTransformProvider now produce a configuration Schema with snake_case naming convention (<a href="https://redirect.github.com/apache/beam/pull/31374";>#31374</a>). This will make the following cases problematic: <ul> <li>Running a pre-2.57.0 remote SDK pipeline containing a 2.57.0+ Java SchemaTransform, and vice versa:</li> <li>Running a 2.57.0+ remote SDK pipeline containing a pre-2.57.0 Java SchemaTransform</li> <li>All direct uses of Python's <a href="https://github.com/apache/beam/blob/a998107a1f5c3050821eef6a5ad5843d8adb8aec/sdks/python/apache_beam/transforms/external.py#L381";>SchemaAwareExternalTransform</a> should be updated to use new snake_case parameter names.</li> </ul> </li> <li>Upgraded Jackson Databind to 2.15.4 (Java) (<a href="https://redirect.github.com/apache/beam/issues/26743";>#26743</a>). jackson-2.15 has known breaking changes. An important one is it imposed a buffer limit for parser. If your custom PTransform/DoFn are affected, refer to <a href="https://redirect.github.com/apache/beam/pull/31580";>#31580</a> for mitigation.</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/e3314d4c942d6fb7c9669e7eb98c5e526b83e1aa";><code>e3314d4</code></a> Set version for 2.57.0 RC1</li> <li><a href="https://github.com/apache/beam/commit/96766f28eb64679d4b3284ddfeeb6408a758a97c";><code>96766f2</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/31626";>#31626</a>: [release-2.57.0] Cherrypick <a href="https://redirect.github.com/apache/beam/issues/31490";>#31490</a> into the releas...</li> <li><a href="https://github.com/apache/beam/commit/40653e730b6997395d99efa0fb981b7abed45edc";><code>40653e7</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/31642";>#31642</a>: Use correct name for tox doc task.</li> <li><a href="https://github.com/apache/beam/commit/4b132b29b96141913f3e4b1e2732f7ad62fb5224";><code>4b132b2</code></a> Use correct name for tox doc task.</li> <li><a href="https://github.com/apache/beam/commit/2ff8b61108aa125533139d7ba4533c8ef98aca80";><code>2ff8b61</code></a> Plumb Redistribute "allow duplicates" property to Dataflow (<a href="https://redirect.github.com/apache/beam/issues/31490";>#31490</a>)</li> <li><a href="https://github.com/apache/beam/commit/df480af7776dc25102c89a4ceb9111db07d012ad";><code>df480af</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/31562";>#31562</a>: Cherrypick <a href="https://redirect.github.com/apache/beam/issues/31550";>#31550</a> and <a href="https://redirect.github.com/apache/beam/issues/31602";>#31602</a> onto release branch</li> <li><a href="https://github.com/apache/beam/commit/f1da72dc54e07a68cf56fe5fbf40355ca1c02660";><code>f1da72d</code></a> Fix internal test failure caused by PR 31550 (<a href="https://redirect.github.com/apache/beam/issues/31602";>#31602</a>)</li> <li><a href="https://github.com/apache/beam/commit/6df1214ea5f9352005cf64efcc2fc6bb48836957";><code>6df1214</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/31589";>#31589</a>: [Release-2.57.0] Cherry-pick <a href="https://redirect.github.com/apache/beam/issues/31580";>#31580</a> into release b...</li> <li><a href="https://github.com/apache/beam/commit/d64f8ca0ade7e6804e7868bad315884c1e421af6";><code>d64f8ca</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/31598";>#31598</a>: [release-2.57.0] Cherrypick <a href="https://redirect.github.com/apache/beam/issues/31581";>#31581</a> into the releas...</li> <li><a href="https://github.com/apache/beam/commit/d7da9d318aae85a777c5bdef63ea22e3135b372c";><code>d7da9d3</code></a> Use a type-compliant sentinel.</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.56.0...v2.57.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
