dependabot[bot] opened a new pull request, #24: URL: https://github.com/apache/beam-starter-python/pull/24
Bumps [apache-beam](https://github.com/apache/beam) from 2.46.0 to 2.51.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>apache-beam's releases</a>.</em></p> <blockquote> <h2>Beam 2.51.0 release</h2> <p>We are happy to present the new 2.51.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://github.com/apache/beam/blob/HEAD/get-started/downloads/#2510-2023-10-03";>download page</a> for this release.</p> <!-- raw HTML omitted --> <p>For more information on changes in 2.51.0, check out the <a href="https://github.com/apache/beam/milestone/15";>detailed release notes</a>.</p> <h2>New Features / Improvements</h2> <ul> <li>In Python, <a href="https://beam.apache.org/documentation/sdks/python-machine-learning/#why-use-the-runinference-api";>RunInference</a> now supports loading many models in the same transform using a <a href="https://beam.apache.org/documentation/sdks/python-machine-learning/#use-a-keyed-modelhandler";>KeyedModelHandler</a> (<a href="https://redirect.github.com/apache/beam/issues/27628";>#27628</a>).</li> <li>In Python, the <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.ml.inference.vertex_ai_inference.html#apache_beam.ml.inference.vertex_ai_inference.VertexAIModelHandlerJSON";>VertexAIModelHandlerJSON</a> now supports passing in inference_args. These will be passed through to the Vertex endpoint as parameters.</li> <li>Added support to run <code>mypy</code> on user pipelines (<a href="https://redirect.github.com/apache/beam/issues/27906";>#27906</a>)</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Removed fastjson library dependency for Beam SQL. Table property is changed to be based on jackson ObjectNode (Java) (<a href="https://redirect.github.com/apache/beam/issues/24154";>#24154</a>).</li> <li>Removed TensorFlow from Beam Python container images <a href="https://redirect.github.com/apache/beam/pull/28424";>PR</a>. If you have been negatively affected by this change, please comment on <a href="https://redirect.github.com/apache/beam/issues/20605";>#20605</a>.</li> <li>Removed the parameter <code>t reflect.Type</code> from <code>parquetio.Write</code>. The element type is derived from the input PCollection (Go) (<a href="https://redirect.github.com/apache/beam/issues/28490";>#28490</a>)</li> <li>Refactor BeamSqlSeekableTable.setUp adding a parameter joinSubsetType. <a href="https://redirect.github.com/apache/beam/issues/28283";>#28283</a></li> </ul> <h2>Bugfixes</h2> <ul> <li>Fixed exception chaining issue in GCS connector (Python) (<a href="https://redirect.github.com/apache/beam/issues/26769#issuecomment-1700422615";>#26769</a>).</li> <li>Fixed streaming inserts exception handling, GoogleAPICallErrors are now retried according to retry strategy and routed to failed rows where appropriate rather than causing a pipeline error (Python) (<a href="https://redirect.github.com/apache/beam/issues/21080";>#21080</a>).</li> <li>Fixed a bug in Python SDK's cross-language Bigtable sink that mishandled records that don't have an explicit timestamp set: <a href="https://redirect.github.com/apache/beam/issues/28632";>#28632</a>.</li> </ul> <h2>Security Fixes</h2> <ul> <li>Python containers updated, fixing <a href="https://nvd.nist.gov/vuln/detail/CVE-2021-30474";>CVE-2021-30474</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2021-30475";>CVE-2021-30475</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2021-30473";>CVE-2021-30473</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2020-36133";>CVE-2020-36133</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2020-36131";>CVE-2020-36131</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2020-36130";>CVE-2020-36130</a>, and <a href="https://nvd.nist.gov/vuln/detail/CVE-2020-36135";>CVE-2020-36135</a></li> <li>Used go 1.21.1 to build, fixing <a href="https://security-tracker.debian.org/tracker/CVE-2023-39320";>CVE-2023-39320</a></li> </ul> <h2>Known Issues</h2> <ul> <li>Python pipelines using BigQuery Storage Read API must pin <code>fastavro</code> dependency to 1.8.3 or earlier: <a href="https://redirect.github.com/apache/beam/issues/28811";>#28811</a></li> </ul> <h2>List of Contributors</h2> <p>According to git shortlog, the following people contributed to the 2.50.0 release. Thank you to all contributors!</p> <p>Adam Whitmore</p> <p>Ahmed Abualsaud</p> <p>Ahmet Altay</p> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>apache-beam's changelog</a>.</em></p> <blockquote> <h1>[2.51.0] - 2023-10-03</h1> <h2>New Features / Improvements</h2> <ul> <li>In Python, <a href="https://beam.apache.org/documentation/sdks/python-machine-learning/#why-use-the-runinference-api";>RunInference</a> now supports loading many models in the same transform using a <a href="https://beam.apache.org/documentation/sdks/python-machine-learning/#use-a-keyed-modelhandler";>KeyedModelHandler</a> (<a href="https://redirect.github.com/apache/beam/issues/27628";>#27628</a>).</li> <li>In Python, the <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.ml.inference.vertex_ai_inference.html#apache_beam.ml.inference.vertex_ai_inference.VertexAIModelHandlerJSON";>VertexAIModelHandlerJSON</a> now supports passing in inference_args. These will be passed through to the Vertex endpoint as parameters.</li> <li>Added support to run <code>mypy</code> on user pipelines (<a href="https://redirect.github.com/apache/beam/issues/27906";>#27906</a>)</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Removed fastjson library dependency for Beam SQL. Table property is changed to be based on jackson ObjectNode (Java) (<a href="https://redirect.github.com/apache/beam/issues/24154";>#24154</a>).</li> <li>Removed TensorFlow from Beam Python container images <a href="https://redirect.github.com/apache/beam/pull/28424";>PR</a>. If you have been negatively affected by this change, please comment on <a href="https://redirect.github.com/apache/beam/issues/20605";>#20605</a>.</li> <li>Removed the parameter <code>t reflect.Type</code> from <code>parquetio.Write</code>. The element type is derived from the input PCollection (Go) (<a href="https://redirect.github.com/apache/beam/issues/28490";>#28490</a>)</li> <li>Refactor BeamSqlSeekableTable.setUp adding a parameter joinSubsetType. <a href="https://redirect.github.com/apache/beam/issues/28283";>#28283</a></li> </ul> <h2>Bugfixes</h2> <ul> <li>Fixed exception chaining issue in GCS connector (Python) (<a href="https://redirect.github.com/apache/beam/issues/26769#issuecomment-1700422615";>#26769</a>).</li> <li>Fixed streaming inserts exception handling, GoogleAPICallErrors are now retried according to retry strategy and routed to failed rows where appropriate rather than causing a pipeline error (Python) (<a href="https://redirect.github.com/apache/beam/issues/21080";>#21080</a>).</li> <li>Fixed a bug in Python SDK's cross-language Bigtable sink that mishandled records that don't have an explicit timestamp set: <a href="https://redirect.github.com/apache/beam/issues/28632";>#28632</a>.</li> </ul> <h2>Security Fixes</h2> <ul> <li>Python containers updated, fixing <a href="https://nvd.nist.gov/vuln/detail/CVE-2021-30474";>CVE-2021-30474</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2021-30475";>CVE-2021-30475</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2021-30473";>CVE-2021-30473</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2020-36133";>CVE-2020-36133</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2020-36131";>CVE-2020-36131</a>, <a href="https://nvd.nist.gov/vuln/detail/CVE-2020-36130";>CVE-2020-36130</a>, and <a href="https://nvd.nist.gov/vuln/detail/CVE-2020-36135";>CVE-2020-36135</a></li> <li>Used go 1.21.1 to build, fixing <a href="https://security-tracker.debian.org/tracker/CVE-2023-39320";>CVE-2023-39320</a></li> </ul> <h2>Known Issues</h2> <ul> <li>Python pipelines using BigQuery Storage Read API must pin <code>fastavro</code> dependency to 1.8.3 or earlier: <a href="https://redirect.github.com/apache/beam/issues/28811";>#28811</a></li> </ul> <h1>[2.50.0] - 2023-08-30</h1> <h2>Highlights</h2> <ul> <li>Spark 3.2.2 is used as default version for Spark runner (<a href="https://redirect.github.com/apache/beam/issues/23804";>#23804</a>).</li> <li>The Go SDK has a new default local runner, called Prism (<a href="https://redirect.github.com/apache/beam/issues/24789";>#24789</a>).</li> <li>All Beam released container images are now <a href="https://cloud.google.com/kubernetes-engine/docs/how-to/build-multi-arch-for-arm#what_is_a_multi-arch_image";>multi-arch images</a> that support both x86 and ARM CPU architectures.</li> </ul> <h2>I/Os</h2> <ul> <li>Java KafkaIO now supports picking up topics via topicPattern (<a href="https://redirect.github.com/apache/beam/pull/26948";>#26948</a>)</li> <li>Support for read from Cosmos DB Core SQL API (<a href="https://redirect.github.com/apache/beam/issues/23604";>#23604</a>)</li> <li>Upgraded to HBase 2.5.5 for HBaseIO. (Java) (<a href="https://redirect.github.com/apache/beam/issues/19554";>#27711</a>)</li> <li>Added support for GoogleAdsIO source (Java) (<a href="https://redirect.github.com/apache/beam/pull/27681";>#27681</a>).</li> </ul> <h2>New Features / Improvements</h2> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/cd653e33b342bd09c76c2bbaca12597fec5b4a2c";><code>cd653e3</code></a> Set version for 2.51.0 RC1</li> <li><a href="https://github.com/apache/beam/commit/2420c904f66a8882eb454416f4029604c9160502";><code>2420c90</code></a> Cherry picking PR <a href="https://redirect.github.com/apache/beam/issues/28618";>#28618</a> into 2.51.0 (setting numShards for Python BigQuery x...</li> <li><a href="https://github.com/apache/beam/commit/70f4a1ae26d71fc89c3f5a99cae4e417cd1ee446";><code>70f4a1a</code></a> CP for <a href="https://redirect.github.com/apache/beam/issues/28624";>#28624</a> into release 2.51.0 (Bigtable Python timestamp bug fix) (<a href="https://redirect.github.com/apache/beam/issues/28634";>#28634</a>)</li> <li><a href="https://github.com/apache/beam/commit/34ff286c2b3bd6a3b2fdfd0ca7b683ca0dda547f";><code>34ff286</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/28658";>#28658</a>: [release-2.51.0] Cherrypick <a href="https://redirect.github.com/apache/beam/issues/28571";>#28571</a> to release branch.</li> <li><a href="https://github.com/apache/beam/commit/94adacdcfb1a07cb21a843eabd1c09f56061cde8";><code>94adacd</code></a> Use a single marker for Vertex AI tests to not run them twice.</li> <li><a href="https://github.com/apache/beam/commit/22abcde2aa5688d4f61411949c851a4ac33b725f";><code>22abcde</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/28628";>#28628</a>: [Cherry-pick <a href="https://redirect.github.com/apache/beam/issues/28625";>#28625</a> for 2.51.0] Update Python base...</li> <li><a href="https://github.com/apache/beam/commit/042ac5249b0a5dee2d621d168e8047a92b44690b";><code>042ac52</code></a> Update Python container image deps in preparation for 2.51.0</li> <li><a href="https://github.com/apache/beam/commit/6306b21b3c38c937f0c256a40bccaf46614a0602";><code>6306b21</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/28594";>#28594</a>: [Release-2.51.0] Cherry pick <a href="https://redirect.github.com/apache/beam/issues/28588";>#28588</a>: Fix sync it f...</li> <li><a href="https://github.com/apache/beam/commit/693380f23d000ebf13462cda4bf9c36089e1ee9c";><code>693380f</code></a> Fix sync it (<a href="https://redirect.github.com/apache/beam/issues/28588";>#28588</a>)</li> <li><a href="https://github.com/apache/beam/commit/20e11a661c8b5a5b1e3cad45f5e092edb1be5689";><code>20e11a6</code></a> Set Dataflow container to release version.</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.46.0...v2.51.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
