dependabot[bot] opened a new pull request, #63: URL: https://github.com/apache/beam-starter-python/pull/63
Bumps [apache-beam](https://github.com/apache/beam) from 2.75.0 to 2.76.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>apache-beam's releases</a>.</em></p> <blockquote> <h2>Beam 2.76.0 release</h2> <p>We are happy to present the new 2.76.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://github.com/apache/beam/blob/HEAD/get-started/downloads/#2760-2026-08-??";>download page</a> for this release.</p> <!-- raw HTML omitted --> <p>For more information on changes in 2.76.0, check out the <a href="https://github.com/apache/beam/milestone/43";>detailed release notes</a>.</p> <h2>Highlights</h2> <ul> <li>Added a full Iceberg batch and streaming changelog source (CDC) (<a href="https://redirect.github.com/apache/beam/issues/38831";>#38831</a>)</li> <li>(Java) Added per-element OpenTelemetry trace propagation across stages in the Dataflow Streaming Runner. Enable it with <code>--experiments=enable_otel_defaults,element_metadata_supported,disable_portable_worker</code>. Cloud Trace incurs additional cost. (<a href="https://redirect.github.com/apache/beam/issues/33176";>#33176</a>)</li> <li>(Java) Added OpenTelemetry header propagation support for both reads and writes in KafkaIO and PubSubIO. (<a href="https://redirect.github.com/apache/beam/issues/33176";>#33176</a>)</li> <li>(Java) Added OpenTelemetry tracing support for SpannerIO change streams (<a href="https://redirect.github.com/apache/beam/issues/33176";>#33176</a>)</li> <li>(Python) JmsIO (IBM MQ, ActiveMQ, and other providers) is now supported in Python via cross-language (<a href="https://redirect.github.com/apache/beam/issues/30716";>#30716</a>).</li> </ul> <h3>I/Os</h3> <ul> <li>Upgraded Iceberg dependency to 1.11.0 (Java) (<a href="https://redirect.github.com/apache/beam/issues/38925";>#38925</a>).</li> <li>Add ArrowFlight IO (Java) (<a href="https://redirect.github.com/apache/beam/issues/20116";>#20116</a>).</li> <li>Added a Delta Lake batch changelog source (CDC) (<a href="https://redirect.github.com/apache/beam/issues/39492";>#39492</a>)</li> </ul> <h3>New Features / Improvements</h3> <ul> <li>Added <code>GroupIntoBatches</code> transform and the standard <code>beam:coder:sharded_key:v1</code> coder to the Go SDK, along with <code>beam.Coder.IsDeterministic</code>, <code>beam.PCollection.WindowingStrategy</code>, and <code>coder.RegisterDeterministicCoder</code> for opt-in deterministic custom coders (Go) (<a href="https://redirect.github.com/apache/beam/issues/19868";>#19868</a>).</li> <li>TriggerStateMachineRunner changes from BitSetCoder to SentinelBitSetCoder to encode finished bitset. SentinelBitSetCoder and BitSetCoder are state compatible. Both coders can decode encoded bytes from the other coder (<a href="https://redirect.github.com/apache/beam/issues/38139";>#38139</a>).</li> <li>(Python) Removed the <code>envoy-data-plane</code> (and transitive <code>betterproto</code>) dependency; <code>EnvoyRateLimiter</code> now uses a small vendored protobuf definition instead, resolving dependency conflicts for downstream projects (<a href="https://redirect.github.com/apache/beam/issues/37854";>#37854</a>).</li> <li>(Java) Supported acknowledge mode for JmsIO (<a href="https://redirect.github.com/apache/beam/issues/39253";>#39253</a>).</li> <li>(Python) Staged files directory is now automatically added to <code>sys.path</code> on the Python SDK worker at startup. This makes Python files provided via the '--files_to_stage' pipeline option importable in the pipeline code and makes it easier to initialize Python SDK harness at startup via the <code>--beam_plugins</code> pipeline option. For more information, see the <a href="https://beam.apache.org/documentation/sdks/python-pipeline-dependencies/#staging-files";>Staging Individual Files</a> section of the dependency management docs. This behavior can be disabled by passing the '--experiments=no_staged_dir_in_sys_path' pipeline option (<a href="https://redirect.github.com/apache/beam/issues/39431";>#39431</a>).</li> <li>(Python) Added <code>equal_to_approx</code>, an <code>assert_that</code> matcher that compares numeric pipeline outputs with a configurable tolerance (<a href="https://redirect.github.com/apache/beam/issues/18028";>#18028</a>).</li> <li>(Python) <code>Timestamp</code> now supports variable subsecond precision, up to nanoseconds. The portable <code>beam:logical_type:timestamp:v1</code> logical type now maps to Python's <code>Timestamp</code> (<a href="https://redirect.github.com/apache/beam/issues/39344";>#39344</a>).</li> <li>(Python) Added <code>UnboundedSource</code>, an interface for reading an infinite stream of records with checkpointing, watermark reporting, and bundle finalization. Read one with <code>beam.io.Read</code> (<a href="https://redirect.github.com/apache/beam/issues/19137";>#19137</a>).</li> <li>(Python) Added <code>Watch</code>, a transform that polls a growing set of outputs for each input element, deduplicates outputs across poll rounds, and stops per a user-supplied termination condition (<a href="https://redirect.github.com/apache/beam/issues/21521";>#21521</a>).</li> <li>(Python) Added support to analyze core dumps created after python worker segmentation faults with <code>pystack</code> (or <code>gdb</code> if installed) using the <code>--profiler_agent=coredump</code> pipeline option. (<a href="https://redirect.github.com/apache/beam/issues/39484";>#39484</a>).</li> <li>(Python) Added <code>Sample.Any</code>, the Python equivalent of Java's <code>Sample.any</code>, which returns up to n arbitrary elements from a PCollection (<a href="https://redirect.github.com/apache/beam/issues/18552";>#18552</a>).</li> </ul> <h3>Breaking Changes</h3> <ul> <li>(Python) Removed <code>google-perftools</code> from the SDK container images. Users who wish to use <code>--profiler_agent=tcmalloc</code> should install google-perftools APT package in their custom container images separately (<a href="https://redirect.github.com/apache/beam/issues/39323";>#39323</a>).</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>apache-beam's changelog</a>.</em></p> <blockquote> <h1>[2.76.0] - 2026-08-31</h1> <h2>Highlights</h2> <ul> <li>Added a full Iceberg batch and streaming changelog source (CDC) (<a href="https://redirect.github.com/apache/beam/issues/38831";>#38831</a>)</li> <li>(Java) Added per-element OpenTelemetry trace propagation across stages in the Dataflow Streaming Runner. Enable it with <code>--experiments=enable_otel_defaults,element_metadata_supported,disable_portable_worker</code>. Cloud Trace incurs additional cost. (<a href="https://redirect.github.com/apache/beam/issues/33176";>#33176</a>)</li> <li>(Java) Added OpenTelemetry header propagation support for both reads and writes in KafkaIO and PubSubIO. (<a href="https://redirect.github.com/apache/beam/issues/33176";>#33176</a>)</li> <li>(Java) Added OpenTelemetry tracing support for SpannerIO change streams (<a href="https://redirect.github.com/apache/beam/issues/33176";>#33176</a>)</li> <li>(Python) JmsIO (IBM MQ, ActiveMQ, and other providers) is now supported in Python via cross-language (<a href="https://redirect.github.com/apache/beam/issues/30716";>#30716</a>).</li> </ul> <h2>I/Os</h2> <ul> <li>Upgraded Iceberg dependency to 1.11.0 (Java) (<a href="https://redirect.github.com/apache/beam/issues/38925";>#38925</a>).</li> <li>Add ArrowFlight IO (Java) (<a href="https://redirect.github.com/apache/beam/issues/20116";>#20116</a>).</li> <li>Added a Delta Lake batch changelog source (CDC) (<a href="https://redirect.github.com/apache/beam/issues/39492";>#39492</a>)</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>Added <code>GroupIntoBatches</code> transform and the standard <code>beam:coder:sharded_key:v1</code> coder to the Go SDK, along with <code>beam.Coder.IsDeterministic</code>, <code>beam.PCollection.WindowingStrategy</code>, and <code>coder.RegisterDeterministicCoder</code> for opt-in deterministic custom coders (Go) (<a href="https://redirect.github.com/apache/beam/issues/19868";>#19868</a>).</li> <li>TriggerStateMachineRunner changes from BitSetCoder to SentinelBitSetCoder to encode finished bitset. SentinelBitSetCoder and BitSetCoder are state compatible. Both coders can decode encoded bytes from the other coder (<a href="https://redirect.github.com/apache/beam/issues/38139";>#38139</a>).</li> <li>(Python) Removed the <code>envoy-data-plane</code> (and transitive <code>betterproto</code>) dependency; <code>EnvoyRateLimiter</code> now uses a small vendored protobuf definition instead, resolving dependency conflicts for downstream projects (<a href="https://redirect.github.com/apache/beam/issues/37854";>#37854</a>).</li> <li>(Java) Supported acknowledge mode for JmsIO (<a href="https://redirect.github.com/apache/beam/issues/39253";>#39253</a>).</li> <li>(Python) Staged files directory is now automatically added to <code>sys.path</code> on the Python SDK worker at startup. This makes Python files provided via the '--files_to_stage' pipeline option importable in the pipeline code and makes it easier to initialize Python SDK harness at startup via the <code>--beam_plugins</code> pipeline option. For more information, see the <a href="https://beam.apache.org/documentation/sdks/python-pipeline-dependencies/#staging-files";>Staging Individual Files</a> section of the dependency management docs. This behavior can be disabled by passing the '--experiments=no_staged_dir_in_sys_path' pipeline option (<a href="https://redirect.github.com/apache/beam/issues/39431";>#39431</a>).</li> <li>(Python) Added <code>equal_to_approx</code>, an <code>assert_that</code> matcher that compares numeric pipeline outputs with a configurable tolerance (<a href="https://redirect.github.com/apache/beam/issues/18028";>#18028</a>).</li> <li>(Python) <code>Timestamp</code> now supports variable subsecond precision, up to nanoseconds. The portable <code>beam:logical_type:timestamp:v1</code> logical type now maps to Python's <code>Timestamp</code> (<a href="https://redirect.github.com/apache/beam/issues/39344";>#39344</a>).</li> <li>(Python) Added <code>UnboundedSource</code>, an interface for reading an infinite stream of records with checkpointing, watermark reporting, and bundle finalization. Read one with <code>beam.io.Read</code> (<a href="https://redirect.github.com/apache/beam/issues/19137";>#19137</a>).</li> <li>(Python) Added <code>Watch</code>, a transform that polls a growing set of outputs for each input element, deduplicates outputs across poll rounds, and stops per a user-supplied termination condition (<a href="https://redirect.github.com/apache/beam/issues/21521";>#21521</a>).</li> <li>(Python) Added support to analyze core dumps created after python worker segmentation faults with <code>pystack</code> (or <code>gdb</code> if installed) using the <code>--profiler_agent=coredump</code> pipeline option. (<a href="https://redirect.github.com/apache/beam/issues/39484";>#39484</a>).</li> </ul> <h2>Breaking Changes</h2> <ul> <li> <p>(Python) Removed <code>google-perftools</code> from the SDK container images. Users who wish to use <code>--profiler_agent=tcmalloc</code> should install google-perftools APT package in their custom container images separately (<a href="https://redirect.github.com/apache/beam/issues/39323";>#39323</a>).</p> </li> <li> <p>[IcebergIO] Reading a <code>timestamptz</code> column will now return a <code>Timestamp.MICROS</code> Beam logical type to preserve microseconds (the old Beam <code>Schema.FieldType#DATETIME</code> primitive type truncates past milliseconds). This may break the following use cases when a <code>timestamptz</code> column is present:</p> <ul> <li>Existing streaming read pipelines.</li> <li>Managed Iceberg batch reads when upgraded from an older SDK.</li> <li>Python reads.</li> </ul> <p>Use pipeline option <code>--updateCompatibilityVersion=2.75.0</code> (or any older version) to keep the old behavior (<a href="https://redirect.github.com/apache/beam/issues/39344";>#39344</a>).</p> </li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/3862626d08b234f127dbf69253b8a9f00904c671";><code>3862626</code></a> Set version for 2.76.0 RC4</li> <li><a href="https://github.com/apache/beam/commit/2c478dc2d1cc0996cb503f153f4905798cc7ab41";><code>2c478dc</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/39838";>#39838</a> from apache/cp-39837</li> <li><a href="https://github.com/apache/beam/commit/f8e3f1859a8a647c082106b4d54f42ff107864a1";><code>f8e3f18</code></a> Cherrypick <a href="https://redirect.github.com/apache/beam/issues/39837";>#39837</a></li> <li><a href="https://github.com/apache/beam/commit/b8429d18910653cef46a4bd0263657f9d12de72e";><code>b8429d1</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/39719";>#39719</a> from ahmedabu98/cp39645</li> <li><a href="https://github.com/apache/beam/commit/900714878ef77b1f07ecf8e1ee478149772087c8";><code>9007148</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/39832";>#39832</a> from parveensania/cherrypick-pr39646</li> <li><a href="https://github.com/apache/beam/commit/7c8159c95fb063b13bfcca13b362e897df734142";><code>7c8159c</code></a> Retrigger checks</li> <li><a href="https://github.com/apache/beam/commit/b4877ceb1553b8b0503b138e50df96d909871a93";><code>b4877ce</code></a> Make primary channel failover timeout configurable (<a href="https://redirect.github.com/apache/beam/issues/39646";>#39646</a>)</li> <li><a href="https://github.com/apache/beam/commit/63850b7f32a01231838cb6f91e07b7d574f696e7";><code>63850b7</code></a> Require google-cloud-bigtable>=2.42.0 and test write error surfacing (<a href="https://redirect.github.com/apache/beam/issues/39820";>#39820</a>)...</li> <li><a href="https://github.com/apache/beam/commit/161ea0b7b49cd1894f9d293687955f3f82d20d07";><code>161ea0b</code></a> Fix stale broken cluster connection in CassandraIO (<a href="https://redirect.github.com/apache/beam/issues/39788";>#39788</a>) (<a href="https://redirect.github.com/apache/beam/issues/39803";>#39803</a>)</li> <li><a href="https://github.com/apache/beam/commit/e6c61df8033e78399bea94585ffefdba5f47689a";><code>e6c61df</code></a> improve documentation</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.75.0...v2.76.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
