dependabot[bot] opened a new pull request, #146: URL: https://github.com/apache/beam-starter-java/pull/146
Bumps [org.apache.beam:beam-runners-direct-java](https://github.com/apache/beam) from 2.66.0 to 2.67.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>org.apache.beam:beam-runners-direct-java's releases</a>.</em></p> <blockquote> <h2>Beam 2.67.0 release</h2> <p>We are happy to present the new 2.67.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://github.com/apache/beam/blob/HEAD/get-started/downloads/#2670-2025-08-12";>download page</a> for this release.</p> <!-- raw HTML omitted --> <p>For more information on changes in 2.67.0, check out the <a href="https://github.com/apache/beam/milestone/35?closed=1";>detailed release notes</a>.</p> <h2>Highlights</h2> <h3>I/Os</h3> <ul> <li>Debezium IO upgraded to 3.1.1 requires Java 17 (Java) (<a href="https://redirect.github.com/apache/beam/issues/34747";>#34747</a>).</li> <li>Add support for streaming writes in IOBase (Python)</li> <li>Implement support for streaming writes in FileBasedSink (Python)</li> <li>Expose support for streaming writes in TextIO (Python)</li> </ul> <h3>New Features / Improvements</h3> <ul> <li>Added support for Processing time Timer in the Spark Classic runner (<a href="https://redirect.github.com/apache/beam/issues/33633";>#33633</a>).</li> <li>Add pip-based install support for JupyterLab Sidepanel extension (<a href="https://redirect.github.com/apache/beam/issues/%5B#35397%5D(https://redirect.github.com/apache/beam/issues/35397)">#35397</a>).</li> <li>[IcebergIO] Create tables with a specified table properties (<a href="https://redirect.github.com/apache/beam/pull/35496";>#35496</a>)</li> <li>Add support for comma-separated options in Python SDK (Python) (<a href="https://redirect.github.com/apache/beam/pull/35580";>#35580</a>). Python SDK now supports comma-separated values for experiments and dataflow_service_options, matching Java SDK behavior while maintaining backward compatibility.</li> <li>Milvus enrichment handler added (Python) (<a href="https://redirect.github.com/apache/beam/pull/35216";>#35216</a>). Beam now supports Milvus enrichment handler capabilities for vector, keyword, and hybrid search operations.</li> <li>[Beam SQL] Add support for DATABASEs, with an implementation for Iceberg (<a href="https://redirect.github.com/apache/beam/issues/35637";>#35637</a>)</li> <li>Respect BatchSize and MaxBufferingDuration when using <code>JdbcIO.WriteWithResults</code>. Previously, these settings were ignored (<a href="https://redirect.github.com/apache/beam/pull/35669";>#35669</a>).</li> </ul> <h3>Breaking Changes</h3> <ul> <li>Go: The pubsubio.Read transform now accepts ReadOptions as a value type instead of a pointer, and requires exactly one of Topic or Subscription to be set (they are mutually exclusive). Additionally, the ReadOptions struct now includes a Topic field for specifying the topic directly, replacing the previous topic parameter in the Read function signature (<a href="https://redirect.github.com/apache/beam/issues/35369";>#35369</a>)(<a href="https://redirect.github.com/apache/beam/pull/35369";>apache/beam#35369</a>).</li> <li>SQL: The <code>ParquetTable</code> external table provider has changed its handling of the <code>LOCATION</code> property. To read from a directory, the path must now end with a trailing slash (e.g., <code>LOCATION '/path/to/data/'</code>). Previously, a trailing slash was not required. This change was made to enable support for glob patterns and single-file paths (<a href="https://redirect.github.com/apache/beam/issues/35582";>#35582</a>)(<a href="https://redirect.github.com/apache/beam/pull/35582";>apache/beam#35582</a>).</li> </ul> <h3>Bugfixes</h3> <ul> <li>[YAML] Fixed handling of missing optional fields in JSON parsing (<a href="https://redirect.github.com/apache/beam/issues/35179";>#35179</a>).</li> <li>[Python] Fix WriteToBigQuery transform using CopyJob does not work with WRITE_TRUNCATE write disposition (<a href="https://redirect.github.com/apache/beam/issues/34247";>#34247</a>)</li> <li>[Python] Fixed dicomio tags mismatch in integration tests (<a href="https://redirect.github.com/apache/beam/issues/30760";>#30760</a>).</li> <li>[Java] Fixed spammy logging issues that affected versions 2.64.0 to 2.66.0.</li> </ul> <h3>Known Issues</h3> <ul> <li>(<a href="https://redirect.github.com/apache/beam/issues/35666";>#35666</a>). YAML Flatten incorrectly drops fields when input PCollections' schema are different. This issue exists for all versions since 2.52.0.</li> </ul> <h2>List of Contributors</h2> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>org.apache.beam:beam-runners-direct-java's changelog</a>.</em></p> <blockquote> <h1>[2.67.0] - 2025-08-12</h1> <h2>Highlights</h2> <h2>I/Os</h2> <ul> <li>Debezium IO upgraded to 3.1.1 requires Java 17 (Java) (<a href="https://redirect.github.com/apache/beam/issues/34747";>#34747</a>).</li> <li>Add support for streaming writes in IOBase (Python)</li> <li>Add IT test for streaming writes for IOBase (Python)</li> <li>Implement support for streaming writes in FileBasedSink (Python)</li> <li>Expose support for streaming writes in AvroIO (Python)</li> <li>Expose support for streaming writes in ParquetIO (Python)</li> <li>Expose support for streaming writes in TextIO (Python)</li> <li>Expose support for streaming writes in TFRecordsIO (Python)</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>Added support for Processing time Timer in the Spark Classic runner (<a href="https://redirect.github.com/apache/beam/issues/33633";>#33633</a>).</li> <li>Add pip-based install support for JupyterLab Sidepanel extension (<a href="https://redirect.github.com/apache/beam/issues/35397";>#35397</a>).</li> <li>[IcebergIO] Create tables with a specified table properties (<a href="https://redirect.github.com/apache/beam/pull/35496";>#35496</a>)</li> <li>Add support for comma-separated options in Python SDK (Python) (<a href="https://redirect.github.com/apache/beam/pull/35580";>#35580</a>). Python SDK now supports comma-separated values for experiments and dataflow_service_options, matching Java SDK behavior while maintaining backward compatibility.</li> <li>Milvus enrichment handler added (Python) (<a href="https://redirect.github.com/apache/beam/pull/35216";>#35216</a>). Beam now supports Milvus enrichment handler capabilities for vector, keyword, and hybrid search operations.</li> <li>[Beam SQL] Add support for DATABASEs, with an implementation for Iceberg (<a href="https://redirect.github.com/apache/beam/issues/35637";>#35637</a>)</li> <li>Respect BatchSize and MaxBufferingDuration when using <code>JdbcIO.WriteWithResults</code>. Previously, these settings were ignored (<a href="https://redirect.github.com/apache/beam/pull/35669";>#35669</a>).</li> <li>BigTableWrite Connector for BeamYaml added with mutation feature (<a href="https://redirect.github.com/apache/beam/pull/35435";>#35435</a>)</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Go: The pubsubio.Read transform now accepts ReadOptions as a value type instead of a pointer, and requires exactly one of Topic or Subscription to be set (they are mutually exclusive). Additionally, the ReadOptions struct now includes a Topic field for specifying the topic directly, replacing the previous topic parameter in the Read function signature (<a href="https://redirect.github.com/apache/beam/pull/35369";>#35369</a>).</li> <li>SQL: The <code>ParquetTable</code> external table provider has changed its handling of the <code>LOCATION</code> property. To read from a directory, the path must now end with a trailing slash (e.g., <code>LOCATION '/path/to/data/'</code>). Previously, a trailing slash was not required. This change was made to enable support for glob patterns and single-file paths (<a href="https://redirect.github.com/apache/beam/pull/35582";>#35582</a>).</li> </ul> <h2>Bugfixes</h2> <ul> <li>[YAML] Fixed handling of missing optional fields in JSON parsing (<a href="https://redirect.github.com/apache/beam/issues/35179";>#35179</a>).</li> <li>[Python] Fix WriteToBigQuery transform using CopyJob does not work with WRITE_TRUNCATE write disposition (<a href="https://redirect.github.com/apache/beam/issues/34247";>#34247</a>)</li> <li>[Python] Fixed dicomio tags mismatch in integration tests (<a href="https://redirect.github.com/apache/beam/issues/30760";>#30760</a>).</li> <li>[Java] Fixed spammy logging issues that affected versions 2.64.0 to 2.66.0.</li> </ul> <h2>Known Issues</h2> <ul> <li>(<a href="https://redirect.github.com/apache/beam/issues/35666";>#35666</a>). YAML Flatten incorrectly drops fields when input PCollections' schema are different. This issue exists for all versions since 2.52.0.</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/ab2b8d3fa9b1eecb30f6ae1fa87be16feb677957";><code>ab2b8d3</code></a> Set version for 2.67.0 RC2</li> <li><a href="https://github.com/apache/beam/commit/0ec6e01c47575a6477417ec8f28fabea509719c2";><code>0ec6e01</code></a> Fix BeamSQL CalcRel DATETIME expression (<a href="https://redirect.github.com/apache/beam/issues/35743";>#35743</a>) (<a href="https://redirect.github.com/apache/beam/issues/35799";>#35799</a>)</li> <li><a href="https://github.com/apache/beam/commit/3327e2e3b87f8f762e06e5f4f3dfc06f91ca1075";><code>3327e2e</code></a> Cherrypick <a href="https://redirect.github.com/apache/beam/issues/35789";>#35789</a> for 2.67.0: Fix timestamp issue in a yaml pipeline that cal...</li> <li><a href="https://github.com/apache/beam/commit/2306debefcbe5abeb1a335471c2343a0e1627afb";><code>2306deb</code></a> Fix timestamp issue in a yaml pipeline that calls SQL transform (<a href="https://redirect.github.com/apache/beam/issues/35789";>#35789</a>)</li> <li><a href="https://github.com/apache/beam/commit/97d40eeb1ddf766ee0b0a588ddf37e60c8f4752f";><code>97d40ee</code></a> [Cherrypick] Fix PostCommit Python job (<a href="https://redirect.github.com/apache/beam/issues/35709";>#35709</a>)</li> <li><a href="https://github.com/apache/beam/commit/34bb3adb1aca514940769c931791a05b27f8a9bf";><code>34bb3ad</code></a> Fix PostCommit Python job (<a href="https://redirect.github.com/apache/beam/issues/35709";>#35709</a>)</li> <li><a href="https://github.com/apache/beam/commit/bd6a10ab05a3d41bb95e55dc09747c87df47ecda";><code>bd6a10a</code></a> Remove tox dependency (<a href="https://redirect.github.com/apache/beam/issues/35687";>#35687</a>)</li> <li><a href="https://github.com/apache/beam/commit/d653c115e30992d6188553436e7850cd4bf43c94";><code>d653c11</code></a> docs: update known issues in CHANGES.md with YAML Flatten bug (<a href="https://redirect.github.com/apache/beam/issues/35681";>#35681</a>)</li> <li><a href="https://github.com/apache/beam/commit/0cba5340257dad3ad733b8f11d9fd4fe9325213f";><code>0cba534</code></a> docs: update known issues in CHANGES.md with YAML Flatten bug (<a href="https://redirect.github.com/apache/beam/issues/35678";>#35678</a>)</li> <li><a href="https://github.com/apache/beam/commit/aaaf2b2ae5c3701a9392b55d98085f20d432aa08";><code>aaaf2b2</code></a> Cherrypick <a href="https://redirect.github.com/apache/beam/issues/35669";>#35669</a> onto the release branch (<a href="https://redirect.github.com/apache/beam/issues/35674";>#35674</a>)</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.66.0...v2.67.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
