This is an automated email from the ASF dual-hosted git repository. Amar3tto pushed a commit to branch website-2-75 in repository https://gitbox.apache.org/repos/asf/beam.git
commit 80d0f450e979a809379d7d714e34308fe5b8761f Author: Vitaly Terentyev <[email protected]> AuthorDate: Wed Jul 1 16:00:29 2026 +0400 Update Beam website to release 2.75.0 --- CHANGES.md | 14 +---- website/www/site/config.toml | 2 +- website/www/site/content/en/blog/beam-2.75.0.md | 72 ++++++++++++++++++++++ .../www/site/content/en/get-started/downloads.md | 18 ++++-- 4 files changed, 87 insertions(+), 19 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index e20194f9ab0..74c6deecf59 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -55,18 +55,16 @@ * ([#X](https://github.com/apache/beam/issues/X)). --> -# [2.75.0] - Unreleased +# [2.75.0] - 2026-07-?? ## Highlights * Python SDK now supports memory profiling with Memray ([#38853](https://github.com/apache/beam/issues/38853)). * (Python) Added [Qdrant](https://qdrant.tech/) VectorDatabaseWriteConfig implementation ([#38141](https://github.com/apache/beam/issues/38141)). - ## I/Os * Support for reading from Delta Lake added (Java) ([#38551](https://github.com/apache/beam/issues/38551)). -* Support for X source added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)). * ClickHouseIO: support writing `DateTime64(precision[, 'timezone'])` columns with sub-second precision (Java) ([#38466](https://github.com/apache/beam/issues/38466)). * Upgraded IO Expansion Service to Java 17 ([#38974](https://github.com/apache/beam/issues/38974)). @@ -89,24 +87,14 @@ use pipeline option `--exclude_infer_dataclass_field_type` ([#38797](https://github.com/apache/beam/issues/38797)). However fixing forward is recommended. -## Deprecations - -* X behavior is deprecated and will be removed in X versions ([#X](https://github.com/apache/beam/issues/X)). - ## Bugfixes * Fixed GCS filesystem glob matching to correctly handle `/` in object names and support `**` for recursive matching (Go) ([#38059](https://github.com/apache/beam/issues/38059)). * Fixed BigQueryEnrichmentHandler batch mode dropping earlier requests when multiple requests share the same enrichment key (Python) ([#38035](https://github.com/apache/beam/issues/38035)). * Fixed IcebergIO writing manifest column bounds padded with trailing `0x00` bytes, which broke equality predicate pushdown in some query engines (Java) ([#38580](https://github.com/apache/beam/issues/38580)). -## Security Fixes - -* Fixed [CVE-YYYY-NNNN](https://www.cve.org/CVERecord?id=CVE-YYYY-NNNN) (Java/Python/Go) ([#X](https://github.com/apache/beam/issues/X)). - ## Known Issues -[comment]: # ( When updating known issues after release, make sure also update website blog in website/www/site/content/blog.) -* ([#X](https://github.com/apache/beam/issues/X)). * (Java) Projects using the Flink runner with Flink 2.1 or later alongside libraries requiring `org.lz4:lz4-java` (e.g., Kafka clients) may encounter a Gradle capability conflict, because Flink 2.1+ ships `at.yawk.lz4:lz4-java` which declares the same capability. To resolve, add a `capabilitiesResolution` rule to your `build.gradle` that selects `at.yawk.lz4:lz4-java` ([#38947](https://github.com/apache/beam/issues/38947)). # [2.74.0] - 2026-06-02 diff --git a/website/www/site/config.toml b/website/www/site/config.toml index 9b6caf2dd65..e4dfa0e3fa5 100644 --- a/website/www/site/config.toml +++ b/website/www/site/config.toml @@ -104,7 +104,7 @@ github_project_repo = "https://github.com/apache/beam"; [params] description = "Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud service). Be [...] -release_latest = "2.74.0" +release_latest = "2.75.0" # The repository and branch where the files live in Github or Colab. This is used # to serve and stage from your local branch, but publish to the master branch. # e.g. https://github.com/{{< param branch_repo >}}/path/to/notebook.ipynb diff --git a/website/www/site/content/en/blog/beam-2.75.0.md b/website/www/site/content/en/blog/beam-2.75.0.md new file mode 100644 index 00000000000..64a7121b3fc --- /dev/null +++ b/website/www/site/content/en/blog/beam-2.75.0.md @@ -0,0 +1,72 @@ +--- +title: "Apache Beam 2.75.0" +date: 2026-07-?? 14:00:00 -0500 +categories: + - blog + - release +authors: + - vterentev +--- +<!-- +Licensed under the Apache License, Version 2.0 (the "License"); +you may not use this file except in compliance with the License. +You may obtain a copy of the License at +http://www.apache.org/licenses/LICENSE-2.0 +Unless required by applicable law or agreed to in writing, software +distributed under the License is distributed on an "AS IS" BASIS, +WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +See the License for the specific language governing permissions and +limitations under the License. +--> + +We are happy to present the new 2.75.0 release of Beam. +This release includes both improvements and new functionality. +See the [download page](/get-started/downloads/#2750-2026-07-??) for this release. + +<!--more--> + +For more information on changes in 2.75.0, check out the [detailed release notes](https://github.com/apache/beam/milestone/43). + +## Highlights + +* Python SDK now supports memory profiling with Memray ([#38853](https://github.com/apache/beam/issues/38853)). +* (Python) Added [Qdrant](https://qdrant.tech/) VectorDatabaseWriteConfig implementation ([#38141](https://github.com/apache/beam/issues/38141)). + +### I/Os + +* Support for reading from Delta Lake added (Java) ([#38551](https://github.com/apache/beam/issues/38551)). +* ClickHouseIO: support writing `DateTime64(precision[, 'timezone'])` columns with sub-second precision (Java) ([#38466](https://github.com/apache/beam/issues/38466)). +* Upgraded IO Expansion Service to Java 17 ([#38974](https://github.com/apache/beam/issues/38974)). + +### New Features / Improvements + +* Dataflow Runner v2 has been renamed to Dataflow Portable Runner. Please refer to Dataflow [public documentation](https://docs.cloud.google.com/dataflow/docs/runner-v2) on when to enable Portable Runner.([#39000](https://github.com/apache/beam/issues/39000)). +* (Java) Enabled state tag encoding v2 by default for new Dataflow Streaming Engine jobs. It can be disabled by passing `--experiments=disable_streaming_engine_state_tag_encoding_v2` or `--updateCompatibilityVersion=2.74.0` pipeline option. Note that the tag encoding version cannot change during a job update. Jobs using tag encoding v2 (enabled by default for new jobs on 2.75.0+) cannot be downgraded to Beam versions prior to 2.73.0, as only versions 2.73.0 and later support tag encoding [...] +* (Python) Added instrumentation to support off-the-shelf profiling agents when launching Python SDK Harness ([#38853](https://github.com/apache/beam/issues/38853)). +* (Java) Added support to the FnApi Data stream protocol allowing runners to isolate bundles slowly processing input from other bundles. ([#39001](https://github.com/apache/beam/issues/39001)). +* (YAML) Switched js2py library to Quickjs ([#38473](https://github.com/apache/beam/issues/38473)). +* (YAML) Added HuggingFaceModelHandler for YAML usage ([#38696](https://github.com/apache/beam/issues/38696)). +* (YAML) Added WriteToMongoDB transform ([#38376](https://github.com/apache/beam/issues/38376)). +* (YAML) Added WriteToDatadog transform ([#38362](https://github.com/apache/beam/issues/38362)). +* (Java) Flink 2.1 and 2.2 support is added ([#38947](https://github.com/apache/beam/issues/38947)) ([#38978](https://github.com/apache/beam/issues/38978)); Flink 1.17 and 1.18 support is dropped. +* (Python) MqttIO is now supported in Python via cross-language ([#21060](https://github.com/apache/beam/issues/21060)). + +### Breaking Changes + +* (Python) Typehints of dataclass fields are honored during type inferences. To restore the behavior of fallback-to-any, + use pipeline option `--exclude_infer_dataclass_field_type` ([#38797](https://github.com/apache/beam/issues/38797)). + However fixing forward is recommended. + +### Bugfixes + +* Fixed GCS filesystem glob matching to correctly handle `/` in object names and support `**` for recursive matching (Go) ([#38059](https://github.com/apache/beam/issues/38059)). +* Fixed BigQueryEnrichmentHandler batch mode dropping earlier requests when multiple requests share the same enrichment key (Python) ([#38035](https://github.com/apache/beam/issues/38035)). +* Fixed IcebergIO writing manifest column bounds padded with trailing `0x00` bytes, which broke equality predicate pushdown in some query engines (Java) ([#38580](https://github.com/apache/beam/issues/38580)). + +### Known Issues + +* (Java) Projects using the Flink runner with Flink 2.1 or later alongside libraries requiring `org.lz4:lz4-java` (e.g., Kafka clients) may encounter a Gradle capability conflict, because Flink 2.1+ ships `at.yawk.lz4:lz4-java` which declares the same capability. To resolve, add a `capabilitiesResolution` rule to your `build.gradle` that selects `at.yawk.lz4:lz4-java` ([#38947](https://github.com/apache/beam/issues/38947)). + +According to git shortlog, the following people contributed to the 2.75.0 release. Thank you to all contributors! + +Abdelrahman Ibrahim, Ahmed Abualsaud, Akshat, Andrew Crites, Andrew Kabas, Anurag Pappula, Arpit Jain, Arun Pandian, Atharv, Chamikara Jayalath, Danny McCormick, Deji Ibrahim, Derrick Williams, Drew Stevens, Durgaprasad M L, Elia Liu, Enzo Maruffa Moreira, Ganesh Sivakumar, Goutam Adwant, HansMarcus01, Jack McCluskey, Joe Santos, Kenneth Knowles, Lalit Yadav, Liam Miller-Cushon, Maciej Szwaja, Manan Mangal, Michael Gruschke, Nikita Grover, Radek Stankiewicz, Radosław Stankiewicz, Reuven [...] diff --git a/website/www/site/content/en/get-started/downloads.md b/website/www/site/content/en/get-started/downloads.md index 61cc6bfe464..f7e9fa0aeb1 100644 --- a/website/www/site/content/en/get-started/downloads.md +++ b/website/www/site/content/en/get-started/downloads.md @@ -95,16 +95,24 @@ versions denoted `0.x.y`. ### Current release -#### 2.74.0 (2026-06-02) +#### 2.75.0 (2026-07-??) -Official [source code download](https://www.apache.org/dyn/closer.lua/beam/2.74.0/apache-beam-2.74.0-source-release.zip). -[SHA-512](https://downloads.apache.org/beam/2.74.0/apache-beam-2.74.0-source-release.zip.sha512). -[signature](https://downloads.apache.org/beam/2.74.0/apache-beam-2.74.0-source-release.zip.asc). +Official [source code download](https://www.apache.org/dyn/closer.lua/beam/2.75.0/apache-beam-2.75.0-source-release.zip). +[SHA-512](https://downloads.apache.org/beam/2.75.0/apache-beam-2.75.0-source-release.zip.sha512). +[signature](https://downloads.apache.org/beam/2.75.0/apache-beam-2.75.0-source-release.zip.asc). -[Release notes](https://github.com/apache/beam/releases/tag/v2.74.0) +[Release notes](https://github.com/apache/beam/releases/tag/v2.75.0) ### Archived releases +#### 2.74.0 (2026-06-02) + +Official [source code download](https://archive.apache.org/dist/beam/2.74.0/apache-beam-2.74.0-source-release.zip). +[SHA-512](https://archive.apache.org/dist/beam/2.74.0/apache-beam-2.74.0-source-release.zip.sha512). +[signature](https://archive.apache.org/dist/beam/2.74.0/apache-beam-2.74.0-source-release.zip.asc). + +[Release notes](https://github.com/apache/beam/releases/tag/v2.74.0) + #### 2.73.0 (2026-04-29) Official [source code download](https://archive.apache.org/dist/beam/2.73.0/apache-beam-2.73.0-source-release.zip).
