This is an automated email from the ASF dual-hosted git repository.
janl pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 3d651eb51dd Bump google.golang.org/protobuf from 1.36.3 to 1.36.4 in
/sdks (#33769)
add 73d254bf824 [Spark] Restore memory sensitive GBK translation (#33520)
(#33521)
No new revisions were added by this update.
Summary of changes:
.../batch/GroupByKeyTranslatorBatch.java | 18 ++---
.../translation/batch/GroupByKeyTest.java | 23 ++++++-
.../runners/spark/SparkCommonPipelineOptions.java | 9 +++
.../org/apache/beam/runners/spark/SparkRunner.java | 4 ++
.../spark/translation/EvaluationContext.java | 25 +++++++
.../spark/translation/GroupByKeyVisitor.java | 77 ++++++++++++++++++++++
.../spark/translation/TransformTranslator.java | 54 +++++++++------
.../spark/translation/GroupByKeyVisitorTest.java | 71 ++++++++++++++++++++
8 files changed, 249 insertions(+), 32 deletions(-)
create mode 100644
runners/spark/src/main/java/org/apache/beam/runners/spark/translation/GroupByKeyVisitor.java
create mode 100644
runners/spark/src/test/java/org/apache/beam/runners/spark/translation/GroupByKeyVisitorTest.java
