This is an automated email from the ASF dual-hosted git repository.
derrickaw pushed a change to branch 20260624_zizmorInitial
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 46e6046bce1 another fix
discard 9bb84c3e30f redo build release candidate workflow after change
discard 61f061cacb2 fix another workflow
discard 062522ee351 add comment
discard 42beba04b3f add rule about action hashes
discard 9e4d607527a Initial zizmor findings
add b2a2e451f80 Bump golang.org/x/net from 0.56.0 to 0.57.0 in /sdks
(#39258)
add dac472292a9 [Iceberg CDC] Add Snapshot Changelog Scanner (#38836)
add f8b0616e7fa [Iceberg CDC] Add watch for snapshots source (#38834)
add 668c6a38f37 (IcebergIO) bugfix: propagate config properties to
RecordWriter (#39250)
add 3d9dbfefc29 Bump google.golang.org/api from 0.287.1 to 0.288.0 in
/sdks (#39275)
add db27f6bf856 Bump cloud.google.com/go/bigquery from 1.77.0 to 1.78.0 in
/sdks (#39277)
add 3e7885d6125 Bump github.com/johannesboyne/gofakes3 in /sdks (#39276)
add 7d682e210f9 Bump httplib2 upper bound to `<1.0.0` (#39280)
add 2c92949b6a0 pass --add-opens to Spark PVR test JVM on Java 21 (#39278)
add 89cc292fc18 Fix Flink runner tests on Java 21 (#39272)
add 0712cf6722d Initial zizmor findings
add 9b519a94fec add rule about action hashes
add fe21a137890 add comment
add 797dc002098 fix another workflow
add 8f78fd98a56 redo build release candidate workflow after change
add acfb341637d another fix
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (46e6046bce1)
\
N -- N -- N refs/heads/20260624_zizmorInitial (acfb341637d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../beam_PostCommit_Java_PVR_Spark3_Streaming.json | 2 +-
.github/trigger_files/beam_PreCommit_Java.json | 2 +-
runners/flink/flink_runner.gradle | 17 +
.../beam/runners/flink/FlinkSubmissionTest.java | 51 +-
.../streaming/io/UnboundedSourceWrapperTest.java | 14 +-
runners/spark/job-server/spark_job_server.gradle | 7 +
sdks/go.mod | 15 +-
sdks/go.sum | 50 +-
.../org/apache/beam/sdk/io/iceberg/IcebergIO.java | 15 +-
.../beam/sdk/io/iceberg/IcebergScanConfig.java | 54 ++
.../IcebergWriteSchemaTransformProvider.java | 12 +
.../org/apache/beam/sdk/io/iceberg/ReadUtils.java | 5 +-
.../apache/beam/sdk/io/iceberg/RecordWriter.java | 24 +-
.../beam/sdk/io/iceberg/RecordWriterManager.java | 14 +-
.../org/apache/beam/sdk/io/iceberg/TableCache.java | 22 +-
.../sdk/io/iceberg/WriteDirectRowsToFiles.java | 15 +-
.../sdk/io/iceberg/WriteGroupedRowsToFiles.java | 17 +-
.../io/iceberg/WritePartitionedRowsToFiles.java | 17 +-
.../beam/sdk/io/iceberg/WriteToDestinations.java | 29 +-
.../beam/sdk/io/iceberg/WriteToPartitions.java | 9 +-
.../sdk/io/iceberg/WriteUngroupedRowsToFiles.java | 16 +-
.../sdk/io/iceberg/cdc/ChangelogDescriptor.java | 106 ++
.../beam/sdk/io/iceberg/cdc/ChangelogScanner.java | 1011 ++++++++++++++++++++
.../sdk/io/iceberg/cdc/WatchForSnapshotsSdf.java | 298 ++++++
.../sdk/io/iceberg/RecordWriterManagerTest.java | 69 ++
.../sdk/io/iceberg/cdc/ChangelogScannerTest.java | 445 +++++++++
.../io/iceberg/cdc/WatchForSnapshotsSdfTest.java | 265 +++++
sdks/python/setup.py | 2 +-
28 files changed, 2507 insertions(+), 96 deletions(-)
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc/ChangelogDescriptor.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc/ChangelogScanner.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/cdc/WatchForSnapshotsSdf.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/cdc/ChangelogScannerTest.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/cdc/WatchForSnapshotsSdfTest.java
