This is an automated email from the ASF dual-hosted git repository.
Amar3tto pushed a change to branch release-2.77
in repository https://gitbox.apache.org/repos/asf/beam.git
from b692dd1d502 Merge pull request #40247: [release-2.77] [Spanner Change
Streams] Leave tracker at last claimed position instead of artificial query end
timestamp
add 125e65f1866 AddFiles: Add dry_run (#40167)
new 670e12184a7 Merge pull request #40255 from claudevdm/cp-40167
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../IO_Iceberg_Integration_Tests.json | 2 +-
.../org/apache/beam/sdk/io/iceberg/AddFiles.java | 119 ++--
.../iceberg/AddFilesSchemaTransformProvider.java | 41 +-
.../beam/sdk/io/iceberg/CommitSchemaOnce.java | 25 +-
.../beam/sdk/io/iceberg/CommitSchemaUnion.java | 671 +++++++--------------
.../apache/beam/sdk/io/iceberg/DryRunReport.java | 434 +++++++++++++
.../beam/sdk/io/iceberg/ReadFooterSchema.java | 33 +-
.../apache/beam/sdk/io/iceberg/SchemaDelta.java | 9 +-
.../beam/sdk/io/iceberg/SchemaEvolutionConfig.java | 34 +-
.../org/apache/beam/sdk/io/iceberg/SchemaPlan.java | 618 +++++++++++++++++++
.../AddFilesSchemaTransformProviderTest.java | 14 +
.../apache/beam/sdk/io/iceberg/AddFilesTest.java | 347 ++++++++++-
.../beam/sdk/io/iceberg/CommitSchemaOnceTest.java | 14 +-
.../beam/sdk/io/iceberg/CommitSchemaUnionTest.java | 345 +++++------
.../beam/sdk/io/iceberg/ReadFooterSchemaTest.java | 2 +-
.../sdk/io/iceberg/SchemaEvolutionConfigTest.java | 10 +
.../apache/beam/sdk/io/iceberg/SchemaPlanTest.java | 325 ++++++++++
sdks/python/apache_beam/yaml/standard_io.yaml | 1 +
.../yaml/tests/iceberg_add_files_dry_run.yaml | 185 ++++++
19 files changed, 2475 insertions(+), 754 deletions(-)
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/DryRunReport.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/SchemaPlan.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/SchemaPlanTest.java
create mode 100644
sdks/python/apache_beam/yaml/tests/iceberg_add_files_dry_run.yaml
