This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 13a46356a02 Update Python Dependencies (#38775)
add 7916452e232 Fix internal test configuration for Dataflow client
(#38792)
add a83754a5360 Implements the Delta Lake source with support for
splitting (#38706)
add bec756f89b8 Fix offlineRepositoryRoot relative to Beam repo root
(#38790)
add 41d5dd4f55e Update republish released docker workflow defaults to
2.74.0 (#38796)
add 8346a68b5bc Update beam-master container (#38795)
add 96165fcbc52 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#38801)
add a0c96065833 Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#38804)
No new revisions were added by this update.
Summary of changes:
.../republish_released_docker_containers.yml | 4 +-
.../org/apache/beam/gradle/Repositories.groovy | 4 +-
sdks/go.mod | 36 +-
sdks/go.sum | 72 +--
sdks/java/io/delta/build.gradle | 44 ++
.../org/apache/beam/sdk/io/delta/BeamEngine.java | 55 ++
.../beam/sdk/io/delta/BeamParquetHandler.java | 376 +++++++++++
.../beam/sdk/io/delta/CreateReadTasksDoFn.java | 140 ++++
.../java/org/apache/beam/sdk/io/delta/DeltaIO.java | 92 ++-
.../apache/beam/sdk/io/delta/DeltaReadTask.java | 88 +++
.../beam/sdk/io/delta/DeltaReadTaskTracker.java | 56 ++
.../apache/beam/sdk/io/delta/DeltaSourceDoFn.java | 455 +++++++++++++
.../apache/beam/sdk/io/delta/SerializableRow.java | 544 ++++++++++++++++
.../beam/sdk/io/delta/SerializableStructType.java} | 58 +-
.../org/apache/beam/sdk/io/delta/DeltaIOTest.java | 712 ++++++++++++++++++++-
.../beam/sdk/io/delta/SerializableRowTest.java | 498 ++++++++++++++
.../runners/dataflow/internal/apiclient.py | 2 +-
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
18 files changed, 3144 insertions(+), 94 deletions(-)
create mode 100644
sdks/java/io/delta/src/main/java/org/apache/beam/sdk/io/delta/BeamEngine.java
create mode 100644
sdks/java/io/delta/src/main/java/org/apache/beam/sdk/io/delta/BeamParquetHandler.java
create mode 100644
sdks/java/io/delta/src/main/java/org/apache/beam/sdk/io/delta/CreateReadTasksDoFn.java
create mode 100644
sdks/java/io/delta/src/main/java/org/apache/beam/sdk/io/delta/DeltaReadTask.java
create mode 100644
sdks/java/io/delta/src/main/java/org/apache/beam/sdk/io/delta/DeltaReadTaskTracker.java
create mode 100644
sdks/java/io/delta/src/main/java/org/apache/beam/sdk/io/delta/DeltaSourceDoFn.java
create mode 100644
sdks/java/io/delta/src/main/java/org/apache/beam/sdk/io/delta/SerializableRow.java
copy sdks/java/{core/src/main/java/org/apache/beam/sdk/values/ShardedKey.java
=>
io/delta/src/main/java/org/apache/beam/sdk/io/delta/SerializableStructType.java}
(53%)
create mode 100644
sdks/java/io/delta/src/test/java/org/apache/beam/sdk/io/delta/SerializableRowTest.java
