This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 351664567de Try deepcopy combine_fn and fallback to pickling if
TypeError. (#32645)
add 9ceb14e23f4 [Managed Iceberg] Add support for TIMESTAMP, TIME, and
DATE types (#32688)
add 95bf98338a2 Add support for Read with Meatadata in `MqttIO` (#32668)
add ec0f2f6b933 Attempt to fix the permred "PostCommit Java IO Performance
Tests" (#32736)
add 75d804c1acb Add Application Default Authentication as an Option for
Kafka Clients in KafkaIO When Using Managed Service for Apache Kafka (#32722)
add 538db45b3be Remove setup-gcloud as they are not in java_tests and
python_tests (#32741)
add 38ecfa9bb94 Fix the FlinkRunner for Dataproc
add 2049e6b6a58 Merge pull request #32737 from liferoad/dataproc-notebook
add 4cf99ea31aa Add check to avro and kafka compatibility tests (#32698)
add 84aa5ac4a77 Fix the snapshot publishing script (#32744)
add 42a0d20ed29 Update Pydoc Dependencies
add f646944ae70 Bump rtd theme
add 8c944ca4ec7 Remove warning fail
add fefd18475ef fix broken imports
add 255e6cc42a9 fix edge case
add 5f4342bb348 Merge pull request #32747 from apache/pydocUpdate
add 02241acca4e fixed the tox and pyproject settings for numpy 2
add 7bb3aa8669e retry the subprocess to start the server
add d629485d21d revert the retry
add ae563183a5d Merge pull request #32745 from liferoad/numpy-2-fix
No new revisions were added by this update.
Summary of changes:
.../IO_Iceberg_Integration_Tests.json | 2 +-
.../beam_PostCommit_Java_IO_Performance_Tests.yml | 8 +-
CHANGES.md | 2 +
.../beam/gradle/kafka/KafkaTestUtilities.groovy | 4 +-
sdks/java/extensions/avro/build.gradle | 1 +
.../avro/AvroVersionVerificationTest.java} | 22 +--
.../sdk/io/iceberg/hive/IcebergHiveCatalogIT.java | 12 ++
.../org/apache/beam/sdk/io/iceberg/IcebergIO.java | 34 ++++-
.../apache/beam/sdk/io/iceberg/IcebergUtils.java | 166 ++++++++++++++++++---
.../apache/beam/sdk/io/iceberg/IcebergIOIT.java | 15 +-
.../beam/sdk/io/iceberg/IcebergUtilsTest.java | 166 ++++++++++++++++++---
sdks/java/io/kafka/build.gradle | 3 +
sdks/java/io/kafka/kafka-integration-test.gradle | 6 +-
.../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 37 +++++
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 14 +-
.../org/apache/beam/sdk/io/kafka/KafkaIOIT.java | 71 +++++++++
.../org/apache/beam/sdk/io/kafka/KafkaIOTest.java | 17 +++
.../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java | 5 +
.../java/org/apache/beam/sdk/io/mqtt/MqttIO.java | 163 ++++++++++++++++----
.../org/apache/beam/sdk/io/mqtt/MqttRecord.java} | 29 ++--
.../org/apache/beam/sdk/io/mqtt/MqttIOTest.java | 78 +++++++++-
sdks/python/apache_beam/dataframe/frame_base.py | 15 ++
.../dataproc/dataproc_cluster_manager.py | 4 +-
.../runners/interactive/interactive_beam.py | 7 +-
sdks/python/pyproject.toml | 2 +-
sdks/python/scripts/generate_pydoc.sh | 7 +-
sdks/python/scripts/run_snapshot_publish.sh | 4 +-
sdks/python/setup.py | 6 +-
sdks/python/tox.ini | 9 +-
29 files changed, 775 insertions(+), 134 deletions(-)
copy
sdks/java/{core/src/test/java/org/apache/beam/sdk/options/RemoteEnvironmentOptionsTest.java
=>
extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/AvroVersionVerificationTest.java}
(63%)
copy sdks/java/{core/src/main/java/org/apache/beam/sdk/schemas/io/Failure.java
=> io/mqtt/src/main/java/org/apache/beam/sdk/io/mqtt/MqttRecord.java} (65%)
