This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from e336419205c Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#36867)
add 8ef3a2446bc Change KafkaIO to default to offset-based deduplication
when redistribute is enabled for Dataflow java runner. (#36849)
add 3d5d04b9f39 Enable some advanced state validates runner tests for
dataflow legacy and v2. (#36808)
add b0b67bf0796 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#36872)
add 62ffc638bcb Fix DROP IF NOT EXISTS statement
add 4970cba9482 Merge pull request #36863: Fix DROP IF NOT EXISTS statement
add 7f499788a40 Add Iceberg Schema Support for PassThroughLogicalType
(#36870)
add b20ccbfe3ef [2/3] sdks/python: sink data with Milvus Search I/O
connector (#36729)
No new revisions were added by this update.
Summary of changes:
...m_PostCommit_Java_ValidatesRunner_Dataflow.json | 5 +-
...it_Java_ValidatesRunner_Dataflow_Streaming.json | 7 +-
...ostCommit_Java_ValidatesRunner_Dataflow_V2.json | 7 +-
...Java_ValidatesRunner_Dataflow_V2_Streaming.json | 5 +-
CHANGES.md | 2 +
runners/google-cloud-dataflow-java/build.gradle | 9 +-
.../beam/runners/dataflow/DataflowRunner.java | 4 +
.../KafkaReadWithRedistributeOverride.java | 75 +++
.../KafkaReadWithRedistributeOverrideTest.java | 133 +++++
sdks/go.mod | 2 +-
sdks/go.sum | 4 +-
.../beam/sdk/schemas/logicaltypes/SqlTypes.java | 4 +
.../extensions/sql/impl/parser/SqlDropObject.java | 6 +-
.../apache/beam/sdk/io/iceberg/IcebergUtils.java | 16 +-
.../beam/sdk/io/iceberg/IcebergUtilsTest.java | 103 ++++
.../apache_beam/ml/rag/ingestion/milvus_search.py | 346 +++++++++++
.../ml/rag/ingestion/milvus_search_it_test.py | 635 +++++++++++++++++++++
.../ml/rag/ingestion/milvus_search_test.py | 123 ++++
.../ml/rag/ingestion/postgres_common.py | 37 ++
19 files changed, 1492 insertions(+), 31 deletions(-)
create mode 100644
runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/KafkaReadWithRedistributeOverride.java
create mode 100644
runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/KafkaReadWithRedistributeOverrideTest.java
create mode 100644 sdks/python/apache_beam/ml/rag/ingestion/milvus_search.py
create mode 100644
sdks/python/apache_beam/ml/rag/ingestion/milvus_search_it_test.py
create mode 100644
sdks/python/apache_beam/ml/rag/ingestion/milvus_search_test.py
