This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from c7b79211856 Merge pull request #28053: Editorial pass on the new
Transform service docs
add 5dd484ea234 Add Java IO Direct jobs: JDBC, Jms, Snowflake (#28021)
add 3d0bc5bdfda Remove fastjson library (#28007)
add c320ea93055 Update CHANGES.md to include 2.51.0 section (#28063)
add 988559dff62 Bump cloud.google.com/go/bigquery from 1.53.0 to 1.54.0 in
/sdks (#28060)
add d2f6058ace6 Updates validation on --dataflow_endpoint to accept any
legal url. (#27959)
No new revisions were added by this update.
Summary of changes:
.github/workflows/README.md | 3 +
....yml => beam_PreCommit_Java_JDBC_IO_Direct.yml} | 27 ++--
...t.yml => beam_PreCommit_Java_Jms_IO_Direct.yml} | 27 ++--
...=> beam_PreCommit_Java_Snowflake_IO_Direct.yml} | 31 +++--
CHANGES.md | 36 +++++
playground/backend/containers/java/Dockerfile | 4 -
sdks/go.mod | 2 +-
sdks/go.sum | 4 +-
sdks/java/extensions/sql/build.gradle | 1 -
sdks/java/extensions/sql/datacatalog/build.gradle | 2 +-
.../provider/datacatalog/BigQueryTableFactory.java | 5 +-
.../meta/provider/datacatalog/GcsTableFactory.java | 4 +-
.../provider/datacatalog/PubsubTableFactory.java | 4 +-
sdks/java/extensions/sql/hcatalog/build.gradle | 1 -
.../meta/provider/hcatalog/DatabaseProvider.java | 2 -
.../apache/beam/sdk/extensions/sql/TableUtils.java | 69 ++++++++++
.../sql/impl/parser/SqlCreateExternalTable.java | 7 +-
.../apache/beam/sdk/extensions/sql/meta/Table.java | 9 +-
.../provider/SchemaIOTableProviderWrapper.java | 7 +-
.../sql/meta/provider/bigquery/BigQueryTable.java | 8 +-
.../provider/bigquery/BigQueryTableProvider.java | 8 +-
.../sql/meta/provider/bigtable/BigtableTable.java | 8 +-
.../meta/provider/kafka/KafkaTableProvider.java | 23 ++--
.../pubsublite/PubsubLiteTableProvider.java | 18 +--
.../provider/seqgen/GenerateSequenceTable.java | 4 +-
.../sql/meta/provider/test/TestTableProvider.java | 4 +-
.../sql/meta/provider/text/TextTableProvider.java | 11 +-
.../extensions/sql/impl/parser/BeamDDLTest.java | 23 ++--
.../rule/BeamAggregateProjectMergeRuleTest.java | 5 +-
.../sql/impl/rule/IOPushDownRuleTest.java | 5 +-
.../provider/SchemaIOTableProviderWrapperTest.java | 4 +-
.../meta/provider/bigquery/BigQueryFilterTest.java | 5 +-
.../bigquery/BigQueryTableProviderTest.java | 14 +-
.../bigquery/BigQueryTestTableProvider.java | 4 +-
.../meta/provider/bigtable/BigtableFilterTest.java | 5 +-
.../provider/bigtable/BigtableTableFlatTest.java | 8 +-
.../provider/kafka/BeamKafkaTableAvroTest.java | 4 +-
.../provider/kafka/BeamKafkaTableJsonTest.java | 4 +-
.../provider/kafka/BeamKafkaTableProtoTest.java | 4 +-
.../provider/kafka/BeamKafkaTableThriftTest.java | 4 +-
.../meta/provider/kafka/KafkaTableProviderIT.java | 4 +-
.../provider/kafka/KafkaTableProviderTest.java | 19 ++-
.../meta/provider/mongodb/MongoDbFilterTest.java | 5 +-
.../provider/pubsub/PubsubTableProviderTest.java | 4 +-
.../pubsublite/PubsubLiteTableProviderTest.java | 4 +-
.../meta/provider/test/TestTableProviderTest.java | 11 +-
...tTableProviderWithFilterAndProjectPushDown.java | 5 +-
.../test/TestTableProviderWithFilterPushDown.java | 5 +-
.../test/TestTableProviderWithProjectPushDown.java | 5 +-
.../sql/meta/store/InMemoryMetaStoreTest.java | 4 +-
sdks/java/extensions/sql/zetasql/build.gradle | 2 +-
.../sql/zetasql/ZetaSQLPushDownTest.java | 5 +-
sdks/java/testing/tpcds/build.gradle | 2 +-
.../apache/beam/sdk/tpcds/BeamSqlEnvRunner.java | 5 +-
.../python/apache_beam/options/pipeline_options.py | 38 ++++--
.../apache_beam/options/pipeline_options_test.py | 99 ++++++++++++++
.../options/pipeline_options_validator.py | 35 ++++-
.../options/pipeline_options_validator_test.py | 149 +++++++++++----------
.../runners/dataflow/dataflow_runner_test.py | 6 +-
.../runners/dataflow/template_runner_test.py | 23 ++--
.../python/apache_beam/transforms/external_test.py | 7 +-
61 files changed, 565 insertions(+), 290 deletions(-)
copy .github/workflows/{beam_PreCommit_Java_Amqp_IO_Direct.yml =>
beam_PreCommit_Java_JDBC_IO_Direct.yml} (78%)
copy .github/workflows/{beam_PreCommit_Java_Csv_IO_Direct.yml =>
beam_PreCommit_Java_Jms_IO_Direct.yml} (78%)
copy .github/workflows/{beam_PreCommit_Java_Cassandra_IO_Direct.yml =>
beam_PreCommit_Java_Snowflake_IO_Direct.yml} (73%)
create mode 100644
sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/TableUtils.java
