This is an automated email from the ASF dual-hosted git repository.
chamikara pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from f50c8d503af Deprecate Cloud Debugger and its pipeline options (#25998)
add fc7a240eb4e BigQuery Storage Write API wrapper for Python SDK (#25685)
No new revisions were added by this update.
Summary of changes:
...ommit_Python_CrossLanguage_Gcp_Dataflow.groovy} | 22 +-
...tCommit_Python_CrossLanguage_Gcp_Direct.groovy} | 22 +-
CHANGES.md | 1 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 144 +++++++++++++
.../java/org/apache/beam/sdk/schemas/Schema.java | 6 +-
.../org/apache/beam/sdk/schemas/SchemaTest.java | 1 -
...xpansionServiceSchemaTransformProviderTest.java | 14 +-
.../expansion-service/build.gradle | 1 -
.../io/gcp/bigquery/BeamRowToStorageApiProto.java | 2 +-
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 11 +-
...ueryStorageWriteApiSchemaTransformProvider.java | 60 ++++--
.../gcp/bigquery/BeamRowToStorageApiProtoTest.java | 2 +-
...StorageWriteApiSchemaTransformProviderTest.java | 155 +++++++-------
sdks/python/apache_beam/io/gcp/bigquery.py | 213 ++++++++++++++++--
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 119 +++++++++++
.../apache_beam/io/gcp/bigquery_tools_test.py | 238 +++++++++++++++++++++
.../apache_beam/io/gcp/bigquery_write_it_test.py | 190 ++++++++++++++++
sdks/python/apache_beam/transforms/external.py | 30 +++
.../python/apache_beam/transforms/external_test.py | 43 ++++
sdks/python/pytest.ini | 1 +
sdks/python/test-suites/dataflow/common.gradle | 24 +++
sdks/python/test-suites/direct/common.gradle | 25 +++
.../test-suites/{direct => }/xlang/build.gradle | 57 +++--
settings.gradle.kts | 1 +
24 files changed, 1207 insertions(+), 175 deletions(-)
copy
.test-infra/jenkins/{job_PostCommit_CrossLanguageValidatesRunner_PythonUsingJava_Dataflow.groovy
=> job_PostCommit_Python_CrossLanguage_Gcp_Dataflow.groovy} (67%)
copy
.test-infra/jenkins/{job_PostCommit_CrossLanguageValidatesRunner_PythonUsingJava_Dataflow.groovy
=> job_PostCommit_Python_CrossLanguage_Gcp_Direct.groovy} (68%)
copy sdks/python/test-suites/{direct => }/xlang/build.gradle (59%)
