This is an automated email from the ASF dual-hosted git repository.
pabloem pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from bac1733 Merge pull request #10311: [BEAM-8810] Detect stuck commits
in StreamingDataflowWorker
new 112ed5e [BEAM-1440] Provide functions for waiting for BQ job and
exporting tables
new 786c6ae [BEAM-1440] Create _BigQuerySource that implements
iobase.BoundedSource
new 4861a92 [BEAM-1440] Reorganised BigQuery read IT tests
new 6d19d84 [BEAM-1440] Create postCommitIT jobs running on Flink Runner
new fa0abda [BEAM-1440] Convert strings to bytes on Python 3 if field
type is BYTES
new 437321e [BEAM-1440]: Support RECORD fields in coder
new e06b769 [BEAM-1440] Remove json files after reading
new 4480238 [BEAM-1440] Marked classes as private
new 82db02d [BEAM-1440] Do not force to create temp dataset when using
dry run
new 605c59b Merge pull request #9772 from kamilwu/bounded-source-for-bq
The 24719 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
sdks/python/apache_beam/io/gcp/bigquery.py | 325 +++++++++++++++++++++
.../apache_beam/io/gcp/bigquery_file_loads.py | 34 +--
.../apache_beam/io/gcp/bigquery_read_it_test.py | 185 +++++++-----
sdks/python/apache_beam/io/gcp/bigquery_test.py | 103 +++++++
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 97 +++++-
.../apache_beam/io/gcp/bigquery_tools_test.py | 29 ++
sdks/python/test-suites/direct/py2/build.gradle | 2 +
sdks/python/test-suites/portable/py2/build.gradle | 23 ++
sdks/python/test-suites/portable/py35/build.gradle | 26 ++
sdks/python/test-suites/portable/py36/build.gradle | 26 ++
sdks/python/test-suites/portable/py37/build.gradle | 26 ++
11 files changed, 769 insertions(+), 107 deletions(-)