This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 939fa99 (commit)
to 7c2b4b0 (commit)
from 939fa99 [BEAM-1833] Preserve inputs names at graph construction and
through proto transaltion. (#15202)
add ccf55e7 [BEAM-9615] Recover from registration panics. (#15228)
add 86db595 [BEAM-11994] Update BigQueryStorageStreamSource and
BigQueryServicesImpl to capture API_REQUEST_COUNT metrics/errors for storage
API reads
add 9673d8b Merge pull request #15117 from ajamato/bq_java_read_metrics
add bbfe6c4 [BEAM-12609] Enable projection pushdown in SchemaIO. (#15216)
add 72dbbf2 [BEAM-12670] Fix regression, properly report API call metric
properly on error for BQ streaming_inserts
add 37d71e2 Merge pull request #15234: [BEAM-12670] Fix regression,
properly report API call metric properly on error for BQ streaming_inserts
add 7c2b4b0 [BEAM-12675] Fix issue with language switcher on hadoop page
(#15243)
No new revisions were added by this update.
Summary of changes:
.../pkg/beam/core/runtime/graphx/schema/schema.go | 9 +-
...ericDlqProvider.java => PushdownProjector.java} | 34 +++--
.../extensions/sql/meta/DefaultTableFilter.java | 2 +-
.../provider/SchemaIOTableProviderWrapper.java | 45 ++++++
.../provider/SchemaIOTableProviderWrapperTest.java | 98 ++++++++++++
.../provider/TestSchemaIOTableProviderWrapper.java | 143 ++++++++++++++++++
.../beam/sdk/io/gcp/bigquery/BigQueryServices.java | 11 +-
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 80 +++++++---
.../gcp/bigquery/BigQueryStorageQuerySource.java | 5 +
.../io/gcp/bigquery/BigQueryStorageSourceBase.java | 15 +-
.../gcp/bigquery/BigQueryStorageStreamSource.java | 31 +++-
.../gcp/bigquery/BigQueryStorageTableSource.java | 32 +++-
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 102 +++++++++++++
.../gcp/bigquery/BigQueryIOStorageQueryTest.java | 2 +-
.../io/gcp/bigquery/BigQueryIOStorageReadTest.java | 66 ++++----
.../io/gcp/bigquery/BigQueryServicesImplTest.java | 167 ++++++++++++++++++++-
.../sdk/io/gcp/bigquery/BigQueryUtilsTest.java | 80 ++++++++++
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 8 +-
.../apache_beam/io/gcp/bigquery_tools_test.py | 59 ++++++++
website/CONTRIBUTE.md | 27 ++++
.../content/en/documentation/io/built-in/hadoop.md | 5 +-
21 files changed, 947 insertions(+), 74 deletions(-)
copy
sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/io/{GenericDlqProvider.java
=> PushdownProjector.java} (50%)
create mode 100644
sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/meta/provider/SchemaIOTableProviderWrapperTest.java
create mode 100644
sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/meta/provider/TestSchemaIOTableProviderWrapper.java
