This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 8a78fa0 (commit)
to 943af02 (commit)
from 8a78fa0 [BEAM-9547] Identify remaining WontImplement operations
(#15095)
add e1b8f1f Fix typo in 2.31.0 on website
add eb6dcdc Merge pull request #15147 from apilloud/website-2-31
add ef03f0b Cleanup cruft from #14239
add 41bdd40 Merge pull request #14958: Cleanup cruft from #14239
add d72fafc [BEAM-12532] correctly handle LocalDateTime and LocalTime
with 0 seconds and 0 nanoseconds
add 07bcc74 [BEAM-12532] ./gradlew spotlessApply
add 0e0aed9 [BEAM-12532] correctly handle LocalDateTime and LocalTime
with 0 seco…
add 7724cfe [BEAM-8933] Add support for reading Arrow over the BigQuery
Storage API (#14586)
add d996727 [BEAM-12548] Add AllWithinBounds() check to PAssert (#15136)
add 07b6da6 [BEAM-12516] - Fix exception from ShardedKey.toString if key
is less than 100 bytes.
add 4f15609 Swap length() for size()
add 9a4bf32 [BEAM-12516] - Fix exception from ShardedKey.toString if key
is less than 100 bytes.
add 0b12e64 docs: remove extra backtick (#15149)
add 4ad87f1 [BEAM-12594] Remove google-cloud-profiler package from
apache-beam dependency.
add 943af02 Merge pull request #15150 from y1chi/remove_dep
No new revisions were added by this update.
Summary of changes:
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 4 +
release/src/main/scripts/cut_release_branch.sh | 3 -
.../dataflow/worker/StreamingDataflowWorker.java | 9 +-
sdks/go/pkg/beam/testing/passert/floats.go | 72 ++
sdks/go/pkg/beam/testing/passert/floats_test.go | 226 +++++++
.../apache/beam/sdk/schemas/CachingFactory.java | 2 +-
.../{sql/perf-tests => arrow}/build.gradle | 24 +-
.../beam/sdk/extensions/arrow/ArrowConversion.java | 513 +++++++++++++++
.../beam/sdk/extensions/arrow}/package-info.java | 4 +-
.../sdk/extensions/arrow/ArrowConversionTest.java | 176 +++++
.../BigQueryHllSketchCompatibilityIT.java | 2 +
sdks/java/io/google-cloud-platform/build.gradle | 4 +
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 15 +
.../gcp/bigquery/BigQueryStorageArrowReader.java | 107 +++
.../io/gcp/bigquery/BigQueryStorageAvroReader.java | 80 +++
.../gcp/bigquery/BigQueryStorageQuerySource.java | 34 +-
...riteRequest.java => BigQueryStorageReader.java} | 29 +-
...uest.java => BigQueryStorageReaderFactory.java} | 25 +-
.../io/gcp/bigquery/BigQueryStorageSourceBase.java | 27 +-
.../gcp/bigquery/BigQueryStorageStreamSource.java | 31 +-
.../gcp/bigquery/BigQueryStorageTableSource.java | 18 +-
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 30 +-
.../gcp/bigquery/BigQueryIOStorageQueryTest.java | 22 +-
.../io/gcp/bigquery/BigQueryIOStorageReadIT.java | 23 +-
.../io/gcp/bigquery/BigQueryIOStorageReadTest.java | 723 ++++++++++++++++++++-
.../io/gcp/bigquery/BigQueryStorageReaderTest.java | 92 +++
.../sdk/io/gcp/bigquery/BigQueryUtilsTest.java | 121 +++-
sdks/python/container/base_image_requirements.txt | 1 -
sdks/python/setup.py | 2 -
settings.gradle.kts | 1 +
.../site/content/en/documentation/runners/flink.md | 3 +-
.../www/site/content/en/get-started/downloads.md | 2 +-
32 files changed, 2309 insertions(+), 116 deletions(-)
create mode 100644 sdks/go/pkg/beam/testing/passert/floats.go
create mode 100644 sdks/go/pkg/beam/testing/passert/floats_test.go
copy sdks/java/extensions/{sql/perf-tests => arrow}/build.gradle (61%)
create mode 100644
sdks/java/extensions/arrow/src/main/java/org/apache/beam/sdk/extensions/arrow/ArrowConversion.java
copy
{examples/java/src/main/java/org/apache/beam/examples/complete/kafkatopubsub/options
=>
sdks/java/extensions/arrow/src/main/java/org/apache/beam/sdk/extensions/arrow}/package-info.java
(89%)
create mode 100644
sdks/java/extensions/arrow/src/test/java/org/apache/beam/sdk/extensions/arrow/ArrowConversionTest.java
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryStorageArrowReader.java
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryStorageAvroReader.java
copy
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/{AvroWriteRequest.java
=> BigQueryStorageReader.java} (60%)
copy
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/{AvroWriteRequest.java
=> BigQueryStorageReaderFactory.java} (60%)
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryStorageReaderTest.java