This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.53.1
in repository https://gitbox.apache.org/repos/asf/beam.git
discard fa6851eab3e Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
add d59ef194908 fix error in BigQueryUtils when retrieving non existent
avro field (#30720)
add 336e8701f7b Include everit_json_schema in schemaio expansion service
uber jar (#30779)
add fecc9d995e4 add get beam latest release and fix GCP auth (#30751)
add db338059439 only record per state change processing times for
streaming pipelines (#30653)
add a520b95ab36 Fix typo in side-inputs (#30817)
add 4316b2fe203 Don't double-nest display data payloads. (#30812)
add 5ae3751fc0d Duet ai code prompts for gcloud services (#30749)
add 65f4ad94b1a Duet AI code prompts final (#30785)
add 0e861184775 Add SpannerIO Stress test (#30800)
add eb5c73da86f Add WaitOn transform to Python, analogous to Java's
Wait.on. (#30807)
add c45e2f0e416 add channel cache (#30765)
add 1ea9054ec64 Bump github.com/tetratelabs/wazero from 1.6.0 to 1.7.0 in
/sdks (#30731)
add 6f6bbe1ca73 Protect 2.55.1 branch (#30832)
add c44b4542627 Add cancel button to Prism UI (#30811)
add 864f8535644 Add patch release docs (#30838)
add 3caa1d8ff19 Add back Avro 1.8.2 to test (#30833)
add 61eee6dd672 White space Fix log and error messages (#30804)
add 21129a41e03 update gcloud to 471 in runner image (#30846)
add 0d41168a096 byte-buddy:1.14.12 (#30746)
add 6c280c64e5c Use empty flags for default expansion service options.
(#30858)
add f437a783e19 Tune maximum thread count for streaming dataflow worker
executor dynamically. (#30439)
add 92fe69212f9 update runner image (#30866)
add 4eefc6dd544 Apply changes (#30857)
add 1651e54786d Docker - Remove Deprecated Types (#30826)
add ffc96bc2edf Bump cloud.google.com/go/bigquery from 1.59.1 to 1.60.0 in
/sdks (#30837)
add 580ebba3e41 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (fa6851eab3e)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.53.1
(580ebba3e41)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 1 +
.../arc/environments/beam.env | 6 +-
.../arc/images/Dockerfile | 6 +-
.../beam_PostCommit_Java_DataflowV1.json | 2 +-
...s.json => beam_PostCommit_Java_DataflowV2.json} | 0
.../beam_PostCommit_Java_IO_Performance_Tests.yml | 27 +-
CHANGES.md | 2 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 4 +-
contributor-docs/release-guide.md | 20 ++
it/google-cloud-platform/build.gradle | 2 +
.../it/gcp/spanner/SpannerResourceManager.java | 24 +-
.../beam/it/gcp/bigquery/BigQueryStreamingLT.java | 6 +
.../apache/beam/it/gcp/bigtable/BigTableIOLT.java | 6 +
.../apache/beam/it/gcp/spanner/SpannerIOST.java | 391 +++++++++++++++++++++
.../it/gcp/spanner/SpannerResourceManagerTest.java | 15 +-
.../apache/beam/it/gcp/storage/FileBasedIOLT.java | 6 +
.../prompts/code-explanation/java/01_io_kafka.md | 118 +++++++
.../prompts/code-explanation/java/02_io_pubsub.md | 78 ++++
.../code-explanation/java/03_io_bigquery.md | 76 ++++
.../code-explanation/java/04_io_bigtable.md | 164 +++++++++
.../prompts/code-explanation/java/05_io_spanner.md | 150 ++++++++
.../code-explanation/java/06_io_tfrecord.md | 116 ++++++
.../prompts/code-explanation/java/11_io_jdbc.md | 252 +++++++++++++
.../prompts/code-generation/java/01_io_kafka.md | 79 +++++
.../prompts/code-generation/java/02_io_pubsub.md | 64 ++++
.../prompts/code-generation/java/03_io_bigquery.md | 97 +++++
.../prompts/code-generation/java/04_io_bigtable.md | 133 +++++++
.../prompts/code-generation/java/05_io_spanner.md | 113 ++++++
.../prompts/code-generation/java/06_io_tfrecord.md | 80 +++++
.../prompts/code-generation/java/11_io_jdbc.md | 130 +++++++
.../core-transforms/side-inputs/description.md | 4 +-
.../dataflow/options/DataflowPipelineOptions.java | 2 +-
.../options/DataflowStreamingPipelineOptions.java | 2 +-
.../dataflow/worker/DataflowExecutionContext.java | 27 +-
.../dataflow/worker/DataflowWorkUnitClient.java | 10 +-
.../dataflow/worker/StreamingDataflowWorker.java | 49 +--
.../runners/dataflow/worker/WorkUnitClient.java | 4 +-
.../harness/StreamingWorkerStatusReporter.java | 57 ++-
.../dataflow/worker/util/BoundedQueueExecutor.java | 76 ++--
.../worker/windmill/WindmillConnection.java | 5 +
.../windmill/client/grpc/GrpcDispatcherClient.java | 4 +-
.../windmill/client/grpc/GrpcWindmillServer.java | 29 +-
.../client/grpc/StreamingEngineClient.java | 25 +-
.../windmill/client/grpc/stubs/ChannelCache.java | 134 +++++++
...y.java => ChannelCachingRemoteStubFactory.java} | 38 +-
.../grpc/stubs/ChannelCachingStubFactory.java | 38 ++
.../client/grpc/stubs/IsolationChannel.java | 2 +-
.../client/grpc/stubs/WindmillChannelFactory.java | 2 +-
.../worker/DataflowExecutionContextTest.java | 50 ++-
.../worker/DataflowWorkUnitClientTest.java | 13 +-
.../harness/StreamingWorkerStatusReporterTest.java | 100 ++++++
.../worker/util/BoundedQueueExecutorTest.java | 268 ++++++++++++++
.../client/grpc/GrpcWindmillServerTest.java | 3 +-
.../client/grpc/StreamingEngineClientTest.java | 41 +--
.../client/grpc/stubs/ChannelCacheTest.java | 153 ++++++++
.../windmill/testing/FakeWindmillStubFactory.java | 27 +-
.../runners/twister2/Twister2PipelineResult.java | 2 +-
sdks/go.mod | 12 +-
sdks/go.sum | 26 +-
.../beam/runners/prism/internal/environments.go | 4 +-
.../prism/internal/web/assets/job-action.js | 97 +++++
.../runners/prism/internal/web/assets/style.css | 8 +-
.../runners/prism/internal/web/jobdetails.html | 6 +
.../main/java/org/apache/beam/sdk/Pipeline.java | 2 +-
.../sdk/util/construction/UnknownCoderWrapper.java | 4 +-
.../org/apache/beam/sdk/RequiresStableInputIT.java | 2 +-
.../sdk/util/construction/MorePipelineTest.java | 2 +-
sdks/java/extensions/avro/build.gradle | 4 +-
.../schemaio-expansion-service/build.gradle | 1 +
.../FileReadSchemaTransformConfiguration.java | 4 +-
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 8 +-
.../apache/beam/sdk/io/gcp/healthcare/FhirIO.java | 2 +-
.../sdk/io/gcp/bigquery/BigQueryUtilsTest.java | 16 +
.../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 2 +-
.../sdk/io/kafka/upgrade/KafkaIOTranslation.java | 4 +-
.../apache/beam/sdk/nexmark/NexmarkOptions.java | 2 +-
sdks/python/apache_beam/coders/coders.py | 10 +-
sdks/python/apache_beam/coders/coders_test.py | 6 +
.../runners/portability/expansion_service.py | 4 +-
sdks/python/apache_beam/transforms/display.py | 22 +-
sdks/python/apache_beam/transforms/util.py | 43 ++-
sdks/python/apache_beam/transforms/util_test.py | 29 ++
82 files changed, 3431 insertions(+), 222 deletions(-)
rename .github/trigger_files/{beam_PostCommit_Java_Avro_Versions.json =>
beam_PostCommit_Java_DataflowV2.json} (100%)
create mode 100644
it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/spanner/SpannerIOST.java
create mode 100644 learning/prompts/code-explanation/java/01_io_kafka.md
create mode 100644 learning/prompts/code-explanation/java/02_io_pubsub.md
create mode 100644 learning/prompts/code-explanation/java/03_io_bigquery.md
create mode 100644 learning/prompts/code-explanation/java/04_io_bigtable.md
create mode 100644 learning/prompts/code-explanation/java/05_io_spanner.md
create mode 100644 learning/prompts/code-explanation/java/06_io_tfrecord.md
create mode 100644 learning/prompts/code-explanation/java/11_io_jdbc.md
create mode 100644 learning/prompts/code-generation/java/01_io_kafka.md
create mode 100644 learning/prompts/code-generation/java/02_io_pubsub.md
create mode 100644 learning/prompts/code-generation/java/03_io_bigquery.md
create mode 100644 learning/prompts/code-generation/java/04_io_bigtable.md
create mode 100644 learning/prompts/code-generation/java/05_io_spanner.md
create mode 100644 learning/prompts/code-generation/java/06_io_tfrecord.md
create mode 100644 learning/prompts/code-generation/java/11_io_jdbc.md
create mode 100644
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/stubs/ChannelCache.java
rename
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/stubs/{RemoteWindmillStubFactory.java
=> ChannelCachingRemoteStubFactory.java} (67%)
create mode 100644
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/stubs/ChannelCachingStubFactory.java
create mode 100644
runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/streaming/harness/StreamingWorkerStatusReporterTest.java
create mode 100644
runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/util/BoundedQueueExecutorTest.java
create mode 100644
runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/stubs/ChannelCacheTest.java
create mode 100644
sdks/go/pkg/beam/runners/prism/internal/web/assets/job-action.js
