This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.11.87
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 6c2938b74a6 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks
add 5c4bea2fdbb add YAML SDK component to issue template (#28678)
add 725a2d62b27 Feature/add retry to gcp auth (#28475)
add f35a4130ef3 Make SerializableConfiguration cacheable (#28590)
add ced3de3feae Require --sdk_location for Dataflow pipelines running with
dev SDKs. (#28670)
add 1c50fd2e6a8 Upgrade transforms without upgrading the pipelines (#28210)
add 3cdb9fe2b2d Bump Python FnAPI beam-master container. (#28704)
add 218bda98624 added jobs to GitHub Actions (#28679)
add b74a0dc8e65 Add Load Tests Combine Dataflow Batch Java workflow
(#28676)
add e53b68b368d Add GitHub Workflow Replacements for Jenkins
job_PerformanceTests_SpannerIO and
job_PerformanceTests_SQLBigQueryIO_Batch_Java (#28555)
add 941e77d295a beam_PostCommit_Java_Tpcds (#28495)
add f824adcae1f Add GitHub Workflow Replacements for Jenkins
job_PerformanceTests_JDBC (#28602)
add 072848f069d Add Load Tests Combine/ParDo SparkStructuredStreaming
Batch Java workflows (#28714)
add c3cfccae1e1 Add Load Tests ParDo Dataflow Java workflows (#28713)
add 052d2644c17 Add Load Tests Combine Dataflow Streaming Java workflow
(#28677)
add 50f2b116596 Add GitHub Workflow Replacements for Jenkins
job_PerformanceTests_Kafka_IO (#28712)
add 1c0f1beede0 Github Workflow Replacement for Jenkins Jobs,
beam_PerformanceTests_XmlIOIT* and beam_PerformanceTests_TFRecordIOIT (#28584)
add e328ab51f1b Github Workflow Replacement for Jenkins Jobs,
beam_PerformanceTests_ManyFiles_TextIOIT* (#28581)
add dda0eb9d642 Create RequestResponseIO gradle project (#28706)
add b9ac87ecbe2 add write to checks due to publish unit test result
(#28720)
add b371ab9e0b3 Bump get-func-name from 2.0.0 to 2.0.2 in /sdks/typescript
(#28707)
add 5f6817e8213 Run other arm tests on Dataflow Java (#28666)
add 2b7df3b64b3 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#28674)
add f8a0dc3c437 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6c2938b74a6)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.11.87
(f8a0dc3c437)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ISSUE_TEMPLATE/bug.yml | 1 +
.github/ISSUE_TEMPLATE/failing_test.yml | 1 +
.github/ISSUE_TEMPLATE/feature.yml | 1 +
.github/ISSUE_TEMPLATE/task.yml | 1 +
.github/issue-rules.yml | 2 +
.github/workflows/README.md | 5 +-
...beam_LoadTests_Java_Combine_Dataflow_Batch.yml} | 71 ++--
...m_LoadTests_Java_Combine_Dataflow_Streaming.yml | 107 ++++++
...Java_Combine_SparkStructuredStreaming_Batch.yml | 107 ++++++
.../beam_LoadTests_Java_ParDo_Dataflow_Batch.yml | 117 +++++++
...eam_LoadTests_Java_ParDo_Dataflow_Streaming.yml | 117 +++++++
...s_Java_ParDo_SparkStructuredStreaming_Batch.yml | 117 +++++++
...eam_PerformanceTests_BiqQueryIO_Read_Python.yml | 35 +-
...formanceTests_BiqQueryIO_Write_Python_Batch.yml | 33 +-
...d_Python.yml => beam_PerformanceTests_Cdap.yml} | 69 ++--
....yml => beam_PerformanceTests_HadoopFormat.yml} | 69 ++--
...d_Python.yml => beam_PerformanceTests_JDBC.yml} | 68 ++--
.../workflows/beam_PerformanceTests_Kafka_IO.yml | 122 +++++++
...> beam_PerformanceTests_ManyFiles_TextIOIT.yml} | 52 ++-
...m_PerformanceTests_ManyFiles_TextIOIT_HDFS.yml} | 70 ++--
....yml => beam_PerformanceTests_MongoDBIO_IT.yml} | 69 ++--
...rformanceTests_PubsubIOIT_Python_Streaming.yml} | 51 ++-
..._PerformanceTests_SQLBigQueryIO_Batch_Java.yml} | 65 ++--
...PerformanceTests_SpannerIO_Read_2GB_Python.yml} | 51 ++-
...anceTests_SpannerIO_Write_2GB_Python_Batch.yml} | 51 ++-
... => beam_PerformanceTests_SparkReceiver_IO.yml} | 69 ++--
....yml => beam_PerformanceTests_TFRecordIOIT.yml} | 45 ++-
.../beam_PerformanceTests_TFRecordIOIT_HDFS.yml | 112 +++++++
...erformanceTests_WordCountIT_PythonVersions.yml} | 72 ++--
..._Test.yml => beam_PerformanceTests_XmlIOIT.yml} | 45 ++-
....yml => beam_PerformanceTests_XmlIOIT_HDFS.yml} | 70 ++--
.github/workflows/beam_PostCommit_Java.yml | 4 +-
.../beam_PostCommit_Java_Examples_Dataflow_ARM.yml | 1 +
...yml => beam_PostCommit_Java_Tpcds_Dataflow.yml} | 49 ++-
...st.yml => beam_PostCommit_Java_Tpcds_Flink.yml} | 46 ++-
...st.yml => beam_PostCommit_Java_Tpcds_Spark.yml} | 45 ++-
.github/workflows/beam_PostCommit_Website_Test.yml | 2 +-
.../config_Combine_Java_Dataflow_Batch_10b.txt} | 29 +-
...onfig_Combine_Java_Dataflow_Batch_Fanout_4.txt} | 29 +-
...onfig_Combine_Java_Dataflow_Batch_Fanout_8.txt} | 29 +-
.../java_Combine_Dataflow_Streaming_10b.txt | 31 ++
.../java_Combine_Dataflow_Streaming_Fanout_4.txt | 31 ++
.../java_Combine_Dataflow_Streaming_Fanout_8.txt | 31 ++
..._Combine_SparkStructuredStreaming_Batch_10b.txt | 27 ++
...ine_SparkStructuredStreaming_Batch_Fanout_4.txt | 27 ++
...ine_SparkStructuredStreaming_Batch_Fanout_8.txt | 27 ++
.../java_ParDo_Dataflow_Batch_100_counters.txt | 29 ++
.../java_ParDo_Dataflow_Batch_10_counters.txt | 29 ++
.../java_ParDo_Dataflow_Batch_10_times.txt | 29 ++
.../java_ParDo_Dataflow_Batch_200_times.txt | 30 ++
.../java_ParDo_Dataflow_Streaming_100_counters.txt | 30 ++
.../java_ParDo_Dataflow_Streaming_10_counters.txt | 30 ++
.../java_ParDo_Dataflow_Streaming_10_times.txt | 30 ++
.../java_ParDo_Dataflow_Streaming_200_times.txt | 30 ++
...SparkStructuredStreaming_Batch_100_counters.txt | 26 ++
..._SparkStructuredStreaming_Batch_10_counters.txt | 26 ++
...rDo_SparkStructuredStreaming_Batch_10_times.txt | 26 ++
...Do_SparkStructuredStreaming_Batch_200_times.txt | 26 ++
.../performance-tests-job-configs/JDBC.txt | 29 ++
.../SQLBigQueryIO_Batch_Java.txt | 24 ++
.../TFRecordIOIT_HDFS.txt | 23 ++
..._Read_Python.txt => biqQueryIO_Read_Python.txt} | 11 +-
...ython.txt => biqQueryIO_Write_Python_Batch.txt} | 11 +-
.../performance-tests-job-configs/cdap.txt | 29 ++
.../config_ManyFiles_TextIOIT.txt | 29 ++
.../config_ManyFiles_TextIOIT_HDFS.txt | 29 ++
.../config_TFRecordIOIT.txt | 26 ++
.../config_XmlIOIT.txt | 27 ++
.../config_XmlIOIT_HDFS.txt | 27 ++
.../performance-tests-job-configs/hadoopFormat.txt | 29 ++
.../kafka_IO_Batch.txt | 26 ++
.../kafka_IO_Streaming.txt | 27 ++
.../performance-tests-job-configs/mongoDBIO_IT.txt | 28 ++
..._Python.txt => pubsubIOIT_Python_Streaming.txt} | 23 +-
...ad_Python.txt => spannerIO_Read_2GB_Python.txt} | 23 +-
...d_Python.txt => spannerIO_Write_2GB_Python.txt} | 23 +-
.../sparkReceiver_IO.txt | 26 ++
...ryIO_Read_Python.txt => wordCountIT_Python.txt} | 26 +-
runners/core-construction-java/build.gradle | 1 +
.../core/construction/CombineTranslation.java | 6 +-
.../CreatePCollectionViewTranslation.java | 2 +-
.../beam/runners/core/construction/External.java | 10 +-
.../construction/ExternalTranslationOptions.java | 43 +++
.../ExternalTranslationOptionsRegistrar.java | 36 ++
.../core/construction/FlattenTranslator.java | 2 +-
.../core/construction/GroupByKeyTranslation.java | 2 +-
.../construction/GroupIntoBatchesTranslation.java | 4 +-
.../core/construction/ImpulseTranslation.java | 2 +-
.../core/construction/PTransformTranslation.java | 102 +++++-
.../core/construction/PipelineTranslation.java | 15 +
.../runners/core/construction/ReadTranslation.java | 4 +-
.../core/construction/ReshuffleTranslation.java | 2 +-
.../runners/core/construction/SplittableParDo.java | 2 +-
.../core/construction/TestStreamTranslation.java | 2 +-
.../core/construction/TransformUpgrader.java | 330 ++++++++++++++++++
.../core/construction/WindowIntoTranslation.java | 5 +-
.../core/construction/WriteFilesTranslation.java | 2 +-
.../core/construction/TransformUpgraderTest.java | 369 +++++++++++++++++++++
.../flink/FlinkStreamingTransformTranslators.java | 2 +-
.../google-cloud-dataflow-java/arm/build.gradle | 5 +-
.../beam/runners/dataflow/DataflowRunner.java | 6 +
.../dataflow/PrimitiveParDoSingleFactory.java | 2 +-
.../beam/runners/dataflow/DataflowRunnerTest.java | 2 +-
.../samza/translation/SamzaPublishView.java | 2 +-
.../streaming/StreamingTransformTranslator.java | 4 +-
.../sdk/expansion/service/ExpansionService.java | 65 ++++
sdks/java/harness/build.gradle | 2 +
.../io/gcp/pubsub/PubSubPayloadTranslation.java | 9 +-
.../sdk/io/hadoop/SerializableConfiguration.java | 19 +-
sdks/java/io/rrio/build.gradle | 36 ++
sdks/python/apache_beam/internal/gcp/auth.py | 14 +-
sdks/python/apache_beam/internal/gcp/auth_test.py | 135 ++++++++
.../runners/dataflow/dataflow_runner.py | 10 +
.../runners/dataflow/dataflow_runner_test.py | 17 +-
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
.../apache_beam/runners/portability/stager.py | 8 +-
sdks/typescript/package-lock.json | 20 +-
settings.gradle.kts | 1 +
118 files changed, 3713 insertions(+), 699 deletions(-)
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_LoadTests_Java_Combine_Dataflow_Batch.yml} (51%)
create mode 100644
.github/workflows/beam_LoadTests_Java_Combine_Dataflow_Streaming.yml
create mode 100644
.github/workflows/beam_LoadTests_Java_Combine_SparkStructuredStreaming_Batch.yml
create mode 100644
.github/workflows/beam_LoadTests_Java_ParDo_Dataflow_Batch.yml
create mode 100644
.github/workflows/beam_LoadTests_Java_ParDo_Dataflow_Streaming.yml
create mode 100644
.github/workflows/beam_LoadTests_Java_ParDo_SparkStructuredStreaming_Batch.yml
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_PerformanceTests_Cdap.yml} (55%)
copy
.github/workflows/{beam_PerformanceTests_BiqQueryIO_Write_Python_Batch.yml =>
beam_PerformanceTests_HadoopFormat.yml} (54%)
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_PerformanceTests_JDBC.yml} (55%)
create mode 100644 .github/workflows/beam_PerformanceTests_Kafka_IO.yml
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_PerformanceTests_ManyFiles_TextIOIT.yml} (60%)
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_PerformanceTests_ManyFiles_TextIOIT_HDFS.yml} (51%)
copy
.github/workflows/{beam_PerformanceTests_BiqQueryIO_Write_Python_Batch.yml =>
beam_PerformanceTests_MongoDBIO_IT.yml} (54%)
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_PerformanceTests_PubsubIOIT_Python_Streaming.yml} (62%)
copy
.github/workflows/{beam_PerformanceTests_BiqQueryIO_Write_Python_Batch.yml =>
beam_PerformanceTests_SQLBigQueryIO_Batch_Java.yml} (57%)
copy
.github/workflows/{beam_PerformanceTests_BiqQueryIO_Write_Python_Batch.yml =>
beam_PerformanceTests_SpannerIO_Read_2GB_Python.yml} (63%)
copy
.github/workflows/{beam_PerformanceTests_BiqQueryIO_Write_Python_Batch.yml =>
beam_PerformanceTests_SpannerIO_Write_2GB_Python_Batch.yml} (63%)
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_PerformanceTests_SparkReceiver_IO.yml} (53%)
copy .github/workflows/{beam_PostCommit_Website_Test.yml =>
beam_PerformanceTests_TFRecordIOIT.yml} (60%)
create mode 100644
.github/workflows/beam_PerformanceTests_TFRecordIOIT_HDFS.yml
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_PerformanceTests_WordCountIT_PythonVersions.yml} (50%)
copy .github/workflows/{beam_PostCommit_Website_Test.yml =>
beam_PerformanceTests_XmlIOIT.yml} (60%)
copy .github/workflows/{beam_PerformanceTests_BiqQueryIO_Read_Python.yml =>
beam_PerformanceTests_XmlIOIT_HDFS.yml} (52%)
copy .github/workflows/{beam_PostCommit_Website_Test.yml =>
beam_PostCommit_Java_Tpcds_Dataflow.yml} (60%)
copy .github/workflows/{beam_PostCommit_Website_Test.yml =>
beam_PostCommit_Java_Tpcds_Flink.yml} (62%)
copy .github/workflows/{beam_PostCommit_Website_Test.yml =>
beam_PostCommit_Java_Tpcds_Spark.yml} (63%)
copy
.github/workflows/{performance-tests-job-configs/config_PerformanceTests_BiqQueryIO_Read_Python.txt
=> load-tests-job-configs/config_Combine_Java_Dataflow_Batch_10b.txt} (51%)
copy
.github/workflows/{performance-tests-job-configs/config_PerformanceTests_BiqQueryIO_Read_Python.txt
=> load-tests-job-configs/config_Combine_Java_Dataflow_Batch_Fanout_4.txt}
(51%)
copy
.github/workflows/{performance-tests-job-configs/config_PerformanceTests_BiqQueryIO_Read_Python.txt
=> load-tests-job-configs/config_Combine_Java_Dataflow_Batch_Fanout_8.txt}
(51%)
create mode 100644
.github/workflows/load-tests-job-configs/java_Combine_Dataflow_Streaming_10b.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_Combine_Dataflow_Streaming_Fanout_4.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_Combine_Dataflow_Streaming_Fanout_8.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_Combine_SparkStructuredStreaming_Batch_10b.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_Combine_SparkStructuredStreaming_Batch_Fanout_4.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_Combine_SparkStructuredStreaming_Batch_Fanout_8.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_Dataflow_Batch_100_counters.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_Dataflow_Batch_10_counters.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_Dataflow_Batch_10_times.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_Dataflow_Batch_200_times.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_Dataflow_Streaming_100_counters.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_Dataflow_Streaming_10_counters.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_Dataflow_Streaming_10_times.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_Dataflow_Streaming_200_times.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_SparkStructuredStreaming_Batch_100_counters.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_SparkStructuredStreaming_Batch_10_counters.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_SparkStructuredStreaming_Batch_10_times.txt
create mode 100644
.github/workflows/load-tests-job-configs/java_ParDo_SparkStructuredStreaming_Batch_200_times.txt
create mode 100644 .github/workflows/performance-tests-job-configs/JDBC.txt
create mode 100644
.github/workflows/performance-tests-job-configs/SQLBigQueryIO_Batch_Java.txt
create mode 100644
.github/workflows/performance-tests-job-configs/TFRecordIOIT_HDFS.txt
copy
.github/workflows/performance-tests-job-configs/{config_PerformanceTests_BiqQueryIO_Read_Python.txt
=> biqQueryIO_Read_Python.txt} (75%)
rename
.github/workflows/performance-tests-job-configs/{config_PerformanceTests_BiqQueryIO_Write_Python.txt
=> biqQueryIO_Write_Python_Batch.txt} (74%)
create mode 100644 .github/workflows/performance-tests-job-configs/cdap.txt
create mode 100644
.github/workflows/performance-tests-job-configs/config_ManyFiles_TextIOIT.txt
create mode 100644
.github/workflows/performance-tests-job-configs/config_ManyFiles_TextIOIT_HDFS.txt
create mode 100644
.github/workflows/performance-tests-job-configs/config_TFRecordIOIT.txt
create mode 100644
.github/workflows/performance-tests-job-configs/config_XmlIOIT.txt
create mode 100644
.github/workflows/performance-tests-job-configs/config_XmlIOIT_HDFS.txt
create mode 100644
.github/workflows/performance-tests-job-configs/hadoopFormat.txt
create mode 100644
.github/workflows/performance-tests-job-configs/kafka_IO_Batch.txt
create mode 100644
.github/workflows/performance-tests-job-configs/kafka_IO_Streaming.txt
create mode 100644
.github/workflows/performance-tests-job-configs/mongoDBIO_IT.txt
copy
.github/workflows/performance-tests-job-configs/{config_PerformanceTests_BiqQueryIO_Read_Python.txt
=> pubsubIOIT_Python_Streaming.txt} (58%)
copy
.github/workflows/performance-tests-job-configs/{config_PerformanceTests_BiqQueryIO_Read_Python.txt
=> spannerIO_Read_2GB_Python.txt} (57%)
copy
.github/workflows/performance-tests-job-configs/{config_PerformanceTests_BiqQueryIO_Read_Python.txt
=> spannerIO_Write_2GB_Python.txt} (57%)
create mode 100644
.github/workflows/performance-tests-job-configs/sparkReceiver_IO.txt
rename
.github/workflows/performance-tests-job-configs/{config_PerformanceTests_BiqQueryIO_Read_Python.txt
=> wordCountIT_Python.txt} (52%)
create mode 100644
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/ExternalTranslationOptions.java
create mode 100644
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/ExternalTranslationOptionsRegistrar.java
create mode 100644
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/TransformUpgrader.java
create mode 100644
runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction/TransformUpgraderTest.java
create mode 100644 sdks/java/io/rrio/build.gradle
create mode 100644 sdks/python/apache_beam/internal/gcp/auth_test.py
