This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from e259f472add Don't override existing consumer config values KafkaIO
(#32443)
add 12974595cd0 Bump golang.org/x/text from 0.17.0 to 0.18.0 in /sdks
(#32466)
add 6514136c17e fix: ensure that all outstanding future have completed in
FinishBundle (#32454)
add bbd09d60665 Remove Python 3.8 GitHub Actions Runs (#32429)
add 8d1c8d2cb9d Add the script to extract docs from the dev list
add 56cb2c22e02 Add the script to extract docs from the dev list
add dd511fb22a6 Merge remote-tracking branch
'refs/remotes/origin/discussion-docs' into discussion-docs
add f2992149035 update license
add a65bed2ea23 updated the md content
add 6b3043ba100 run this for all years
add b808e9e90c4 fixed some author name errors
add c2b09e26ae6 standardized the urls
add e00559140df Merge pull request #32460 from liferoad/discussion-docs
add f8475c952c1 Fix macos tox.ini definition (#32472)
add 9f8a4b2d177 [yaml] Add examples for Spanner IO in YAML (#32288)
add d20c0b1bbb2 Add information on python metrics to the programming guide
(#32464)
No new revisions were added by this update.
Summary of changes:
.../test-properties.json | 18 +-
.../actions/setup-environment-action/action.yml | 2 +-
.../workflows/beam_CloudML_Benchmarks_Dataflow.yml | 2 +-
.../beam_Inference_Python_Benchmarks_Dataflow.yml | 10 +-
.../beam_LoadTests_Python_CoGBK_Dataflow_Batch.yml | 8 +-
...m_LoadTests_Python_CoGBK_Dataflow_Streaming.yml | 8 +-
...eam_LoadTests_Python_Combine_Dataflow_Batch.yml | 6 +-
...LoadTests_Python_Combine_Dataflow_Streaming.yml | 6 +-
.../beam_LoadTests_Python_Combine_Flink_Batch.yml | 6 +-
...am_LoadTests_Python_Combine_Flink_Streaming.yml | 4 +-
...LoadTests_Python_FnApiRunner_Microbenchmark.yml | 2 +-
.../beam_LoadTests_Python_GBK_Dataflow_Batch.yml | 10 +-
...eam_LoadTests_Python_GBK_Dataflow_Streaming.yml | 2 +-
...adTests_Python_GBK_reiterate_Dataflow_Batch.yml | 4 +-
...sts_Python_GBK_reiterate_Dataflow_Streaming.yml | 4 +-
.../beam_LoadTests_Python_ParDo_Dataflow_Batch.yml | 8 +-
...m_LoadTests_Python_ParDo_Dataflow_Streaming.yml | 8 +-
.../beam_LoadTests_Python_ParDo_Flink_Batch.yml | 6 +-
...beam_LoadTests_Python_ParDo_Flink_Streaming.yml | 10 +-
...m_LoadTests_Python_SideInput_Dataflow_Batch.yml | 20 +-
.github/workflows/beam_LoadTests_Python_Smoke.yml | 4 +-
...eam_PerformanceTests_BiqQueryIO_Read_Python.yml | 2 +-
...formanceTests_BiqQueryIO_Write_Python_Batch.yml | 2 +-
...erformanceTests_PubsubIOIT_Python_Streaming.yml | 2 +-
..._PerformanceTests_SpannerIO_Read_2GB_Python.yml | 2 +-
...manceTests_SpannerIO_Write_2GB_Python_Batch.yml | 2 +-
.../beam_PerformanceTests_TextIOIT_Python.yml | 2 +-
...PerformanceTests_WordCountIT_PythonVersions.yml | 2 +-
.../beam_PerformanceTests_xlang_KafkaIO_Python.yml | 2 +-
.../beam_PostCommit_PortableJar_Flink.yml | 4 +-
.../beam_PostCommit_PortableJar_Spark.yml | 4 +-
.github/workflows/beam_PostCommit_Python.yml | 2 +-
.github/workflows/beam_PostCommit_Python_Arm.yml | 2 +-
.../beam_PostCommit_Python_Dependency.yml | 2 +-
.../beam_PostCommit_Python_Examples_Direct.yml | 2 +-
.../beam_PostCommit_Python_Examples_Flink.yml | 2 +-
.../beam_PostCommit_Python_Examples_Spark.yml | 2 +-
.../beam_PostCommit_Python_Nexmark_Direct.yml | 2 +-
...stCommit_Python_ValidatesContainer_Dataflow.yml | 2 +-
..._Python_ValidatesContainer_Dataflow_With_RC.yml | 2 +-
..._PostCommit_Python_ValidatesRunner_Dataflow.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Flink.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Samza.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Spark.yml | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Dataflow.yml | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Direct.yml | 2 +-
.../beam_PostCommit_Python_Xlang_IO_Dataflow.yml | 2 +-
.../workflows/beam_PostCommit_Sickbay_Python.yml | 2 +-
.../beam_PostCommit_TransformService_Direct.yml | 4 +-
.github/workflows/beam_PostCommit_XVR_Direct.yml | 8 +-
.github/workflows/beam_PostCommit_XVR_Flink.yml | 8 +-
...eam_PostCommit_XVR_JavaUsingPython_Dataflow.yml | 4 +-
...eam_PostCommit_XVR_PythonUsingJava_Dataflow.yml | 4 +-
.github/workflows/beam_PostCommit_XVR_Samza.yml | 8 +-
.github/workflows/beam_PostCommit_XVR_Spark3.yml | 8 +-
.../workflows/beam_PreCommit_Portable_Python.yml | 4 +-
.github/workflows/beam_PreCommit_Python.yml | 2 +-
.github/workflows/beam_PreCommit_PythonDocker.yml | 2 +-
.../workflows/beam_PreCommit_Python_Coverage.yml | 2 +-
.../workflows/beam_PreCommit_Python_Dataframes.yml | 2 +-
.../workflows/beam_PreCommit_Python_Examples.yml | 2 +-
.../beam_PreCommit_Python_Integration.yml | 2 +-
.github/workflows/beam_PreCommit_Python_ML.yml | 2 +-
.../workflows/beam_PreCommit_Python_Runners.yml | 2 +-
.../workflows/beam_PreCommit_Python_Transforms.yml | 2 +-
.../beam_PreCommit_Xlang_Generated_Transforms.yml | 2 +-
.../workflows/beam_Publish_Beam_SDK_Snapshots.yml | 1 -
...beam_Python_ValidatesContainer_Dataflow_ARM.yml | 2 +-
.github/workflows/build_release_candidate.yml | 8 +-
.github/workflows/build_wheels.yml | 8 +-
.github/workflows/dask_runner_tests.yml | 3 +-
...Combine_Flink_Streaming_2GB_10_byte_records.txt | 2 +-
...python_Combine_Flink_Streaming_2GB_Fanout_4.txt | 2 +-
...python_Combine_Flink_Streaming_2GB_Fanout_8.txt | 2 +-
.../python_GBK_Flink_Batch_2GB_of_100B_records.txt | 2 +-
...nout_4_times_with_2GB_10-byte_records_total.txt | 2 +-
...nout_8_times_with_2GB_10-byte_records_total.txt | 2 +-
...K_Flink_Batch_reiterate_4_times_10kB_values.txt | 2 +-
.../python_ParDo_Flink_Batch_10_Counters.txt | 2 +-
.../python_ParDo_Flink_Batch_10_Iterations.txt | 2 +-
.../python_ParDo_Flink_Batch_200_Iterations.txt | 2 +-
.../python_ParDo_Flink_Streaming_100_Counters.txt | 2 +-
.../python_ParDo_Flink_Streaming_10_Counters.txt | 2 +-
.../python_ParDo_Flink_Streaming_10_Iterations.txt | 2 +-
...python_ParDo_Flink_Streaming_200_Iterations.txt | 2 +-
.../python_ParDo_Flink_Streaming_5_Iterations.txt | 2 +-
.github/workflows/playground_backend_precommit.yml | 2 +-
.github/workflows/python_dependency_tests.yml | 1 -
.github/workflows/python_tests.yml | 5 +-
.github/workflows/run_perf_alert_tool.yml | 2 +-
.github/workflows/run_rc_validation.yml | 14 +-
.github/workflows/typescript_tests.yml | 4 +-
.github/workflows/update_python_dependencies.yml | 1 -
.test-infra/jenkins/PythonTestProperties.groovy | 12 +-
.test-infra/metrics/influxdb/Dockerfile | 2 +-
.test-infra/metrics/influxdb/gsutil/Dockerfile | 2 +-
.test-infra/metrics/sync/github/Dockerfile | 2 +-
.test-infra/metrics/sync/jenkins/Dockerfile | 2 +-
.test-infra/mock-apis/poetry.lock | 8 +-
build.gradle.kts | 15 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 6 +-
contributor-docs/discussion-docs/2016.md | 50 ++++
contributor-docs/discussion-docs/2017.md | 90 ++++++
contributor-docs/discussion-docs/2018.md | 116 ++++++++
contributor-docs/discussion-docs/2019.md | 103 +++++++
contributor-docs/discussion-docs/2020.md | 80 +++++
contributor-docs/discussion-docs/2021.md | 69 +++++
contributor-docs/discussion-docs/2022.md | 89 ++++++
contributor-docs/discussion-docs/2023.md | 62 ++++
contributor-docs/discussion-docs/2024.md | 45 +++
.../discussion-docs/generate_doc_md.py | 321 +++++++++++++++++++++
gradle.properties | 2 +-
local-env-setup.sh | 4 +-
release/src/main/Dockerfile | 3 +-
.../python-release/python_release_automation.sh | 2 +-
release/src/main/scripts/run_rc_validation.sh | 2 +-
.../beam/runners/dataflow/DataflowRunnerTest.java | 8 +-
sdks/go.mod | 2 +-
sdks/go.sum | 4 +-
.../beam/sdk/io/gcp/bigtable/BigtableIO.java | 48 ++-
.../beam/sdk/io/gcp/bigtable/BigtableService.java | 4 +-
.../sdk/io/gcp/bigtable/BigtableServiceImpl.java | 5 +-
.../beam/sdk/io/gcp/bigtable/BigtableIOTest.java | 8 +-
.../io/gcp/bigtable/BigtableServiceImplTest.java | 5 +-
.../runners/dataflow/internal/apiclient.py | 2 +-
.../runners/dataflow/internal/apiclient_test.py | 4 +-
.../runners/interactive/interactive_beam.py | 15 +-
.../external_transform_provider_it_test.py | 2 +-
.../apache_beam/yaml/examples/io/spanner_read.yaml | 80 +++++
.../yaml/examples/io/spanner_write.yaml | 53 ++++
sdks/python/apache_beam/yaml/yaml_io.py | 2 +-
sdks/python/expansion-service-container/Dockerfile | 2 +-
sdks/python/mypy.ini | 3 +-
.../tensorrt_runinference/tensor_rt.dockerfile | 4 +-
sdks/python/test-suites/gradle.properties | 20 +-
sdks/python/test-suites/tox/py39/build.gradle | 195 +++++++++++++
sdks/python/tox.ini | 40 +--
sdks/standard_external_transforms.yaml | 5 +-
.../content/en/documentation/programming-guide.md | 79 +++++
139 files changed, 1748 insertions(+), 284 deletions(-)
create mode 100644 contributor-docs/discussion-docs/2016.md
create mode 100644 contributor-docs/discussion-docs/2017.md
create mode 100644 contributor-docs/discussion-docs/2018.md
create mode 100644 contributor-docs/discussion-docs/2019.md
create mode 100644 contributor-docs/discussion-docs/2020.md
create mode 100644 contributor-docs/discussion-docs/2021.md
create mode 100644 contributor-docs/discussion-docs/2022.md
create mode 100644 contributor-docs/discussion-docs/2023.md
create mode 100644 contributor-docs/discussion-docs/2024.md
create mode 100644 contributor-docs/discussion-docs/generate_doc_md.py
create mode 100644 sdks/python/apache_beam/yaml/examples/io/spanner_read.yaml
create mode 100644 sdks/python/apache_beam/yaml/examples/io/spanner_write.yaml