This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 52abb1452e6 Merge pull request #28485 [BEAM-28399] Ensure dataflow
experiments are always set when dataflowflow runner is used.
add 011efacee3f Add GitHub Workflow Replacement for Jenkins
job_PostCommit_SQL (#28469)
add f087afad003 Remove extra registrations for createFn. (#28488)
add fa144f45b14 Add GitHub Workflow Replacement for Jenkins
job_PostCommit_Java_Examples_Dataflow_V2 (#28352)
add 3f56f6578b7 Comment results to PR only when issue_comments (#28480)
add 8c7e8b0949a Retrieve element type from input PCollection in
parquetio.Write (#28491)
add a0e9775ac25 Support legacy DATE and TIME logical types in xlang JdbcIO
(#28382)
add 1fc54fdfb91 Add Load Tests CoGBK Dataflow Streaming Java github action
(#28372)
add ffde6888ee0 Add GitHub Workflow Replacement for Jenkins
job_PostCommit_Python (#28301)
add de10fbd5e5b Add GitHub Workflow Replacement for Jenkins
job_PostCommit_Java_PVR_* (#28412)
add 7e830593e61 Remove TableSchema to JSON conversion. (#28274)
add 99743347470 migrate CancelStaleDataflowJobs to GitHub (#28408)
add e7e140ec216 Implement unittest
add f37d86014ae Implement fix
add 4a5a0076f35 Update translations_test.py
add b3a8e1531ca yapf
add 881c5979e96 Merge pull request #28489 Propagate annotations of
CombinePerKey transforms.
add b6f432dbaad Bump google.golang.org/api from 0.140.0 to 0.141.0 in
/sdks (#28463)
add db01dbe5f3c create run_portable_pipeline test
add 7642b60385c implement change - required seemingly unrelated changes as
well
add 718fb77722b Move confib validation to runner execution time
add ee603b7d279 Move dot requiring tests out into separate testcase
add e42f4fb6708 Use module-specific logger
add 36038fcad4c use tempdir for unit test
add 7f709e712c3 remove unuseful test comments
add 90059bdbc57 mypy fix
add 91842e632b2 Merge pull request #28496 RenderRunner cleanup and fixes.
add 0d37c6f45d8 [#28187] Add standalone prism validates runner precommit
(#28487)
add d6068ad66b0 Updating Storage API Autosharding documentation to include
that it doesn't work on Runner V2 (#28233)
add 3024ec24006 Better errors when inputs are omitted. (#28289)
add cd65aac2be7 Fix broken link (#28510)
add 6d7c6999a01 Fix building prism in action. (#28509)
add 8871a4e8d2c Remove internal series.append call from frames.py (#28499)
add 71c68ca041d Fix numeric_only logic in frames_test for Pandas 2 (#28422)
add a722740e2cc Support kw only arguments for frame methods for Pandas 2
(#28454)
add d79f537927c Suppress FutureWarnings for Pandas < 2 (#28481)
add 08a97671516 Sets recommended max Xmx 32G when set_recommended_max_xmx
experiment is enabled (#28442)
add 5ffddb82f72 Add PerformanceTests BigQueryIO actions (#28325)
add 49283e31ece Bump archive from 3.3.7 to 3.3.8 in /playground/frontend
(#28351)
add 79f46e00184 Bump archive from 3.3.7 to 3.3.8 in
/learning/tour-of-beam/frontend (#28350)
add 34024902746 Bump actions/setup-python from 2 to 4 (#28275)
add 8f3a38e7d09 kubectl install direct and use only auth plugin from
gcloud (#28501)
add 2ad06b3cdcd Bump actions/checkout from 3 to 4 (#28302)
add c7274e9b151 Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#28519)
add 9c4e8bff7c9 Support writes to Postgres with pgx driver (#28521)
add 346541b1b82 Update build.gradle -- remove duplicate deps (#28377)
add 82228873f41 Fix numpy install when building wheels (#28532)
add 3915c85b842 [Document]: `HealthcareApiClient` methods. (#28482)
add e6ecface49a Add GitHub Workflow Replacements for Jenkins
job_PostCommit_Java_Nexmark (#28468)
add 6f91ef83cad Migrate "beam_PostCommit_Python_Nexmark_Direct" Jenkins
jobs to GitHub Actions (#28483)
add 6c4bdf10556 added beam_PostCommit_Javadoc job to GitHub Actions
(#28522)
add a90879af543 Revert "Remove TableSchema to JSON conversion. (#28274)"
(#28533)
add f2a0c76703b Remove inplace argument from set_axis for Pandas 2 (#28536)
add 0f2f3b12ac6 Only value_counts.drop_na for Pandas 2 (#28500)
add 0f727927c01 Return errors for insert_rows_json exceptions (#21080)
(#28091)
add 272da41a1cc Updating access modifiers for utility methods (#28511)
add 6261a007a9e Log user code exceptions in Java (#28514)
add 612bfc4b486 Log user code exceptions in Python (#28515)
add 27ada99648b Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#28517)
add a1ec0552a34 Add extra marks to VertexAI IT tests (#28534)
add 845dfc51e07 Create py.typed for use with mypy (#27942)
add b39089870e7 Remove unused ToRow, GroupByKey, mark WithSchema as
experimental. (#28504)
No new revisions were added by this update.
Summary of changes:
.../arc/images/Dockerfile | 8 +-
.github/workflows/README.md | 23 +-
.github/workflows/assign_milestone.yml | 2 +-
...t_Java.yml => beam_CancelStaleDataflowJobs.yml} | 48 +-
...eam_LoadTests_Java_CoGBK_Dataflow_Streaming.yml | 126 +++
...erformanceTests_BigQueryIO_Batch_Java_Avro.yml} | 56 +-
...erformanceTests_BigQueryIO_Batch_Java_Json.yml} | 56 +-
...PerformanceTests_BigQueryIO_Streaming_Java.yml} | 56 +-
.../beam_PostCommit_BeamMetrics_Publish.yml | 2 +-
.github/workflows/beam_PostCommit_Go.yml | 2 +-
.../workflows/beam_PostCommit_Go_Dataflow_ARM.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Flink.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Samza.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Spark.yml | 2 +-
.github/workflows/beam_PostCommit_Java.yml | 16 +-
.../beam_PostCommit_Java_Avro_Versions.yml | 4 +-
.../workflows/beam_PostCommit_Java_DataflowV1.yml | 4 +-
.../workflows/beam_PostCommit_Java_DataflowV2.yml | 4 +-
.../beam_PostCommit_Java_Examples_Dataflow_ARM.yml | 4 +-
...beam_PostCommit_Java_Examples_Dataflow_Java.yml | 4 +-
... beam_PostCommit_Java_Examples_Dataflow_V2.yml} | 21 +-
..._PostCommit_Java_Examples_Dataflow_V2_Java.yml} | 37 +-
.../beam_PostCommit_Java_Examples_Direct.yml | 4 +-
.../beam_PostCommit_Java_Examples_Flink.yml | 4 +-
.../beam_PostCommit_Java_Examples_Spark.yml | 4 +-
.../beam_PostCommit_Java_Hadoop_Versions.yml | 4 +-
.../beam_PostCommit_Java_IO_Performance_Tests.yml | 19 +-
.../beam_PostCommit_Java_Jpms_Dataflow_Java11.yml | 4 +-
.../beam_PostCommit_Java_Jpms_Dataflow_Java17.yml | 4 +-
.../beam_PostCommit_Java_Jpms_Direct_Java11.yml | 4 +-
.../beam_PostCommit_Java_Jpms_Direct_Java17.yml | 4 +-
.../beam_PostCommit_Java_Jpms_Flink_Java11.yml | 4 +-
.../beam_PostCommit_Java_Jpms_Spark_Java11.yml | 4 +-
...l => beam_PostCommit_Java_Nexmark_Dataflow.yml} | 83 +-
...> beam_PostCommit_Java_Nexmark_Dataflow_V2.yml} | 61 +-
...m_PostCommit_Java_Nexmark_Dataflow_V2_Java.yml} | 79 +-
...yml => beam_PostCommit_Java_Nexmark_Direct.yml} | 78 +-
....yml => beam_PostCommit_Java_Nexmark_Flink.yml} | 77 +-
....yml => beam_PostCommit_Java_Nexmark_Spark.yml} | 77 +-
...> beam_PostCommit_Java_PVR_Flink_Streaming.yml} | 31 +-
...kbay.yml => beam_PostCommit_Java_PVR_Samza.yml} | 20 +-
... beam_PostCommit_Java_PVR_Spark3_Streaming.yml} | 25 +-
...ml => beam_PostCommit_Java_PVR_Spark_Batch.yml} | 27 +-
.github/workflows/beam_PostCommit_Java_Sickbay.yml | 6 +-
...am_PostCommit_Java_ValidatesRunner_Dataflow.yml | 4 +-
..._Java_ValidatesRunner_Dataflow_JavaVersions.yml | 4 +-
...mit_Java_ValidatesRunner_Dataflow_Streaming.yml | 4 +-
...PostCommit_Java_ValidatesRunner_Dataflow_V2.yml | 4 +-
..._Java_ValidatesRunner_Dataflow_V2_Streaming.yml | 4 +-
...beam_PostCommit_Java_ValidatesRunner_Direct.yml | 4 +-
...it_Java_ValidatesRunner_Direct_JavaVersions.yml | 4 +-
.../beam_PostCommit_Java_ValidatesRunner_Flink.yml | 4 +-
...ostCommit_Java_ValidatesRunner_Flink_Java11.yml | 4 +-
.../beam_PostCommit_Java_ValidatesRunner_Samza.yml | 4 +-
.../beam_PostCommit_Java_ValidatesRunner_Spark.yml | 4 +-
...va_ValidatesRunner_SparkStructuredStreaming.yml | 4 +-
...ostCommit_Java_ValidatesRunner_Spark_Java11.yml | 4 +-
...am_PostCommit_Java_ValidatesRunner_Twister2.yml | 4 +-
.../beam_PostCommit_Java_ValidatesRunner_ULR.yml | 4 +-
...Commit_Java.yml => beam_PostCommit_Javadoc.yml} | 20 +-
.../beam_PostCommit_PortableJar_Flink.yml | 2 +-
.../beam_PostCommit_PortableJar_Spark.yml | 2 +-
...ckbay_Python.yml => beam_PostCommit_Python.yml} | 25 +-
.../beam_PostCommit_Python_Examples_Dataflow.yml | 2 +-
.../beam_PostCommit_Python_Examples_Direct.yml | 2 +-
.../beam_PostCommit_Python_Examples_Flink.yml | 2 +-
.../beam_PostCommit_Python_Examples_Spark.yml | 2 +-
.../beam_PostCommit_Python_MongoDBIO_IT.yml | 2 +-
.../beam_PostCommit_Python_Nexmark_Direct.yml | 138 ++++
...stCommit_Python_ValidatesContainer_Dataflow.yml | 2 +-
..._Python_ValidatesContainer_Dataflow_With_RC.yml | 4 +-
..._PostCommit_Python_ValidatesRunner_Dataflow.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Flink.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Samza.yml | 2 +-
...eam_PostCommit_Python_ValidatesRunner_Spark.yml | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Dataflow.yml | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Direct.yml | 2 +-
.../beam_PostCommit_Python_Xlang_IO_Dataflow.yml | 2 +-
...Java_DataflowV2.yml => beam_PostCommit_SQL.yml} | 20 +-
.../workflows/beam_PostCommit_Sickbay_Python.yml | 18 +-
.../beam_PostCommit_TransformService_Direct.yml | 2 +-
.../workflows/beam_PostCommit_Website_Publish.yml | 2 +-
.github/workflows/beam_PostCommit_Website_Test.yml | 2 +-
.github/workflows/beam_PostCommit_XVR_Direct.yml | 2 +-
.github/workflows/beam_PostCommit_XVR_Flink.yml | 2 +-
.../beam_PostCommit_XVR_GoUsingJava_Dataflow.yml | 4 +-
...eam_PostCommit_XVR_JavaUsingPython_Dataflow.yml | 2 +-
..._PostCommit_XVR_PythonUsingJavaSQL_Dataflow.yml | 2 +-
...eam_PostCommit_XVR_PythonUsingJava_Dataflow.yml | 2 +-
.github/workflows/beam_PostCommit_XVR_Samza.yml | 2 +-
.github/workflows/beam_PostCommit_XVR_Spark3.yml | 2 +-
.../workflows/beam_PreCommit_CommunityMetrics.yml | 2 +-
.github/workflows/beam_PreCommit_Go.yml | 2 +-
.github/workflows/beam_PreCommit_GoPortable.yml | 2 +-
...t_GoPortable.yml => beam_PreCommit_GoPrism.yml} | 18 +-
.github/workflows/beam_PreCommit_ItFramework.yml | 4 +-
.github/workflows/beam_PreCommit_Java.yml | 4 +-
...eCommit_Java_Amazon-Web-Services2_IO_Direct.yml | 4 +-
...reCommit_Java_Amazon-Web-Services_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Amqp_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Azure_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Cassandra_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Cdap_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Clickhouse_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Csv_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Debezium_IO_Direct.yml | 4 +-
...beam_PreCommit_Java_ElasticSearch_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Examples_Dataflow.yml | 4 +-
...eam_PreCommit_Java_Examples_Dataflow_Java11.yml | 4 +-
...eam_PreCommit_Java_Examples_Dataflow_Java17.yml | 4 +-
...Commit_Java_File-schema-transform_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Flink_Versions.yml | 4 +-
.../beam_PreCommit_Java_GCP_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_HBase_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_HCatalog_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Hadoop_IO_Direct.yml | 4 +-
.../workflows/beam_PreCommit_Java_IOs_Direct.yml | 4 +-
.../beam_PreCommit_Java_InfluxDb_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_JDBC_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Jms_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Kafka_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Kinesis_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Kudu_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_MongoDb_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Mqtt_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Neo4j_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_PVR_Flink_Batch.yml | 4 +-
.../beam_PreCommit_Java_PVR_Flink_Docker.yml | 4 +-
.../beam_PreCommit_Java_Parquet_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Pulsar_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_RabbitMq_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Redis_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_SingleStore_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Snowflake_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Solr_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Spark3_Versions.yml | 4 +-
.../beam_PreCommit_Java_Splunk_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Thrift_IO_Direct.yml | 4 +-
.../beam_PreCommit_Java_Tika_IO_Direct.yml | 4 +-
.../workflows/beam_PreCommit_Kotlin_Examples.yml | 2 +-
.../workflows/beam_PreCommit_Portable_Python.yml | 2 +-
.github/workflows/beam_PreCommit_Python.yml | 2 +-
.github/workflows/beam_PreCommit_PythonDocker.yml | 2 +-
.github/workflows/beam_PreCommit_PythonDocs.yml | 2 +-
.../workflows/beam_PreCommit_PythonFormatter.yml | 2 +-
.github/workflows/beam_PreCommit_PythonLint.yml | 2 +-
.../workflows/beam_PreCommit_Python_Coverage.yml | 2 +-
.../workflows/beam_PreCommit_Python_Dataframes.yml | 2 +-
.../workflows/beam_PreCommit_Python_Examples.yml | 2 +-
.../beam_PreCommit_Python_Integration.yml | 2 +-
.../workflows/beam_PreCommit_Python_PVR_Flink.yml | 2 +-
.../workflows/beam_PreCommit_Python_Runners.yml | 2 +-
.../workflows/beam_PreCommit_Python_Transforms.yml | 2 +-
.github/workflows/beam_PreCommit_RAT.yml | 2 +-
.github/workflows/beam_PreCommit_SQL.yml | 4 +-
.github/workflows/beam_PreCommit_SQL_Java11.yml | 4 +-
.github/workflows/beam_PreCommit_SQL_Java17.yml | 4 +-
.github/workflows/beam_PreCommit_Spotless.yml | 2 +-
.github/workflows/beam_PreCommit_Typescript.yml | 2 +-
.github/workflows/beam_PreCommit_Website.yml | 2 +-
.../workflows/beam_PreCommit_Website_Stage_GCS.yml | 2 +-
.github/workflows/beam_PreCommit_Whitespace.yml | 2 +-
...beam_Python_ValidatesContainer_Dataflow_ARM.yml | 2 +-
.github/workflows/beam_Release_NightlySnapshot.yml | 2 +-
.../beam_Release_Python_NightlySnapshot.yml | 4 +-
.github/workflows/build_release_candidate.yml | 8 +-
.github/workflows/build_runner_image.yml | 2 +-
.github/workflows/build_wheels.yml | 10 +-
.github/workflows/cancel.yml | 2 +-
.github/workflows/choose_rc_commit.yml | 2 +-
.github/workflows/code_completion_plugin_tests.yml | 4 +-
.github/workflows/cut_release_branch.yml | 6 +-
.github/workflows/dask_runner_tests.yml | 4 +-
.github/workflows/git_tag_released_version.yml | 2 +-
.github/workflows/go_tests.yml | 2 +-
.github/workflows/issue-tagger.yml | 2 +-
.github/workflows/java_tests.yml | 8 +-
...config_CoGBK_Java_Streaming_2GB_MultipleKey.txt | 34 +
...g_CoGBK_Java_Streaming_2GB_Reiteration_10KB.txt | 34 +
...ig_CoGBK_Java_Streaming_2GB_Reiteration_2MB.txt | 34 +
.../config_CoGBK_Java_Streaming_2GB_SingleKey.txt | 34 +
.github/workflows/local_env_tests.yml | 4 +-
.../config_BigQueryIO_Batch_Java_Avro.txt | 38 +
.../config_BigQueryIO_Batch_Java_Json.txt | 38 +
.../config_BigQueryIO_Streaming_Java.txt | 39 +
.github/workflows/playground_backend_precommit.yml | 2 +-
.github/workflows/playground_frontend_test.yml | 2 +-
.github/workflows/pr-bot-new-prs.yml | 2 +-
.github/workflows/pr-bot-pr-updates.yml | 2 +-
.github/workflows/pr-bot-prs-needing-attention.yml | 2 +-
.github/workflows/pr-bot-update-reviewers.yml | 2 +-
.github/workflows/publish_github_release_notes.yml | 4 +-
.github/workflows/python_dependency_tests.yml | 2 +-
.github/workflows/python_tests.yml | 10 +-
.github/workflows/reportGenerator.yml | 2 +-
.github/workflows/run_perf_alert_tool.yml | 2 +-
.github/workflows/run_rc_validation.yml | 16 +-
.github/workflows/tour_of_beam_backend.yml | 2 +-
.../workflows/tour_of_beam_backend_integration.yml | 2 +-
.github/workflows/tour_of_beam_frontend_test.yml | 2 +-
.github/workflows/typescript_tests.yml | 8 +-
.github/workflows/update_python_dependencies.yml | 4 +-
CHANGES.md | 3 +
build.gradle.kts | 4 +
learning/tour-of-beam/frontend/pubspec.lock | 48 +-
playground/frontend/pubspec.lock | 48 +-
sdks/go.mod | 16 +-
sdks/go.sum | 28 +-
sdks/go/README.md | 1 +
sdks/go/cmd/prism/prism.go | 10 +-
sdks/go/pkg/beam/beam.shims.go | 15 -
sdks/go/pkg/beam/create.go | 5 -
sdks/go/pkg/beam/io/databaseio/writer.go | 2 +-
sdks/go/pkg/beam/io/databaseio/writer_test.go | 6 +
sdks/go/pkg/beam/io/parquetio/parquetio.go | 5 +-
sdks/go/pkg/beam/io/parquetio/parquetio_test.go | 2 +-
.../beam/runners/prism/internal/environments.go | 16 +-
sdks/go/pkg/beam/runners/prism/internal/execute.go | 4 +
.../beam/runners/prism/internal/jobservices/job.go | 4 +
.../beam/runners/prism/internal/worker/worker.go | 11 +-
sdks/go/pkg/beam/runners/prism/prism.go | 6 +-
sdks/go/pkg/beam/util.go | 2 +-
sdks/go/test/build.gradle | 24 +
sdks/go/test/integration/integration.go | 4 +-
sdks/go/test/run_validatesrunner_tests.sh | 20 +-
sdks/java/container/boot.go | 14 +-
.../apache/beam/sdk/schemas/SchemaTranslation.java | 74 +-
.../beam/sdk/schemas/SchemaTranslationTest.java | 69 +-
.../java/org/apache/beam/fn/harness/FnHarness.java | 1 -
.../fn/harness/control/BeamFnControlClient.java | 4 +-
.../fn/harness/control/ExecutionStateSampler.java | 23 +
.../harness/data/PCollectionConsumerRegistry.java | 47 +-
.../fn/harness/logging/BeamFnLoggingClient.java | 23 +-
.../beam/fn/harness/logging/BeamFnLoggingMDC.java | 20 +
.../harness/control/ExecutionStateSamplerTest.java | 25 +
.../data/PCollectionConsumerRegistryTest.java | 134 ++++
.../harness/logging/BeamFnLoggingClientTest.java | 20 +
sdks/java/io/google-ads/build.gradle | 1 -
.../sdk/io/gcp/healthcare/HealthcareApiClient.java | 242 ++++--
.../java/org/apache/beam/sdk/io/jdbc/JdbcIO.java | 2 +-
.../org/apache/beam/sdk/io/jdbc/LogicalTypes.java | 70 +-
.../org/apache/beam/sdk/io/jdbc/SchemaUtil.java | 2 +-
sdks/python/apache_beam/dataframe/frame_base.py | 22 +-
.../apache_beam/dataframe/frame_base_test.py | 47 +-
sdks/python/apache_beam/dataframe/frames.py | 34 +-
sdks/python/apache_beam/dataframe/frames_test.py | 87 ++-
.../io/external/xlang_jdbcio_it_test.py | 16 +-
sdks/python/apache_beam/io/gcp/bigquery_test.py | 853 +++++++++++++++------
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 22 +-
.../apache_beam/io/gcp/bigquery_write_it_test.py | 51 +-
sdks/python/apache_beam/io/jdbc.py | 100 +++
.../ml/inference/vertex_ai_inference_it_test.py | 1 +
.../python/apache_beam/py.typed | 22 +-
sdks/python/apache_beam/runners/common.py | 4 +
.../portability/fn_api_runner/translations.py | 4 +
.../portability/fn_api_runner/translations_test.py | 30 +
sdks/python/apache_beam/runners/render.py | 41 +-
sdks/python/apache_beam/runners/render_test.py | 47 +-
.../apache_beam/runners/worker/log_handler_test.py | 151 ++++
sdks/python/apache_beam/yaml/yaml_provider.py | 83 +-
sdks/python/apache_beam/yaml/yaml_transform.py | 84 +-
.../apache_beam/yaml/yaml_transform_scope_test.py | 31 +-
.../python/apache_beam/yaml/yaml_transform_test.py | 47 ++
.../apache_beam/yaml/yaml_transform_unit_test.py | 4 +
sdks/python/build.gradle | 2 +-
sdks/python/test-suites/dataflow/common.gradle | 3 +-
.../documentation/io/built-in/google-bigquery.md | 4 +
.../en/documentation/sdks/python-dependencies.md | 2 +-
268 files changed, 3528 insertions(+), 1395 deletions(-)
copy .github/workflows/{beam_PostCommit_Java.yml =>
beam_CancelStaleDataflowJobs.yml} (76%)
create mode 100644
.github/workflows/beam_LoadTests_Java_CoGBK_Dataflow_Streaming.yml
copy .github/workflows/{beam_PostCommit_Java_ValidatesRunner_Flink.yml =>
beam_PerformanceTests_BigQueryIO_Batch_Java_Avro.yml} (62%)
copy .github/workflows/{beam_PostCommit_Java_ValidatesRunner_Flink.yml =>
beam_PerformanceTests_BigQueryIO_Batch_Java_Json.yml} (62%)
copy .github/workflows/{beam_PostCommit_Java_ValidatesRunner_Flink.yml =>
beam_PerformanceTests_BigQueryIO_Streaming_Java.yml} (62%)
copy .github/workflows/{beam_PostCommit_Java_DataflowV2.yml =>
beam_PostCommit_Java_Examples_Dataflow_V2.yml} (82%)
copy .github/workflows/{beam_PostCommit_Java_Examples_Dataflow_Java.yml =>
beam_PostCommit_Java_Examples_Dataflow_V2_Java.yml} (68%)
copy .github/workflows/{beam_PostCommit_Java_ValidatesRunner_Flink_Java11.yml
=> beam_PostCommit_Java_Nexmark_Dataflow.yml} (56%)
copy .github/workflows/{beam_PostCommit_Java_DataflowV1.yml =>
beam_PostCommit_Java_Nexmark_Dataflow_V2.yml} (62%)
copy
.github/workflows/{beam_PostCommit_Java_ValidatesRunner_Direct_JavaVersions.yml
=> beam_PostCommit_Java_Nexmark_Dataflow_V2_Java.yml} (53%)
copy .github/workflows/{beam_PostCommit_Java_ValidatesRunner_Spark_Java11.yml
=> beam_PostCommit_Java_Nexmark_Direct.yml} (58%)
copy .github/workflows/{beam_PostCommit_Java_ValidatesRunner_Spark_Java11.yml
=> beam_PostCommit_Java_Nexmark_Flink.yml} (59%)
copy .github/workflows/{beam_PostCommit_Java_ValidatesRunner_Spark_Java11.yml
=> beam_PostCommit_Java_Nexmark_Spark.yml} (58%)
copy .github/workflows/{beam_PostCommit_Java.yml =>
beam_PostCommit_Java_PVR_Flink_Streaming.yml} (79%)
copy .github/workflows/{beam_PostCommit_Java_Sickbay.yml =>
beam_PostCommit_Java_PVR_Samza.yml} (83%)
copy .github/workflows/{beam_PostCommit_Java_Examples_Spark.yml =>
beam_PostCommit_Java_PVR_Spark3_Streaming.yml} (82%)
copy .github/workflows/{beam_PostCommit_Java_DataflowV1.yml =>
beam_PostCommit_Java_PVR_Spark_Batch.yml} (81%)
copy .github/workflows/{beam_PostCommit_Java.yml =>
beam_PostCommit_Javadoc.yml} (85%)
copy .github/workflows/{beam_PostCommit_Sickbay_Python.yml =>
beam_PostCommit_Python.yml} (75%)
create mode 100644 .github/workflows/beam_PostCommit_Python_Nexmark_Direct.yml
copy .github/workflows/{beam_PostCommit_Java_DataflowV2.yml =>
beam_PostCommit_SQL.yml} (85%)
copy .github/workflows/{beam_PreCommit_GoPortable.yml =>
beam_PreCommit_GoPrism.yml} (88%)
create mode 100644
.github/workflows/load-tests-job-configs/config_CoGBK_Java_Streaming_2GB_MultipleKey.txt
create mode 100644
.github/workflows/load-tests-job-configs/config_CoGBK_Java_Streaming_2GB_Reiteration_10KB.txt
create mode 100644
.github/workflows/load-tests-job-configs/config_CoGBK_Java_Streaming_2GB_Reiteration_2MB.txt
create mode 100644
.github/workflows/load-tests-job-configs/config_CoGBK_Java_Streaming_2GB_SingleKey.txt
create mode 100644
.github/workflows/performance-tests-job-configs/config_BigQueryIO_Batch_Java_Avro.txt
create mode 100644
.github/workflows/performance-tests-job-configs/config_BigQueryIO_Batch_Java_Json.txt
create mode 100644
.github/workflows/performance-tests-job-configs/config_BigQueryIO_Streaming_Java.txt
copy .github/workflows/issue-tagger.yml => sdks/python/apache_beam/py.typed
(63%)
