This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from fd854635552 Merge pull request #17759: Fix 2.38.0 download page.
add 8a389892373 [BEAM-14492] add flinkConfDir to FlinkPipelineOptions
add c5e521a85f9 Merge pull request #17715: [BEAM-14492] add flinkConfDir
to FlinkPipelineOptions
add f10d5781aa9 [BEAM-14336] Re-enable `flight_delays_it_test` with
`apache-beam-testing` dataset (#17758)
add ff39fcb5229 [BEAM-11106] small nits to truncate sdf exec unit (#17755)
add 7c92e8c3c7b Added standard logging when exception is thrown (#17717)
add 9a67e308f23 [BEAM-13829] Enable worker status in Go
add ff2ac0af470 [BEAM-14519] Add website page for Go dependencies (#17766)
add 075757d7369 [BEAM-11106] Validate that DoFn returns Process
continuation when Truncating (#17770)
add 92b8dc75286 [BEAM-14505] Add Dataflow streaming pipeline update
support to the Go SDK (#17747)
add c4af119545c DLQ for BQ Storage Api writes
add 25039a8aea8 Merge pull request #17423: Handle invalid rows in the
Storage Api sink
add 46ca24304b3 Bump google.golang.org/api from 0.76.0 to 0.81.0 in /sdks
add 9dea7ebd8fc Merge pull request #17751: Bump google.golang.org/api from
0.76.0 to 0.81.0 in /sdks
No new revisions were added by this update.
Summary of changes:
.../runners/flink/FlinkExecutionEnvironments.java | 26 +++--
.../flink/FlinkPipelineExecutionEnvironment.java | 8 +-
.../beam/runners/flink/FlinkPipelineOptions.java | 8 ++
.../flink/FlinkExecutionEnvironmentsTest.java | 118 ++++++--------------
sdks/go.mod | 16 +--
sdks/go.sum | 31 ++++--
sdks/go/pkg/beam/core/graph/fn.go | 8 ++
sdks/go/pkg/beam/core/graph/fn_test.go | 18 ++-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 15 ++-
.../beam/core/runtime/exec/sdf_invokers_test.go | 10 +-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 5 +-
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 17 +++
sdks/go/pkg/beam/runners/dataflow/dataflow_test.go | 78 +++++++++++++
.../beam/runners/dataflow/dataflowlib/execute.go | 2 +-
.../pkg/beam/runners/dataflow/dataflowlib/job.go | 18 ++-
.../beam/sdk/io/gcp/bigquery/BatchLoads.java | 4 +-
...nfo.java => BigQueryStorageApiInsertError.java} | 39 +++++--
.../BigQueryStorageApiInsertErrorCoder.java} | 38 +++----
.../io/gcp/bigquery/StorageApiConvertMessages.java | 64 ++++++++---
.../bigquery/StorageApiDynamicDestinations.java | 3 +
.../StorageApiDynamicDestinationsBeamRow.java | 6 +
.../StorageApiDynamicDestinationsTableRow.java | 6 +-
.../beam/sdk/io/gcp/bigquery/StorageApiLoads.java | 124 +++++++++++++++------
.../sdk/io/gcp/bigquery/StreamingWriteTables.java | 2 +
.../io/gcp/bigquery/TableRowToStorageApiProto.java | 107 ++++++++++++++----
.../beam/sdk/io/gcp/bigquery/TableSchemaCache.java | 1 +
.../beam/sdk/io/gcp/bigquery/WriteResult.java | 103 +++++++++++------
.../beam/sdk/io/gcp/spanner/BatchSpannerRead.java | 4 +
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 94 +++++++++++++++-
.../gcp/bigquery/TableRowToStorageApiProtoIT.java | 1 -
.../examples/dataframe/flight_delays.py | 21 ++--
.../examples/dataframe/flight_delays_it_test.py | 63 ++++++-----
.../en/documentation/sdks/go-dependencies.md | 32 ++++++
.../layouts/partials/section-menu/en/sdks.html | 1 +
.../shortcodes/flink_java_pipeline_options.html | 5 +
.../shortcodes/flink_python_pipeline_options.html | 5 +
36 files changed, 793 insertions(+), 308 deletions(-)
copy
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/{TableRowInfo.java
=> BigQueryStorageApiInsertError.java} (56%)
copy
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/{bigtable/BigtableWriteResultCoder.java
=> bigquery/BigQueryStorageApiInsertErrorCoder.java} (51%)
create mode 100644
website/www/site/content/en/documentation/sdks/go-dependencies.md
