damccorm opened a new pull request, #41025:
URL: https://github.com/apache/beam/pull/41025

   ## Summary
   
   Populates missing options in the Go Dataflow runner's 
`sdk_pipeline_options.options` (`dataflowOptions` in 
`sdks/go/pkg/beam/runners/dataflow/dataflowlib/job.go`):
   
   - `project` and `dataflowServiceOptions`: Required by Dataflow Managed 
Transforms expansion (`GcsBasedExpansionServiceManager`) and cross-language 
Java/Python SDK harnesses (which deserialize top-level 
`sdk_pipeline_options["options"]` when `"options"` is present).
   - `jobName`: Read by Dataflow worker provisioning 
(`FnApiProvisioningService`) to populate `ProvisionInfo.metadata["job_name"]`, 
which the Go and Java container boot loaders use as the default service name 
when `enable_google_cloud_profiler` is enabled.
   - `diskProvisionedIops` and `diskProvisionedThroughputMibps`: Added to the 
`dataflowOptions` struct in #38349 and filtered out of 
`beam:option:go_options:v1` by `flagFilter`, but never populated in the 
`dataflowOptions` literal in `Translate` (so they always serialized as `0`).
   
   ## Testing
   
   - Updated `TestTranslate` in 
`sdks/go/pkg/beam/runners/dataflow/dataflowlib/job_test.go`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to