ahmedabu98 commented on PR #33026:
URL: https://github.com/apache/beam/pull/33026#issuecomment-2466002493
This is supposed to work for cross-language too right? I tried the following
pipeline but the underlying transform doesn't recognize the pipeline options
passed from the Python SDK:
```python
options = PipelineOptions([
"--project=google.com:clouddfe",
"--region=us-central1",
"--temp_location=gs://ahmedabualsaud-wordcount/tmp",
])
with beam.Pipeline(options=options) as p:
(p
| beam.Create([beam.Row(int=999)])
| beam.managed.Write("bigquery",
config={"table":
"google.com:clouddfe.ahmedabualsaud.test_table"}))
```
File Loads is meant to fetch the GCS location from pipeline options
`temp_location`, but does not find it. I added some logging and can see that
pipeline options are not getting picked up by the expanded xlang transform
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
