[
https://issues.apache.org/jira/browse/BEAM-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497052#comment-17497052
]
Doug Mackenzie commented on BEAM-2985:
--------------------------------------
pipeline_result = DataflowRunner().run_pipeline(p, options=options)
> BigQuery IO write transform is broken for DirectRunner
> ------------------------------------------------------
>
> Key: BEAM-2985
> URL: https://issues.apache.org/jira/browse/BEAM-2985
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Chamikara Madhusanka Jayalath
> Assignee: Chamikara Madhusanka Jayalath
> Priority: P2
> Fix For: 2.2.0
>
>
> I get following error when trying to run BigQuery tornadoes using
> DirectRunner.
> DataflowRunner seems to be working fine.
> python -m apache_beam.examples.cookbook.bigquery_tornadoes --output
> <dataset>.<table> --project <project>
> Request missing required parameter projectId
> Traceback for above exception (most recent call last):
> File "apache_beam/utils/retry.py", line 175, in wrapper
> return fun(*args, **kwargs)
> File "apache_beam/io/gcp/bigquery.py", line 828, in _get_table
> response = self.client.tables.Get(request)
> File "apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
> line 608, in Get
> config, request, global_params=global_params)
> File
> "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py",
> line 695, in _RunMethod
> download)
> File
> "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py",
> line 676, in PrepareHttpRequest
> method_config, request, relative_path=url_builder.relative_path)
> File
> "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/base_api.py",
> line 580, in __ConstructRelativePath
> relative_path=relative_path)
> File
> "/Users/chamikara/testing/beam_bq_09_22_2017/env1/lib/python2.7/site-packages/apitools/base/py/util.py",
> line 124, in ExpandRelativePath
> 'Request missing required parameter %s' % param)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
