[
https://issues.apache.org/jira/browse/BEAM-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144591#comment-16144591
]
Chamikara Jayalath commented on BEAM-2817:
------------------------------------------
Looks like this will be a good starter/newbie issue.
Relevant links:
https://cloud.google.com/bigquery/docs/running-queries#bigquery-query-batch-api
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryQuerySource.java#L167
> Bigquery queries should allow options to run in batch mode or not
> -----------------------------------------------------------------
>
> Key: BEAM-2817
> URL: https://issues.apache.org/jira/browse/BEAM-2817
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-gcp
> Affects Versions: 2.0.0
> Reporter: Lara Schmidt
> Assignee: Chamikara Jayalath
>
> When bigquery read does a query it sets the mode to batch. A batch query can
> be very slow to schedule as it batches it with other queries. However it
> doesn't use batch quota which is better for some cases. However, in some
> cases a fast query is better (especially in timed tests). It would be a good
> idea to have a configuration to the bigquery source to set this per-read.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
