Aryan Naraghi created BEAM-7495:
-----------------------------------
Summary: Add support for dynamic worker re-balancing when reading
BigQuery data using Cloud Dataflow
Key: BEAM-7495
URL: https://issues.apache.org/jira/browse/BEAM-7495
Project: Beam
Issue Type: New Feature
Components: io-java-gcp
Reporter: Aryan Naraghi
Currently, the BigQuery connector for reading data using the BigQuery Storage
API does not support any of the facilities on the source for Dataflow to split
streams.
On the server side, the BigQuery Storage API supports splitting streams at a
fraction. By adding support to the connector, we enable Dataflow to split
streams, which unlocks dynamic worker re-balancing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
