Udi Meiri created BEAM-11521:
--------------------------------
Summary: BigQuery: add maxStreamingBatchSize for Python streaming
inserts
Key: BEAM-11521
URL: https://issues.apache.org/jira/browse/BEAM-11521
Project: Beam
Issue Type: Bug
Components: io-py-gcp
Reporter: Udi Meiri
Java SDK has maxStreamingBatchSize.
Implementing something similar for Python would prevent 400 HTTP errors from
BigQuery when batches are too large. Instead, Beam should try to split batches
and log a warning (once) when trying to insert a single very large row.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
