Kenneth Jung created BEAM-9675:
----------------------------------

             Summary: BigQueryStorageStreamSource reader quota issues at split 
time
                 Key: BEAM-9675
                 URL: https://issues.apache.org/jira/browse/BEAM-9675
             Project: Beam
          Issue Type: Bug
          Components: io-java-gcp
    Affects Versions: 2.19.0
            Reporter: Kenneth Jung
            Assignee: Kenneth Jung


The [BigQuery Storage 
API|[https://cloud.google.com/bigquery/docs/reference/storage]] returns an 
empty SplitStreamResponse when a stream cannot be split any further. The 
BigQueryStorageStreamSource reader should honor this response and not make 
further split calls for a stream when such a response is encountered; 
continuing to attempt splits leads to unnecessary quota exhaustion for 
management plane API calls.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to