[jira] [Created] (HUDI-7086) Scale GCS event source to consume large no of msgs from queue

[sivabalan narayanan (Jira)]

sivabalan narayanan created HUDI-7086:
-----------------------------------------

             Summary: Scale GCS event source to consume large no of msgs from 
queue
                 Key: HUDI-7086
                 URL: https://issues.apache.org/jira/browse/HUDI-7086
             Project: Apache Hudi
          Issue Type: Improvement
          Components: deltastreamer
            Reporter: sivabalan narayanan


We should be able to consume 100 or more messages in one batch for GCS event 
source. 

 

If apis has some limitations, lets invoke multiple times before ingesting to 
hudi. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)