Timothy Brown created HUDI-9557:
-----------------------------------
Summary: Add ability to configure batch size and max concurrent
requests in Glue Sync
Key: HUDI-9557
URL: https://issues.apache.org/jira/browse/HUDI-9557
Project: Apache Hudi
Issue Type: Improvement
Reporter: Timothy Brown
Currently the max partitions per request is hardcoded. Let's make this
configurable and also configure a max concurrent requests. We have seen the
initial sync timeout due to too many inflight requests when there are hundreds
of thousands of partitions for a table.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
