Vinish Reddy created HUDI-7452:
----------------------------------
Summary: Repartition row dataset in S3/GCS based on task size
Key: HUDI-7452
URL: https://issues.apache.org/jira/browse/HUDI-7452
Project: Apache Hudi
Issue Type: Improvement
Reporter: Vinish Reddy
Assignee: Vinish Reddy
In our current code we are doing a coalesce which just decreases the partitions
but doesn't increase them.
[https://github.com/vinishjail97/hudi/blob/master/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/CloudObjectsSelectorCommon.java#L207]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
