[
https://issues.apache.org/jira/browse/HUDI-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinish Reddy updated HUDI-7501:
-------------------------------
Description: Use SourceProfile in S3/GCS sources for the sourceLimit and
numPartitions. Instead of relying on the sourceLimit passed in from static
config use the one provided by the source profile.
> Use source profile for S3 and GCS sources
> -----------------------------------------
>
> Key: HUDI-7501
> URL: https://issues.apache.org/jira/browse/HUDI-7501
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Vinish Reddy
> Assignee: Vinish Reddy
> Priority: Minor
>
> Use SourceProfile in S3/GCS sources for the sourceLimit and numPartitions.
> Instead of relying on the sourceLimit passed in from static config use the
> one provided by the source profile.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)