[
https://issues.apache.org/jira/browse/HUDI-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Mahindra updated HUDI-7418:
----------------------------------
Description: We have support for filter the input files based on an
extension (custom) for GCS Incr Source that can be configured. But we don't
have the same for the S3 incr source (which always assumes that file extension
is same as the format which may not be the case always). (was: We have support
for filter the input files based on an extension (custom) that can be
configured. But we don't have the same for the s3 source (which always assumes
that file extension is same as the format which may not be the case always).)
> Implement file extension filter for s3 incr source
> --------------------------------------------------
>
> Key: HUDI-7418
> URL: https://issues.apache.org/jira/browse/HUDI-7418
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Rajesh Mahindra
> Assignee: Rajesh Mahindra
> Priority: Trivial
> Labels: pull-request-available
>
> We have support for filter the input files based on an extension (custom) for
> GCS Incr Source that can be configured. But we don't have the same for the S3
> incr source (which always assumes that file extension is same as the format
> which may not be the case always).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
