MyeoungDev opened a new issue, #10504: URL: https://github.com/apache/seatunnel/issues/10504
### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description ## Purpose Currently, File-based connectors (LocalFile, S3, HDFS, etc.) do not provide a way to control subdirectory scanning. In certain scenarios, users need to process files only in the specific root directory. 1. Improve performance by avoiding unnecessary deep-tree walking. 2. Prevent loading incorrect data that might be stored in subfolders (e.g., archived or partitioned data not meant for the current task). ## Proposed Change I'd like to introduce a new option recursive_file_scan (boolean) to the File Source connectors. `true` (default): Scan all files in the specified path and its subdirectories. `false`: Only scan files located directly in the specified path, ignoring subdirectories. ### Usage Scenario _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
