Carl-Zhou-CN commented on code in PR #10332:
URL: https://github.com/apache/seatunnel/pull/10332#discussion_r2692826874
##########
docs/en/connector-v2/source/HdfsFile.md:
##########
@@ -88,6 +88,8 @@ Read data from hdfs file system.
| common-options | | no | -
| Source plugin common parameters, please refer to [Source Common
Options](../source-common-options.md) for details.
|
| file_filter_modified_start | string | no | -
| File modification time filter. The connector will filter some files base on
the last modification start time (include start time). The default data format
is `yyyy-MM-dd HH:mm:ss`.
|
| file_filter_modified_end | string | no | -
| File modification time filter. The connector will filter some files base on
the last modification end time (not include end time). The default data format
is `yyyy-MM-dd HH:mm:ss`.
|
+| enable_file_split | boolean | no | false
| Turn on logical file split to improve parallelism for huge files. Only
supported for `text`/`csv`/`json`/`parquet` and non-compressed format.
|
Review Comment:
Do we need this parameter? Can the size parameter be a positive number to
indicate that it is enabled
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
