yzeng1618 commented on code in PR #10332:
URL: https://github.com/apache/seatunnel/pull/10332#discussion_r2692901078
##########
docs/en/connector-v2/source/HdfsFile.md:
##########
@@ -88,6 +88,8 @@ Read data from hdfs file system.
| common-options | | no | -
| Source plugin common parameters, please refer to [Source Common
Options](../source-common-options.md) for details.
|
| file_filter_modified_start | string | no | -
| File modification time filter. The connector will filter some files base on
the last modification start time (include start time). The default data format
is `yyyy-MM-dd HH:mm:ss`.
|
| file_filter_modified_end | string | no | -
| File modification time filter. The connector will filter some files base on
the last modification end time (not include end time). The default data format
is `yyyy-MM-dd HH:mm:ss`.
|
+| enable_file_split | boolean | no | false
| Turn on logical file split to improve parallelism for huge files. Only
supported for `text`/`csv`/`json`/`parquet` and non-compressed format.
|
Review Comment:
At present, the parameters are mainly consistent with those of the
localfile, and this parameter is used by default to control whether sharding is
enabled. https://github.com/apache/seatunnel/pull/10142/changes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
