[
https://issues.apache.org/jira/browse/APEXMALHAR-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418962#comment-15418962
]
ASF GitHub Bot commented on APEXMALHAR-2184:
--------------------------------------------
Github user amberarrow commented on a diff in the pull request:
https://github.com/apache/apex-malhar/pull/368#discussion_r74606337
--- Diff: docs/operators/fsInputOperator.md ---
@@ -0,0 +1,101 @@
+File Input Operator
+=============
+
+## Operator Objective
+This operator scans a directory for files. Files are then read and split
into tuples, which are emitted. The default implementation scans a single
directory. The operator is fault tolerant. It tracks previously read files and
current offset as part of checkpoint state. In case of failure the operator
will skip files that were already processed and fast forward to the offset of
the current file. Supports partitioning and changes to number of partitions.
The directory scanner is responsible to only accept the files that belong to a
partition.
--- End diff --
"Supports partitioning ... partitions." => Supports both static and dynamic
partitioning.
> Add documentation for FileSystem Input Operator
> -----------------------------------------------
>
> Key: APEXMALHAR-2184
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2184
> Project: Apache Apex Malhar
> Issue Type: Documentation
> Reporter: Priyanka Gugale
> Assignee: Priyanka Gugale
> Priority: Minor
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
