Github user bbende commented on a diff in the pull request:
https://github.com/apache/nifi/pull/1383#discussion_r94950985
--- Diff:
nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/src/main/java/org/apache/nifi/processors/hadoop/ListHDFS.java
---
@@ -176,7 +176,7 @@ private HDFSListing deserialize(final String
serializedState) throws JsonParseEx
// Build a sorted map to determine the latest possible entries
for (final FileStatus status : statuses) {
- if (status.getPath().getName().endsWith("_COPYING_")) {
+ if (status.getPath().getName().endsWith("_COPYING_") ||
status.getPath().getName().startsWith(".")) {
--- End diff --
I think we should try to be consistent with how ListFile works. It has a
property to apply a regex to filer filenames and the default value is anything
that doesn't start with a dot:
```
public static final PropertyDescriptor FILE_FILTER = new
PropertyDescriptor.Builder()
.name("File Filter")
.description("Only files whose names match the given regular
expression will be picked up")
.required(true)
.defaultValue("[^\\.].*")
.addValidator(StandardValidators.REGULAR_EXPRESSION_VALIDATOR)
.build();
```
This way the user can determine if they want dot files or not.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
