Jeff Storck created NIFI-6275:
---------------------------------
Summary: ListHDFS with Full Path filter mode regex does not work
as intended
Key: NIFI-6275
URL: https://issues.apache.org/jira/browse/NIFI-6275
Project: Apache NiFi
Issue Type: Improvement
Components: Documentation & Website, Extensions
Affects Versions: 1.9.2, 1.9.1, 1.9.0, 1.8.0
Reporter: Jeff Storck
Assignee: Jeff Storck
When using the *{{Full Path}}* filter mode, the regex is applied to the URI
returned for each file which includes the scheme and authority (hostname, HA
namespace, port). For the filter to work across multiple HDFS installations
(such as a flow used on multiple environments that is retrieved from NiFi
Registry), the regex filter would have to account for the scheme and authority
by matching possible scheme and authority values.
To make it easier for the user, the *{{Full Path}}* filter mode's filter regex
should only be applied to the path components of the URI, without the scheme
and authority. This can be done by updating the filter for *{{Full Path}}*
mode to use:
https://hadoop.apache.org/docs/r2.7.3/api/org/apache/hadoop/fs/Path.html#getPathWithoutSchemeAndAuthority(org.apache.hadoop.fs.Path).
This will bring the regex values in line with the other modes, since those
are only applied to the value of *{{Path.getName()}}*.
Migration guidance will be needed when this improvement is released. Existing
regex values for *{{Full Path}}* filter mode that accepted any scheme and
authority will still work.
Those that specify a scheme and authority will *_not_* work, and will have to
be updated to specify only path components.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
