Sudarshan Vasudevan created GOBBLIN-368:
-------------------------------------------
Summary: Add configuration property to allow application of
filters to directory paths
Key: GOBBLIN-368
URL: https://issues.apache.org/jira/browse/GOBBLIN-368
Project: Apache Gobblin
Issue Type: Bug
Components: distcp-ng
Affects Versions: 0.11.0, 0.12.0, 0.13.0
Reporter: Sudarshan Vasudevan
Assignee: Issac Buenrostro
Fix For: 0.13.0
Currently, CopyableDatasets such as RecursiveCopyableDataset apply pathfilters
only to files and not to directories. As a result, "hidden" and temporary
directories (and their contents) can get listed for distcp. We ideally want to
control whether pathfilters should be applied to directories via a config
property.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)