Vikram Bohra created GOBBLIN-910:
------------------------------------
Summary: Add Unix timestamp copyable recursive dataset finder with
snapshot selection policy
Key: GOBBLIN-910
URL: https://issues.apache.org/jira/browse/GOBBLIN-910
Project: Apache Gobblin
Issue Type: New Feature
Reporter: Vikram Bohra
A dataset finder that takes a lookback time and a snapshot selection p[olicy to
return a list of files to copy from source to destination.
The finder also takes in a regex that is used to extract the timestamp from the
path.
snapshot policies
ALL: Returns all files within the look back time
EARLIEST: returns the earliest snapshot per day of the look back time
LATEST: returns the last snapshot per day of the look back time
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
