Aditya Sharma created GOBBLIN-267:
-------------------------------------
Summary: HiveSource creates workunit even when update time is
before maxLookBackDays
Key: GOBBLIN-267
URL: https://issues.apache.org/jira/browse/GOBBLIN-267
Project: Apache Gobblin
Issue Type: Bug
Components: misc
Reporter: Aditya Sharma
Assignee: Aditya Sharma
org.apache.gobblin.data.management.conversion.hive.source.HiveSource creates
workunit if:
1) Create time is after maxLookBackDays
2) Update time is greater than watermark
Since there are multiple policies to decide update time, it can happen that
create time is greater than update time and hence maxLookBackDays will be
redundant.
HiveSource should check for maxLookBackDays corresponding to update time
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
