[
https://issues.apache.org/jira/browse/SQOOP-1168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248129#comment-14248129
]
Vinoth Chandar commented on SQOOP-1168:
---------------------------------------
>> At this point I am convinced that the connector needs to explicitly say that
>> they support DFM in the directions that they support. i.e a connector can
>> support DF and and not DM or vice versa. So the initializer seems like place
>> to declare this
+1 .
>> I am debating whether the word predicate just adds to more confusion, and I
>> should just stick to config
>From what I understand, Predicates (If Predicates basically mean a set of
>conditions that determine matching rows to be fetched each time) seem a high
>level construct than Configs (where connector already decides what checks we
>will do and we simply provide things like compare column name etc in the Job
>config). Configs are more useful, easier to comprehend and for the most part
>sufficient, in my opinion.
>> As a user, does he have to really know the difference between a full
>> transfer and sub set transfer of records?
In my mind, a Job is a created once.. First run is a full transfer and
subsequent runs are delta. Sqoop server should track this state internally in
the repository and possibly provide means to "reset" this state (say HDFS
output is lost and we need to do a full transfer again).
I prefer keeping it simple and consistent with "create job" . If user does not
configure delta configs, we do full transfers everytime..
Hope it helps.
> Sqoop2: Delta Fetch/ Merge ( formerly called Incremental Import )
> -----------------------------------------------------------------
>
> Key: SQOOP-1168
> URL: https://issues.apache.org/jira/browse/SQOOP-1168
> Project: Sqoop
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Veena Basavaraj
> Fix For: 1.99.5
>
>
> The formal design wiki is here
> https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+and+Merge+Design
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
