[
https://issues.apache.org/jira/browse/SQOOP-1168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251135#comment-14251135
]
Veena Basavaraj commented on SQOOP-1168:
----------------------------------------
[~gwenshap]
>>>Extra clarification about use of COUNTER:
I prefer doing the right thing, than the easy thing. If submission is the
place we want to store it seems apt, BTW the right thing is as not that hard
either, adding a table and extending the current table to support more types is
not that hard, I have done many changes in the repo so far so I speak from that
experience.:). the wiki explains the details of the change
>>n this case, what's the plan on validating that the inputs for "from" and
>>"to" connectors are consistent?
I am not sure what consistent means? The connectors have a api in initializer
that says if they support delta fetch / merge.
[~jarcec] and I were discussing this offline, so will repeat the same here
There are few things that can happen
create job -f 1 -t 2
f and t both dont support, all good, since there wont be any such configs
displayed
f supports delta and t supports delta, all good
For the following two
f supports delta and t does not,
f does not support, but t does.
we can do upfront check and do not display the delta configs at all, not that
hard to do ( that I prefer )
or we can be more flexible and say if the t supports delta, then lets its ok.
very similar to schema matching, where the rules have been defined based on the
current assumptions that LocationMatcher takes precedence over Name matching.
> Sqoop2: Delta Fetch/ Merge ( formerly called Incremental Import )
> -----------------------------------------------------------------
>
> Key: SQOOP-1168
> URL: https://issues.apache.org/jira/browse/SQOOP-1168
> Project: Sqoop
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Veena Basavaraj
> Fix For: 1.99.5
>
>
> The formal design wiki is here
> https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+and+Merge+Design
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
