[
https://issues.apache.org/jira/browse/SQOOP-1168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252244#comment-14252244
]
Veena Basavaraj edited comment on SQOOP-1168 at 12/18/14 9:05 PM:
------------------------------------------------------------------
[~jarcec]
NOTE: I am using delta consistently, that is what probably means incremental.
1. Explain to me why sqoop needs to know it is delta read/ write? connectors
need to know that is all. I have seen this question from @gwen too but unclear
as to why sqoop needs to know about it, since we have no code in sqoop that
will influence the delta fetch and merge
2. I am again not sure what part of the wiki is not clear, see the Storing
state section. It has the details and lays out possible ways. and to answer
the history question, is it not obvious that once it is in submission or config
values per job that is is history and is not overwriiten?
every start job should have its own record of what happend in that job
Update: here is the wiki link if you have no read it
https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+and+Merge+Design#DeltaFetchandMergeDesign-DesignFeaturesTake2
was (Author: vybs):
[~jarcec]
NOTE: I am using delta consistently, that is what probably means incremental.
1. Explain to me why sqoop needs to know it is delta read/ write? connectors
need to know that is all. I have seen this question from @gwen too but unclear
as to why sqoop needs to know about it, since we have no code in sqoop that
will influence the delta fetch and merge
2. I am again not sure what part of the wiki is not clear, see the STORE
section. It has the details and lays out possible ways. and to answer the
history question, is it not obvious that once it is in submission or config
values per job that is is history and is not overwriiten?
every start job should have its own record of what happend in that job
> Sqoop2: Delta Fetch/ Merge ( formerly called Incremental Import )
> -----------------------------------------------------------------
>
> Key: SQOOP-1168
> URL: https://issues.apache.org/jira/browse/SQOOP-1168
> Project: Sqoop
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Veena Basavaraj
> Fix For: 1.99.5
>
>
> The formal design wiki is here
> https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+and+Merge+Design
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)