[
https://issues.apache.org/jira/browse/SQOOP-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Veena Basavaraj updated SQOOP-1804:
-----------------------------------
Description:
Details of this proposal are in the wiki.
https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+And+Merge+Design#DeltaFetchAndMergeDesign-Wheretostoretheoutputinsqoop?
Will use this ticket for more detailed discussion on storage options for the
output from connectors
{code}
public static final String QUERY_CREATE_TABLE_SQ_JOB_OUTPUT =
"CREATE TABLE " + TABLE_SQ_JOB_OUTPUT + " ("
+ COLUMN_SQ_JOB_OUT_ID + " BIGINT, "
+ COLUMN_SQ_JOB_OUT_KEY + " BIGINT, "
+ COLUMN_SQ_JOB_OUT_VALUE + " LONG VARCHAR,"
+ COLUMN_SQ_JOB_OUT_TYPE + " VARCHAR(32),"
{code}
At the code level, we will define MOutputType, one of the types can be BLOB as
well, if a connector decides to store the value as a BLOB
{code}
class JobOutput {
String key;
Object value;
MOutputType type;
}
{code}
was:
Details of this proposal are in the wiki.
https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+And+Merge+Design#DeltaFetchAndMergeDesign-Wheretostoretheoutputinsqoop?
Will use this ticket for more detailed discussion on storage options for the
output from connectors
{code}
public static final String QUERY_CREATE_TABLE_SQ_JOB_OUTPUT =
"CREATE TABLE " + TABLE_SQ_JOB_INPUT + " ("
+ COLUMN_SQ_JOB_OUT_ID + " BIGINT, "
+ COLUMN_SQ_JOB_OUT_KEY + " BIGINT, "
+ COLUMN_SQ_JOB_OUT_VALUE + " LONG VARCHAR,"
+ COLUMN_SQ_JOB_OUT_TYPE + " VARCHAR(32),"
{code}
At the code level, we will define MOutputType, one of the types can be BLOB as
well, if a connector decides to store the value as a BLOB
{code}
class JobOutput {
String key;
Object value;
MOutputType type;
}
{code}
> Respository API: Storing/Retrieving the From/To state of the incremental
> read/ write
> ------------------------------------------------------------------------------------
>
> Key: SQOOP-1804
> URL: https://issues.apache.org/jira/browse/SQOOP-1804
> Project: Sqoop
> Issue Type: Sub-task
> Reporter: Veena Basavaraj
> Assignee: Veena Basavaraj
> Fix For: 1.99.5
>
>
> Details of this proposal are in the wiki.
> https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+And+Merge+Design#DeltaFetchAndMergeDesign-Wheretostoretheoutputinsqoop?
> Will use this ticket for more detailed discussion on storage options for the
> output from connectors
> {code}
> public static final String QUERY_CREATE_TABLE_SQ_JOB_OUTPUT =
> "CREATE TABLE " + TABLE_SQ_JOB_OUTPUT + " ("
> + COLUMN_SQ_JOB_OUT_ID + " BIGINT, "
> + COLUMN_SQ_JOB_OUT_KEY + " BIGINT, "
> + COLUMN_SQ_JOB_OUT_VALUE + " LONG VARCHAR,"
> + COLUMN_SQ_JOB_OUT_TYPE + " VARCHAR(32),"
> {code}
> At the code level, we will define MOutputType, one of the types can be BLOB
> as well, if a connector decides to store the value as a BLOB
> {code}
> class JobOutput {
> String key;
> Object value;
> MOutputType type;
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
