[
https://issues.apache.org/jira/browse/SQOOP-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14218936#comment-14218936
]
Abraham Elmahrek commented on SQOOP-1751:
-----------------------------------------
So what do you guys think about this:
# All configuration related to metadata should be in the LinkConfiguration:
Dataset URI, Data Format (Parquet, Avro, CSV, etc.), etc.
# Modes of operation can be in the JobConfiguration: Overwrite, create dataset,
etc.
Reasoning for #1 is that the Dataset metadata is fixed and may some day have
sensitive information (an equivalent is a JDBC connection). Also, the users
responsible for knowing this kind of information may be Hadoop administrators.
Reasoning for #2 is that modes of operation will vary based on use case and do
not require metadata changes.
Thoughts?
> Rearrange LinkConfig and ToJobConfig
> ------------------------------------
>
> Key: SQOOP-1751
> URL: https://issues.apache.org/jira/browse/SQOOP-1751
> Project: Sqoop
> Issue Type: Sub-task
> Components: connectors
> Reporter: Qian Xu
> Assignee: Qian Xu
> Priority: Minor
> Fix For: 1.99.5
>
>
> Regarding Abe's review comments, here are thoughts to rearrange configuration
> items.
> 1. File Output Format should be specified in ToJobConfig.
> 2. Corresponding validation should happen on time.
> 3. Split protocol, host and port part to link and leave destination to
> toJobConfig
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
