[
https://issues.apache.org/jira/browse/SQOOP-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Qian Xu updated SQOOP-1751:
---------------------------
Description:
This is a follow up jira of SQOOP-1588. As Abe has pointed out, that File
Output Format should be moved to ToJobConfig. Corresponding validation should
happen on time.
Also as the credential stuff should remain in LinkConfig, I think we should add
{{hdfsHostPort}} into LinkConfig. Later we can also put other filesystem
location properties into it, if we do not want to use the hadoop environment
values (or they are not provided). User should only configure a job using
{{dataset:hdfs:/path/to/dataset}} instead of
{{dataset:hdfs://host:port:/path/to/dataset}} (Thank Ryan)
was:
This is a follow up jira of SQOOP-1588. As Abe has pointed out, that File
Output Format should be moved to ToJobConfig. Corresponding validation should
happen on time.
Also as the credential stuff should remain in LinkConfig, I think we should add
{{HostInfo}} in LinkConfig. Later we can move host:port out of dataset uri.
User should only give {{dataset:hdfs:/path/to/dataset}} instead of
{{dataset:hdfs://host:port:/path/to/dataset}} (Thank Ryan)
> Rearrange LinkConfig and ToJobConfig of Kite Connector
> ------------------------------------------------------
>
> Key: SQOOP-1751
> URL: https://issues.apache.org/jira/browse/SQOOP-1751
> Project: Sqoop
> Issue Type: Sub-task
> Components: connectors
> Reporter: Qian Xu
> Assignee: Qian Xu
> Fix For: 1.99.5
>
> Attachments: SQOOP-1751.3.patch, SQOOP-1751.4.patch, SQOOP-1751.patch
>
>
> This is a follow up jira of SQOOP-1588. As Abe has pointed out, that File
> Output Format should be moved to ToJobConfig. Corresponding validation should
> happen on time.
> Also as the credential stuff should remain in LinkConfig, I think we should
> add {{hdfsHostPort}} into LinkConfig. Later we can also put other filesystem
> location properties into it, if we do not want to use the hadoop environment
> values (or they are not provided). User should only configure a job using
> {{dataset:hdfs:/path/to/dataset}} instead of
> {{dataset:hdfs://host:port:/path/to/dataset}} (Thank Ryan)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
