[
https://issues.apache.org/jira/browse/SQOOP-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509809#comment-14509809
]
Jarek Jarcec Cecho commented on SQOOP-2318:
-------------------------------------------
Thank you for updating your patch [~szehon]! I'm wondering what are your
thoughts on adding an explicit check to see if the variable {{configDirectory}}
is empty and executing the "local" mode only in case that the property is
undefined?
I'm worried that with current version, the administrator might mis-spell the
path to Hadoop configuration files (or we won't have proper privileges to read
the path) and then instead of failing the start, we'll silently fall into a
"test" mode which might be quite hard to debug. Hence I'm thinking whether it
would make sense to make this test mode explicit by allowing the local mode
only as long as the {{configDirectory}} is configured as empty string (or
{{null}}) - that seems like an explicit action that is hard to do by "mistake".
> Use hadoop configuration defaults for MapReduceSubmissionEngine
> ---------------------------------------------------------------
>
> Key: SQOOP-2318
> URL: https://issues.apache.org/jira/browse/SQOOP-2318
> Project: Sqoop
> Issue Type: Bug
> Components: sqoop2-framework
> Reporter: Szehon Ho
> Assignee: Szehon Ho
> Attachments: SQOOP-2318.2.patch, SQOOP-2318.patch
>
>
> Found this while trying to run a local job runner out of the box for
> development testing.
> The MapReduceSubmissionEngine looks in /etc/hadoop/conf for hadoop
> configurations. When trying to run a local job runner without an actual
> hadoop install, this forces the user to create an /etc/hadoop/conf directory,
> and then put a lot of configs in there to get local job runner to work.
> Proposing a change to use hadoop defaults (comes with Hadoop Configuration
> object), which will make local job runner work out of the box. Though, empty
> /etc/hadoop/conf directory still needs to be created.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
