[
https://issues.apache.org/jira/browse/PIG-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887898#comment-13887898
]
Aniket Mokashi commented on PIG-3731:
-------------------------------------
Thinking about this again, there are two problems here-
1. "io." settings which are similar to fs settings should not be modified in
local mode.
2. Some of the "io." or other settings may not be suitable across MR and local
mode (eg- io.sort.mb). We should provide a mechanism so that they can be
overridden (on per script basis- for users running same script in local mode
and for auto local mode).
> Ability to specify local-mode specific configuration (useful for
> local/auto-local mode)
> ---------------------------------------------------------------------------------------
>
> Key: PIG-3731
> URL: https://issues.apache.org/jira/browse/PIG-3731
> Project: Pig
> Issue Type: Improvement
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
>
> This could be done in several ways, however, adding a namespace (pig.local.)
> for this is better so that only a few number of jobs that require this can
> make use of it.
> set pig.local.io.sort.mb 50 will set io.sort.mb=50 for local mode jobs
> allowing many jobs to run in parallel. Another setting that might be required
> is - io.compression.codecs.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
