[
https://issues.apache.org/jira/browse/HADOOP-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-17631:
------------------------------------
Description:
When configuration reads in resources with a restricted parser, it skips
evaluaging system ${env. } vars. But it also skips evaluating fallbacks
As a result, a property like {{fs.s3a.buffer.dir}}
{code}
${env.LOCAL_DIRS:-${hadoop.tmp.dir}} ends up evaluating as
${env.LOCAL_DIRS:-${hadoop.tmp.dir}}
{code}
It should instead fall back to the "env var unset" option of ${hadoop.tmp.dir}.
This allows for configs (like for s3a buffer dirs) which are usable in
restricted mode as well as unrestricted deployments.
was:
When configuration reads in resources with a restricted parser, it skips
evaluaging system ${env. } vars. But it also skips evaluating fallbacks
As a result, a property like
${env.LOCAL_DIRS:-${hadoop.tmp.dir}} ends up evaluating as
${env.LOCAL_DIRS:-${hadoop.tmp.dir}}
It should instead fall back to the "env var unset" option of ${hadoop.tmp.dir}.
This allows for configs (like for s3a buffer dirs) which are usable in
restricted mode as well as unrestricted deployments.
> Configuration ${env.VAR:-FALLBACK} should eval FALLBACK when
> restrictSystemProps=true
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-17631
> URL: https://issues.apache.org/jira/browse/HADOOP-17631
> Project: Hadoop Common
> Issue Type: Bug
> Components: common
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Labels: pull-request-available
> Fix For: 3.3.2
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> When configuration reads in resources with a restricted parser, it skips
> evaluaging system ${env. } vars. But it also skips evaluating fallbacks
> As a result, a property like {{fs.s3a.buffer.dir}}
> {code}
> ${env.LOCAL_DIRS:-${hadoop.tmp.dir}} ends up evaluating as
> ${env.LOCAL_DIRS:-${hadoop.tmp.dir}}
> {code}
> It should instead fall back to the "env var unset" option of
> ${hadoop.tmp.dir}. This allows for configs (like for s3a buffer dirs) which
> are usable in restricted mode as well as unrestricted deployments.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
