[
https://issues.apache.org/jira/browse/HDDS-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyao Meng updated HDDS-5542:
-----------------------------
Description:
In rare cases, applications will not seemingly trigger
OzoneConfiguration#loadDefaults, resulting in only default in ozone-default.xml
being loaded (in activate()). We can *steadily repro* the bug with pysparkshell
in the below mode:
{code}
pyspark --master yarn --deploy-mode client --name "PySparkShell"
{code}
The line was removed in HDDS-1469
([PR|https://github.com/apache/hadoop/pull/773#pullrequestreview-230833296])
with the refactoring as it was seemingly unnecessary to keep it.
was:
In rare cases, applications will not seemingly trigger
OzoneConfiguration#loadDefaults, resulting in only default in ozone-default.xml
being loaded (in activate()). We can *steadily repro* the bug with pysparkshell
in the below mode:
{code}
pyspark --master yarn --deploy-mode client --name "PySparkShell"
{code}
The line was removed in HDDS-1469
([PR|https://github.com/apache/hadoop/pull/773#pullrequestreview-230833296])
before with the refactoring as it was seemingly unnecessary to keep it.
> Restore adding ozone-site.xml to default resource in
> OzoneConfiguration#activate
> --------------------------------------------------------------------------------
>
> Key: HDDS-5542
> URL: https://issues.apache.org/jira/browse/HDDS-5542
> Project: Apache Ozone
> Issue Type: Bug
> Reporter: Siyao Meng
> Assignee: Siyao Meng
> Priority: Major
> Labels: pull-request-available
>
> In rare cases, applications will not seemingly trigger
> OzoneConfiguration#loadDefaults, resulting in only default in
> ozone-default.xml being loaded (in activate()). We can *steadily repro* the
> bug with pysparkshell in the below mode:
> {code}
> pyspark --master yarn --deploy-mode client --name "PySparkShell"
> {code}
> The line was removed in HDDS-1469
> ([PR|https://github.com/apache/hadoop/pull/773#pullrequestreview-230833296])
> with the refactoring as it was seemingly unnecessary to keep it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
