[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Release Note: By default, none of the built-in erasure coding policies are enabled. Users have to explicitly enable the erasure coding policy via the hdfs configuration 'dfs.namenode.ec.policies.enabled' before setting the policy on any directories. > Do not enable any erasure coding policies by default > > > Key: HDFS-11505 > URL: https://issues.apache.org/jira/browse/HDFS-11505 > Project: Hadoop HDFS > Issue Type: Improvement > Components: erasure-coding >Affects Versions: 3.0.0-alpha3 >Reporter: Andrew Wang >Assignee: Manoj Govindassamy > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HDFS-11505.01.patch, HDFS-11505.02.patch, > HDFS-11505.03.patch, HDFS-11505.04.patch > > > As discussed on HDFS-11314, administrators need to choose the correct set of > EC policies based on cluster size and desired fault-tolerance properties. > This means we should not enable any EC policies by default, since any default > value could be incorrect. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11505: --- Resolution: Fixed Hadoop Flags: Incompatible change Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available) Committed to trunk, thanks Manoj for the patch and Takanobu for the review! Manoj, do you mind adding a release note for this change? I'm going to be conservative and mark this as incompatible so it is flagged in the release notes. > Do not enable any erasure coding policies by default > > > Key: HDFS-11505 > URL: https://issues.apache.org/jira/browse/HDFS-11505 > Project: Hadoop HDFS > Issue Type: Improvement > Components: erasure-coding >Affects Versions: 3.0.0-alpha3 >Reporter: Andrew Wang >Assignee: Manoj Govindassamy > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HDFS-11505.01.patch, HDFS-11505.02.patch, > HDFS-11505.03.patch, HDFS-11505.04.patch > > > As discussed on HDFS-11314, administrators need to choose the correct set of > EC policies based on cluster size and desired fault-tolerance properties. > This means we should not enable any EC policies by default, since any default > value could be incorrect. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default
[
https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manoj Govindassamy updated HDFS-11505:
--
Attachment: HDFS-11505.04.patch
Thanks [~andrew.wang] and [~tasanuma0829] for the review. Attaching v04 patch
to enable EC policy in the needed tests only. Also, extended
{{TestEnabledECPolicies#testValid}} based on Takanobu's comment. Please tae a
look at the patch.
> Do not enable any erasure coding policies by default
>
>
> Key: HDFS-11505
> URL: https://issues.apache.org/jira/browse/HDFS-11505
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: erasure-coding
>Affects Versions: 3.0.0-alpha3
>Reporter: Andrew Wang
>Assignee: Manoj Govindassamy
> Labels: hdfs-ec-3.0-must-do
> Attachments: HDFS-11505.01.patch, HDFS-11505.02.patch,
> HDFS-11505.03.patch, HDFS-11505.04.patch
>
>
> As discussed on HDFS-11314, administrators need to choose the correct set of
> EC policies based on cluster size and desired fault-tolerance properties.
> This means we should not enable any EC policies by default, since any default
> value could be incorrect.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Attachment: HDFS-11505.03.patch Attaching v03 patch to address the test failures. > Do not enable any erasure coding policies by default > > > Key: HDFS-11505 > URL: https://issues.apache.org/jira/browse/HDFS-11505 > Project: Hadoop HDFS > Issue Type: Improvement > Components: erasure-coding >Affects Versions: 3.0.0-alpha3 >Reporter: Andrew Wang >Assignee: Manoj Govindassamy > Labels: hdfs-ec-3.0-must-do > Attachments: HDFS-11505.01.patch, HDFS-11505.02.patch, > HDFS-11505.03.patch > > > As discussed on HDFS-11314, administrators need to choose the correct set of > EC policies based on cluster size and desired fault-tolerance properties. > This means we should not enable any EC policies by default, since any default > value could be incorrect. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Status: Patch Available (was: Open) > Do not enable any erasure coding policies by default > > > Key: HDFS-11505 > URL: https://issues.apache.org/jira/browse/HDFS-11505 > Project: Hadoop HDFS > Issue Type: Improvement > Components: erasure-coding >Affects Versions: 3.0.0-alpha3 >Reporter: Andrew Wang >Assignee: Manoj Govindassamy > Labels: hdfs-ec-3.0-must-do > Attachments: HDFS-11505.01.patch, HDFS-11505.02.patch > > > As discussed on HDFS-11314, administrators need to choose the correct set of > EC policies based on cluster size and desired fault-tolerance properties. > This means we should not enable any EC policies by default, since any default > value could be incorrect. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Attachment: HDFS-11505.02.patch Attached v02 patch to fix the typo and default policy reference in doc. [~andrew.wang], [~tasanuma0829], please take a look at the patch. > Do not enable any erasure coding policies by default > > > Key: HDFS-11505 > URL: https://issues.apache.org/jira/browse/HDFS-11505 > Project: Hadoop HDFS > Issue Type: Improvement > Components: erasure-coding >Affects Versions: 3.0.0-alpha3 >Reporter: Andrew Wang >Assignee: Manoj Govindassamy > Labels: hdfs-ec-3.0-must-do > Attachments: HDFS-11505.01.patch, HDFS-11505.02.patch > > > As discussed on HDFS-11314, administrators need to choose the correct set of > EC policies based on cluster size and desired fault-tolerance properties. > This means we should not enable any EC policies by default, since any default > value could be incorrect. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Attachment: HDFS-11505.01.patch [~andrew.wang], Attached a patch which goes on top of HDFS-11314 to remove the default EC Policy. Also updated doc and tests accordingly. Please take a look and let me know if you have more things in mind that needs to be taken care for this. Will update the status of this bug to PATCH AVAILABLE once HDFS-11314 is committed as the patch is dependent on it. > Do not enable any erasure coding policies by default > > > Key: HDFS-11505 > URL: https://issues.apache.org/jira/browse/HDFS-11505 > Project: Hadoop HDFS > Issue Type: Improvement > Components: erasure-coding >Affects Versions: 3.0.0-alpha3 >Reporter: Andrew Wang >Assignee: Manoj Govindassamy > Labels: hdfs-ec-3.0-must-do > Attachments: HDFS-11505.01.patch > > > As discussed on HDFS-11314, administrators need to choose the correct set of > EC policies based on cluster size and desired fault-tolerance properties. > This means we should not enable any EC policies by default, since any default > value could be incorrect. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
