[jira] [Comment Edited] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960373#comment-15960373 ] Wei-Chiu Chuang edited comment on HDFS-11623 at 4/7/17 7:30 AM: Overall

[jira] [Comment Edited] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960373#comment-15960373 ] Wei-Chiu Chuang edited comment on HDFS-11623 at 4/7/17 7:38 AM: Overall

[jira] [Updated] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Labels: hdfs-ec-3.0-must-do (was: ) > FSImage loading fallback may disable all erasure

[jira] [Updated] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Status: Patch Available (was: Open) > FSImage loading fallback may disable all erasure

[jira] [Updated] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Summary: FSImage loading fallback may disable all erasure coding policies (was: FSImage

[jira] [Updated] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Attachment: (was: HDFS-11633.001.patch) > FSImage loading fallback may disable all

[jira] [Updated] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Attachment: HDFS-11633.test.patch > FSImage loading fallback may disable all erasure coding

[jira] [Updated] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Attachment: HDFS-11633.test.patch > FSImage loading fallback may disable all erasure coding

[jira] [Commented] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960465#comment-15960465 ] Kai Zheng commented on HDFS-11633: -- Hi [~jojochuang], I saw you only added some test codes and am not

[jira] [Updated] (HDFS-11633) FSImage load fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Attachment: HDFS-11633.001.patch patch v001: a simple fix: do not clear enabled ec policies

[jira] [Commented] (HDFS-11622) TraceId hardcoded to 0 in DataStreamer, correlation between multiple spans is lost

2017-04-07 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960420#comment-15960420 ] Masatake Iwasaki commented on HDFS-11622: - bq. If you want, I can submit a patch for this one. I

[jira] [Commented] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960538#comment-15960538 ] Hadoop QA commented on HDFS-11633: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960624#comment-15960624 ] Hadoop QA commented on HDFS-9342: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-04-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9342: Attachment: HDFS-9342.04.patch Refine the v3 patch > Erasure coding: client should update and commit block

[jira] [Updated] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-04-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9342: Status: Patch Available (was: Open) > Erasure coding: client should update and commit block based on

[jira] [Commented] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961409#comment-15961409 ] Hadoop QA commented on HDFS-11623: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10687) Federation Membership State Store internal API

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961434#comment-15961434 ] Hadoop QA commented on HDFS-10687: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-07 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-11634: -- Summary: Optimize BlockIterator when interating starts in the middle. Key: HDFS-11634 URL: https://issues.apache.org/jira/browse/HDFS-11634 Project:

[jira] [Updated] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11634: --- Attachment: HDFS-11634.001.patch Simple optimization. > Optimize BlockIterator when

[jira] [Updated] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11634: --- Status: Patch Available (was: Open) > Optimize BlockIterator when interating starts

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: (was: HDFS-11384.003.patch) > Add option for balancer to disperse

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384.003.patch > Add option for balancer to disperse getBlocks

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961664#comment-15961664 ] Hadoop QA commented on HDFS-11402: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961666#comment-15961666 ] Manoj Govindassamy commented on HDFS-11402: --- Above unit test failures are not related to the

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961667#comment-15961667 ] Hadoop QA commented on HDFS-11384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961669#comment-15961669 ] Hadoop QA commented on HDFS-11634: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961332#comment-15961332 ] Hadoop QA commented on HDFS-10630: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961386#comment-15961386 ] Wei-Chiu Chuang commented on HDFS-11623: Cool. That makes sense to me. Thanks! > Move system

[jira] [Updated] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Attachment: HDFS-11633.002.patch Thanks [~andrew.wang]! Post 002 patch to make ECPM.clear() a

[jira] [Commented] (HDFS-10459) getTurnOffTip computes needed block incorrectly for threshold < 1 in b2.7

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961501#comment-15961501 ] Hadoop QA commented on HDFS-10459: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961548#comment-15961548 ] Hudson commented on HDFS-11633: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11551 (See

[jira] [Commented] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961531#comment-15961531 ] Hadoop QA commented on HDFS-11633: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961533#comment-15961533 ] Andrew Wang commented on HDFS-11633: +1 LGTM checking this in > FSImage failover disables all erasure

[jira] [Commented] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961568#comment-15961568 ] Andrew Wang commented on HDFS-11623: Filed HADOOP-14293 for the TestFsDatasetImpl failure, others are

[jira] [Updated] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11623: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961625#comment-15961625 ] Hadoop QA commented on HDFS-11384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11565) Use compact identifiers for built-in ECPolicies in HdfsFileStatus

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961634#comment-15961634 ] Hadoop QA commented on HDFS-11565: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11633: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961554#comment-15961554 ] Hadoop QA commented on HDFS-11623: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11565) Use compact identifiers for built-in ECPolicies in HdfsFileStatus

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11565: --- Attachment: HDFS-11565.002.patch Patch attached. I also reverted the change to the PB tag numbers,

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384.003.patch Here is a relatively simple patch, which restricts

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: (was: HDFS-11384.003.patch) > Add option for balancer to disperse

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384.003.patch > Add option for balancer to disperse getBlocks

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11402: -- Attachment: HDFS-11402.03.patch Thanks for the review [~yzhangal]. Attached v03 patch

[jira] [Commented] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960373#comment-15960373 ] Wei-Chiu Chuang commented on HDFS-11623: Overall looks good to me. I just want to point out a few

[jira] [Comment Edited] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960373#comment-15960373 ] Wei-Chiu Chuang edited comment on HDFS-11623 at 4/7/17 6:57 AM: Overall

[jira] [Commented] (HDFS-11618) Block Storage: Add Support for Direct I/O

2017-04-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961125#comment-15961125 ] Chen Liang commented on HDFS-11618: --- Committed to feature branch, thanks [~msingh] for the contribution!

[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API

2017-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10687-HDFS-10467-002.patch Rebase HDFS-10467. > Federation Membership State Store

[jira] [Commented] (HDFS-7343) HDFS smart storage management

2017-04-07 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960830#comment-15960830 ] Wei Zhou commented on HDFS-7343: Thanks [~rakeshr] for reviewing the design and thoughtful comments.

[jira] [Commented] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961052#comment-15961052 ] Wei-Chiu Chuang commented on HDFS-11633: Ping [~andrew.wang] you implemented fsimage fail over in

[jira] [Commented] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961250#comment-15961250 ] Andrew Wang commented on HDFS-11633: Good catch! Yea, the clear is only supposed to clear things

[jira] [Updated] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11623: --- Attachment: HDFS-11623.005.patch > Move system erasure coding policies into hadoop-hdfs-client >

[jira] [Commented] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961289#comment-15961289 ] Andrew Wang commented on HDFS-11623: Thanks for reviewing Wei-chiu! New patch to simplify the array as

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10631: --- Attachment: HDFS-10631-HDFS-10467-002.patch Rebase HDFS-10467. > Federation State Store ZooKeeper

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

2017-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-005.patch Fixing unit tests, check style and find bugs. >

[jira] [Commented] (HDFS-11622) TraceId hardcoded to 0 in DataStreamer, correlation between multiple spans is lost

2017-04-07 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961241#comment-15961241 ] Andrew Purtell commented on HDFS-11622: --- bq. I appreciate it if there are specific problems in

[jira] [Comment Edited] (HDFS-11622) TraceId hardcoded to 0 in DataStreamer, correlation between multiple spans is lost

2017-04-07 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961241#comment-15961241 ] Andrew Purtell edited comment on HDFS-11622 at 4/7/17 6:36 PM: --- bq. I

[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API

2017-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10467-HDFS-10687-002.patch Rebased to HDFS-10467. Unit tests pending HDFS-10630. >

[jira] [Commented] (HDFS-10687) Federation Membership State Store internal API

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961275#comment-15961275 ] Hadoop QA commented on HDFS-10687: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API

2017-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: (was: HDFS-10467-HDFS-10687-002.patch) > Federation Membership State Store internal

[jira] [Commented] (HDFS-11626) Deprecate oiv_legacy tool

2017-04-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960871#comment-15960871 ] Kihwal Lee commented on HDFS-11626: --- bq. oiv_legacy only works for fsimage at or before Hadoop 2.4. We

[jira] [Commented] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961004#comment-15961004 ] Wei-Chiu Chuang commented on HDFS-11633: Okay now I understand where's the confusion. I probably

[jira] [Commented] (HDFS-11633) FSImage loading fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960838#comment-15960838 ] Wei-Chiu Chuang commented on HDFS-11633: [~drankye] bq. I saw you only added some test codes and

[jira] [Updated] (HDFS-11633) FSImage failover disables all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11633: --- Summary: FSImage failover disables all erasure coding policies (was: FSImage loading

[jira] [Updated] (HDFS-10459) getTurnOffTip computes needed block incorrectly for threshold < 1 in b2.7

2017-04-07 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10459: --- Attachment: HDFS-10459.003.patch Either missed a test when I initially uploaded the trunk patch or it

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961399#comment-15961399 ] Hadoop QA commented on HDFS-10631: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961428#comment-15961428 ] Wei-Chiu Chuang commented on HDFS-10999: Thanks [~manojg] this is a pretty big patch and I am

[jira] [Updated] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client

2017-04-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11623: --- Attachment: HDFS-11623.006.patch Patch attached to fix TestOIV failure, have to use XOR for this. >