[jira] [Commented] (HDFS-12224) Add tests to TestJournalNodeSync for sync after JN downtime

2017-08-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112194#comment-16112194 ] Arpit Agarwal commented on HDFS-12224: -- Thanks for the updated patch [~hanishakoneru]. # Can you

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112130#comment-16112130 ] Hadoop QA commented on HDFS-11885: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12224) Add tests to TestJournalNodeSync for sync after JN downtime

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112125#comment-16112125 ] Hadoop QA commented on HDFS-12224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12046) Hadoop CRC implementation using Intel ISA-L library

2017-08-02 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-12046: - Status: Patch Available (was: Open) > Hadoop CRC implementation using Intel ISA-L library >

[jira] [Updated] (HDFS-11975) Provide a system-default EC policy

2017-08-02 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11975: - Attachment: HDFS-11975-009.patch [~Sammi] Hi Sammi, updated according to your comments > Provide a

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112112#comment-16112112 ] Hadoop QA commented on HDFS-10391: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10880) Federation Mount Table State Store internal API

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112109#comment-16112109 ] Hadoop QA commented on HDFS-10880: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12251) Add document for StreamCapabilities

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112065#comment-16112065 ] Hadoop QA commented on HDFS-12251: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-08-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11885: --- Attachment: HDFS-11885.004.patch Rebased patch attached. > createEncryptionZone should not block on

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-08-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112005#comment-16112005 ] Andrew Wang commented on HDFS-11885: Thanks for taking a look Daryn, createEncryptionZone calls

[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API

2017-08-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-003.patch Fixing merge with branch. > Federation Mount Table State

[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API

2017-08-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: (was: HDFS-10880-HDFS-10467-003.patch) > Federation Mount Table State Store internal

[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API

2017-08-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-003.patch Tackled comments from [~chris.douglas]: * Changed locking

[jira] [Resolved] (HDFS-12253) CLONE - Pretty-format the output for DFSIO

2017-08-02 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo resolved HDFS-12253. --- Resolution: Fixed > CLONE - Pretty-format the output for DFSIO >

[jira] [Created] (HDFS-12253) CLONE - Pretty-format the output for DFSIO

2017-08-02 Thread Dennis Huo (JIRA)
Dennis Huo created HDFS-12253: - Summary: CLONE - Pretty-format the output for DFSIO Key: HDFS-12253 URL: https://issues.apache.org/jira/browse/HDFS-12253 Project: Hadoop HDFS Issue Type: Test

[jira] [Updated] (HDFS-12224) Add tests to TestJournalNodeSync for sync after JN downtime

2017-08-02 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12224: -- Attachment: HDFS-12224.003.patch Thanks [~arpitagarwal]. I have made a fix for one of the

[jira] [Commented] (HDFS-12251) Add document for StreamCapabilities

2017-08-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111965#comment-16111965 ] Andrew Wang commented on HDFS-12251: Thanks for the rev Eddy. Could you add a link from the EC doc to

[jira] [Commented] (HDFS-12172) Reduce EZ lookup overhead

2017-08-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111958#comment-16111958 ] Xiao Chen commented on HDFS-12172: -- Thanks for the work here [~daryn]! Looks pretty good overall. A few

[jira] [Updated] (HDFS-9388) Refactor decommission related code to support maintenance state for datanodes

2017-08-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9388: - Resolution: Fixed Fix Version/s: 3.0.0-beta1 2.9.0

[jira] [Updated] (HDFS-12074) [branch-2] Add counters for block re-replication

2017-08-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12074: - Resolution: Duplicate Status: Resolved (was: Patch Available) Dup'ing against HDFS-12043

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-08-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12043: - Fix Version/s: 2.9.0 Committed to branch-2. Thanks for the backport [~vagarychen]. > Add

[jira] [Updated] (HDFS-12251) Add document for StreamCapabilities

2017-08-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12251: - Attachment: HDFS-12251.01.patch Hi, [~andrew.wang] Thanks for the suggestions. I added a section

[jira] [Updated] (HDFS-10391) Always enable NameNode service RPC port

2017-08-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10391: - Attachment: HDFS-10391.009.patch v009 patch addresses the valid checkstyle issues. > Always

[jira] [Commented] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111801#comment-16111801 ] Andrew Wang commented on HDFS-11082: Seems similar to what we discussed earlier, SGTM! > Erasure

[jira] [Commented] (HDFS-9388) Refactor decommission related code to support maintenance state for datanodes

2017-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111782#comment-16111782 ] Hudson commented on HDFS-9388: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12108 (See

[jira] [Updated] (HDFS-12250) Reduce usage of FsPermissionExtension in HDFS unit tests

2017-08-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12250: - Status: Patch Available (was: Open) > Reduce usage of FsPermissionExtension in HDFS unit tests >

[jira] [Updated] (HDFS-12250) Reduce usage of FsPermissionExtension in HDFS unit tests

2017-08-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12250: - Attachment: HDFS-12250.000.patch > Reduce usage of FsPermissionExtension in HDFS unit tests >

[jira] [Commented] (HDFS-12247) Ozone: TestKSMMetrcis fails constantly

2017-08-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111747#comment-16111747 ] Xiaoyu Yao commented on HDFS-12247: --- Thanks [~linyiqun] for reporting the issue and posting for it. The

[jira] [Commented] (HDFS-12251) Add document for StreamCapabilities

2017-08-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111721#comment-16111721 ] Andrew Wang commented on HDFS-12251: Thanks for working on this Eddy. Could we add some content to the

[jira] [Commented] (HDFS-12102) VolumeScanner throttle dropped (fast scan enabled) when there is a corrupt block

2017-08-02 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111696#comment-16111696 ] Nathan Roberts commented on HDFS-12102: --- [~arpitagarwal] Hi Arpit. To provide a bit more background

[jira] [Comment Edited] (HDFS-12246) Ozone: potential thread leaks

2017-08-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111666#comment-16111666 ] Xiaoyu Yao edited comment on HDFS-12246 at 8/2/17 8:50 PM: --- Thanks [~cheersyang]

[jira] [Updated] (HDFS-12220) hdfs' parallel tests don't work for Windows

2017-08-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12220: Resolution: Duplicate Status: Resolved (was: Patch Available) > hdfs' parallel

[jira] [Commented] (HDFS-11644) Support for querying outputstream capabilities

2017-08-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111674#comment-16111674 ] Lei (Eddy) Xu commented on HDFS-11644: -- [~busbey] I filed HDFS-12251 for the filesystem docs. In

[jira] [Created] (HDFS-12252) Ozone: SCM: Container State Machine -1- Track container creation state in SCM

2017-08-02 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12252: - Summary: Ozone: SCM: Container State Machine -1- Track container creation state in SCM Key: HDFS-12252 URL: https://issues.apache.org/jira/browse/HDFS-12252 Project:

[jira] [Updated] (HDFS-12251) Add document for StreamCapabilities

2017-08-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12251: - Attachment: HDFS-12251.00.patch > Add document for StreamCapabilities >

[jira] [Commented] (HDFS-12249) dfsadmin -metaSave to output maintenance mode blocks

2017-08-02 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111667#comment-16111667 ] Wellington Chevreuil commented on HDFS-12249: - Thanks for the insights, [~jojochuang]! Just to

[jira] [Commented] (HDFS-12246) Ozone: potential thread leaks

2017-08-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111666#comment-16111666 ] Xiaoyu Yao commented on HDFS-12246: --- Thanks [~cheersyang] for reporting and posting the fix. The patch

[jira] [Updated] (HDFS-12251) Add document for StreamCapabilities

2017-08-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12251: - Status: Patch Available (was: Open) > Add document for StreamCapabilities >

[jira] [Created] (HDFS-12251) Add document for StreamCapabilities

2017-08-02 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12251: Summary: Add document for StreamCapabilities Key: HDFS-12251 URL: https://issues.apache.org/jira/browse/HDFS-12251 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6984) Serialize FileStatus via protobuf

2017-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111635#comment-16111635 ] Hudson commented on HDFS-6984: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12107 (See

[jira] [Updated] (HDFS-6984) Serialize FileStatus via protobuf

2017-08-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Resolution: Fixed Assignee: Chris Douglas (was: Colin P. McCabe) Hadoop Flags:

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-02 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12182: Status: Patch Available (was: In Progress) > BlockManager.metaSave does not

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-02 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12182: Status: In Progress (was: Patch Available) > BlockManager.metaSave does not

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-02 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12182: Attachment: HDFS-12182.004.patch Attaching new patch version with the applied

[jira] [Updated] (HDFS-6984) Serialize FileStatus via protobuf

2017-08-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Summary: Serialize FileStatus via protobuf (was: In Hadoop 3, make FileStatus serialize itself via

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-08-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111547#comment-16111547 ] Chris Douglas commented on HDFS-6984: - Thanks, [~andrew.wang]! I'll commit this shortly. I filed

[jira] [Created] (HDFS-12250) Reduce usage of FsPermissionExtension in HDFS unit tests

2017-08-02 Thread Chris Douglas (JIRA)
Chris Douglas created HDFS-12250: Summary: Reduce usage of FsPermissionExtension in HDFS unit tests Key: HDFS-12250 URL: https://issues.apache.org/jira/browse/HDFS-12250 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-08-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy resolved HDFS-12217. --- Resolution: Fixed Fix Version/s: 2.9.0 Resolved the issue in

[jira] [Commented] (HDFS-12220) hdfs' parallel tests don't work for Windows

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111330#comment-16111330 ] Hadoop QA commented on HDFS-12220: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111321#comment-16111321 ] Daryn Sharp commented on HDFS-10326: +1 Looks good. For the test, just make sure the major OSes

[jira] [Commented] (HDFS-10244) Avoid accumulation of IBRs for SNN when the standby is down for more than expected time

2017-08-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111272#comment-16111272 ] Daryn Sharp commented on HDFS-10244: #2 is not necessary. The are no "important IBRs" that warrant a

[jira] [Commented] (HDFS-12245) Update INodeId javadoc

2017-08-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111252#comment-16111252 ] Xiao Chen commented on HDFS-12245: -- >From [this

[jira] [Comment Edited] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2017-08-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111229#comment-16111229 ] Daryn Sharp edited comment on HDFS-11146 at 8/2/17 4:32 PM: Yes, this appears

[jira] [Commented] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2017-08-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111229#comment-16111229 ] Daryn Sharp commented on HDFS-11146: Yes, this appears it would destroy the NN with FBRs. I'd rather

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-08-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111225#comment-16111225 ] Manoj Govindassamy commented on HDFS-12217: --- Sorry for the inconvenience [~jlowe]. The

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-02 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11576: -- Status: Patch Available (was: Open) > Block recovery will fail indefinitely if recovery time >

[jira] [Created] (HDFS-12249) dfsadmin -metaSave to output maintenance mode blocks

2017-08-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12249: -- Summary: dfsadmin -metaSave to output maintenance mode blocks Key: HDFS-12249 URL: https://issues.apache.org/jira/browse/HDFS-12249 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111222#comment-16111222 ] Wei-Chiu Chuang commented on HDFS-12182: Let's keep the scope of the jira the same. Filed a new

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12182: --- Target Version/s: 2.9.0, 3.0.0-beta1 > BlockManager.metaSave does not distinguish between

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12182: --- Fix Version/s: (was: 3.0.0-alpha3) > BlockManager.metaSave does not distinguish between

[jira] [Updated] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-08-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-12217: -- Fix Version/s: (was: 2.9.0) > HDFS snapshots doesn't capture all open files when one of the open

[jira] [Reopened] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-08-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened HDFS-12217: --- I reverted this from branch-2 because the commit broke the build. {noformat} [ERROR] COMPILATION ERROR :

[jira] [Commented] (HDFS-12091) [READ] Check that the replicas served from a {{ProvidedVolumeImpl}} belong to the correct external storage

2017-08-02 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1687#comment-1687 ] Ewan Higgs commented on HDFS-12091: --- Thanks for adding the test. I tested the first patch and now we

[jira] [Commented] (HDFS-8387) Erasure Coding: Revisit the long and int datatypes usage in striping logic

2017-08-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1658#comment-1658 ] Rakesh R commented on HDFS-8387: Hi Andrew Wang, As per initial analysis, I found only two cases. I will

[jira] [Updated] (HDFS-12220) hdfs' parallel tests don't work for Windows

2017-08-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12220: Status: Patch Available (was: Open) > hdfs' parallel tests don't work for Windows >

[jira] [Updated] (HDFS-12220) hdfs' parallel tests don't work for Windows

2017-08-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12220: Priority: Minor (was: Major) > hdfs' parallel tests don't work for Windows >

[jira] [Updated] (HDFS-12220) hdfs' parallel tests don't work for Windows

2017-08-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12220: Attachment: HDFS-12220.00.patch -00: * add path conversions to unix so that the javascript

[jira] [Assigned] (HDFS-12220) hdfs' parallel tests don't work for Windows

2017-08-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HDFS-12220: --- Assignee: Allen Wittenauer > hdfs' parallel tests don't work for Windows >

[jira] [Commented] (HDFS-12209) VolumeScanner scan cursor not save periodic

2017-08-02 Thread fatkun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111091#comment-16111091 ] fatkun commented on HDFS-12209: --- [~vagarychen] nanoTime may reset after machine restart? [~jojochuang] I

[jira] [Comment Edited] (HDFS-8298) HA: NameNode should not shut down completely without quorum, doesn't recover from temporary network outages

2017-08-02 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108851#comment-16108851 ] Hari Sekhon edited comment on HDFS-8298 at 8/2/17 2:30 PM: --- [~qwertymaniac] I

[jira] [Commented] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110971#comment-16110971 ] Hadoop QA commented on HDFS-12248: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-08-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110815#comment-16110815 ] Rakesh R commented on HDFS-10285: - Thanks [~xiaochen] for the interests. Below is the response, please

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110801#comment-16110801 ] Hadoop QA commented on HDFS-5040: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12248: Attachment: HDFS-12248.patch we should update {{lastUploadTime}} and

[jira] [Updated] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12248: Status: Patch Available (was: Open) > SNN will not upload fsimage on IOE and

[jira] [Updated] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12248: Description: Related to HDFS-9787. When fsimage uploading to ANN, if there is any

[jira] [Updated] (HDFS-12084) Scheduled Count will not decrement when file is deleted before all IBR's received

2017-08-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12084: Target Version/s: 3.0.0-beta1 > Scheduled Count will not decrement when file is

[jira] [Created] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-02 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-12248: --- Summary: SNN will not upload fsimage on IOE and Interrupted exceptions Key: HDFS-12248 URL: https://issues.apache.org/jira/browse/HDFS-12248 Project:

[jira] [Commented] (HDFS-12247) Ozone: TestKSMMetrcis fails constantly

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110751#comment-16110751 ] Hadoop QA commented on HDFS-12247: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110753#comment-16110753 ] Brahma Reddy Battula commented on HDFS-5040: [~kshukla] thanks for updating the patch. 1.looks

[jira] [Assigned] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-08-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11580: Assignee: Anu Engineer (was: Yiqun Lin) Fix Version/s: HDFS-7240 Thanks [~anu] for the

[jira] [Commented] (HDFS-12246) Ozone: potential thread leaks

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110717#comment-16110717 ] Hadoop QA commented on HDFS-12246: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12231) Ozone: KSM: Add creation time field in volume info

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110705#comment-16110705 ] Hadoop QA commented on HDFS-12231: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-02 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110689#comment-16110689 ] Wellington Chevreuil commented on HDFS-12182: - Thanks for the comments [~jojochuang]! I will

[jira] [Commented] (HDFS-12247) Ozone: TestKSMMetrcis fails constantly

2017-08-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110649#comment-16110649 ] Yiqun Lin commented on HDFS-12247: -- Attach the initial patch. Reuse the minicluster instance can fix

[jira] [Updated] (HDFS-12247) Ozone: TestKSMMetrcis fails constantly

2017-08-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12247: - Status: Patch Available (was: Open) > Ozone: TestKSMMetrcis fails constantly >

[jira] [Updated] (HDFS-12247) Ozone: TestKSMMetrcis fails constantly

2017-08-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12247: - Attachment: HDFS-12247-HDFS-7240.001.patch > Ozone: TestKSMMetrcis fails constantly >

[jira] [Created] (HDFS-12247) Ozone: TestKSMMetrcis fails constantly

2017-08-02 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12247: Summary: Ozone: TestKSMMetrcis fails constantly Key: HDFS-12247 URL: https://issues.apache.org/jira/browse/HDFS-12247 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-12163) Ozone: MiniOzoneCluster uses 400+ threads

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110619#comment-16110619 ] Hadoop QA commented on HDFS-12163: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12246) Ozone: potential thread leaks

2017-08-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12246: --- Attachment: HDFS-12246-HDFS-7240.001.patch > Ozone: potential thread leaks >

[jira] [Updated] (HDFS-12246) Ozone: potential thread leaks

2017-08-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12246: --- Status: Patch Available (was: Open) > Ozone: potential thread leaks > -

[jira] [Updated] (HDFS-12231) Ozone: KSM: Add creation time field in volume info

2017-08-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12231: - Status: Patch Available (was: Open) > Ozone: KSM: Add creation time field in volume info >

[jira] [Updated] (HDFS-12231) Ozone: KSM: Add creation time field in volume info

2017-08-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12231: - Attachment: HDFS-12231-HDFS-7240.001.patch Attach the initial patch. Add creation time field that will be

[jira] [Created] (HDFS-12246) Ozone: potential thread leaks

2017-08-02 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12246: -- Summary: Ozone: potential thread leaks Key: HDFS-12246 URL: https://issues.apache.org/jira/browse/HDFS-12246 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-12163) Ozone: MiniOzoneCluster uses 400+ threads

2017-08-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12163: --- Attachment: HDFS-12163-HDFS-7240.002.patch Hi [~anu] I am going to split this patch to two. v2 patch

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110467#comment-16110467 ] Haohui Mai commented on HDFS-10326: --- +1 It seems that we have a consensus now -- I'll commit it

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-02 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110440#comment-16110440 ] Huafeng Wang commented on HDFS-1: - Hi guys, I'd like to take this one. > Add EC information to

[jira] [Assigned] (HDFS-12222) Add EC information to BlockLocation

2017-08-02 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang reassigned HDFS-1: --- Assignee: Huafeng Wang > Add EC information to BlockLocation >

[jira] [Commented] (HDFS-11935) Ozone: TestStorageContainerManager#testRpcPermission fails when ipv6 address used

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110408#comment-16110408 ] Hadoop QA commented on HDFS-11935: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||