[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12018: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Updated] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12045: Status: Patch Available (was: Open) > Add log when Diskbalancer volume is transient storage type >

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064263#comment-16064263 ] Weiwei Yang commented on HDFS-12018: I just committed v3 patch to the feature branch, thanks

[jira] [Commented] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064259#comment-16064259 ] Hadoop QA commented on HDFS-12011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064256#comment-16064256 ] Weiwei Yang commented on HDFS-12018: The jenkins result seems good, +1 to the v3 patch. I am going to

[jira] [Updated] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12028: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Comment Edited] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064250#comment-16064250 ] Anu Engineer edited comment on HDFS-12045 at 6/27/17 4:41 AM: -- +1, pending

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064251#comment-16064251 ] Weiwei Yang commented on HDFS-12028: Just committed to the feature branch, thanks for [~vagarychen] to

[jira] [Updated] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12045: Component/s: diskbalancer > Add log when Diskbalancer volume is transient storage type >

[jira] [Commented] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064250#comment-16064250 ] Anu Engineer commented on HDFS-12045: - +1, pending jenkins. Thanks for take care of this oversight. I

[jira] [Assigned] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-12045: --- Assignee: Anu Engineer > Add log when Diskbalancer volume is transient storage type >

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064246#comment-16064246 ] Anu Engineer commented on HDFS-12028: - +1 [~vagarychen] Thanks for taking care of this. I

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064245#comment-16064245 ] Weiwei Yang commented on HDFS-12028: Hi [~vagarychen] You are right. I just did a clean and rebuilt,

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064238#comment-16064238 ] Hadoop QA commented on HDFS-11870: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064230#comment-16064230 ] Yiqun Lin commented on HDFS-12040: -- LGTM, +1. Thanks [~kihwal] for reminding me. >

[jira] [Commented] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064223#comment-16064223 ] Hadoop QA commented on HDFS-12025: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064215#comment-16064215 ] Hadoop QA commented on HDFS-12040: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12046) Hadoop CRC implementation using Intel ISAL library

2017-06-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12046: - Summary: Hadoop CRC implementation using Intel ISAL library (was: Hadoop CRC implementation using Intel

[jira] [Created] (HDFS-12046) Hadoop CRC implementation using Intel ISAL-CRC library

2017-06-26 Thread luhuichun (JIRA)
luhuichun created HDFS-12046: Summary: Hadoop CRC implementation using Intel ISAL-CRC library Key: HDFS-12046 URL: https://issues.apache.org/jira/browse/HDFS-12046 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12011: --- Attachment: HADOOP-12011.002.patch > Add a new load balancing volume choosing policy >

[jira] [Updated] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12045: - Attachment: HDFS-12045.patch > Add log when Diskbalancer volume is transient storage type >

[jira] [Updated] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12011: --- Attachment: (was: HADOOP-12011.003.patch) > Add a new load balancing volume choosing policy >

[jira] [Updated] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12011: --- Attachment: (was: HADOOP-12011.002.path) > Add a new load balancing volume choosing policy >

[jira] [Created] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-26 Thread steven-wugang (JIRA)
steven-wugang created HDFS-12045: Summary: Add log when Diskbalancer volume is transient storage type Key: HDFS-12045 URL: https://issues.apache.org/jira/browse/HDFS-12045 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-26 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064147#comment-16064147 ] lufei commented on HDFS-11870: -- Thank you very much for your careful check. I have Modified in patch

[jira] [Updated] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-26 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-11870: - Attachment: HDFS-11870.005.patch > Add CLI cmd to enable/disable an erasure code policy >

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12025: - Status: Patch Available (was: Open) > Modify help instructions of Plan command and Execute

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12025: - Attachment: (was: HDFS-12025.001.patch) > Modify help instructions of Plan command and

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12025: - Attachment: HDFS-12025.002.patch > Modify help instructions of Plan command and Execute command

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-26 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12025: - Status: Open (was: Patch Available) > Modify help instructions of Plan command and Execute

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12040: --- Attachment: HDFS-12040.001.patch > TestFsDatasetImpl.testCleanShutdownOfVolume fails >

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12040: --- Affects Version/s: 3.0.0-alpha3 Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12040: --- Attachment: HDFS-12040-branch-2.001.patch > TestFsDatasetImpl.testCleanShutdownOfVolume fails >

[jira] [Assigned] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong reassigned HDFS-12040: -- Assignee: hu xiaodong > TestFsDatasetImpl.testCleanShutdownOfVolume fails >

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064056#comment-16064056 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-26 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12044: Summary: Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery. Key: HDFS-12044 URL:

[jira] [Commented] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064036#comment-16064036 ] Hadoop QA commented on HDFS-12042: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063946#comment-16063946 ] Hudson commented on HDFS-12033: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11927 (See

[jira] [Updated] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12033: - Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Status: Patch Available (was: Open) > Reduce memory used by snapshot diff data structures >

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Attachment: HDFS-12042.01.patch > Reduce memory used by snapshot diff data structures >

[jira] [Commented] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063900#comment-16063900 ] Andrew Wang commented on HDFS-12033: +1 LGTM, thanks Eddy! > DatanodeManager picking EC recovery

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-06-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.014.patch Rebased patch > In Hadoop 3, make FileStatus serialize itself via

[jira] [Commented] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063812#comment-16063812 ] Hadoop QA commented on HDFS-12033: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12043) Add counters for block re-replication

2017-06-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12043: - Summary: Add counters for block re-replication Key: HDFS-12043 URL: https://issues.apache.org/jira/browse/HDFS-12043 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063761#comment-16063761 ] Hudson commented on HDFS-11993: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11926 (See

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063755#comment-16063755 ] Andrew Wang commented on HDFS-11882: I added the nice-to-have label to it, thanks Zhe. > Client fails

[jira] [Resolved] (HDFS-11787) After HDFS-11515, -du still throws ConcurrentModificationException

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-11787. Resolution: Duplicate Fix Version/s: (was: 2.8.2) (was:

[jira] [Reopened] (HDFS-11515) -du throws ConcurrentModificationException

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11515: I think we can simplify the JIRA history since this change never made it into a release, re-opening.

[jira] [Reopened] (HDFS-11787) After HDFS-11515, -du still throws ConcurrentModificationException

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11787: > After HDFS-11515, -du still throws ConcurrentModificationException >

[jira] [Updated] (HDFS-11515) -du throws ConcurrentModificationException

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11515: --- Fix Version/s: (was: 2.8.2) (was: 3.0.0-alpha4)

[jira] [Reopened] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11419: My mistake, the commit message of a subtask included the JIRA # of this one. Reopening. >

[jira] [Updated] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11419: --- Fix Version/s: (was: 3.0.0-alpha4) > BlockPlacementPolicyDefault is choosing datanode in an

[jira] [Updated] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Description: When snapshot diff operation is performed in a NameNode that manages several

[jira] [Resolved] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-11419. Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Resolving as it looks like this was completed.

[jira] [Updated] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11907: --- Fix Version/s: 3.0.0-alpha4 > Add metric for time taken by NameNode resource check >

[jira] [Closed] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash closed HDFS-11993. --- > Add log info when connect to datanode socket address failed >

[jira] [Updated] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-11993: Fix Version/s: 3.0.0-alpha4 2.9.0 > Add log info when connect to datanode socket

[jira] [Updated] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-11993: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk and

[jira] [Commented] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-26 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063699#comment-16063699 ] Ravi Prakash commented on HDFS-11993: - Thanks Chen Liang for the review and suggestion. Thanks chencan

[jira] [Updated] (HDFS-11078) Fix NPE in LazyPersistFileScrubber

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11078: --- Summary: Fix NPE in LazyPersistFileScrubber (was: NPE in LazyPersistFileScrubber) > Fix NPE in

[jira] [Created] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-26 Thread Misha Dmitriev (JIRA)
Misha Dmitriev created HDFS-12042: - Summary: Reduce memory used by snapshot diff data structures Key: HDFS-12042 URL: https://issues.apache.org/jira/browse/HDFS-12042 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063669#comment-16063669 ] Hadoop QA commented on HDFS-12018: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063658#comment-16063658 ] Kihwal Lee commented on HDFS-12008: --- Test failures are not caused by the patch. {{TestFsDatasetImpl}}

[jira] [Updated] (HDFS-12033) DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks.

2017-06-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12033: - Attachment: HDFS-12033.01.patch Thanks for the suggestions, [~andrew.wang] Added a new test in

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063639#comment-16063639 ] Xiaoyu Yao commented on HDFS-12018: --- Patch v3 looks good to me. +1 pending Jenkins. > Ozone: Misc: Add

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063608#comment-16063608 ] Hadoop QA commented on HDFS-9079: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9079: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Erasure coding: preallocate multiple generation stamps and

[jira] [Commented] (HDFS-11956) Do not require a storage ID or target storage IDs when writing a block

2017-06-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063595#comment-16063595 ] Hudson commented on HDFS-11956: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11925 (See

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-06-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063592#comment-16063592 ] Zhe Zhang commented on HDFS-11882: -- Sorry I missed this ping earlier. bq. Although it says that "at

[jira] [Updated] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11992: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Attachment: HDFS-12018-HDFS-7240.003.patch Post v003 patch to rebase. > Ozone: Misc: Add CBlocks

[jira] [Updated] (HDFS-11956) Do not require a storage ID or target storage IDs when writing a block

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11956: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063551#comment-16063551 ] Hadoop QA commented on HDFS-12018: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12032) Inaccurate comment on DatanodeDescriptor#getNumberOfBlocksToBeErasureCoded

2017-06-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063550#comment-16063550 ] Hudson commented on HDFS-12032: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11924 (See

[jira] [Updated] (HDFS-11956) Do not require a storage ID or target storage IDs when writing a block

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11956: --- Summary: Do not require a storage ID or target storage IDs when writing a block (was: Fix BlockToken

[jira] [Updated] (HDFS-11956) Fix BlockToken compatibility with Hadoop 2.x clients

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11956: --- Release Note: Hadoop 2.x clients do not pass the storage ID or target storage IDs when writing a

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Attachment: HDFS-12018-HDFS-7240.002.patch Thanks [~xyao] for the comments! Post v002 patch. The last

[jira] [Commented] (HDFS-11956) Fix BlockToken compatibility with Hadoop 2.x clients

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063533#comment-16063533 ] Andrew Wang commented on HDFS-11956: +1 LGTM, I'll adjust the release notes as well. > Fix BlockToken

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12040: -- Summary: TestFsDatasetImpl.testCleanShutdownOfVolume fails (was:

[jira] [Commented] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails in branch-2

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063528#comment-16063528 ] Kihwal Lee commented on HDFS-12040: --- I just ran it on trunk and it failed. {noformat} Running

[jira] [Created] (HDFS-12041) Block Storage : make the server address config more concise

2017-06-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12041: - Summary: Block Storage : make the server address config more concise Key: HDFS-12041 URL: https://issues.apache.org/jira/browse/HDFS-12041 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12032) Inaccurate comment on DatanodeDescriptor#getNumberOfBlocksToBeErasureCoded

2017-06-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12032: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063503#comment-16063503 ] Xiaoyu Yao commented on HDFS-12030: --- Thanks [~linyiqun] for working on this. The patch looks good to me

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063487#comment-16063487 ] Akira Ajisaka commented on HDFS-11992: -- LGTM, +1. All the failed tests except TestFsDatasetImpl

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails in branch-2

2017-06-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12040: - Description: Found when reviewing HDFS-11992 {noformat} Running

[jira] [Created] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails in branch-2

2017-06-26 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-12040: Summary: TestFsDatasetImpl.testCleanShutdownOfVolume fails in branch-2 Key: HDFS-12040 URL: https://issues.apache.org/jira/browse/HDFS-12040 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063457#comment-16063457 ] Chen Liang commented on HDFS-12028: --- Thanks [~xyao] for the comments. [~cheersyang] it seems to have

[jira] [Commented] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063447#comment-16063447 ] Xiaoyu Yao commented on HDFS-12018: --- Thanks [~vagarychen] for working on this. The patch looks good to

[jira] [Resolved] (HDFS-11589) Unable to remove dead node after datanode decommission

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-11589. --- Resolution: Duplicate > Unable to remove dead node after datanode decommission >

[jira] [Resolved] (HDFS-12004) Namenode UI continues to list DNs that have been removed from include and exclude

2017-06-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-12004. Resolution: Duplicate > Namenode UI continues to list DNs that have been removed from include and

[jira] [Commented] (HDFS-12004) Namenode UI continues to list DNs that have been removed from include and exclude

2017-06-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063339#comment-16063339 ] Erik Krogen commented on HDFS-12004: Ah, don't know how I missed that. Thank you, [~kihwal]. Sorry for

[jira] [Commented] (HDFS-12004) Namenode UI continues to list DNs that have been removed from include and exclude

2017-06-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063279#comment-16063279 ] Kihwal Lee commented on HDFS-12004: --- I thought it was fixed in HDFS-8950. > Namenode UI continues to

[jira] [Created] (HDFS-12039) Ozone: Implement update volume owner in ozone shell

2017-06-26 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12039: -- Summary: Ozone: Implement update volume owner in ozone shell Key: HDFS-12039 URL: https://issues.apache.org/jira/browse/HDFS-12039 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12038) Ozone: Non-admin user is unable to run InfoVolume to the volume owned by itself

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063229#comment-16063229 ] Weiwei Yang commented on HDFS-12038: Seems like there is a bug in {{InfoVolumeHandler}} line 82 - 86

[jira] [Created] (HDFS-12038) Ozone: Non-admin user is unable to run InfoVolume to the volume owned by itself

2017-06-26 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12038: -- Summary: Ozone: Non-admin user is unable to run InfoVolume to the volume owned by itself Key: HDFS-12038 URL: https://issues.apache.org/jira/browse/HDFS-12038 Project:

[jira] [Created] (HDFS-12037) Ozone: Improvement rest API output format for better looking

2017-06-26 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12037: -- Summary: Ozone: Improvement rest API output format for better looking Key: HDFS-12037 URL: https://issues.apache.org/jira/browse/HDFS-12037 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063189#comment-16063189 ] Hadoop QA commented on HDFS-12008: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063115#comment-16063115 ] Hadoop QA commented on HDFS-12011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11773) Ozone: KSM : add listVolumes

2017-06-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11773: --- Attachment: listVolume_tests.log > Ozone: KSM : add listVolumes > > >

  1   2   >