[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186699#comment-15186699 ] Brahma Reddy Battula commented on HDFS-9917: *{color:blue}As current intention is not overload

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2016-03-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186681#comment-15186681 ] Akira AJISAKA commented on HDFS-9038: - bq. it's a question of whether this metric means "Raw Non-DFS

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186632#comment-15186632 ] Kai Zheng commented on HDFS-7866: - Thanks [~zhz], [~lirui] and all for making of this major moving! >

[jira] [Resolved] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-03-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved HDFS-9530. - Resolution: Duplicate > huge Non-DFS Used in hadoop 2.6.2 & 2.7.1 >

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-03-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186626#comment-15186626 ] Akira AJISAKA commented on HDFS-9530: - bq. Should we resolve this as a duplicate of HDFS-9038? Agree.

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186623#comment-15186623 ] Rui Li commented on HDFS-7866: -- Thanks guys for the review! > Erasure coding: NameNode manages multiple

[jira] [Commented] (HDFS-9860) Update Documentation for HADOOP-11009

2016-03-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186622#comment-15186622 ] Akira AJISAKA commented on HDFS-9860: - Hi [~jojochuang], do you think HDFS-9638 should be backported to

[jira] [Updated] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7866: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Target Version/s:

[jira] [Commented] (HDFS-1477) Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186609#comment-15186609 ] Hadoop QA commented on HDFS-1477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9925) Ozone: Add Ozone Client lib for bucket handling

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186607#comment-15186607 ] Chris Nauroth commented on HDFS-9925: - Hi [~anu]. This looks good overall, but I am seeing failures in

[jira] [Updated] (HDFS-9916) OzoneHandler : Add Key handler

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9916: Hadoop Flags: Reviewed [~anu], thank you for the patch update. +1 pending pre-commit run. >

[jira] [Commented] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186555#comment-15186555 ] Hadoop QA commented on HDFS-9922: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9926) ozone : Add volume commands to CLI

2016-03-08 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9926: -- Summary: ozone : Add volume commands to CLI Key: HDFS-9926 URL: https://issues.apache.org/jira/browse/HDFS-9926 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186533#comment-15186533 ] Lei (Eddy) Xu commented on HDFS-9702: - Hey, [~anu] My intention was to not include {{hamcrest}} as a

[jira] [Commented] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186513#comment-15186513 ] Anu Engineer commented on HDFS-9702: Hi [~eddyxu], Thanks for the feedback and pointing to me to

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186512#comment-15186512 ] Chris Nauroth commented on HDFS-9924: - +1 for the proposal. I expect this will be very helpful for

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186510#comment-15186510 ] Li Bo commented on HDFS-9822: - hi,Rakesh After reading the code of {{UnderReplicationBlocks}} I am still a

[jira] [Commented] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186496#comment-15186496 ] Lei (Eddy) Xu commented on HDFS-9702: - Hey, [~anu] Thanks for the update, just one minor issue, there

[jira] [Commented] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-03-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186493#comment-15186493 ] Uma Maheswara Rao G commented on HDFS-9719: --- [~drankye], Thanks Kai for working on this JIRA.

[jira] [Updated] (HDFS-9921) Stop tracking CHANGES.txt in the HDFS-1312 feature branch.

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9921: --- Resolution: Fixed Status: Resolved (was: Patch Available) [~xiaobingo] Thank you for the

[jira] [Updated] (HDFS-9005) Provide support for upgrade domain script

2016-03-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9005: -- Attachment: HDFS-9005-2.patch Thanks [~eddyxu]! Here is the updated patch that addresses the issues you raised.

[jira] [Updated] (HDFS-9826) Erasure Coding: Postpone the recovery work for a configurable time period

2016-03-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-9826: Status: Patch Available (was: Open) > Erasure Coding: Postpone the recovery work for a configurable time period >

[jira] [Updated] (HDFS-9826) Erasure Coding: Postpone the recovery work for a configurable time period

2016-03-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-9826: Attachment: HDFS-9826-002.patch > Erasure Coding: Postpone the recovery work for a configurable time period >

[jira] [Updated] (HDFS-9925) Ozone: Add Ozone Client lib for bucket handling

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9925: --- Status: Patch Available (was: Open) > Ozone: Add Ozone Client lib for bucket handling >

[jira] [Updated] (HDFS-9925) Ozone: Add Ozone Client lib for bucket handling

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9925: --- Attachment: HDFS-9925-HDFS-7240.001.patch > Ozone: Add Ozone Client lib for bucket handling >

[jira] [Created] (HDFS-9925) Ozone: Add Ozone Client lib for bucket handling

2016-03-08 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9925: -- Summary: Ozone: Add Ozone Client lib for bucket handling Key: HDFS-9925 URL: https://issues.apache.org/jira/browse/HDFS-9925 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186426#comment-15186426 ] Jing Zhao commented on HDFS-7866: - Yes, the plan sounds good to me. +1 on the v13 patch. > Erasure coding:

[jira] [Commented] (HDFS-9921) Stop tracking CHANGES.txt in the HDFS-1312 feature branch.

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186389#comment-15186389 ] Hadoop QA commented on HDFS-9921: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186372#comment-15186372 ] Brahma Reddy Battula commented on HDFS-9917: *Following tested on trunk,not the original

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186359#comment-15186359 ] Zhe Zhang commented on HDFS-7866: - Thanks Jing for the clarification. bq. So we're good to leave the field

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186314#comment-15186314 ] Rui Li commented on HDFS-7866: -- Thanks [~jingzhao] and [~zhz] for the great discussions. So we're good to

[jira] [Commented] (HDFS-9763) Add merge api

2016-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186308#comment-15186308 ] Tsz Wo Nicholas Sze commented on HDFS-9763: --- Alternative to the merge API, we may support

[jira] [Created] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9924: - Summary: [umbrella] Asynchronous HDFS Access Key: HDFS-9924 URL: https://issues.apache.org/jira/browse/HDFS-9924 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186291#comment-15186291 ] Hadoop QA commented on HDFS-9118: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186286#comment-15186286 ] Kai Zheng commented on HDFS-7866: - Thanks for the nice discussions. bq. Because EC is only in 3.0, we can

[jira] [Updated] (HDFS-9916) OzoneHandler : Add Key handler

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9916: --- Attachment: HDFS-9916-HDFS-7240.002.patch [~cnauroth] Thanks for the review. I have updated the patch

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186270#comment-15186270 ] Jing Zhao commented on HDFS-7866: - Sorry for the confusion. I mean the change on

[jira] [Updated] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9694: Attachment: HDFS-9694-v5.patch Updated the patch for addressing the findbugs. > Make existing

[jira] [Commented] (HDFS-9919) TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly

2016-03-08 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186254#comment-15186254 ] Lin Yiqun commented on HDFS-9919: - Thanks [~andrew.wang] for quick review and commit! >

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186217#comment-15186217 ] Zhe Zhang commented on HDFS-7866: - bq. ErasureCodingPolicyProto is only used in getFileStatus RPC

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186205#comment-15186205 ] Zhe Zhang commented on HDFS-7866: - Thanks for pointing out the change in protobuf 3. Yes I think we can

[jira] [Updated] (HDFS-1477) Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart

2016-03-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Attachment: HDFS-1477-HDFS-9000.009.patch V009 addressed your comments, thanks [~arpitagarwal] for

[jira] [Updated] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-3702: Attachment: HDFS-3702.004.patch Hey, [~andrew.wang] Thanks for the suggestions. I change the patch

[jira] [Updated] (HDFS-7661) Erasure coding: support hflush and hsync

2016-03-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-7661: Attachment: (was: HDFS-EC-file-flush-sync-design-version2.0.pdf) > Erasure coding: support

[jira] [Updated] (HDFS-7661) Erasure coding: support hflush and hsync

2016-03-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-7661: Attachment: (was: HDFS-EC-file-flush-sync-design-version2.1.pdf) > Erasure coding: support

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186164#comment-15186164 ] Kai Zheng commented on HDFS-9694: - Thanks [~andrew.wang] for the nice hint and I will try it! > Make

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-03-08 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-9922: --- Status: Patch Available (was: In Progress) > Upgrade Domain placement policy status marks a good

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-03-08 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-9922: --- Attachment: HDFS-9922-trunk-v1.patch [~mingma] v1 patch attached. > Upgrade Domain placement policy

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186150#comment-15186150 ] Kai Zheng commented on HDFS-9822: - BIN ZHOU => [~zhz]. > Erasure Coding: Avoids scheduling multiple

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186145#comment-15186145 ] Kai Zheng commented on HDFS-9822: - Thanks [~zhzhoubin]. bq. I don't think we should schedule all EC tasks

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-03-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186102#comment-15186102 ] James Clampffer commented on HDFS-9556: --- That makes sense, I'm running gcc 4.8.2. Is this something

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186089#comment-15186089 ] Jing Zhao commented on HDFS-7866: - I checked the current code again. {{ErasureCodingPolicyProto}} is only

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186073#comment-15186073 ] Jing Zhao commented on HDFS-7866: - There are already too many debates about optional and required. Maybe

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186017#comment-15186017 ] Zhe Zhang commented on HDFS-9822: - Interesting case here. I think it happens when 1) a under replicated

[jira] [Commented] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186007#comment-15186007 ] Chris Nauroth commented on HDFS-9920: - Thanks [~anu]! > Stop tracking CHANGES.txt in the HDFS-7240

[jira] [Commented] (HDFS-9919) TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly

2016-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185994#comment-15185994 ] Hudson commented on HDFS-9919: -- FAILURE: Integrated in Hadoop-trunk-Commit #9444 (See

[jira] [Commented] (HDFS-9921) Stop tracking CHANGES.txt in the HDFS-1312 feature branch.

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185993#comment-15185993 ] Anu Engineer commented on HDFS-9921: [~xiaobingo] Thanks for the patch. +1, looks good, pending

[jira] [Updated] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9920: --- Resolution: Fixed Status: Resolved (was: Patch Available) [~cnauroth], Thanks for the patch.

[jira] [Updated] (HDFS-9921) Stop tracking CHANGES.txt in the HDFS-1312 feature branch.

2016-03-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9921: Status: Patch Available (was: Open) > Stop tracking CHANGES.txt in the HDFS-1312 feature branch. >

[jira] [Commented] (HDFS-9921) Stop tracking CHANGES.txt in the HDFS-1312 feature branch.

2016-03-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185988#comment-15185988 ] Xiaobing Zhou commented on HDFS-9921: - I posted initial patch 001, please kindly review it, thanks. >

[jira] [Updated] (HDFS-9921) Stop tracking CHANGES.txt in the HDFS-1312 feature branch.

2016-03-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9921: Attachment: HDFS-9921-HDFS-1312.000.patch > Stop tracking CHANGES.txt in the HDFS-1312 feature

[jira] [Commented] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185979#comment-15185979 ] Hadoop QA commented on HDFS-9920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

2016-03-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185946#comment-15185946 ] Andrew Wang commented on HDFS-9405: --- SGTM, thanks for picking this up Xiao! > When starting a file,

[jira] [Comment Edited] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2016-03-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185927#comment-15185927 ] Arpit Agarwal edited comment on HDFS-9478 at 3/8/16 10:08 PM: -- Sounds good.

[jira] [Commented] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2016-03-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185927#comment-15185927 ] Arpit Agarwal commented on HDFS-9478: - Sounds good. One comment - the {{catch

[jira] [Updated] (HDFS-9908) Datanode should tolerate disk scan failure during NN handshake

2016-03-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9908: -- Attachment: HDFS-9908.002.patch Rev02: A quick and dirty fix for this issue. The new test case

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-03-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185911#comment-15185911 ] Bob Hansen commented on HDFS-9556: -- std::regex isn't included in GCC until 4.9:

[jira] [Commented] (HDFS-9703) DiskBalancer : getBandwidth implementation

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185905#comment-15185905 ] Anu Engineer commented on HDFS-9703: [~eddyxu] Thank you for your comments. I could write a wrapper on

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185895#comment-15185895 ] Andrew Wang commented on HDFS-9694: --- Findbugs might be sensing confusion because the member references

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.001.patch New patch: -LogManager no longer a singleton, just

[jira] [Commented] (HDFS-7597) DNs should not open new NN connections when webhdfs clients seek

2016-03-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185866#comment-15185866 ] Xiaobing Zhou commented on HDFS-7597: - [~daryn] and [~cnauroth] At least for insecure case, HDFS-8855

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185855#comment-15185855 ] Zhe Zhang commented on HDFS-7866: - Thanks Jing for the review. Changing the proto field to optional is a

[jira] [Created] (HDFS-9923) Datanode disk failure handling should be improved (consistently?)

2016-03-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9923: - Summary: Datanode disk failure handling should be improved (consistently?) Key: HDFS-9923 URL: https://issues.apache.org/jira/browse/HDFS-9923 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

2016-03-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185670#comment-15185670 ] Colin Patrick McCabe commented on HDFS-8564: bq. I'm sorry for confusion. This refers to the

[jira] [Updated] (HDFS-9919) TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly

2016-03-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9919: -- Resolution: Fixed Fix Version/s: 3.0.0 Target Version/s: 3.0.0 Status:

[jira] [Commented] (HDFS-9919) TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly

2016-03-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185637#comment-15185637 ] Andrew Wang commented on HDFS-9919: --- LGTM +1, will commit shortly >

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

2016-03-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185567#comment-15185567 ] Wei-Chiu Chuang commented on HDFS-8564: --- I'm sorry for confusion. This refers to the comments in

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

2016-03-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185558#comment-15185558 ] Wei-Chiu Chuang commented on HDFS-8564: --- [~cmccabe] Colin, you're right. The docs about BlockScanner

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1518#comment-1518 ] Jing Zhao commented on HDFS-7866: - The patch also LGTM. Thanks for the great work, [~lirui]. My only

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

2016-03-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185548#comment-15185548 ] Colin Patrick McCabe commented on HDFS-8564: Hi [~jojochuang], The VolumeScanner class is part

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-03-08 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-9922: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-7541 > Upgrade Domain placement policy status

[jira] [Created] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-03-08 Thread Chris Trezzo (JIRA)
Chris Trezzo created HDFS-9922: -- Summary: Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes Key: HDFS-9922 URL:

[jira] [Work started] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-03-08 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9922 started by Chris Trezzo. -- > Upgrade Domain placement policy status marks a good block in violation when >

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-03-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185541#comment-15185541 ] James Clampffer commented on HDFS-9556: --- Just checked again after I realized applied patch to one

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185526#comment-15185526 ] Zhe Zhang commented on HDFS-7866: - Sure Jing. Would be great to have your opinion. > Erasure coding:

[jira] [Commented] (HDFS-8786) Erasure coding: use simple replication for internal blocks on decommissioning datanodes

2016-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185517#comment-15185517 ] Hudson commented on HDFS-8786: -- FAILURE: Integrated in Hadoop-trunk-Commit #9443 (See

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-03-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185516#comment-15185516 ] James Clampffer commented on HDFS-9556: --- It looks like you could get rid of the following in

[jira] [Assigned] (HDFS-9921) Stop tracking CHANGES.txt in the HDFS-1312 feature branch.

2016-03-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9921: --- Assignee: Xiaobing Zhou > Stop tracking CHANGES.txt in the HDFS-1312 feature branch. >

[jira] [Updated] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9920: Attachment: HDFS-9920-HDFS-7240.001.patch Thank you, Anu. Reattaching same patch with correct

[jira] [Updated] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9920: Status: Patch Available (was: Open) > Stop tracking CHANGES.txt in the HDFS-7240 feature branch. >

[jira] [Updated] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9920: Attachment: (was: HDFS-9920.001.patch) > Stop tracking CHANGES.txt in the HDFS-7240 feature

[jira] [Created] (HDFS-9921) Stop tracking CHANGES.txt in the HDFS-1312 feature branch.

2016-03-08 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9921: -- Summary: Stop tracking CHANGES.txt in the HDFS-1312 feature branch. Key: HDFS-9921 URL: https://issues.apache.org/jira/browse/HDFS-9921 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9920: Status: Open (was: Patch Available) > Stop tracking CHANGES.txt in the HDFS-7240 feature branch. >

[jira] [Commented] (HDFS-8786) Erasure coding: use simple replication for internal blocks on decommissioning datanodes

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185498#comment-15185498 ] Hadoop QA commented on HDFS-8786: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9703) DiskBalancer : getBandwidth implementation

2016-03-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185494#comment-15185494 ] Lei (Eddy) Xu commented on HDFS-9703: - Hi, [~anu] One question regarding this patch: why would

[jira] [Commented] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185482#comment-15185482 ] Anu Engineer commented on HDFS-9920: +1 yes, thank you for this patch. It is one less thing to do while

[jira] [Updated] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9920: Attachment: HDFS-9920.001.patch [~anu], would you please review this? Are you OK to stop tracking

[jira] [Updated] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9920: Priority: Trivial (was: Major) > Stop tracking CHANGES.txt in the HDFS-7240 feature branch. >

[jira] [Updated] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9920: Status: Patch Available (was: Open) > Stop tracking CHANGES.txt in the HDFS-7240 feature branch. >

[jira] [Created] (HDFS-9920) Stop tracking CHANGES.txt in the HDFS-7240 feature branch.

2016-03-08 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9920: --- Summary: Stop tracking CHANGES.txt in the HDFS-7240 feature branch. Key: HDFS-9920 URL: https://issues.apache.org/jira/browse/HDFS-9920 Project: Hadoop HDFS

  1   2   >