[jira] [Created] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-07-13 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10625: Summary: VolumeScanner to report why a block is found bad Key: HDFS-10625 URL: https://issues.apache.org/jira/browse/HDFS-10625 Project: Hadoop HDFS Issue

[jira] [Deleted] (HDFS-10624) VolumeScanner to report why a block is found bad

2016-07-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang deleted HDFS-10624: --- > VolumeScanner to report why a block is found bad > >

[jira] [Updated] (HDFS-10624) VolumeScanner to report why a block is found bad

2016-07-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10624: - Description: (was: Seeing the following on DN log. {code} 2016-04-07 20:27:45,416 INFO

[jira] [Updated] (HDFS-10624) VolumeScanner to report why a block is found bad

2016-07-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10624: - Description: Seeing the following on DN log. {code} 2016-04-07 20:27:45,416 INFO

[jira] [Created] (HDFS-10624) VolumeScanner to report why a block is found bad

2016-07-13 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10624: Summary: VolumeScanner to report why a block is found bad Key: HDFS-10624 URL: https://issues.apache.org/jira/browse/HDFS-10624 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8065) Erasure coding: Support truncate at striped group boundary

2016-07-13 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376304#comment-15376304 ] Rakesh R commented on HDFS-8065: Hi, [~drankye], [~umamaheswararao], [~zhz] IMHO, truncate on block group

[jira] [Updated] (HDFS-8065) Erasure coding: Support truncate at striped group boundary

2016-07-13 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8065: --- Summary: Erasure coding: Support truncate at striped group boundary (was: Erasure coding: Support truncate at

[jira] [Commented] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376257#comment-15376257 ] Hudson commented on HDFS-10617: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10095 (See

[jira] [Commented] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2016-07-13 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376238#comment-15376238 ] Rakesh R commented on HDFS-10477: - It looks like test case is failing due to lock release, please check.

[jira] [Created] (HDFS-10623) Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens.

2016-07-13 Thread Jitendra Nath Pandey (JIRA)
Jitendra Nath Pandey created HDFS-10623: --- Summary: Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens. Key: HDFS-10623 URL: https://issues.apache.org/jira/browse/HDFS-10623

[jira] [Updated] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10617: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved

[jira] [Commented] (HDFS-10612) Optimize mechanism when block report size exceed the limit of PB message

2016-07-13 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376229#comment-15376229 ] Yuanbo Liu commented on HDFS-10612: --- Block report size is difficult to calculate, for the block number

[jira] [Assigned] (HDFS-10612) Optimize mechanism when block report size exceed the limit of PB message

2016-07-13 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HDFS-10612: - Assignee: Yuanbo Liu > Optimize mechanism when block report size exceed the limit of PB message

[jira] [Commented] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376227#comment-15376227 ] Kihwal Lee commented on HDFS-10617: --- +1 lgtm > PendingReconstructionBlocks.size() should be

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage histogram

2016-07-13 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376186#comment-15376186 ] Kai Sasaki commented on HDFS-10534: --- [~zhz] Oh, you are next to dust team! Thanks! > NameNode WebUI

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

2016-07-13 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376170#comment-15376170 ] Inigo Goiri commented on HDFS-10467: After checking the code, I think there might a bunch of overlaps

[jira] [Commented] (HDFS-10619) Cache path in InodesInPath

2016-07-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376158#comment-15376158 ] Yiqun Lin commented on HDFS-10619: -- Hi, [~daryn], the patch looks good. But the failed test seemed

[jira] [Commented] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376069#comment-15376069 ] Hadoop QA commented on HDFS-10477: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10441) libhdfs++: HA namenode support

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376060#comment-15376060 ] Hadoop QA commented on HDFS-10441: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-13 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Zhou updated HDFS-10519: -- Attachment: HDFS-10519.007.patch Add a new parameter isTail to selectInputStream() on the NameNode side

[jira] [Commented] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2016-07-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376009#comment-15376009 ] Daniel Templeton commented on HDFS-10601: - LGTM. > Improve log message to include hostname when

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-07-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376006#comment-15376006 ] Lei (Eddy) Xu commented on HDFS-10598: -- Great. Thanks Arpit . > DiskBalancer does not execute

[jira] [Updated] (HDFS-10441) libhdfs++: HA namenode support

2016-07-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10441: --- Attachment: HDFS-10441.HDFS-8707.013.patch Thanks for the review [~xiaowei.zhu]. bq. In the

[jira] [Commented] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375952#comment-15375952 ] Hadoop QA commented on HDFS-10544: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375945#comment-15375945 ] Hadoop QA commented on HDFS-10620: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10622) o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky

2016-07-13 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10622: Summary: o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky Key: HDFS-10622 URL: https://issues.apache.org/jira/browse/HDFS-10622 Project:

[jira] [Updated] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2016-07-13 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunjiong zhao updated HDFS-10477: - Attachment: HDFS-10477.004.patch Update patch with below changes: 1. release lock after finish

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375922#comment-15375922 ] Yongjun Zhang commented on HDFS-10587: -- The block corruption appears to be corrupted at the very

[jira] [Commented] (HDFS-10441) libhdfs++: HA namenode support

2016-07-13 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375865#comment-15375865 ] Xiaowei Zhu commented on HDFS-10441: The latest patch looks almost good to go with one small typo in

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Component/s: ha balancer & mover > Balancer doesn't work with IPFailoverProxyProvider >

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Affects Version/s: 2.6.1 > Balancer doesn't work with IPFailoverProxyProvider >

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Target Version/s: 2.6.5 (was: 2.8.0, 2.7.3, 2.6.5, 3.0.0-alpha1) > Balancer doesn't work with

[jira] [Updated] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-07-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10598: - Affects Version/s: (was: 2.8.0) > DiskBalancer does not execute multi-steps plan. >

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.5 2.7.3

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-07-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375848#comment-15375848 ] Arpit Agarwal commented on HDFS-10598: -- Disk Balancer is not in branch-2 so I've set updated the

[jira] [Updated] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-07-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10598: - Target Version/s: 3.0.0-beta1 (was: 2.9.0, 3.0.0-beta1) > DiskBalancer does not execute

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-07-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375844#comment-15375844 ] Arpit Agarwal commented on HDFS-10598: -- Hi [~eddyxu], thanks for reporting this problem and posting a

[jira] [Updated] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-07-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10598: - Assignee: Lei (Eddy) Xu (was: Anu Engineer) Fix Version/s: (was: 2.9.0)

[jira] [Updated] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-07-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10598: - Attachment: HDFS-10598.00.patch Upload the patch that changes {{DiskBalancerMover#copyBlocks}} to

[jira] [Commented] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375793#comment-15375793 ] Zhe Zhang commented on HDFS-10544: -- Reported test failures on branch-2.7 patch are unrelated and pass

[jira] [Commented] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-13 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375756#comment-15375756 ] Staffan Friberg commented on HDFS-10620: To avoid all allocation. {noformat} diff --git

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-13 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-10620: --- Fix Version/s: (was: 3.0.0-alpha1) > StringBuilder created and appended even if logging

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-13 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-10620: --- Attachment: HDFS-10620.001.patch > StringBuilder created and appended even if logging is

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-13 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-10620: --- Fix Version/s: 3.0.0-alpha1 Status: Patch Available (was: Open) > StringBuilder

[jira] [Created] (HDFS-10621) libhdfs++: Implement . (dot) and .. (double-dot) semantics

2016-07-13 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10621: Summary: libhdfs++: Implement . (dot) and .. (double-dot) semantics Key: HDFS-10621 URL: https://issues.apache.org/jira/browse/HDFS-10621 Project: Hadoop HDFS

[jira] [Created] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-13 Thread Staffan Friberg (JIRA)
Staffan Friberg created HDFS-10620: -- Summary: StringBuilder created and appended even if logging is disabled Key: HDFS-10620 URL: https://issues.apache.org/jira/browse/HDFS-10620 Project: Hadoop

[jira] [Commented] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375723#comment-15375723 ] Hadoop QA commented on HDFS-10544: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375635#comment-15375635 ] Hadoop QA commented on HDFS-10519: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375617#comment-15375617 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10619) Cache path in InodesInPath

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375596#comment-15375596 ] Hadoop QA commented on HDFS-10619: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10619) Cache path in InodesInPath

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375559#comment-15375559 ] Zhe Zhang commented on HDFS-10619: -- This looks a good fix. Thanks Daryn. If an iip is created but

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-13 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375518#comment-15375518 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- I apologize for attaching a wrong patch.

[jira] [Updated] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-13 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Zhou updated HDFS-10519: -- Attachment: HDFS-10519.006.patch Also add a boolean flag in Journal for the same purpose. > Add a

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Attachment: HDFS-10544-branch-2.7.patch Attaching branch-2.7 patch to trigger Jenkins. > Balancer

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-13 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.008.patch > BlockReport retransmissions may lead to

[jira] [Updated] (HDFS-10619) Cache path in InodesInPath

2016-07-13 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10619: --- Attachment: HDFS-10619.patch > Cache path in InodesInPath > -- > >

[jira] [Updated] (HDFS-10619) Cache path in InodesInPath

2016-07-13 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10619: --- Status: Patch Available (was: Open) > Cache path in InodesInPath > -- > >

[jira] [Created] (HDFS-10619) Cache path in InodesInPath

2016-07-13 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10619: -- Summary: Cache path in InodesInPath Key: HDFS-10619 URL: https://issues.apache.org/jira/browse/HDFS-10619 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10616) Improve performance of path handling

2016-07-13 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375423#comment-15375423 ] Daryn Sharp commented on HDFS-10616: Will be an umbrella for sub-tasks to incrementally integrate

[jira] [Commented] (HDFS-10441) libhdfs++: HA namenode support

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375380#comment-15375380 ] Hadoop QA commented on HDFS-10441: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375352#comment-15375352 ] Hadoop QA commented on HDFS-10617: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10441) libhdfs++: HA namenode support

2016-07-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10441: --- Attachment: HDFS-10441.HDFS-8707.012.patch Just rebasing the patch since HDFS-9890 was

[jira] [Commented] (HDFS-10618) TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375291#comment-15375291 ] Hadoop QA commented on HDFS-10618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10618) TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10618: --- Status: Patch Available (was: Open) > TestPendingReconstruction#testPendingAndInvalidate is flaky

[jira] [Updated] (HDFS-10618) TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10618: --- Attachment: HDFS-10618-b2.001.patch Attaching a branch-2 patch, since reconstruction is known as

[jira] [Updated] (HDFS-10618) TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10618: --- Attachment: HDFS-10618.001.patch Attaching a patch that fixes the race in the test by putting all of

[jira] [Commented] (HDFS-10618) TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375264#comment-15375264 ] Eric Badger commented on HDFS-10618: Inside of the Replication Monitor,

[jira] [Created] (HDFS-10618) TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition

2016-07-13 Thread Eric Badger (JIRA)
Eric Badger created HDFS-10618: -- Summary: TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition Key: HDFS-10618 URL: https://issues.apache.org/jira/browse/HDFS-10618 Project:

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the work

[jira] [Updated] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10617: --- Status: Patch Available (was: Open) > PendingReconstructionBlocks.size() should be synchronized >

[jira] [Updated] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10617: --- Attachment: HDFS-10617.002.patch Attaching updated trunk patch. Eclipse inserted tabs instead of

[jira] [Updated] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10617: --- Attachment: HDSF-10617-b2.001.patch Attaching branch-2 patch > PendingReconstructionBlocks.size()

[jira] [Updated] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10617: --- Attachment: HDFS-10617.001.patch Attaching patch for trunk > PendingReconstructionBlocks.size()

[jira] [Updated] (HDFS-10617) PendingReconstructionBlocks.size() should be synchronized

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10617: --- Description: PendingReconstructionBlocks (PendingReplicationBlocks in branch-2 and below) is a

[jira] [Updated] (HDFS-10425) Clean up NNStorage and TestSaveNamespace

2016-07-13 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10425: Attachment: HDFS-10425.02.patch Patch 02. First one was no longer applicable. > Clean up NNStorage

[jira] [Updated] (HDFS-10617) PendingReconstructions.size() should be synchronized

2016-07-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10617: --- Description: pendingReconstructions (pendingReplicationBlocks in branch-2 and below) is a HashMap,

[jira] [Created] (HDFS-10617) PendingReplicationBlocks.size() should be synchronized

2016-07-13 Thread Eric Badger (JIRA)
Eric Badger created HDFS-10617: -- Summary: PendingReplicationBlocks.size() should be synchronized Key: HDFS-10617 URL: https://issues.apache.org/jira/browse/HDFS-10617 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-9809) Abstract implementation-specific details from the datanode

2016-07-13 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375111#comment-15375111 ] Ewan Higgs edited comment on HDFS-9809 at 7/13/16 2:33 PM: --- Hi, In Storage.java,

[jira] [Commented] (HDFS-9809) Abstract implementation-specific details from the datanode

2016-07-13 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375111#comment-15375111 ] Ewan Higgs commented on HDFS-9809: -- Hi, In Storage.java, I think a good deal of copyFileBuffered can be

[jira] [Comment Edited] (HDFS-9809) Abstract implementation-specific details from the datanode

2016-07-13 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375111#comment-15375111 ] Ewan Higgs edited comment on HDFS-9809 at 7/13/16 2:32 PM: --- Hi, In Storage.java,

[jira] [Commented] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374540#comment-15374540 ] Hadoop QA commented on HDFS-10606: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-3051) A zero-copy ScatterGatherRead api from FSDataInputStream

2016-07-13 Thread Ravikumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374535#comment-15374535 ] Ravikumar commented on HDFS-3051: - How about returning the MappedByteBuffers of all blocks for a file in

[jira] [Commented] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374536#comment-15374536 ] Hadoop QA commented on HDFS-10544: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10590) Fix TestReconstructStripedBlocks.testCountLiveReplicas test failures

2016-07-13 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374519#comment-15374519 ] Rakesh R commented on HDFS-10590: - Thank you [~umamaheswararao] for reviewing and committing the patch. >

[jira] [Updated] (HDFS-10590) Fix TestReconstructStripedBlocks.testCountLiveReplicas test failures

2016-07-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10590: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1

[jira] [Commented] (HDFS-10590) Fix TestReconstructStripedBlocks.testCountLiveReplicas test failures

2016-07-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374516#comment-15374516 ] Hudson commented on HDFS-10590: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10087 (See

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374480#comment-15374480 ] Yongjun Zhang commented on HDFS-10587: -- About the visibleLength, I saw {code} In

[jira] [Commented] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374470#comment-15374470 ] Zhe Zhang commented on HDFS-10544: -- Committed v5 patch to trunk, branch-2, and branch-2.8. I'm working on

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Fix Version/s: 3.0.0-alpha1 2.9.0 2.8.0 > Balancer doesn't work

[jira] [Commented] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374461#comment-15374461 ] Hudson commented on HDFS-10544: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10086 (See

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Affects Version/s: (was: 2.7.1) 2.7.0 Status: Patch

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Attachment: HDFS-10606-branch-2.7.001.patch submit patch for branch-2.7 > TrashPolicyDefault

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Attachment: HDFS-10544.05.patch Thanks [~shv] for the review! Attaching v5 patch which fixes 2 checkstyle