[jira] [Commented] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414657#comment-15414657 ] Arpit Agarwal commented on HDFS-9530: - Hi [~srikanth.sampath], thanks for the report. I just did a dry

[jira] [Comment Edited] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

2016-08-09 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414620#comment-15414620 ] Youwei Wang edited comment on HDFS-8957 at 8/10/16 2:48 AM: Note: this patch

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

2016-08-09 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-8957: -- Attachment: HDFS-8957.v3.patch Note: this patch is based on the Hadoop trunk. Corresponding commitid

[jira] [Commented] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414615#comment-15414615 ] Rakesh R commented on HDFS-10738: - Thanks [~kihwal] for final reviews and committing the patch. > Fix

[jira] [Comment Edited] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

2016-08-09 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414607#comment-15414607 ] Youwei Wang edited comment on HDFS-8957 at 8/10/16 2:40 AM: The uploaded patch

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

2016-08-09 Thread Youwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Youwei Wang updated HDFS-8957: -- Attachment: HDFS-8957.v2.patch This patch depends on the HDFS-8901.v14.patch at this link:

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Attachment: HDFS-10645.009.patch > Make block report size as a metric and add this metric to datanode

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414601#comment-15414601 ] Yuanbo Liu commented on HDFS-10645: --- Uploaded v9 patch to address [~ajisakaa]'s comment. > Make block

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Attachment: (was: HDFS-10645.009.patch) > Make block report size as a metric and add this metric to

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Attachment: HDFS-10645.009.patch > Make block report size as a metric and add this metric to datanode

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414585#comment-15414585 ] Hudson commented on HDFS-8224: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10251 (See

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414581#comment-15414581 ] Yuanbo Liu commented on HDFS-10645: --- [~ajisakaa] Yes I agree with you, since {{maxDataLength}} is part

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414579#comment-15414579 ] Hadoop QA commented on HDFS-10682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-09 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407012#comment-15407012 ] Fenghua Hu edited comment on HDFS-10690 at 8/10/16 1:30 AM: Xiaoyu, [~xyao]I

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414567#comment-15414567 ] Wei-Chiu Chuang commented on HDFS-8224: --- Committed to trunk. Thanks a lot [~shahrs87] for the patch

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8224: -- Fix Version/s: 3.0.0-alpha2 > Schedule a block for scanning if its metadata file is corrupt >

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8224: -- Target Version/s: 2.8.0 Hadoop Flags: Reviewed Fix Version/s: (was: 2.8.0) >

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414545#comment-15414545 ] Wei-Chiu Chuang commented on HDFS-8224: --- The test failures are unrelated. Committing the v3 patch. >

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414539#comment-15414539 ] Hadoop QA commented on HDFS-10742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414535#comment-15414535 ] Hadoop QA commented on HDFS-10742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File.

2016-08-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10638: -- Attachment: HDFS-10638.002.patch Updated patch to work with the new patches of

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414520#comment-15414520 ] Hadoop QA commented on HDFS-8224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-08-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.005.patch Posting a modified patch to work with the latest patch

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.003.patch > Measurement of lock held time in FsDatasetImpl >

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.002.patch > Measurement of lock held time in FsDatasetImpl >

[jira] [Commented] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414429#comment-15414429 ] Hudson commented on HDFS-10457: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10249 (See

[jira] [Commented] (HDFS-10681) DiskBalancer: query command should report Plan file path apart from PlanID

2016-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414428#comment-15414428 ] Hudson commented on HDFS-10681: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10249 (See

[jira] [Updated] (HDFS-10681) DiskBalancer: query command should report Plan file path apart from PlanID

2016-08-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10681: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414396#comment-15414396 ] Wei-Chiu Chuang commented on HDFS-8224: --- +1 pending Jenkins. > Schedule a block for scanning if its

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-08-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414394#comment-15414394 ] Xiao Chen commented on HDFS-9276: - Linking HADOOP-8751. Without it,

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Status: Patch Available (was: Open) > Schedule a block for scanning if its metadata file is

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Attachment: HDFS-8224-trunk-3.patch Created a new patch addressing all the previous comments.

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Status: Open (was: Patch Available) [~jojochuang]: Thanks a lot for your valuable reviews.

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Status: Patch Available (was: Open) > Measurement of lock held time in FsDatasetImpl >

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.001.patch > Measurement of lock held time in FsDatasetImpl >

[jira] [Commented] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414326#comment-15414326 ] James Clampffer commented on HDFS-10740: Cool stuff, relatively minor comments. A little more

[jira] [Commented] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414322#comment-15414322 ] Wei-Chiu Chuang commented on HDFS-10457: Thanks [~eddyxu]! > DataNode should not auto-format

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8224: -- Summary: Schedule a block for scanning if its metadata file is corrupt (was: Any IOException in

[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8224: -- Component/s: datanode > Schedule a block for scanning if its metadata file is corrupt >

[jira] [Commented] (HDFS-9271) Implement basic NN operations

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414311#comment-15414311 ] Hadoop QA commented on HDFS-9271: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10739: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: In RPC engine

[jira] [Updated] (HDFS-9271) Implement basic NN operations

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-9271: Attachment: HDFS-9271.HDFS-8707.008.patch New patch attached. > Implement basic NN operations >

[jira] [Commented] (HDFS-9271) Implement basic NN operations

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414239#comment-15414239 ] Anatoli Shein commented on HDFS-9271: - [~James C], thank you for the review. I have addressed your

[jira] [Created] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-09 Thread Chen Liang (JIRA)
Chen Liang created HDFS-10742: - Summary: Measurement of lock held time in FsDatasetImpl Key: HDFS-10742 URL: https://issues.apache.org/jira/browse/HDFS-10742 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414187#comment-15414187 ] Hadoop QA commented on HDFS-8224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414172#comment-15414172 ] Hudson commented on HDFS-10738: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10247 (See

[jira] [Commented] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414165#comment-15414165 ] Wei-Chiu Chuang commented on HDFS-8224: --- Thanks for the patch! Overall it looks good to me. I just

[jira] [Updated] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10738: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414140#comment-15414140 ] James Clampffer commented on HDFS-10739: Committed this to HDFS-8707. Thanks Anatoli! This

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414133#comment-15414133 ] Hadoop QA commented on HDFS-8897: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414127#comment-15414127 ] Kihwal Lee commented on HDFS-10738: --- +1 the patch looks good. {{TestTracing}} was just fixed by

[jira] [Commented] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414121#comment-15414121 ] Hadoop QA commented on HDFS-10738: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414085#comment-15414085 ] Hadoop QA commented on HDFS-10679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2016-08-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414078#comment-15414078 ] Arpit Agarwal commented on HDFS-9038: - Hi [~brahmareddy], thanks for the updated patch. I will try to

[jira] [Commented] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414066#comment-15414066 ] Hadoop QA commented on HDFS-10740: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-09 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414057#comment-15414057 ] churro morales commented on HDFS-10608: --- Hi [~surendrasingh] Thank you for the review. Our original

[jira] [Commented] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414033#comment-15414033 ] Hadoop QA commented on HDFS-10739: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-10741) TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration fails consistently.

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-10741. Resolution: Duplicate Looks like it's a dup of HDFS-10738 where a patch is uploaded. Let's

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414010#comment-15414010 ] Surendra Singh Lilhore commented on HDFS-10608: --- Thanks [~churromorales] for the patch..

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Attachment: HDFS-8897.006.patch Patch 006: * Fix checkstyle Unit test failures in 005 were unrelated. >

[jira] [Updated] (HDFS-10741) TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration fails consistently.

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10741: -- Description: Following test is failing consistently in trunk. Tests run: 2, Failures: 1,

[jira] [Commented] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414003#comment-15414003 ] Rushabh S Shah commented on HDFS-8224: -- {quote} TestRefreshUserMappings is failing with and without my

[jira] [Created] (HDFS-10741) TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration fails consistently.

2016-08-09 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-10741: - Summary: TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration fails consistently. Key: HDFS-10741 URL: https://issues.apache.org/jira/browse/HDFS-10741

[jira] [Updated] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10738: Attachment: HDFS-10738-01.patch Attached patch to fix checkstyle warnings. > Fix

[jira] [Comment Edited] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413953#comment-15413953 ] Rakesh R edited comment on HDFS-10738 at 8/9/16 6:22 PM: - Attached patch by fixing

[jira] [Updated] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Attachment: HDFS-8224-trunk-2.patch Attaching a patch for trunk. Will post a patch for branch-2.8

[jira] [Updated] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Status: Patch Available (was: Open) > Any IOException in DataTransfer#run() will run diskError

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Attachment: HDFS-10679.HDFS-8707.005.patch Fixed locking to use lock_guards and time-out in RPC

[jira] [Updated] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Status: Open (was: Patch Available) Cancelling the patch since forgot to add a new file in the

[jira] [Commented] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413936#comment-15413936 ] Hadoop QA commented on HDFS-10738: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413934#comment-15413934 ] James Clampffer commented on HDFS-10739: +1 Thanks for finding/fixing this. I'll commit as soon

[jira] [Commented] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413929#comment-15413929 ] Bob Hansen commented on HDFS-10739: --- Looks good. +1 if it passes tests. > libhdfs++: In RPC engine

[jira] [Updated] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10740: - Attachment: HDFS-10740.HDFS-8707.000.patch Generator implemented. This also has fix HDFS-10739

[jira] [Updated] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10740: - Status: Patch Available (was: Open) > libhdfs++: Implement recursive directory generator >

[jira] [Assigned] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein reassigned HDFS-10740: Assignee: Anatoli Shein > libhdfs++: Implement recursive directory generator >

[jira] [Created] (HDFS-10740) libhdfs++: Implement recursive directory generator

2016-08-09 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10740: Summary: libhdfs++: Implement recursive directory generator Key: HDFS-10740 URL: https://issues.apache.org/jira/browse/HDFS-10740 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10739: - Attachment: HDFS-10739.HDFS-8707.000.patch Attached. > libhdfs++: In RPC engine replace vector

[jira] [Assigned] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein reassigned HDFS-10739: Assignee: Anatoli Shein > libhdfs++: In RPC engine replace vector with deque for pending

[jira] [Created] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10739: Summary: libhdfs++: In RPC engine replace vector with deque for pending requests Key: HDFS-10739 URL: https://issues.apache.org/jira/browse/HDFS-10739 Project:

[jira] [Updated] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests

2016-08-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10739: - Status: Patch Available (was: Open) > libhdfs++: In RPC engine replace vector with deque for

[jira] [Commented] (HDFS-8406) Lease recovery continually failed

2016-08-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413905#comment-15413905 ] Ravi Prakash commented on HDFS-8406: It may not be related to HDFS-9194. I am seeing this on a 2.7.1

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682-branch-2.003.patch Somehow there is one call missed in a method... Which breaks

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: In Progress (was: Patch Available) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Commented] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413883#comment-15413883 ] Hadoop QA commented on HDFS-8224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413874#comment-15413874 ] Hudson commented on HDFS-10342: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10244 (See

[jira] [Commented] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413845#comment-15413845 ] Wei-Chiu Chuang commented on HDFS-8224: --- Sure I'll review soon. Thx for the patch. > Any IOException

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-08-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413846#comment-15413846 ] Daryn Sharp commented on HDFS-10301: My main objections (other than the fatal bug) are the

[jira] [Updated] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Status: Open (was: Patch Available) Cancelling the patch to address checkstyle issues. Following

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10342: -- Target Version/s: 2.8.0 > BlockManager#createLocatedBlocks should not check corrupt replicas if none >

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10342: -- Fix Version/s: 3.0.0-alpha2 > BlockManager#createLocatedBlocks should not check corrupt replicas if

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413838#comment-15413838 ] Kihwal Lee commented on HDFS-10342: --- Committed this to trunk. > BlockManager#createLocatedBlocks should

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413835#comment-15413835 ] Kihwal Lee commented on HDFS-10342: --- +1 lgtm. This is a simple optimization for the common case, but

[jira] [Updated] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Status: Patch Available (was: Open) [~jojochuang]: Since you know the most context, do you mind

[jira] [Updated] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2016-08-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Attachment: HDFS-8224-trunk-1.patch > Any IOException in DataTransfer#run() will run diskError

[jira] [Commented] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

2016-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413811#comment-15413811 ] Kihwal Lee commented on HDFS-10733: --- Can we something similar to HDFS-9107? > NameNode terminated after

[jira] [Updated] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10738: Target Version/s: 2.8.0 (was: 2.9.0) > Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration

[jira] [Updated] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10738: Target Version/s: 2.9.0 Status: Patch Available (was: Open) > Fix

[jira] [Commented] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413791#comment-15413791 ] Rakesh R commented on HDFS-10738: - Thank you [~kihwal] for the advice and it worked. Attached patch with

[jira] [Updated] (HDFS-10738) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10738: Attachment: HDFS-10738-00.patch > Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test

  1   2   >