[jira] [Updated] (HDFS-9198) Coalesce IBR processing in the NN

2015-10-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9198: -- Status: Patch Available (was: Open) > Coalesce IBR processing in the NN >

[jira] [Resolved] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved HDFS-9176. Resolution: Not A Problem The test failed twice is an odd way and hasn't failed since in the

[jira] [Commented] (HDFS-9196) TestWebHdfsContentLength fails on trunk

2015-10-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943720#comment-14943720 ] Mingliang Liu commented on HDFS-9196: - Thank you for this patch. I checked it out and also found the

[jira] [Commented] (HDFS-9158) [OEV-Doc] : Document does not mention about "-f" and "-r" options

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943727#comment-14943727 ] Hudson commented on HDFS-9158: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #455 (See

[jira] [Updated] (HDFS-9198) Coalesce IBR processing in the NN

2015-10-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9198: -- Attachment: HDFS-9198-trunk.patch HDFS-9198-branch2.patch Incremental block reports are

[jira] [Commented] (HDFS-9158) [OEV-Doc] : Document does not mention about "-f" and "-r" options

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943752#comment-14943752 ] Hudson commented on HDFS-9158: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2395 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-10-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943744#comment-14943744 ] Daryn Sharp commented on HDFS-8855: --- Only glanced at the patch, but did you figure out why HDFS-7597

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-10-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943802#comment-14943802 ] Xiaobing Zhou commented on HDFS-8855: - This issue is from DataNodeUGIProvider#tokenUGI {code} Token

[jira] [Updated] (HDFS-9142) Namenode Http address is not configured correctly for federated cluster in MiniDFSCluster

2015-10-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-9142: -- Attachment: HDFS-9142.v5.patch > Namenode Http address is not configured correctly for federated cluster in >

[jira] [Commented] (HDFS-9114) NameNode and DataNode metric log file name should follow the other log file name format.

2015-10-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943706#comment-14943706 ] Allen Wittenauer commented on HDFS-9114: The more and more I look at this, the more and more I'm

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943730#comment-14943730 ] Daryn Sharp commented on HDFS-9184: --- bq. This is possibly a dumb question, but couldn't clientId be used

[jira] [Commented] (HDFS-9182) Cleanup the findbugs and other issues after HDFS EC merged to trunk.

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944537#comment-14944537 ] Hadoop QA commented on HDFS-9182: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9180) Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers

2015-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944529#comment-14944529 ] Jing Zhao commented on HDFS-9180: - Thanks Walter! [~hitliuyi], could you please take a look at the 03

[jira] [Commented] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944533#comment-14944533 ] Hadoop QA commented on HDFS-8632: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944535#comment-14944535 ] Hadoop QA commented on HDFS-9188: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9182) Cleanup the findbugs and other issues after HDFS EC merged to trunk.

2015-10-05 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9182: -- Attachment: HDFSS-9182.00.patch Attached a patch to address the findbugs and release

[jira] [Updated] (HDFS-9182) Cleanup the findbugs and other issues after HDFS EC merged to trunk.

2015-10-05 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9182: -- Status: Patch Available (was: In Progress) > Cleanup the findbugs and other issues

[jira] [Updated] (HDFS-4167) Add support for restoring/rolling back to a snapshot

2015-10-05 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated HDFS-4167: -- Status: Open (was: Patch Available) > Add support for restoring/rolling back to a snapshot >

[jira] [Updated] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9155: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Commented] (HDFS-9138) TestDatanodeStartupFixesLegacyStorageIDs fails on Windows due to failure to unpack old image tarball that contains hard links

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943915#comment-14943915 ] Colin Patrick McCabe commented on HDFS-9138: [~cnauroth], just out of curiosity, what was the

[jira] [Commented] (HDFS-9138) TestDatanodeStartupFixesLegacyStorageIDs fails on Windows due to failure to unpack old image tarball that contains hard links

2015-10-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943925#comment-14943925 ] Chris Nauroth commented on HDFS-9138: - Hi [~cmccabe]. We create the hard links on Windows now. In

[jira] [Commented] (HDFS-9155) [OEV] : The inputFile does not follow case insensitiveness incase of XML file

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943924#comment-14943924 ] Colin Patrick McCabe commented on HDFS-9155: +1. Thanks, nijel > [OEV] : The inputFile does

[jira] [Updated] (HDFS-9155) OEV should treat .XML files as XML even when the extension is uppercase

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9155: --- Summary: OEV should treat .XML files as XML even when the extension is uppercase

[jira] [Updated] (HDFS-7087) Ability to list /.reserved

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7087: Attachment: HDFS-7087.patch.draft Thanks very much [~andrew.wang] for the explanation! I have created a

[jira] [Updated] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-10-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8632: Target Version/s: 3.0.0 (was: HDFS-7285) > Erasure Coding: Add InterfaceAudience annotation to the erasure

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Component/s: erasure-coding > Erasure coding: preallocate multiple generation stamps and serialize updates

[jira] [Updated] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8164: Status: Open (was: Patch Available) > cTime is 0 in VERSION file for newly formatted NameNode. >

[jira] [Commented] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943976#comment-14943976 ] Hudson commented on HDFS-9155: -- FAILURE: Integrated in Hadoop-trunk-Commit #8571 (See

[jira] [Updated] (HDFS-7899) Improve EOF error message

2015-10-05 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-7899: --- Attachment: HDFS-7899-02.patch Thanks [~qwertymaniac] , Updated the message please review >

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.000.patch > Move the safemode block count into BlockManager >

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Status: Patch Available (was: Open) > Move the safemode block count into BlockManager >

[jira] [Created] (HDFS-9197) Snapshot FileDiff added to last snapshot when INodeFile accessTime field is updated

2015-10-05 Thread Alex Ivanov (JIRA)
Alex Ivanov created HDFS-9197: - Summary: Snapshot FileDiff added to last snapshot when INodeFile accessTime field is updated Key: HDFS-9197 URL: https://issues.apache.org/jira/browse/HDFS-9197 Project:

[jira] [Work started] (HDFS-9182) Cleanup the findbugs and other issues after HDFS EC merged to trunk.

2015-10-05 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9182 started by Uma Maheswara Rao G. - > Cleanup the findbugs and other issues after HDFS EC merged to trunk.

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-10-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943023#comment-14943023 ] Vinayakumar B commented on HDFS-9151: - +1 LGTM Will commit soon. > Mover should print the exit

[jira] [Commented] (HDFS-7899) Improve EOF error message

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943025#comment-14943025 ] Hadoop QA commented on HDFS-7899: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-10-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9151: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943032#comment-14943032 ] Hudson commented on HDFS-9151: -- FAILURE: Integrated in Hadoop-trunk-Commit #8566 (See

[jira] [Commented] (HDFS-9114) NameNode and DataNode metric log file name should follow the other log file name format.

2015-10-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943038#comment-14943038 ] Vinayakumar B commented on HDFS-9114: - 1. I feel, you can also add one more env variable to define the

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-05 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Status: Open (was: Patch Available) > Allow fsck display pending replica location information for being-written

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943052#comment-14943052 ] Hudson commented on HDFS-9151: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1218 (See

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-05 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Status: Patch Available (was: Open) > Allow fsck display pending replica location information for being-written

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-05 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Attachment: HDFS-9070-trunk.03.patch [~jingzhao] Thanks for your advise, I have uploaded a new patch. Sorry for

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943090#comment-14943090 ] Hudson commented on HDFS-9151: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #487 (See

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-10-05 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943060#comment-14943060 ] Surendra Singh Lilhore commented on HDFS-9151: -- Thanks [~vinayrpet] for review and commit. >

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943091#comment-14943091 ] Hadoop QA commented on HDFS-8578: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943097#comment-14943097 ] Vinayakumar B commented on HDFS-8164: - Thanks [~xiaochen], patch looks good overall. Have few comments

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943103#comment-14943103 ] Hudson commented on HDFS-9151: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2423 (See

[jira] [Commented] (HDFS-9137) DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded

2015-10-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943128#comment-14943128 ] Vinayakumar B commented on HDFS-9137: - I agree with [~hitliuyi], exception could be thrown directly. I

[jira] [Commented] (HDFS-9137) DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded

2015-10-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943133#comment-14943133 ] Vinayakumar B commented on HDFS-9137: - In an another thought.. How about updating the BPOS#toString()

[jira] [Commented] (HDFS-9180) Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944371#comment-14944371 ] Hadoop QA commented on HDFS-9180: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9138) TestDatanodeStartupFixesLegacyStorageIDs fails on Windows due to failure to unpack old image tarball that contains hard links

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944385#comment-14944385 ] Colin Patrick McCabe commented on HDFS-9138: Thanks, [~cnauroth]. >

[jira] [Updated] (HDFS-9142) Namenode Http address is not configured correctly for federated cluster in MiniDFSCluster

2015-10-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-9142: -- Attachment: HDFS-9142.v6.patch > Namenode Http address is not configured correctly for federated cluster in >

[jira] [Updated] (HDFS-9197) Snapshot FileDiff added to last snapshot when INodeFile accessTime field is updated

2015-10-05 Thread Alex Ivanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Ivanov updated HDFS-9197: -- Description: Summary When a file in HDFS is read, its corresponding inode's accessTime field is

[jira] [Assigned] (HDFS-9199) rename dfs.namenode.replication.min to dfs.replication.min

2015-10-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9199: --- Assignee: Mingliang Liu > rename dfs.namenode.replication.min to dfs.replication.min >

[jira] [Updated] (HDFS-9180) Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers

2015-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9180: Attachment: HDFS-9180.003.patch Thanks for the review, Walter and Yi! Update the patch to address Walter's

[jira] [Commented] (HDFS-9199) rename dfs.namenode.replication.min to dfs.replication.min

2015-10-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944104#comment-14944104 ] Mingliang Liu commented on HDFS-9199: - Thanks for reporting this. I agree that we need to make the

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944105#comment-14944105 ] Jing Zhao commented on HDFS-1172: - bq. I'm trying to update the pendingReplications only in the code path

[jira] [Commented] (HDFS-9198) Coalesce IBR processing in the NN

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944117#comment-14944117 ] Hadoop QA commented on HDFS-9198: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-10-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944074#comment-14944074 ] Andrew Wang commented on HDFS-8632: --- There've been some refactors that moved things to hdfs-client, mind

[jira] [Updated] (HDFS-9197) Snapshot FileDiff added to last snapshot when INodeFile accessTime field is updated

2015-10-05 Thread Alex Ivanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Ivanov updated HDFS-9197: -- Description: Summary When a file in HDFS is read, its corresponding inode's accessTime field is

[jira] [Commented] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-10-05 Thread Prasad Alle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944109#comment-14944109 ] Prasad Alle commented on HDFS-8485: --- I am getting the following exception when I read data from the HDFS

[jira] [Commented] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944045#comment-14944045 ] Hadoop QA commented on HDFS-8164: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-9199) rename dfs.namenode.replication.min to dfs.replication.min

2015-10-05 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-9199: -- Summary: rename dfs.namenode.replication.min to dfs.replication.min Key: HDFS-9199 URL: https://issues.apache.org/jira/browse/HDFS-9199 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944103#comment-14944103 ] Yongjun Zhang commented on HDFS-8164: - Thanks for the new rev [~xiaochen]. Patch rev6 looks good to me.

[jira] [Commented] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-10-05 Thread Prasad Alle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944107#comment-14944107 ] Prasad Alle commented on HDFS-8485: --- Can you please describe fix in more details. > Transparent

[jira] [Updated] (HDFS-7087) Ability to list /.reserved

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7087: Attachment: (was: HDFS-7087.patch.draft) > Ability to list /.reserved > -- > >

[jira] [Updated] (HDFS-7087) Ability to list /.reserved

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7087: Attachment: HDFS-7087.draft.patch > Ability to list /.reserved > -- > >

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-10-05 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944280#comment-14944280 ] Aaron T. Myers commented on HDFS-1312: -- bq. There are a large number of clusters which are using

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-10-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944286#comment-14944286 ] Andrew Wang commented on HDFS-1312: --- We discussed changing the default policy in HDFS-8538, Arpit wanted

[jira] [Updated] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9188: Attachment: HDFS-9188.003.patch Fix {{TestProcessCorruptBlocks}}. Could not reproduce

[jira] [Created] (HDFS-9200) Avoid lock in BPOfferService#toString

2015-10-05 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-9200: - Summary: Avoid lock in BPOfferService#toString Key: HDFS-9200 URL: https://issues.apache.org/jira/browse/HDFS-9200 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

2015-10-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944311#comment-14944311 ] Andrew Wang commented on HDFS-8771: --- Seems okay to me, few quick comments: * Can we name the thread

[jira] [Commented] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

2015-10-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944315#comment-14944315 ] Andrew Wang commented on HDFS-8771: --- Other note is that we probably should update javadoc in

[jira] [Commented] (HDFS-9137) DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded

2015-10-05 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944327#comment-14944327 ] Uma Maheswara Rao G commented on HDFS-9137: --- Thanks for the comments, Yi , Vinay and Colin. Here

[jira] [Commented] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943884#comment-14943884 ] Yongjun Zhang commented on HDFS-8164: - Thanks [~vinayrpet] for the review and [~xiaochen] for the new

[jira] [Commented] (HDFS-9181) Better handling of exceptions thrown during upgrade shutdown

2015-10-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943905#comment-14943905 ] Eric Payne commented on HDFS-9181: -- {quote} I think you can get what you want by just changing the catch

[jira] [Commented] (HDFS-9137) DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943908#comment-14943908 ] Colin Patrick McCabe commented on HDFS-9137: bq. In an another thought.. How about updating the

[jira] [Updated] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9155: --- Summary: OEV should treat .XML files as XML even when the file name extension is

[jira] [Commented] (HDFS-9006) Provide BlockPlacementPolicy that supports upgrade domain

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943937#comment-14943937 ] Hadoop QA commented on HDFS-9006: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8164: Status: Patch Available (was: Open) > cTime is 0 in VERSION file for newly formatted NameNode. >

[jira] [Updated] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8164: Attachment: HDFS-8164.006.patch Thanks [~yzhangal] for the new review and comments. Both comments makes

[jira] [Commented] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944015#comment-14944015 ] Hudson commented on HDFS-9155: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #490 (See

[jira] [Commented] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944145#comment-14944145 ] Hudson commented on HDFS-9155: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1221 (See

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944172#comment-14944172 ] Daniel Templeton commented on HDFS-1312: The reporting aspect should perhaps be handled under

[jira] [Commented] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944186#comment-14944186 ] Hadoop QA commented on HDFS-8164: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Reopened] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reopened HDFS-9176: The latest build hit the same issue again, so it wasn't just a temporary environmental effect.

[jira] [Updated] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8164: Status: Patch Available (was: Open) > cTime is 0 in VERSION file for newly formatted NameNode. >

[jira] [Commented] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944207#comment-14944207 ] Hudson commented on HDFS-9155: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #482 (See

[jira] [Updated] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9176: --- Attachment: HDFS-9176.001.patch Doh. If you look carefully at these log lines, you'll see the

[jira] [Updated] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9176: --- Status: Patch Available (was: Reopened) > TestDirectoryScanner#testThrottling often fails. >

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-10-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944247#comment-14944247 ] Anu Engineer commented on HDFS-1312: [~templedf] Thanks for your comments, Please see my thoughts on

[jira] [Updated] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8164: Status: Open (was: Patch Available) > cTime is 0 in VERSION file for newly formatted NameNode. >

[jira] [Updated] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-10-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8164: Attachment: HDFS-8164.007.patch Jenkins seems to have problem running patch 006. Attaching a new patch 007

[jira] [Commented] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944214#comment-14944214 ] Hudson commented on HDFS-9155: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2426 (See

[jira] [Commented] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944220#comment-14944220 ] Daniel Templeton commented on HDFS-9176: This JIRA fixes a new test introduced by HDFS-8873. >

[jira] [Commented] (HDFS-8966) Separate the lock used in namespace and block management layer

2015-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944224#comment-14944224 ] Jing Zhao commented on HDFS-8966: - Based on the discussion in HDFS-8967, it makes more sense to do this

[jira] [Updated] (HDFS-8966) Separate the lock used in namespace and block management layer

2015-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8966: Target Version/s: HDFS-8966 > Separate the lock used in namespace and block management layer >

[jira] [Commented] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944412#comment-14944412 ] Hudson commented on HDFS-9155: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #457 (See

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.001.patch The v1 patch fixes the failing tests (locally) and whitespace

[jira] [Commented] (HDFS-9180) Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers

2015-10-05 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944422#comment-14944422 ] Walter Su commented on HDFS-9180: - Thanks, Jing! The 03 patch LGTM. > Update excluded DataNodes in

  1   2   >