[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904312#comment-14904312 ] Hudson commented on HDFS-9013: -- FAILURE: Integrated in Hadoop-trunk-Commit #8502 (See

[jira] [Commented] (HDFS-8976) Create HTML5 cluster webconsole for federated cluster

2015-09-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904326#comment-14904326 ] Vinayakumar B commented on HDFS-8976: - hi [~wheat9], I wonder whether you could review updated patch?

[jira] [Updated] (HDFS-9126) namenode crash in fsimage transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Description: In our product Hadoop cluster,when active namenode begin download/transfer fsimage from

[jira] [Updated] (HDFS-8739) Move DFSClient to client implementation package

2015-09-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8739: --- Attachment: HDFS-8739-002.patch > Move DFSClient to client implementation package >

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-23 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casey Brotherton updated HDFS-9100: --- Status: Patch Available (was: Open) > HDFS Balancer does not respect

[jira] [Commented] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904337#comment-14904337 ] Hadoop QA commented on HDFS-9044: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8739) Move DFSClient to client implementation package

2015-09-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904409#comment-14904409 ] Brahma Reddy Battula commented on HDFS-8739: Updated patch to fix compile erros in

[jira] [Updated] (HDFS-8882) Erasure Coding: Use datablocks, parityblocks and cell size from ErasureCodingPolicy

2015-09-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8882: Summary: Erasure Coding: Use datablocks, parityblocks and cell size from ErasureCodingPolicy (was:

[jira] [Updated] (HDFS-9126) namenode crash in fsimage download/transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Summary: namenode crash in fsimage download/transfer (was: namenode crash in fsimage transfer) >

[jira] [Commented] (HDFS-3599) Better expose when under-construction files are preventing DN decommission

2015-09-23 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904424#comment-14904424 ] Dave Marion commented on HDFS-3599: --- I have seen this issue in CDH 5.3.0, which is Hadoop 2.5.0+. >

[jira] [Commented] (HDFS-8739) Move DFSClient to client implementation package

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904296#comment-14904296 ] Hadoop QA commented on HDFS-8739: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904333#comment-14904333 ] Hudson commented on HDFS-9013: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #434 (See

[jira] [Updated] (HDFS-9126) namenode crash in fsimage transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Description: In out product Hadoop cluster,when active namenode begin download/transfer fsimage from

[jira] [Updated] (HDFS-9126) namenode crash in fsimage download/transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Description: In our product Hadoop cluster,when active namenode begin download/transfer fsimage from

[jira] [Updated] (HDFS-9126) namenode crash in fsimage download/transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Description: In our product Hadoop cluster,when active namenode begin download/transfer fsimage from

[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904367#comment-14904367 ] Hudson commented on HDFS-9013: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #426 (See

[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904421#comment-14904421 ] Hudson commented on HDFS-9013: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1166 (See

[jira] [Updated] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9013: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Release Note:

[jira] [Updated] (HDFS-9126) namenode crash in fsimage transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Component/s: (was: auto-failover) namenode > namenode crash in fsimage transfer >

[jira] [Updated] (HDFS-9126) namenode crash in fsimage download/transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Environment: OS:Centos 6.5(final) Hadoop:2.6.0 namenode ha base 5 journalnode was: OS:Centos

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-23 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casey Brotherton updated HDFS-9100: --- Attachment: HDFS-9100.000.patch Still testing in my lab. A unit test with multiple networks

[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904468#comment-14904468 ] Hudson commented on HDFS-9013: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2372 (See

[jira] [Commented] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

2015-09-23 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904366#comment-14904366 ] J.Andreina commented on HDFS-9044: -- Checkstyle comments can be ignored , as all the 9 parameters of the

[jira] [Commented] (HDFS-9076) Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten()

2015-09-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904320#comment-14904320 ] Vinayakumar B commented on HDFS-9076: - Can you please update the Log message as below. ? {code}

[jira] [Created] (HDFS-9126) namenode crash in fsimage transfer

2015-09-23 Thread zengyongping (JIRA)
zengyongping created HDFS-9126: -- Summary: namenode crash in fsimage transfer Key: HDFS-9126 URL: https://issues.apache.org/jira/browse/HDFS-9126 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-09-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904476#comment-14904476 ] Brahma Reddy Battula commented on HDFS-8647: {quote}Ideally HDFS should support auto

[jira] [Created] (HDFS-9127) Re-replication for files with enough replicas in single rack

2015-09-23 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-9127: -- Summary: Re-replication for files with enough replicas in single rack Key: HDFS-9127 URL: https://issues.apache.org/jira/browse/HDFS-9127 Project: Hadoop

[jira] [Commented] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-23 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904479#comment-14904479 ] Casey Brotherton commented on HDFS-9100: Created a multi-node cluster with multi-homed networks.

[jira] [Resolved] (HDFS-8341) HDFS mover stuck in loop trying to move corrupt block with no other valid replicas, doesn't move rest of other data blocks

2015-09-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8341. --- Resolution: Cannot Reproduce > HDFS mover stuck in loop trying to move corrupt block

[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904530#comment-14904530 ] Hudson commented on HDFS-9013: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #407 (See

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904605#comment-14904605 ] Nathan Roberts commented on HDFS-8873: -- Thanks [~templedf] for the update. I am sorry I haven't had a

[jira] [Commented] (HDFS-9125) Display help if the command option to "hdfs dfs " is not valid

2015-09-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904676#comment-14904676 ] Daniel Templeton commented on HDFS-9125: I haven't applied the patch and tested it, but it appears

[jira] [Updated] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Description: HDFS forbids copying from a directory to its subdirectory (e.g. hdfs dfs -cp /abc

[jira] [Updated] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Summary: Copying from the root to a subdirectory should be forbidden (was: Validation of a path

[jira] [Commented] (HDFS-9123) Validation of a path ended with a '/'

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904581#comment-14904581 ] Wei-Chiu Chuang commented on HDFS-9123: --- [~andreina] Thanks for pointing out. Yes indeed it looks

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904627#comment-14904627 ] Daniel Templeton commented on HDFS-8873: No worries, [~nroberts]. I'm about to upload a new patch

[jira] [Updated] (HDFS-9125) Display help if the command option to "hdfs dfs " is not valid

2015-09-23 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated HDFS-9125: Status: Patch Available (was: Open) > Display help if the command option to "hdfs dfs " is not valid >

[jira] [Commented] (HDFS-9071) chooseTargets in ReplicationWork may pass incomplete srcPath

2015-09-23 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904511#comment-14904511 ] J.Andreina commented on HDFS-9071: -- Thanks [~He Tianyi] for reporting this issue, that was a good catch.

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

2015-09-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904584#comment-14904584 ] Arun Suresh commented on HDFS-7858: --- [~szetszwo], Unfortunately, I do not remember the specifics, but

[jira] [Commented] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904595#comment-14904595 ] Wei-Chiu Chuang commented on HDFS-9123: --- However, the fact that the source path is the root, does not

[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904559#comment-14904559 ] Hudson commented on HDFS-9013: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2345 (See

[jira] [Commented] (HDFS-8882) Erasure Coding: Use datablocks, parityblocks and cell size from ErasureCodingPolicy

2015-09-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904570#comment-14904570 ] Zhe Zhang commented on HDFS-8882: - Thanks Vinay for updating the patch and Walter for the review. I just

[jira] [Commented] (HDFS-9105) separate replication config for client to create a file or set replication

2015-09-23 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904640#comment-14904640 ] Chang Li commented on HDFS-9105: Hi [~cmccabe], thanks for comment. What I am trying to achieve is to

[jira] [Updated] (HDFS-9125) Display help if the command option to "hdfs dfs " is not valid

2015-09-23 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated HDFS-9125: Attachment: HDFS-9125_1.patch attached the changes. Please review > Display help if the command option to "hdfs

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904730#comment-14904730 ] Daniel Templeton commented on HDFS-8873: Forgot to mention that this patch tries be fair about

[jira] [Updated] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8053: - Status: Patch Available (was: Open) > Move DFSIn/OutputStream and related classes to hadoop-hdfs-client >

[jira] [Commented] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904865#comment-14904865 ] Hadoop QA commented on HDFS-9100: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8739) Move DFSClient to client implementation package

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904737#comment-14904737 ] Hadoop QA commented on HDFS-8739: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: (was: HDFS-8873.006.patch) > throttle directoryScanner >

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.006.patch > throttle directoryScanner > - > >

[jira] [Commented] (HDFS-9126) namenode crash in fsimage download/transfer

2015-09-23 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904724#comment-14904724 ] nijel commented on HDFS-9126: - [~pingley] Can you attach the logs or the error messages for more clarity ? >

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

2015-09-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904789#comment-14904789 ] Daniel Templeton commented on HDFS-9112: Thanks, Anu, I haven't tested the patch yet, but from

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

2015-09-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904828#comment-14904828 ] Anu Engineer commented on HDFS-9112: [~templedf] Thank you very much for your code review and comments.

[jira] [Commented] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904747#comment-14904747 ] Yongjun Zhang commented on HDFS-9123: - Hi Guys, thanks for the review and comments. {quote} However,

[jira] [Commented] (HDFS-8882) Erasure Coding: Use datablocks, parityblocks and cell size from ErasureCodingPolicy

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904754#comment-14904754 ] Hadoop QA commented on HDFS-8882: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Attachment: HDFS-9123.003.patch Updated the code to deal with this bug as a special case when

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.006.patch New patch to address [~cmccabe]'s comments. Based on the

[jira] [Commented] (HDFS-9125) Display help if the command option to "hdfs dfs " is not valid

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904786#comment-14904786 ] Hadoop QA commented on HDFS-9125: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9126) namenode crash in fsimage download/transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Description: In our product Hadoop cluster,when active namenode begin download/transfer fsimage from

[jira] [Resolved] (HDFS-9136) TestDFSUpgrade leaks file descriptors.

2015-09-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9136. - Resolution: Not A Problem I was mistaken. This actually got fixed as part of the test changes

[jira] [Commented] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-09-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905843#comment-14905843 ] Chris Nauroth commented on HDFS-8180: - This patch introduced a test failure on Windows, which has since

[jira] [Commented] (HDFS-9133) ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905849#comment-14905849 ] Hadoop QA commented on HDFS-9133: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905859#comment-14905859 ] Hadoop QA commented on HDFS-9100: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-9137) DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded

2015-09-23 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-9137: - Summary: DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded Key: HDFS-9137 URL: https://issues.apache.org/jira/browse/HDFS-9137

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905863#comment-14905863 ] Hadoop QA commented on HDFS-8696: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9126) namenode crash in fsimage download/transfer

2015-09-23 Thread zengyongping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengyongping updated HDFS-9126: --- Environment: OS:Centos 6.5(final) Hadoop:2.6.0 namenode ha base 5 journalnodes was: OS:Centos

[jira] [Commented] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904908#comment-14904908 ] Mingliang Liu commented on HDFS-9123: - This is a good point. I supposed this is the case for {{distcp}}

[jira] [Commented] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904954#comment-14904954 ] Yongjun Zhang commented on HDFS-9123: - Hello [~liuml07], Thanks for the comments. {quote} This is a

[jira] [Commented] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904925#comment-14904925 ] Mingliang Liu commented on HDFS-9123: - The patch looks good to me. > Copying from the root to a

[jira] [Commented] (HDFS-8976) Create HTML5 cluster webconsole for federated cluster

2015-09-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905078#comment-14905078 ] Vinayakumar B commented on HDFS-8976: - Thanks [~wheat9]. Regards, Vinay > Create HTML5 cluster

[jira] [Comment Edited] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905122#comment-14905122 ] Colin Patrick McCabe edited comment on HDFS-8873 at 9/23/15 7:47 PM: - I

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

2015-09-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904929#comment-14904929 ] Daniel Templeton commented on HDFS-9112: [~aengineer], don't sweat it. I saw the second patch, but

[jira] [Updated] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Status: Open (was: Patch Available) > Copying from the root to a subdirectory should be

[jira] [Updated] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Status: Patch Available (was: Open) Rev 3. > Copying from the root to a subdirectory should

[jira] [Commented] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905045#comment-14905045 ] Wei-Chiu Chuang commented on HDFS-9123: --- Agree with Yongjun's comment #2. The shell currently is not

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Status: Patch Available (was: In Progress) > Implement a libhdfs(3) compatible API >

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905122#comment-14905122 ] Colin Patrick McCabe commented on HDFS-8873: I guess the short summary is that I'm not happy

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905062#comment-14905062 ] Hadoop QA commented on HDFS-8873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8882) Erasure Coding: Use datablocks, parityblocks and cell size from ErasureCodingPolicy

2015-09-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905068#comment-14905068 ] Vinayakumar B commented on HDFS-8882: - This build again got hit with the Collision of other build on

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.000.patch Some notes on first patch: -Just enough done to open,

[jira] [Commented] (HDFS-8880) NameNode metrics logging

2015-09-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904915#comment-14904915 ] Arpit Agarwal commented on HDFS-8880: - I hadn't seen it before. Thanks for mentioning it.

[jira] [Updated] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7270: - Release Note: Introduced a new configuration dfs.pipeline.ecn. When the configuration is turned on,

[jira] [Commented] (HDFS-8976) Create HTML5 cluster webconsole for federated cluster

2015-09-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904989#comment-14904989 ] Haohui Mai commented on HDFS-8976: -- Sure. Will do it in a couple of days. > Create HTML5 cluster

[jira] [Updated] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-09-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Status: Open (was: Patch Available) > Copying from the root to a subdirectory should be

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904106#comment-14904106 ] Hadoop QA commented on HDFS-9053: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904109#comment-14904109 ] Hudson commented on HDFS-8733: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2344 (See

[jira] [Assigned] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-7529: -- Assignee: Rakesh R (was: Haohui Mai) > Consolidate encryption zone related implementation into a

[jira] [Commented] (HDFS-9123) Validation of a path ended with a '/'

2015-09-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904034#comment-14904034 ] Yongjun Zhang commented on HDFS-9123: - BTW, I noticed that your patch rev 2 is not correctly generated.

[jira] [Commented] (HDFS-9123) Validation of a path ended with a '/'

2015-09-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904029#comment-14904029 ] Yongjun Zhang commented on HDFS-9123: - Hi [~jojochuang], Thanks for reporting the issue and the patch.

[jira] [Commented] (HDFS-9123) Validation of a path ended with a '/'

2015-09-23 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904042#comment-14904042 ] J.Andreina commented on HDFS-9123: -- Thanks [~jojochuang] . That was a good catch. I have few comments .

[jira] [Updated] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

2015-09-23 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9044: - Attachment: HDFS-9044.4.patch Updated the patch. Please review. > Give Priority to FavouredNodes , before

[jira] [Commented] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904108#comment-14904108 ] Hudson commented on HDFS-9039: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2344 (See

[jira] [Commented] (HDFS-9123) Validation of a path ended with a '/'

2015-09-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904191#comment-14904191 ] Steve Loughran commented on HDFS-9123: -- should the tests really downgrade exceptions to logs? I'd

[jira] [Commented] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904214#comment-14904214 ] Hadoop QA commented on HDFS-7529: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8671) Add client support for HTTP/2 stream channels

2015-09-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HDFS-8671: Attachment: HDFS-8671-v1.patch Pick code from POC branch. Plan to run YCSB on HDFS-7966 branch which is

[jira] [Commented] (HDFS-8671) Add client support for HTTP/2 stream channels

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904138#comment-14904138 ] Hadoop QA commented on HDFS-8671: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9123) Validation of a path ended with a '/'

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904162#comment-14904162 ] Hadoop QA commented on HDFS-9123: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904130#comment-14904130 ] Hudson commented on HDFS-8733: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #406 (See

[jira] [Commented] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904129#comment-14904129 ] Hudson commented on HDFS-9039: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #406 (See

[jira] [Commented] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905337#comment-14905337 ] Hadoop QA commented on HDFS-8053: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

  1   2   3   >