[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048357#comment-15048357 ] Hadoop QA commented on HDFS-8668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Fei Hui (JIRA)
Fei Hui created HDFS-9530: - Summary: huge Non-DFS Used in hadoop 2.6.2 & 2.7.1 Key: HDFS-9530 URL: https://issues.apache.org/jira/browse/HDFS-9530 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048295#comment-15048295 ] Hadoop QA commented on HDFS-9458: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-12-09 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048347#comment-15048347 ] Rui Li commented on HDFS-7866: -- I tried to add another system policy (with different schema) and hit the

[jira] [Updated] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9472: --- Attachment: HDFS-9472-02.patch > concat() API does not resolve the .reserved path >

[jira] [Commented] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048274#comment-15048274 ] Rakesh R commented on HDFS-9472: Thanks [~umamaheswararao]. Agreed, attached another patch addressing the

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048320#comment-15048320 ] Masatake Iwasaki commented on HDFS-9505: I would like to start working on this. If someone is

[jira] [Assigned] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-9505: -- Assignee: Masatake Iwasaki > HDFS Architecture documentation needs to be refreshed. >

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048384#comment-15048384 ] Fei Hui commented on HDFS-9530: --- i want to add logs to monitor DataNode DFS Used, Non DFS Used,and so on. how

[jira] [Created] (HDFS-9531) Can't use windows network drive

2015-12-09 Thread tian (JIRA)
tian created HDFS-9531: -- Summary: Can't use windows network drive Key: HDFS-9531 URL: https://issues.apache.org/jira/browse/HDFS-9531 Project: Hadoop HDFS Issue Type: Bug Components: fs

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9523: - Summary: libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail (was: libhdfs++: running

[jira] [Commented] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048605#comment-15048605 ] Hadoop QA commented on HDFS-9472: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048535#comment-15048535 ] Hadoop QA commented on HDFS-9448: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048653#comment-15048653 ] Brahma Reddy Battula commented on HDFS-9530: [~ferhui] thanks for reporting this. Can you

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048654#comment-15048654 ] Allen Wittenauer commented on HDFS-8578: ... except that message only shows up when running under

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048563#comment-15048563 ] Bob Hansen commented on HDFS-9523: -- Removing the line from /etc/hosts that reads :::1 localhost

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048617#comment-15048617 ] Hadoop QA commented on HDFS-9448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048644#comment-15048644 ] Vinayakumar B commented on HDFS-8578: - [~aw], yetus is not actually running in docker.

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048664#comment-15048664 ] Allen Wittenauer commented on HDFS-8578: You're misinterpreting the output entirely. a. The first

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-14.patch HDFS-8578-branch-2.7-002.patch Fixed findbugs and

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048659#comment-15048659 ] Vinayakumar B commented on HDFS-8578: - I mean. Its falling back to jenkins mode due to Java missing in

[jira] [Updated] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9448: - Attachment: HDFS-9448.HDFS-8707.005.patch Path 005: removed gdb from Docker image; it apparently caused

[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-12-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048702#comment-15048702 ] Kanaka Kumar Avvaru commented on HDFS-8836: --- Thanks for taking a look at patch [~ajisakaa]. I

[jira] [Commented] (HDFS-9445) Deadlock in datanode

2015-12-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048737#comment-15048737 ] Kihwal Lee commented on HDFS-9445: -- +1. I will commit it this afternoon, if no one objects until then. >

[jira] [Commented] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-12-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048708#comment-15048708 ] Kanaka Kumar Avvaru commented on HDFS-8894: --- As commented earlier, the check style issues and no

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9523: - Status: Patch Available (was: Open) > libhdfs++: failure to connect to ipv6 host causes CI unit tests to

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048850#comment-15048850 ] Hadoop QA commented on HDFS-8578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048867#comment-15048867 ] Bob Hansen commented on HDFS-9448: -- That patch looks good. All of the valgrind tests run under CI (except

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048912#comment-15048912 ] Hadoop QA commented on HDFS-9523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9281) Change TestDeleteBlockPool to not explicitly use File to check block pool existence.

2015-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048937#comment-15048937 ] Colin Patrick McCabe commented on HDFS-9281: Thanks, [~eddyxu]. {{checkBlockPool}} feels like

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9523: - Attachment: HDFS-9523.HDFS-8707.000.patch Patch: have the RpcConnection try all of the endpoints returned

[jira] [Assigned] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reassigned HDFS-9523: Assignee: Bob Hansen > libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail >

[jira] [Commented] (HDFS-9529) Extend Erasure Code to support POWER Chip acceleration

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049101#comment-15049101 ] Zhe Zhang commented on HDFS-9529: - I agree. This change most likely will happen under

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049200#comment-15049200 ] Yongjun Zhang commented on HDFS-7916: - HI [~rushabh.shah], Thanks for your reply and sorry I missed

[jira] [Created] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2015-12-09 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9533: Summary: seen_txid in the shared edits directory is modified during bootstrapping Key: HDFS-9533 URL: https://issues.apache.org/jira/browse/HDFS-9533 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2015-12-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049203#comment-15049203 ] Kihwal Lee commented on HDFS-9533: -- It turned out a standby namenode was bootstrapped. This is from

[jira] [Updated] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9532: Priority: Trivial (was: Major) > Detailed exception info is lost in reportTo method of

[jira] [Updated] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9532: Attachment: HDFS-9532.001.patch Submitted patch 001. Thanks for reviewing. > Detailed exception

[jira] [Updated] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9532: Status: Patch Available (was: Open) > Detailed exception info is lost in reportTo method of

[jira] [Commented] (HDFS-9445) Deadlock in datanode

2015-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049119#comment-15049119 ] Chris Nauroth commented on HDFS-9445: - [~kihwal] and [~walter.k.su], if I understand correctly, this

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049177#comment-15049177 ] Bob Hansen commented on HDFS-9523: -- This passes fine on my local Docker instance with this patch (it

[jira] [Created] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9532: --- Summary: Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction Key: HDFS-9532 URL: https://issues.apache.org/jira/browse/HDFS-9532

[jira] [Updated] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9483: - Attachment: HDFS-9483.001.patch Resubmitting patch to trigger jenkins. >

[jira] [Commented] (HDFS-9526) DiskBalancer: change htrace...JsonIgnore to codehaus...JsonIgnore

2015-12-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049147#comment-15049147 ] Xiaobing Zhou commented on HDFS-9526: - Test failures are not related. Kindly commit it, thanks! >

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049149#comment-15049149 ] Hadoop QA commented on HDFS-9483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049398#comment-15049398 ] Tsz Wo Nicholas Sze commented on HDFS-9527: --- Thanks, Jing. Will fix

[jira] [Updated] (HDFS-9526) DiskBalancer: change htrace...JsonIgnore to codehaus...JsonIgnore

2015-12-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9526: Description: This is to change org.apache.htrace.fasterxml.jackson.annotation.JsonIgnore

[jira] [Updated] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9527: -- Attachment: h9527_20151209.patch Here is a new patch. h9527_20151209.patch > The

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049494#comment-15049494 ] James Clampffer commented on HDFS-9523: --- [~bobthansen] - I was able to get the shim test to fail

[jira] [Updated] (HDFS-9526) DiskBalancer: change htrace...JsonIgnore to codehaus...JsonIgnore

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9526: -- Resolution: Fixed Fix Version/s: HDFS-1312 Status: Resolved (was:

[jira] [Commented] (HDFS-9411) HDFS ZoneLabel support

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049509#comment-15049509 ] Zhe Zhang commented on HDFS-9411: - Thanks for the interesting proposal Vinay. Are the file/dir => zone

[jira] [Commented] (HDFS-9365) Balaner does not work with the HDFS-6376 HA setup

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049416#comment-15049416 ] Tsz Wo Nicholas Sze commented on HDFS-9365: --- Actually, do you mean combined keys

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049367#comment-15049367 ] Chris Nauroth commented on HDFS-9530: - Additionally, Apache Hadoop 2.7.1 has a bug that configured

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9523: -- Attachment: failed_docker_run.txt > libhdfs++: failure to connect to ipv6 host causes CI unit

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049649#comment-15049649 ] Zhe Zhang commented on HDFS-9342: - Thanks Walter (and sorry about the late review). The algorithm LGTM. A

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049671#comment-15049671 ] Xiao Chen commented on HDFS-9519: - Thanks [~liuml07] and [~aw] for the comments and sorry for my delayed

[jira] [Updated] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9519: Attachment: HDFS-9519.01.patch > Some coding improvement in SecondaryNameNode#main >

[jira] [Assigned] (HDFS-9534) Add CLI command to clear storage policy from a path.

2015-12-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9534: --- Assignee: Xiaobing Zhou > Add CLI command to clear storage policy from a path. >

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049657#comment-15049657 ] Hadoop QA commented on HDFS-9527: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9535: --- Summary: Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate Key: HDFS-9535 URL: https://issues.apache.org/jira/browse/HDFS-9535 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9535: Assignee: Mingliang Liu > Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate >

[jira] [Commented] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049755#comment-15049755 ] Jing Zhao commented on HDFS-9535: - The failure is because: # In HDFS-1172 we update the pending replication

[jira] [Updated] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9527: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049598#comment-15049598 ] Hadoop QA commented on HDFS-9532: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049658#comment-15049658 ] Konstantin Shvachko commented on HDFS-9516: --- Btw which branch are you running it on? Couldn't

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

2015-12-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049781#comment-15049781 ] Benoy Antony commented on HDFS-9034: I'll review this tomorrow. > "StorageTypeStats" Metric should not

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049820#comment-15049820 ] Tsz Wo Nicholas Sze commented on HDFS-8578: --- There are two different problems: # data dirs are

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049855#comment-15049855 ] Yongjun Zhang commented on HDFS-9519: - Thanks [~xiaochen] for the patch. Can we move the main comment

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049705#comment-15049705 ] Chris Nauroth commented on HDFS-9038: - I'm in favor of using {{File#getUsableSpace}} for the sake of

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049840#comment-15049840 ] Tsz Wo Nicholas Sze commented on HDFS-8578: --- > ... Also, #2 need more discussion. ...

[jira] [Created] (HDFS-9534) Add CLI command to clear storage policy from a path.

2015-12-09 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9534: --- Summary: Add CLI command to clear storage policy from a path. Key: HDFS-9534 URL: https://issues.apache.org/jira/browse/HDFS-9534 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9173: Attachment: HDFS-9173.06.patch Upload a rebased patch for Walter. Also did some minor code cleanup in class

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049644#comment-15049644 ] Konstantin Shvachko commented on HDFS-9516: --- Indeed, looks like an attempt to rename across

[jira] [Commented] (HDFS-9514) TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049709#comment-15049709 ] Yongjun Zhang commented on HDFS-9514: - Thanks [~ste...@apache.org] for reporting the issue and

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049734#comment-15049734 ] Jing Zhao commented on HDFS-9527: - The new patch looks good to me. The failed tests should be unrelated. +1

[jira] [Updated] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9535: Description: TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate failed in several Jenkins run

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049978#comment-15049978 ] Xiao Chen commented on HDFS-9519: - Thanks Yongjun. I agree with your general idea that we should focus on

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050038#comment-15050038 ] Vinayakumar B commented on HDFS-8578: - bq. I suggest that we fix #1 first and then fix #2 in a

[jira] [Commented] (HDFS-9411) HDFS ZoneLabel support

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050090#comment-15050090 ] Vinayakumar B commented on HDFS-9411: - Thanks [~zhz] for taking look here. bq. Are the file/dir => zone

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050172#comment-15050172 ] Yongjun Zhang commented on HDFS-9519: - Thanks Xiao. +1 on rev2 pending jenkins test. > Some coding

[jira] [Updated] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9519: Status: Patch Available (was: Open) > Some coding improvement in SecondaryNameNode#main >

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049967#comment-15049967 ] Hadoop QA commented on HDFS-9173: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9536) OOM errors during parallel upgrade to Block-ID based layout

2015-12-09 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-9536: --- Summary: OOM errors during parallel upgrade to Block-ID based layout Key: HDFS-9536 URL: https://issues.apache.org/jira/browse/HDFS-9536 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-9529) Extend Erasure Code to support POWER Chip acceleration

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-9529. - Resolution: Duplicate Thanks Qijun for confirming this. Resolving this one as dup. > Extend Erasure Code

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050067#comment-15050067 ] Vinayakumar B commented on HDFS-8578: - HDFS-9536 has been created to follow-up #2, OOM issue during

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050241#comment-15050241 ] Yongjun Zhang commented on HDFS-7916: - Hi [~vinayrpet], Thanks for your reply. My question was, this

[jira] [Commented] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry

2015-12-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050239#comment-15050239 ] John Zhuge commented on HDFS-9522: -- Thanks. > Cleanup

[jira] [Commented] (HDFS-9528) Cleanup namenode audit/log/exception messages

2015-12-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049896#comment-15049896 ] Uma Maheswara Rao G commented on HDFS-9528: --- Thankyou for the cleanup. Seems test failures are

[jira] [Commented] (HDFS-9513) DataNodeManager#getDataNodeStorageInfos not backward compatibility

2015-12-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049938#comment-15049938 ] 邓飞 commented on HDFS-9513: -- yes, i will work on it,later upload new patch >

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

2015-12-09 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049962#comment-15049962 ] GAO Rui commented on HDFS-7661: --- [~szetszwo], [~jingzhao], thank you very much for the enlightening

[jira] [Commented] (HDFS-9513) DataNodeManager#getDataNodeStorageInfos not backward compatibility

2015-12-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049937#comment-15049937 ] 邓飞 commented on HDFS-9513: -- yes, i will work on it,later upload new patch >

[jira] [Commented] (HDFS-9513) DataNodeManager#getDataNodeStorageInfos not backward compatibility

2015-12-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049936#comment-15049936 ] 邓飞 commented on HDFS-9513: -- yes, i will work on it,later upload new patch >

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049949#comment-15049949 ] Hudson commented on HDFS-9527: -- FAILURE: Integrated in Hadoop-trunk-Commit #8949 (See

[jira] [Commented] (HDFS-9529) Extend Erasure Code to support POWER Chip acceleration

2015-12-09 Thread wqijun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049970#comment-15049970 ] wqijun commented on HDFS-9529: -- ok, I will put it in Hadoop Common project > Extend Erasure Code to support

[jira] [Updated] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9519: Attachment: HDFS-9519.02.patch > Some coding improvement in SecondaryNameNode#main >

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050084#comment-15050084 ] Vinayakumar B commented on HDFS-7916: - {quote}This patch simply ignores the block when BPServiceActor

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-15.patch HDFS-8578-branch-2.7-003.patch Updated patch as

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050251#comment-15050251 ] Hudson commented on HDFS-9527: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #681 (See

[jira] [Updated] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9472: --- Attachment: HDFS-9472-03.patch > concat() API does not resolve the .reserved path >

[jira] [Commented] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050261#comment-15050261 ] Uma Maheswara Rao G commented on HDFS-9472: --- nit: {code} throw new IOException("Concat operation

  1   2   >