[jira] [Commented] (HDFS-8527) OzoneHandler: Integration of REST interface and container data pipeline back-end

2015-11-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020316#comment-15020316 ] Anu Engineer commented on HDFS-8527: [~cnauroth] I just merged trunk to HDFS-7240. I wi

[jira] [Updated] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-11-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9289: Attachment: HDFS-9289-branch-2.6.patch Thanks [~sjlee0]. I'm attaching a branch-2.6 patch. Am I updating CHAN

[jira] [Commented] (HDFS-8527) OzoneHandler: Integration of REST interface and container data pipeline back-end

2015-11-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020306#comment-15020306 ] Anu Engineer commented on HDFS-8527: No, Please go ahead and merge the trunk. Just so t

[jira] [Commented] (HDFS-9365) Balaner does not work with the HDFS-6376 HA setup

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020282#comment-15020282 ] Hadoop QA commented on HDFS-9365: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020262#comment-15020262 ] Mingliang Liu commented on HDFS-9436: - Failing tests and ASF license warnings are not r

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020242#comment-15020242 ] Hadoop QA commented on HDFS-9436: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020225#comment-15020225 ] Hadoop QA commented on HDFS-9442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020220#comment-15020220 ] Hadoop QA commented on HDFS-9442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020193#comment-15020193 ] Wei-Chiu Chuang commented on HDFS-6101: --- Thanks for the suggestion! That should resol

[jira] [Updated] (HDFS-9365) Balaner does not work with the HDFS-6376 HA setup

2015-11-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9365: -- Attachment: h9365_20151120.patch > Balaner does not work with the HDFS-6376 HA setup > --

[jira] [Commented] (HDFS-9365) Balaner does not work with the HDFS-6376 HA setup

2015-11-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020189#comment-15020189 ] Tsz Wo Nicholas Sze commented on HDFS-9365: --- h9365_20151120.patch: addresses Rake

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-20 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020188#comment-15020188 ] Walter Su commented on HDFS-6101: - bq. When there are 10 writers begin to writer at the sa

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-20 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020186#comment-15020186 ] Ming Ma commented on HDFS-9314: --- Thanks. * If there are two replicas node1(rack 1) and node2

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-11-20 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019290#comment-15019290 ] Joep Rottinghuis commented on HDFS-8791: Probably not-surprisingly I'm a +1 (non-bi

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Status: Patch Available (was: Open) > Make NNThroughputBenchmark$BlockReportStats run with 10 datano

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Attachment: HDFS-9436.000.patch The v0 patch makes number of datanodes in {{BlockReportStat}} 10 by d

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-11-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019286#comment-15019286 ] Haohui Mai commented on HDFS-7060: -- Hi [~nroberts], we're being conservative as you never

[jira] [Commented] (HDFS-9416) Respect OpenSSL and protobuf definitions in maven configuration when building libhdfspp

2015-11-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019277#comment-15019277 ] Allen Wittenauer commented on HDFS-9416: bq. Allen Wittenauer would you please cha

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.001.patch > Move block replication logic from BlockManager to a new class > Re

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: (was: HDFS-9442.001.patch) > Move block replication logic from BlockManager to a new

[jira] [Commented] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019228#comment-15019228 ] Sangjin Lee commented on HDFS-9289: --- Thanks [~zhz]! Could you please cherry-pick the comm

[jira] [Commented] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-11-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019220#comment-15019220 ] Zhe Zhang commented on HDFS-9289: - I think this is a good addition to branch-2.6. > Make

[jira] [Commented] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-11-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019222#comment-15019222 ] Zhe Zhang commented on HDFS-9289: - [~sjlee0] Yes this is a valid bug even for 2.6.x. > Mak

[jira] [Commented] (HDFS-9348) Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-20 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019208#comment-15019208 ] Uma Maheswara Rao G commented on HDFS-9348: --- +1 on the latest patch. I will commi

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.001.patch The v1 patch moves the {{neededReplication}} from {{BlockManager}} to

[jira] [Commented] (HDFS-9416) Respect OpenSSL and protobuf definitions in maven configuration when building libhdfspp

2015-11-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019173#comment-15019173 ] Xiaobing Zhou commented on HDFS-9416: - I looked into FindProtobuf.cmake source in cmak

[jira] [Commented] (HDFS-9443) Disabling HDFS client socket cache causes logging message printed to console for CLI commands.

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019150#comment-15019150 ] Hadoop QA commented on HDFS-9443: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019129#comment-15019129 ] Sangjin Lee commented on HDFS-6945: --- Does this issue exist in 2.6.x? Should this be backp

[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019118#comment-15019118 ] Sangjin Lee commented on HDFS-8676: --- Does this issue exist in 2.6.x? Should this be backp

[jira] [Commented] (HDFS-8527) OzoneHandler: Integration of REST interface and container data pipeline back-end

2015-11-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019116#comment-15019116 ] Chris Nauroth commented on HDFS-8527: - [~anu], it looks like we need the HDFS-7240 bran

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019113#comment-15019113 ] Sangjin Lee commented on HDFS-8767: --- Does this issue exist in 2.6.x? Should this be backp

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019107#comment-15019107 ] Sangjin Lee commented on HDFS-8995: --- Does this issue exist in 2.6.x? Should this be backp

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019108#comment-15019108 ] Sangjin Lee commented on HDFS-8891: --- Does this issue exist in 2.6.x? Should this be backp

[jira] [Commented] (HDFS-9083) Replication violates block placement policy.

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019105#comment-15019105 ] Sangjin Lee commented on HDFS-9083: --- Should this be backported to branch-2.6? > Replicat

[jira] [Updated] (HDFS-9441) Do not construct path string when choosing block placement targets

2015-11-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9441: -- Summary: Do not construct path string when choosing block placement targets (was: Do not

[jira] [Commented] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019098#comment-15019098 ] Sangjin Lee commented on HDFS-9106: --- Does this issue exist in 2.6.x? Should this be backp

[jira] [Commented] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019094#comment-15019094 ] Sangjin Lee commented on HDFS-9178: --- Does this issue exist in 2.6.x? Should this be backp

[jira] [Commented] (HDFS-8527) OzoneHandler: Integration of REST interface and container data pipeline back-end

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019091#comment-15019091 ] Hadoop QA commented on HDFS-8527: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-11-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019084#comment-15019084 ] Sangjin Lee commented on HDFS-9289: --- Does this issue exist in 2.6.x? Should this be backp

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019077#comment-15019077 ] Hadoop QA commented on HDFS-8855: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-8527) OzoneHandler: Integration of REST interface and container data pipeline back-end

2015-11-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8527: Status: Patch Available (was: Open) > OzoneHandler: Integration of REST interface and container data

[jira] [Updated] (HDFS-8527) OzoneHandler: Integration of REST interface and container data pipeline back-end

2015-11-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8527: Attachment: HDFS-8527-HDFS-7240.001.patch I'm attaching a patch that sets up the REST endpoints for O

[jira] [Commented] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019039#comment-15019039 ] Eric Payne commented on HDFS-7163: -- [~wheat9], thank you for your review and comments on t

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019035#comment-15019035 ] Hadoop QA commented on HDFS-6101: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9443) Disabling HDFS client socket cache causes logging message printed to console for CLI commands.

2015-11-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9443: Attachment: HDFS-9443.001.patch > Disabling HDFS client socket cache causes logging message printed t

[jira] [Updated] (HDFS-9443) Disabling HDFS client socket cache causes logging message printed to console for CLI commands.

2015-11-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9443: Status: Open (was: Patch Available) > Disabling HDFS client socket cache causes logging message prin

[jira] [Updated] (HDFS-9443) Disabling HDFS client socket cache causes logging message printed to console for CLI commands.

2015-11-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9443: Status: Patch Available (was: Open) > Disabling HDFS client socket cache causes logging message prin

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2015-11-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019018#comment-15019018 ] Zhe Zhang commented on HDFS-9381: - Thanks Uma for the work! I looked over the patch and the

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019008#comment-15019008 ] Hadoop QA commented on HDFS-9314: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018999#comment-15018999 ] John Zhuge commented on HDFS-9438: -- {code:java} diff --git a/hadoop-hdfs-project/hadoop-h

[jira] [Commented] (HDFS-9336) deleteSnapshot throws NPE when snapshotname is null

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018971#comment-15018971 ] Hadoop QA commented on HDFS-9336: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018962#comment-15018962 ] Hadoop QA commented on HDFS-9038: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9416) Respect OpenSSL and protobuf definitions in maven configuration when building libhdfspp

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018894#comment-15018894 ] Hadoop QA commented on HDFS-9416: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018879#comment-15018879 ] Yongjun Zhang commented on HDFS-9438: - Thanks [~jzhuge] for looking into this. > Test

[jira] [Assigned] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-9438: Assignee: John Zhuge (was: Yongjun Zhang) > TestPipelinesFailover assumes Linux ifconfig >

[jira] [Commented] (HDFS-9426) Rollingupgrade finalization is not backward compatible

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018872#comment-15018872 ] Hadoop QA commented on HDFS-9426: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HDFS-9416) Respect OpenSSL and protobuf definitions in maven configuration when building libhdfspp

2015-11-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15014961#comment-15014961 ] Allen Wittenauer edited comment on HDFS-9416 at 11/20/15 9:23 PM: ---

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-11-20 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018828#comment-15018828 ] Nathan Roberts commented on HDFS-7060: -- Has anyone given any further thought on this p

[jira] [Comment Edited] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018761#comment-15018761 ] Arpit Agarwal edited comment on HDFS-9038 at 11/20/15 8:55 PM: --

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018761#comment-15018761 ] Arpit Agarwal commented on HDFS-9038: - Hi [~brahmareddy], thanks for taking this up. Th

[jira] [Commented] (HDFS-9359) Test libhdfs++ with existing libhdfs tests

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018756#comment-15018756 ] Hadoop QA commented on HDFS-9359: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9441) Do not call construct path string when choosing block placement targets

2015-11-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018732#comment-15018732 ] Tsz Wo Nicholas Sze commented on HDFS-9441: --- There are other callers passing src

[jira] [Updated] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-6101: -- Attachment: HDFS-6101.005.patch I am attach rev5, which reduced the number of writers to 5. > Te

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9314: Attachment: HDFS-9314.004.patch Thanks again [~mingma]! Attached patch 4 with the aforementioned changes: - P

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018639#comment-15018639 ] Wei-Chiu Chuang commented on HDFS-6101: --- Thanks for the comments and reviews. I was h

[jira] [Updated] (HDFS-9359) Test libhdfs++ with existing libhdfs tests

2015-11-20 Thread Stephen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen updated HDFS-9359: -- Status: Patch Available (was: Open) > Test libhdfs++ with existing libhdfs tests > -

[jira] [Updated] (HDFS-9359) Test libhdfs++ with existing libhdfs tests

2015-11-20 Thread Stephen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen updated HDFS-9359: -- Attachment: HDFS-9359.HDFS-8707.001.patch hdfs_shim.c is created to support testing part of libhdfs++ that have b

[jira] [Commented] (HDFS-9144) Refactor libhdfs into stateful/ephemeral objects

2015-11-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018585#comment-15018585 ] James Clampffer commented on HDFS-9144: --- The rebased changes look good to me. Hopefu

[jira] [Commented] (HDFS-9336) deleteSnapshot throws NPE when snapshotname is null

2015-11-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018565#comment-15018565 ] Brahma Reddy Battula commented on HDFS-9336: [~ajisakaa] thanks a lot for takin

[jira] [Updated] (HDFS-9336) deleteSnapshot throws NPE when snapshotname is null

2015-11-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9336: --- Attachment: HDFS-9336-003.patch > deleteSnapshot throws NPE when snapshotname is null >

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018549#comment-15018549 ] Brahma Reddy Battula commented on HDFS-9038: This is not failing locally.But th

[jira] [Updated] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9038: --- Attachment: HDFS-9038-004.patch > Reserved space is erroneously counted towards non-DFS

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Attachment: HDFS-8855.009.patch Posted a new patch v009 to remove white spaces. The UT failures are n

[jira] [Updated] (HDFS-9416) Respect OpenSSL and protobuf definitions in maven configuration when building libhdfspp

2015-11-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9416: Attachment: HDFS-9416.HDFS-8707.005.patch Note that the patch v004 works well in my test environment,

[jira] [Commented] (HDFS-9441) Do not call construct path string when choosing block placement targets

2015-11-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018477#comment-15018477 ] Kihwal Lee commented on HDFS-9441: -- Any particular reason for making it {{Object}} instead

[jira] [Updated] (HDFS-9426) Rollingupgrade finalization is not backward compatible

2015-11-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9426: - Status: Patch Available (was: Open) > Rollingupgrade finalization is not backward compatible > ---

[jira] [Commented] (HDFS-9144) Refactor libhdfs into stateful/ephemeral objects

2015-11-20 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018351#comment-15018351 ] Bob Hansen commented on HDFS-9144: -- [~James Clampffer]: thanks for the review I have atta

[jira] [Updated] (HDFS-9144) Refactor libhdfs into stateful/ephemeral objects

2015-11-20 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9144: - Attachment: HDFS-9144.HDFS-8707.004.patch > Refactor libhdfs into stateful/ephemeral objects >

[jira] [Commented] (HDFS-9445) Deadlock in datanode

2015-11-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018295#comment-15018295 ] Kihwal Lee commented on HDFS-9445: -- And the stack trace: {noformat} Java stack informatio

[jira] [Updated] (HDFS-9445) Deadlock in datanode

2015-11-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9445: - Description: {noformat} Found one Java-level deadlock: = "DataXceiver for clien

[jira] [Updated] (HDFS-9445) Deadlock in datanode

2015-11-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9445: - Affects Version/s: 2.7.2 > Deadlock in datanode > > > Key: HDFS-9445 >

[jira] [Created] (HDFS-9445) Deadlock in datanode

2015-11-20 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9445: Summary: Deadlock in datanode Key: HDFS-9445 URL: https://issues.apache.org/jira/browse/HDFS-9445 Project: Hadoop HDFS Issue Type: Bug Reporter: Kihwal L

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018224#comment-15018224 ] Brahma Reddy Battula commented on HDFS-9407: bq. Yes it is unrelated, but it is

[jira] [Created] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-11-20 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-9444: -- Summary: TestEditLogTailer#testNN1TriggersLogRolls fails bind exception. Key: HDFS-9444 URL: https://issues.apache.org/jira/browse/HDFS-9444 Project: Hado

[jira] [Commented] (HDFS-6937) Another issue in handling checksum errors in write pipeline

2015-11-20 Thread Mikhail Dutikov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018177#comment-15018177 ] Mikhail Dutikov commented on HDFS-6937: --- Good day, any update on this? I seem to be r

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15015584#comment-15015584 ] Vinayakumar B commented on HDFS-9038: - Please check the failure of {{hadoop.hdfs.serve

[jira] [Comment Edited] (HDFS-9426) Rollingupgrade finalization is not backward compatible

2015-11-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15015437#comment-15015437 ] Vinayakumar B edited comment on HDFS-9426 at 11/20/15 10:33 AM: -

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15015526#comment-15015526 ] Hadoop QA commented on HDFS-9038: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-20 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9428: Status: Patch Available (was: Open) +1 pending jenkins. > Fix intermittent failure of TestDNFencing.testQue

[jira] [Updated] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-20 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9428: Status: Open (was: Patch Available) > Fix intermittent failure of TestDNFencing.testQueueingWithAppend > ---

[jira] [Commented] (HDFS-9426) Rollingupgrade finalization is not backward compatible

2015-11-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15015437#comment-15015437 ] Vinayakumar B commented on HDFS-9426: - bq. I am just wondering whether it will be worth

[jira] [Commented] (HDFS-9411) HDFS ZoneLabel support

2015-11-20 Thread Mark Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15015401#comment-15015401 ] Mark Sun commented on HDFS-9411: Hi [~vinayrpet], sorry for late reply * *About use DataNo

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2015-11-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15015395#comment-15015395 ] Aaron T. Myers commented on HDFS-9427: -- +1, let's make this happen. Seems long overdue