[jira] [Commented] (HDFS-8238) Move ClientProtocol to the hdfs-client

2015-05-12 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539339#comment-14539339 ] Takanobu Asanuma commented on HDFS-8238: Thank you very much for your support,

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539350#comment-14539350 ] Kai Sasaki commented on HDFS-8367: -- [~drankye] Could you check this patch?

[jira] [Updated] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

2015-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8362: Summary: Java Compilation Error in TestHdfsConfigFields.java (was: Java Compilation Error in

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

2015-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539354#comment-14539354 ] Vinayakumar B commented on HDFS-8362: - +1 on latest patch to just to rename the package

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539355#comment-14539355 ] Zhe Zhang commented on HDFS-8193: - bq. I have seen many customers running at 90% plus and

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539358#comment-14539358 ] Kai Zheng commented on HDFS-8367: - Hi [~kaisasak], I'm sorry on this. As there is some on

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539365#comment-14539365 ] Kai Sasaki commented on HDFS-8367: -- Thank you for quick response. I'll check

[jira] [Updated] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

2015-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8362: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-8376) Erasure Coding: Update last cellsize calculation according to whether the erasure codec is linear

2015-05-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8376: - Summary: Erasure Coding: Update last cellsize calculation according to whether the erasure codec is linear (was:

[jira] [Created] (HDFS-8376) Erasure Coding: Update last cellsize calculation according to whether the erasure codec is liner

2015-05-12 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8376: Summary: Erasure Coding: Update last cellsize calculation according to whether the erasure codec is liner Key: HDFS-8376 URL: https://issues.apache.org/jira/browse/HDFS-8376

[jira] [Updated] (HDFS-8376) Erasure Coding: Update last cellsize calculation according to whether the erasure codec is linear

2015-05-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8376: - Description: Current calculation for last cell size is as following. For parity cell, the last cell size is the

[jira] [Commented] (HDFS-8255) Rename getBlockReplication to getPreferredBlockReplication

2015-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539523#comment-14539523 ] Hadoop QA commented on HDFS-8255: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

2015-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539370#comment-14539370 ] Hudson commented on HDFS-8362: -- FAILURE: Integrated in Hadoop-trunk-Commit #7802 (See

[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

2015-05-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539372#comment-14539372 ] Kai Zheng commented on HDFS-8062: - Looks like even we have HDFS-8367, the left work here

[jira] [Commented] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

2015-05-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539391#comment-14539391 ] Kai Zheng commented on HDFS-8294: - Would be good to have a more review from other guy and

[jira] [Updated] (HDFS-8364) Erasure coding: fix some minor bugs in EC CLI

2015-05-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8364: Description: issue 1: it's not user-friendly. We should tell user that `hdfs erasurecode` is the

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

2015-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539419#comment-14539419 ] Vinayakumar B commented on HDFS-8362: - Thats not compilation failure. Thats some

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

2015-05-12 Thread Arshad Mohammad (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539413#comment-14539413 ] Arshad Mohammad commented on HDFS-8362: --- From CI link, not getting reason why

[jira] [Updated] (HDFS-8201) Add an end to end test for stripping file writing and reading

2015-05-12 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8201: -- Attachment: HDFS-8201-HDFS-7285.004.patch Update patch with the latest branch-7285. Add an end to end

[jira] [Commented] (HDFS-6184) Capture NN's thread dump when it fails over

2015-05-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539531#comment-14539531 ] Akira AJISAKA commented on HDFS-6184: - Copied from

[jira] [Created] (HDFS-8377) Support HTTP/2 in datanode

2015-05-12 Thread zhangduo (JIRA)
zhangduo created HDFS-8377: -- Summary: Support HTTP/2 in datanode Key: HDFS-8377 URL: https://issues.apache.org/jira/browse/HDFS-8377 Project: Hadoop HDFS Issue Type: Sub-task Reporter:

[jira] [Updated] (HDFS-8378) Erasure Coding: Few improvements for the erasure coding worker

2015-05-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8378: --- Attachment: HDFS-8378-HDFS-7285.00.patch Attached patch fixing these cases. Erasure Coding: Few improvements

[jira] [Updated] (HDFS-8378) Erasure Coding: Few improvements for the erasure coding worker

2015-05-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8378: --- Target Version/s: HDFS-7285 Status: Patch Available (was: Open) Erasure Coding: Few

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539432#comment-14539432 ] Hadoop QA commented on HDFS-8220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding

2015-05-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539446#comment-14539446 ] Yi Liu commented on HDFS-8347: -- yes, the {{chunkSize}} is hardcode in future, and for

[jira] [Updated] (HDFS-8366) Erasure Coding: Make the timeout parameter of polling blocking queue configurable in DFSStripedOutputStream

2015-05-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8366: Status: Patch Available (was: Open) Erasure Coding: Make the timeout parameter of polling blocking queue

[jira] [Updated] (HDFS-8364) Erasure coding: fix some minor bugs in EC CLI

2015-05-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8364: Attachment: HDFS-8364-HDFS-7285.001.patch Erasure coding: fix some minor bugs in EC CLI

[jira] [Commented] (HDFS-8364) Erasure coding: fix some minor bugs in EC CLI

2015-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539458#comment-14539458 ] Vinayakumar B commented on HDFS-8364: - Good catches [~walter.k.su]. +1 for patch.

[jira] [Commented] (HDFS-8366) Erasure Coding: Make the timeout parameter of polling blocking queue configurable in DFSStripedOutputStream

2015-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539472#comment-14539472 ] Hadoop QA commented on HDFS-8366: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8363) Erasure Coding: DFSStripedInputStream#seekToNewSource

2015-05-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539508#comment-14539508 ] Uma Maheswara Rao G commented on HDFS-8363: --- +1 Erasure Coding:

[jira] [Updated] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

2015-05-12 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8202: -- Attachment: HDFS-8202.002.patch Update patch with the latest branch-7285. Improve end to end stirpping

[jira] [Updated] (HDFS-8201) Add an end to end test for stripping file writing and reading

2015-05-12 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8201: -- Status: Patch Available (was: In Progress) Add an end to end test for stripping file writing and

[jira] [Created] (HDFS-8378) Erasure Coding: Few improvements for the erasure coding worker

2015-05-12 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8378: -- Summary: Erasure Coding: Few improvements for the erasure coding worker Key: HDFS-8378 URL: https://issues.apache.org/jira/browse/HDFS-8378 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-8364) Erasure coding: fix some minor bugs in EC CLI

2015-05-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539458#comment-14539458 ] Vinayakumar B edited comment on HDFS-8364 at 5/12/15 7:48 AM: --

[jira] [Updated] (HDFS-8364) Erasure coding: fix some minor bugs in EC CLI

2015-05-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8364: Status: Patch Available (was: Open) Erasure coding: fix some minor bugs in EC CLI

[jira] [Commented] (HDFS-8364) Erasure coding: fix some minor bugs in EC CLI

2015-05-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539444#comment-14539444 ] Walter Su commented on HDFS-8364: - after 001 patch: # bin/hdfs erasurecode -getZoneInfo /

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540208#comment-14540208 ] Zhe Zhang commented on HDFS-7285: - {quote} Thanks for your great job about making erasure

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

2015-05-12 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540331#comment-14540331 ] stack commented on HDFS-7966: - For your consideration: On 1., are you sure this the case?

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540389#comment-14540389 ] Tsz Wo Nicholas Sze commented on HDFS-8220: --- [~rakeshr], thanks for testing

[jira] [Updated] (HDFS-6184) Capture NN's thread dump when it fails over

2015-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6184: -- Attachment: HDFS-6184-5.patch Thanks [~ajisakaa]. Here is the new patch. Capture NN's thread dump when it

[jira] [Commented] (HDFS-8255) Rename getBlockReplication to getPreferredBlockReplication

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540172#comment-14540172 ] Zhe Zhang commented on HDFS-8255: - Thanks Yi for the review and commit! Rename

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

2015-05-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540286#comment-14540286 ] Haohui Mai commented on HDFS-7966: -- Let me try to answer the questions. There are two

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540394#comment-14540394 ] Zhe Zhang commented on HDFS-8220: - Thanks Rakesh for the work and Nicholas for the update.

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540188#comment-14540188 ] Zhe Zhang commented on HDFS-8193: - [~lpstudy] Thanks for the interest! I'll copy your

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-05-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540189#comment-14540189 ] Kihwal Lee commented on HDFS-8344: -- The initial IBR (receiving) usually has the size of

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540242#comment-14540242 ] Hadoop QA commented on HDFS-8220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Reopened] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

2015-05-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reopened HDFS-8372: - Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

[jira] [Updated] (HDFS-8195) Erasure coding: Fix file quota change when we complete/commit the striped blocks

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8195: Attachment: HDFS-8195-HDFS-7285.2.patch Erasure coding: Fix file quota change when we complete/commit the

[jira] [Commented] (HDFS-8341) HDFS mover stuck in loop after failing to move block, doesn't move rest of blocks, can't get data back off decommissioning external storage tier as a result

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540514#comment-14540514 ] Tsz Wo Nicholas Sze commented on HDFS-8341: --- But still problem is there. ...

[jira] [Updated] (HDFS-8356) Document missing properties in hdfs-default.xml

2015-05-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8356: - Component/s: documentation Document missing properties in hdfs-default.xml

[jira] [Updated] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8143: -- Priority: Minor (was: Blocker) Issue Type: Improvement (was: Bug) BTW, this is

[jira] [Commented] (HDFS-7240) Object store in HDFS

2015-05-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540492#comment-14540492 ] Colin Patrick McCabe commented on HDFS-7240: This looks like a really

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540404#comment-14540404 ] Tsz Wo Nicholas Sze commented on HDFS-8220: --- ... recover from a bad DN (like

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540412#comment-14540412 ] Zhe Zhang commented on HDFS-8220: - bq. It will ignore the bad DN and continue but not

[jira] [Commented] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540455#comment-14540455 ] Zhe Zhang commented on HDFS-8372: - Thanks Jing! I fat-fingered on hdfs-default.xml during

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540469#comment-14540469 ] Tsz Wo Nicholas Sze commented on HDFS-8143: --- {code} +retryCount = new

[jira] [Updated] (HDFS-8371) Fix test failure in TestHdfsConfigFields for spanreceiver properties

2015-05-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8371: - Labels: newbie test (was: ) Fix test failure in TestHdfsConfigFields for spanreceiver properties

[jira] [Resolved] (HDFS-7900) ShortCircuitCache.replicaInfoMap keeps too many deleted file descriptor

2015-05-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7900. Resolution: Duplicate ShortCircuitCache.replicaInfoMap keeps too many deleted file

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

2015-05-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540437#comment-14540437 ] Masatake Iwasaki commented on HDFS-8358: I attached 003 which only fixes the

[jira] [Updated] (HDFS-8358) TestTraceAdmin fails

2015-05-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8358: --- Attachment: HDFS-8358.003.patch TestTraceAdmin fails

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

2015-05-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540496#comment-14540496 ] Arpit Agarwal commented on HDFS-8243: - Thank you for the updated patch. Something like

[jira] [Updated] (HDFS-8195) Erasure coding: Fix file quota change when we complete/commit the striped blocks

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8195: Affects Version/s: HDFS-7285 Status: Patch Available (was: Open) Thanks for working on this

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

2015-05-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540405#comment-14540405 ] Haohui Mai commented on HDFS-7966: -- Thanks for the info. I think that the proposal handles

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

2015-05-12 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540424#comment-14540424 ] stack commented on HDFS-7966: - bq. I'm probably missing something .. You answered. New URL. So

[jira] [Updated] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

2015-05-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8372: Attachment: HDFS-8372-HDFS-7285.1.patch Thanks for taking care of this, Zhe! The .0 patch looks good to me.

[jira] [Updated] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

2015-05-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8372: Resolution: Pending Closed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status:

[jira] [Resolved] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

2015-05-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8372. - Resolution: Fixed Erasure coding: compute storage type quotas for striped files, to be consistent with

[jira] [Commented] (HDFS-8341) HDFS mover stuck in loop after failing to move block, doesn't move rest of blocks, can't get data back off decommissioning external storage tier as a result

2015-05-12 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540493#comment-14540493 ] surendra singh lilhore commented on HDFS-8341: -- bq. Do you mean a block has

[jira] [Commented] (HDFS-7900) ShortCircuitCache.replicaInfoMap keeps too many deleted file descriptor

2015-05-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540540#comment-14540540 ] Colin Patrick McCabe commented on HDFS-7900: Since Hadoop 2.3 was released,

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540539#comment-14540539 ] Zhe Zhang commented on HDFS-7613: - Thanks for the feedback [~djp] and sorry about getting

[jira] [Commented] (HDFS-8371) Fix test failure in TestHdfsConfigFields for spanreceiver properties

2015-05-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540413#comment-14540413 ] Masatake Iwasaki commented on HDFS-8371: Thanks for working on this, [~rchiang]. I

[jira] [Commented] (HDFS-6300) Shouldn't allows to run multiple balancer simultaneously

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540503#comment-14540503 ] Tsz Wo Nicholas Sze commented on HDFS-6300: --- Indeed, we could combine

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

2015-05-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540743#comment-14540743 ] Colin Patrick McCabe commented on HDFS-8358: bq. I would like to make

[jira] [Updated] (HDFS-8192) Eviction should key off used locked memory instead of ram disk free space

2015-05-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8192: Attachment: HDFS-8192.01.patch Patch to key eviction off of locked memory. Not clicking 'Submit

[jira] [Updated] (HDFS-8345) Storage policy APIs must be exposed via the FileSystem interface

2015-05-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8345: Status: Patch Available (was: Open) Storage policy APIs must be exposed via the FileSystem

[jira] [Updated] (HDFS-4838) HDFS should use the new methods added in HADOOP-9574

2015-05-12 Thread Dongming Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongming Liang updated HDFS-4838: - Affects Version/s: 2.7.0 Status: Patch Available (was: Open) Remove old code in

[jira] [Updated] (HDFS-6184) Capture NN's thread dump when it fails over

2015-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6184: -- Attachment: HDFS-6184-6.patch New patch to fix the whilespace issue. The TestHdfsConfigFields failure is due to

[jira] [Updated] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-05-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8157: Attachment: HDFS-8157.02.patch Updated the patch, it is ready for review. Also addressed earlier

[jira] [Commented] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540711#comment-14540711 ] Zhe Zhang commented on HDFS-8186: - Thanks Walter for the work. The patch looks good to me

[jira] [Commented] (HDFS-8368) Erasure Coding: DFS opening a non-existent file need to be handled properly

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540803#comment-14540803 ] Zhe Zhang commented on HDFS-8368: - Committed to the branch. Erasure Coding: DFS opening a

[jira] [Updated] (HDFS-8368) Erasure Coding: DFS opening a non-existent file need to be handled properly

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8368: Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-6184) Capture NN's thread dump when it fails over

2015-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540634#comment-14540634 ] Hadoop QA commented on HDFS-6184: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8345) Storage policy APIs must be exposed via the FileSystem interface

2015-05-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8345: Status: Open (was: Patch Available) Storage policy APIs must be exposed via the FileSystem

[jira] [Commented] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540788#comment-14540788 ] Zhe Zhang commented on HDFS-8294: - Thanks for taking care of this Rakesh! It's great to

[jira] [Commented] (HDFS-8368) Erasure Coding: DFS opening a non-existent file need to be handled properly

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540791#comment-14540791 ] Zhe Zhang commented on HDFS-8368: - +1. Thanks Rakesh for the contribution! I will commit

[jira] [Commented] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540171#comment-14540171 ] Zhe Zhang commented on HDFS-8372: - [~drankye] Yes HDFS-8379 is indeed caused by the rebase.

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541153#comment-14541153 ] Tsz Wo Nicholas Sze commented on HDFS-8220: --- It still to tolerate the leading

[jira] [Created] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8383: - Summary: Tolerate multiple failures in DFSStripedOutputStream Key: HDFS-8383 URL: https://issues.apache.org/jira/browse/HDFS-8383 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8383: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-7285 Tolerate multiple

[jira] [Resolved] (HDFS-8363) Erasure Coding: DFSStripedInputStream#seekToNewSource

2015-05-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-8363. -- Resolution: Fixed Hadoop Flags: Reviewed Thanks Uma for review, commit to branch. Erasure Coding:

[jira] [Created] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-12 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-8382: --- Summary: Remove chunkSize parameter from initialize method of raw erasure coder Key: HDFS-8382 URL: https://issues.apache.org/jira/browse/HDFS-8382 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding

2015-05-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541138#comment-14541138 ] Kai Zheng commented on HDFS-8347: - Thanks all for the feedback. Looks like we can proceed

[jira] [Commented] (HDFS-4838) HDFS should use the new methods added in HADOOP-9574

2015-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541145#comment-14541145 ] Hadoop QA commented on HDFS-4838: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-4383) Document the lease limits

2015-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541186#comment-14541186 ] Hadoop QA commented on HDFS-4383: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8345) Storage policy APIs must be exposed via the FileSystem interface

2015-05-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541080#comment-14541080 ] Jing Zhao commented on HDFS-8345: - Thanks for working on this, Arpit! The patch looks good

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541089#comment-14541089 ] Kai Zheng commented on HDFS-8367: - Sounds good and chunkSize isn't involved here. So would

[jira] [Commented] (HDFS-8323) Bump GenerationStamp for write faliure in DFSStripedOutputStream

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541149#comment-14541149 ] Tsz Wo Nicholas Sze commented on HDFS-8323: --- Walter, thanks a lot for the

[jira] [Updated] (HDFS-8323) Bump GenerationStamp for write faliure in DFSStripedOutputStream

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8323: -- Attachment: h8323_20150512.patch h8323_20150512.patch: addresses Walter's comments.

[jira] [Commented] (HDFS-6184) Capture NN's thread dump when it fails over

2015-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541175#comment-14541175 ] Hadoop QA commented on HDFS-6184: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2015-05-12 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8384: - Summary: Allow NN to startup if there are files having a lease but are not under construction Key: HDFS-8384 URL: https://issues.apache.org/jira/browse/HDFS-8384

  1   2   >