[jira] [Created] (HDFS-7659) We should check the new length of truncate can't be a negative value.

Yi Liu created HDFS-7659: Summary: We should check the new length of truncate can't be a negative value. Key: HDFS-7659 URL: https://issues.apache.org/jira/browse/HDFS-7659 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287488#comment-14287488 ] Hudson commented on HDFS-7548: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #78 (See

[jira] [Commented] (HDFS-7655) Expose truncate API for Web HDFS

[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287357#comment-14287357 ] Yi Liu commented on HDFS-7655: -- Upload the patch later. Expose truncate API for Web HDFS

[jira] [Updated] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7659: - Status: Patch Available (was: Open) We should check the new length of truncate can't be a negative value.

[jira] [Updated] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7659: - Attachment: HDFS-7659.001.patch The fix is obvious, no need for test. We should check the new length of truncate

[jira] [Commented] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287472#comment-14287472 ] Hudson commented on HDFS-3443: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2013 (See

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287470#comment-14287470 ] Hudson commented on HDFS-7548: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2013 (See

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287468#comment-14287468 ] Hudson commented on HDFS-7430: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2013 (See

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287486#comment-14287486 ] Hudson commented on HDFS-7430: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #78 (See

[jira] [Commented] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287490#comment-14287490 ] Hudson commented on HDFS-3443: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #78 (See

[jira] [Updated] (HDFS-7418) Raw Reed-Solomon coder in pure Java

[ https://issues.apache.org/jira/browse/HDFS-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7418: Summary: Raw Reed-Solomon coder in pure Java (was: RS coder in pure Java) Raw Reed-Solomon coder in pure

[jira] [Updated] (HDFS-7338) Raw Reed-Solomon coder using Intel ISA-L library

[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7338: Summary: Raw Reed-Solomon coder using Intel ISA-L library (was: Reed-Solomon coder using Intel ISA-L

[jira] [Created] (HDFS-7657) failed start datanode in secure mode with class not found err, but jar is in classpath

prophy Yan created HDFS-7657: Summary: failed start datanode in secure mode with class not found err, but jar is in classpath Key: HDFS-7657 URL: https://issues.apache.org/jira/browse/HDFS-7657 Project:

[jira] [Moved] (HDFS-7658) HDFS Space Quota not working as expected

[ https://issues.apache.org/jira/browse/HDFS-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B moved HADOOP-11503 to HDFS-7658: -- Component/s: (was: fs) Key: HDFS-7658 (was:

[jira] [Commented] (HDFS-7658) HDFS Space Quota not working as expected

[ https://issues.apache.org/jira/browse/HDFS-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287116#comment-14287116 ] Vinayakumar B commented on HDFS-7658: - Moved to HDFS HDFS Space Quota not working as

[jira] [Updated] (HDFS-7338) Reed-Solomon code using Intel ISA-L library

[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7338: Summary: Reed-Solomon code using Intel ISA-L library (was: Reed-Solomon codes using Intel ISA-L library)

[jira] [Updated] (HDFS-7338) Reed-Solomon coder using Intel ISA-L library

[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7338: Summary: Reed-Solomon coder using Intel ISA-L library (was: Reed-Solomon code using Intel ISA-L library)

[jira] [Work started] (HDFS-7655) Expose truncate API for Web HDFS

[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7655 started by Yi Liu. Expose truncate API for Web HDFS Key:

[jira] [Commented] (HDFS-7658) HDFS Space Quota not working as expected

[ https://issues.apache.org/jira/browse/HDFS-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287166#comment-14287166 ] Vinayakumar B commented on HDFS-7658: - bq. Then i tried to put a file of 100 Mb . It

[jira] [Resolved] (HDFS-7657) failed start datanode in secure mode with class not found err, but jar is in classpath

[ https://issues.apache.org/jira/browse/HDFS-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] prophy Yan resolved HDFS-7657. -- Resolution: Fixed this is the jsvc problem, i build the jsvc from commons-daemon, it resolved. failed

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287141#comment-14287141 ] Daniel Pesch commented on HDFS-7392: We are not blocked by his bug and we are able to

[jira] [Commented] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287236#comment-14287236 ] Hudson commented on HDFS-3443: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #81 (See

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287232#comment-14287232 ] Hudson commented on HDFS-7430: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #81 (See

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287234#comment-14287234 ] Hudson commented on HDFS-7548: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #81 (See

[jira] [Commented] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287253#comment-14287253 ] Hudson commented on HDFS-3443: -- FAILURE: Integrated in Hadoop-Yarn-trunk #815 (See

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287251#comment-14287251 ] Hudson commented on HDFS-7548: -- FAILURE: Integrated in Hadoop-Yarn-trunk #815 (See

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287249#comment-14287249 ] Hudson commented on HDFS-7430: -- FAILURE: Integrated in Hadoop-Yarn-trunk #815 (See

[jira] [Commented] (HDFS-7644) minor typo in HffpFS doc

[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287945#comment-14287945 ] Hadoop QA commented on HDFS-7644: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7076) Persist Block Storage Policy in FSImage and Edit Log

[ https://issues.apache.org/jira/browse/HDFS-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287953#comment-14287953 ] Jing Zhao commented on HDFS-7076: - Thanks for the review, Yi! I agree that allowing admin

[jira] [Updated] (HDFS-7076) Persist Block Storage Policy in FSImage and Edit Log

[ https://issues.apache.org/jira/browse/HDFS-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7076: Attachment: HDFS-7076.007.patch Upload a patch to demo the above proposal. Persist Block Storage Policy

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287595#comment-14287595 ] Hudson commented on HDFS-7430: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2032 (See

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287598#comment-14287598 ] Hudson commented on HDFS-7548: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2032 (See

[jira] [Commented] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287600#comment-14287600 ] Hudson commented on HDFS-3443: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2032 (See

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288285#comment-14288285 ] Tsz Wo Nicholas Sze commented on HDFS-7575: --- Yes. It is great that we already

[jira] [Commented] (HDFS-7076) Persist Block Storage Policy in FSImage and Edit Log

[ https://issues.apache.org/jira/browse/HDFS-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288306#comment-14288306 ] Hadoop QA commented on HDFS-7076: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288260#comment-14288260 ] Arpit Agarwal commented on HDFS-7575: - Thanks Colin. bq. We should log the old

[jira] [Comment Edited] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288260#comment-14288260 ] Arpit Agarwal edited comment on HDFS-7575 at 1/22/15 9:34 PM: --

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288272#comment-14288272 ] Colin Patrick McCabe commented on HDFS-7411: {code} public static final

[jira] [Updated] (HDFS-7575) Upgrade should generate a unique storage ID for each volume

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7575: Summary: Upgrade should generate a unique storage ID for each volume (was: NameNode not handling

[jira] [Updated] (HDFS-7575) Upgrade should generate a unique storage ID for each volume

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7575: Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: (was: 2.7.0)

[jira] [Commented] (HDFS-7633) When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime throws IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288344#comment-14288344 ] Arpit Agarwal commented on HDFS-7633: - +1 for the patch. The test failures look

[jira] [Commented] (HDFS-7224) Allow reuse of NN connections via webhdfs

[ https://issues.apache.org/jira/browse/HDFS-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287540#comment-14287540 ] Daryn Sharp commented on HDFS-7224: --- +1 Looks good to me. We've been running in

[jira] [Commented] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287567#comment-14287567 ] Hudson commented on HDFS-3443: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #82 (See

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287565#comment-14287565 ] Hudson commented on HDFS-7548: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #82 (See

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287563#comment-14287563 ] Hudson commented on HDFS-7430: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #82 (See

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287575#comment-14287575 ] Hadoop QA commented on HDFS-7659: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7660) BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.

[ https://issues.apache.org/jira/browse/HDFS-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288427#comment-14288427 ] Lei (Eddy) Xu commented on HDFS-7660: - The failed tests are not related.

[jira] [Created] (HDFS-7663) Erasure Coding: support Append on EC file

Jing Zhao created HDFS-7663: --- Summary: Erasure Coding: support Append on EC file Key: HDFS-7663 URL: https://issues.apache.org/jira/browse/HDFS-7663 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7664) Reed-Solomon ErasureCoder

Kai Zheng created HDFS-7664: --- Summary: Reed-Solomon ErasureCoder Key: HDFS-7664 URL: https://issues.apache.org/jira/browse/HDFS-7664 Project: Hadoop HDFS Issue Type: Sub-task Reporter:

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288606#comment-14288606 ] Tsz Wo Nicholas Sze commented on HDFS-7392: --- {code} + if(server != null)

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288610#comment-14288610 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- ... Do you know when HDFS started

[jira] [Updated] (HDFS-7417) Raw XOR coder

[ https://issues.apache.org/jira/browse/HDFS-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7417: Attachment: HDFS-7417-v1.patch Uploaded a patch implementing XOR code in Java. Raw XOR coder

[jira] [Commented] (HDFS-7417) Raw XOR coder

[ https://issues.apache.org/jira/browse/HDFS-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288658#comment-14288658 ] Kai Zheng commented on HDFS-7417: - As this patch depends on the one in HDFS-7353, let it be

[jira] [Updated] (HDFS-7655) Expose truncate API for Web HDFS

[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7655: - Attachment: HDFS-7655.001.patch Expose truncate API for Web HDFS

[jira] [Updated] (HDFS-7655) Expose truncate API for Web HDFS

[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7655: - Fix Version/s: (was: 3.0.0) Status: Patch Available (was: In Progress) Expose truncate API for

[jira] [Commented] (HDFS-7660) BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.

[ https://issues.apache.org/jira/browse/HDFS-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288677#comment-14288677 ] Yi Liu commented on HDFS-7660: -- Will commit later, thanks [~eddyxu] for the contribution and

[jira] [Comment Edited] (HDFS-7655) Expose truncate API for Web HDFS

[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288683#comment-14288683 ] Yi Liu edited comment on HDFS-7655 at 1/23/15 3:25 AM: --- [~szetszwo],

[jira] [Updated] (HDFS-7660) BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.

[ https://issues.apache.org/jira/browse/HDFS-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7660: - Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0 (was: 3.0.0) Status:

[jira] [Commented] (HDFS-7660) BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.

[ https://issues.apache.org/jira/browse/HDFS-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288692#comment-14288692 ] Lei (Eddy) Xu commented on HDFS-7660: - Thank you so much [~hitliuyi]

[jira] [Commented] (HDFS-3519) Checkpoint upload may interfere with a concurrent saveNamespace

[ https://issues.apache.org/jira/browse/HDFS-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288701#comment-14288701 ] Hudson commented on HDFS-3519: -- FAILURE: Integrated in Hadoop-trunk-Commit #6915 (See

[jira] [Commented] (HDFS-7575) Upgrade should generate a unique storage ID for each volume

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288700#comment-14288700 ] Hudson commented on HDFS-7575: -- FAILURE: Integrated in Hadoop-trunk-Commit #6915 (See

[jira] [Commented] (HDFS-7660) BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.

[ https://issues.apache.org/jira/browse/HDFS-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288702#comment-14288702 ] Hudson commented on HDFS-7660: -- FAILURE: Integrated in Hadoop-trunk-Commit #6915 (See

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288745#comment-14288745 ] Hadoop QA commented on HDFS-7353: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288744#comment-14288744 ] Hadoop QA commented on HDFS-7659: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7655) Expose truncate API for Web HDFS

[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288683#comment-14288683 ] Yi Liu commented on HDFS-7655: -- [~szetszwo], [~cnauroth], [~wheat9], any of you could help to

[jira] [Updated] (HDFS-7662) Erasure Coder API for encoding and decoding of BlockGroup

[ https://issues.apache.org/jira/browse/HDFS-7662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7662: Description: This is to define ErasureCoder API for encoding and decoding of BlockGroup. Given a BlockGroup,

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: editsStored Enable Quota Support for Storage Types (SSD)

[jira] [Commented] (HDFS-7660) BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.

[ https://issues.apache.org/jira/browse/HDFS-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288388#comment-14288388 ] Hadoop QA commented on HDFS-7660: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7633) BlockPoolSliceScanner fails when Datanode has too many blocks

[ https://issues.apache.org/jira/browse/HDFS-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288384#comment-14288384 ] Arpit Agarwal commented on HDFS-7633: - So I just pulled trunk and a commit from

[jira] [Commented] (HDFS-3689) Add support for variable length block

[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288453#comment-14288453 ] Tsz Wo Nicholas Sze commented on HDFS-3689: --- {code} +

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: HDFS-7584.1.patch Update patch with the editsStored and some minor fixes. Enable Quota

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288467#comment-14288467 ] Zhe Zhang commented on HDFS-7584: - bq. If you have 1GB SSD quota dn 2GB DISK quota, which

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288424#comment-14288424 ] Tsz Wo Nicholas Sze commented on HDFS-7392: --- I think we should fix this bug since

[jira] [Commented] (HDFS-7653) Block Readers and Writers used in both client side and datanode side

[ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288433#comment-14288433 ] Zhe Zhang commented on HDFS-7653: - Thanks Bo for the patch. Please find my review below:

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288474#comment-14288474 ] Xiaoyu Yao commented on HDFS-7584: -- bq. But what happens if the user did configure a

[jira] [Updated] (HDFS-7609) startup used too much time to load edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7609: Attachment: HDFS-7609-CreateEditsLogWithRPCIDs.patch I would rather pursue an optimization solution

[jira] [Updated] (HDFS-7633) BlockPoolSliceScanner fails when Datanode has too many blocks

[ https://issues.apache.org/jira/browse/HDFS-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7633: Summary: BlockPoolSliceScanner fails when Datanode has too many blocks (was: When Datanode has too

[jira] [Updated] (HDFS-7417) Raw XOR coder

[ https://issues.apache.org/jira/browse/HDFS-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7417: Summary: Raw XOR coder (was: XOR codes) Raw XOR coder - Key: HDFS-7417

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288491#comment-14288491 ] Konstantin Shvachko commented on HDFS-7659: --- Agreed about Preconditions. Why

[jira] [Updated] (HDFS-3519) Checkpoint upload may interfere with a concurrent saveNamespace

[ https://issues.apache.org/jira/browse/HDFS-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-3519: Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) +1

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288508#comment-14288508 ] Yi Liu commented on HDFS-7392: -- Thanks Daniel. Agree with [~szetszwo]'s suggestion that we

[jira] [Updated] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7545: Attachment: HDFS-7545-PoC.patch Adding a very rough proof-of-concept patch to demonstrate the idea in the

[jira] [Commented] (HDFS-7354) Support parity blocks in block management

[ https://issues.apache.org/jira/browse/HDFS-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288519#comment-14288519 ] Tsz Wo Nicholas Sze commented on HDFS-7354: --- We could view the parity block as a

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288529#comment-14288529 ] Yi Liu commented on HDFS-7659: -- {quote} Why don't we just add the negative check to the

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Status: Patch Available (was: In Progress) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but

[jira] [Commented] (HDFS-7354) Support parity blocks in block management

[ https://issues.apache.org/jira/browse/HDFS-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288556#comment-14288556 ] Zhe Zhang commented on HDFS-7354: - [~szetszwo] Good point, under the striping layout, we

[jira] [Commented] (HDFS-7614) Implement COMPLETE state of erasure coding block groups

[ https://issues.apache.org/jira/browse/HDFS-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288555#comment-14288555 ] Tsz Wo Nicholas Sze commented on HDFS-7614: --- Do we actually need under

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288564#comment-14288564 ] Jing Zhao commented on HDFS-7339: - Thanks for working on this, Zhe! # First a quick

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288566#comment-14288566 ] Kai Zheng commented on HDFS-7353: - Updated the patch. Change summary: 1. Let it focus on

[jira] [Issue Comment Deleted] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7659: - Comment: was deleted (was: Sure, let me do it.) We should check the new length of truncate can't be a negative

[jira] [Updated] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7659: - Attachment: HDFS-7659.002.patch Upload a new patch. We should check the new length of truncate can't be a

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288572#comment-14288572 ] Yi Liu commented on HDFS-7659: -- Sure, let me do it. We should check the new length of

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288571#comment-14288571 ] Yi Liu commented on HDFS-7659: -- Sure, let me do it. We should check the new length of

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288570#comment-14288570 ] Yi Liu commented on HDFS-7659: -- Sure, let me do it. We should check the new length of

[jira] [Issue Comment Deleted] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7659: - Comment: was deleted (was: Sure, let me do it.) We should check the new length of truncate can't be a negative

[jira] [Commented] (HDFS-7653) Block Readers and Writers used in both client side and datanode side

[ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288578#comment-14288578 ] Tsz Wo Nicholas Sze commented on HDFS-7653: --- I think we probably should separate

[jira] [Created] (HDFS-7662) Erasure Coder API for encoding and decoding of BlockGroup

Kai Zheng created HDFS-7662: --- Summary: Erasure Coder API for encoding and decoding of BlockGroup Key: HDFS-7662 URL: https://issues.apache.org/jira/browse/HDFS-7662 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7659: - Attachment: HDFS-7659.003.patch Update... We should check the new length of truncate can't be a negative value.

[jira] [Assigned] (HDFS-7662) Erasure Coder API for encoding and decoding of BlockGroup

[ https://issues.apache.org/jira/browse/HDFS-7662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-7662: --- Assignee: Kai Zheng Erasure Coder API for encoding and decoding of BlockGroup

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288499#comment-14288499 ] Yi Liu commented on HDFS-7659: -- Thanks Colin and Konstantin, will update the patch later. We

  1   2   >