[jira] [Updated] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7677: - Fix Version/s: (was: 2.7.0) Status: Patch Available (was: Open) DistributedFileSystem#truncate

[jira] [Updated] (HDFS-7224) Allow reuse of NN connections via webhdfs

[ https://issues.apache.org/jira/browse/HDFS-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7224: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7224) Allow reuse of NN connections via webhdfs

[ https://issues.apache.org/jira/browse/HDFS-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291862#comment-14291862 ] Kihwal Lee commented on HDFS-7224: -- I've committed this to branch-2 and trunk. Thanks for

[jira] [Commented] (HDFS-7224) Allow reuse of NN connections via webhdfs

[ https://issues.apache.org/jira/browse/HDFS-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291875#comment-14291875 ] Hudson commented on HDFS-7224: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6930 (See

[jira] [Commented] (HDFS-7577) Add additional headers that includes need by Windows

[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291908#comment-14291908 ] Thanh Do commented on HDFS-7577: Hi [~cmccabe]. Could please you take a look at the new

[jira] [Updated] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7677: - Attachment: HDFS-7677.001.patch DistributedFileSystem#truncate should resolve symlinks

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292001#comment-14292001 ] Hadoop QA commented on HDFS-7677: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7676) Fix TestFileTruncate to avoid bug of HDFS-7611

[ https://issues.apache.org/jira/browse/HDFS-7676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292314#comment-14292314 ] Colin Patrick McCabe commented on HDFS-7676: [~shv], are this JIRA and

[jira] [Commented] (HDFS-7312) Update DistCp v1 to optionally not use tmp location

[ https://issues.apache.org/jira/browse/HDFS-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292324#comment-14292324 ] Hadoop QA commented on HDFS-7312: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7665) Add definition of truncate preconditions/postconditions to filesystem specification

[ https://issues.apache.org/jira/browse/HDFS-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292280#comment-14292280 ] Konstantin Shvachko commented on HDFS-7665: --- Makes sense. Do you want to

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292301#comment-14292301 ] Andrew Wang commented on HDFS-7411: --- This is the same testIncludeByRegistrationName

[jira] [Commented] (HDFS-7675) Unused member DFSClient.spanReceiverHost

[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292308#comment-14292308 ] Colin Patrick McCabe commented on HDFS-7675: It's not redundant. Calling

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292295#comment-14292295 ] Tsz Wo Nicholas Sze commented on HDFS-7339: --- Are you proposing we enforce 4 zero

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292298#comment-14292298 ] Konstantin Shvachko commented on HDFS-7677: --- I don't see it in my design, which

[jira] [Updated] (HDFS-7312) Update DistCp v1 to optionally not use tmp location

[ https://issues.apache.org/jira/browse/HDFS-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Prosser updated HDFS-7312: - Status: Patch Available (was: Open) Update DistCp v1 to optionally not use tmp location

[jira] [Created] (HDFS-7680) Support dataset-specific choice of short circuit implementation

Joe Pallas created HDFS-7680: Summary: Support dataset-specific choice of short circuit implementation Key: HDFS-7680 URL: https://issues.apache.org/jira/browse/HDFS-7680 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7666) Datanode blockId layout upgrade threads should be daemon thread

[ https://issues.apache.org/jira/browse/HDFS-7666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292273#comment-14292273 ] Colin Patrick McCabe commented on HDFS-7666: Hi Rakesh, I'm not sure why we

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292311#comment-14292311 ] Colin Patrick McCabe commented on HDFS-7677: I think we should support this,

[jira] [Created] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

Joe Pallas created HDFS-7681: Summary: Fix ReplicaInputStream constructor to take InputStreams Key: HDFS-7681 URL: https://issues.apache.org/jira/browse/HDFS-7681 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7630) TestConnCache hardcode block size without considering native OS

[ https://issues.apache.org/jira/browse/HDFS-7630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292353#comment-14292353 ] Arpit Agarwal commented on HDFS-7630: - HI [~sam liu], it is hard to review and commit

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292174#comment-14292174 ] Zhe Zhang commented on HDFS-7339: - bq. If we enforce block id allocation so that the lower

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292210#comment-14292210 ] Konstantin Shvachko commented on HDFS-7659: --- No problem. I was just trying to

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Status: Patch Available (was: Open) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file

[jira] [Commented] (HDFS-7577) Add additional headers that includes need by Windows

[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292414#comment-14292414 ] Colin Patrick McCabe commented on HDFS-7577: cpuid.h: we need an #error when

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292443#comment-14292443 ] Colin Patrick McCabe commented on HDFS-7648: I agree with Nicholas that we

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292424#comment-14292424 ] Colin Patrick McCabe commented on HDFS-6673: bq. The whole point of this tool

[jira] [Updated] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7611: Attachment: HDFS-7611.000.patch Upload the patch using the above #2 approach. deleteSnapshot and delete of

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.009.patch Added the @Ignore in this latest patch, no other changes. Refactor and

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292496#comment-14292496 ] Zhe Zhang commented on HDFS-7339: - Thanks for the analysis [~szetszwo]. The basic tradeoff

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Attachment: HDFS-7682.000.patch Posting patch for a jenkins run.

[jira] [Resolved] (HDFS-7341) Add initial snapshot support based on pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7341. Resolution: Duplicate Duplicate of HDFS-3107 Add initial snapshot support based on

[jira] [Updated] (HDFS-7577) Add additional headers that includes need by Windows

[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thanh Do updated HDFS-7577: --- Attachment: HDFS-7577-branch-HDFS-6994-2.patch Hi [~cmccabe]. Attached is another patch that throws an error

[jira] [Created] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

Charles Lamb created HDFS-7682: -- Summary: {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content Key: HDFS-7682 URL: https://issues.apache.org/jira/browse/HDFS-7682

[jira] [Commented] (HDFS-3107) HDFS truncate

[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292447#comment-14292447 ] Tsz Wo Nicholas Sze commented on HDFS-3107: --- Thanks a lot for all the great

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292454#comment-14292454 ] Jing Zhao commented on HDFS-7611: - Thanks for digging into the issue, [~Byron Wong]! So

[jira] [Updated] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7018: --- Attachment: (was: HDFS-7018-pnative.004.patch) Implement C interface for libhdfs3

[jira] [Commented] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292915#comment-14292915 ] Zhanwei Wang commented on HDFS-7018: Hi [~cmccabe] In the new patch, 1) simplify the

[jira] [Updated] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7018: --- Attachment: HDFS-7018-pnative.004.patch Implement C interface for libhdfs3

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292919#comment-14292919 ] Kai Zheng commented on HDFS-7353: - Hi [~zhz] or [~szetszwo], 1. I'm sorry to be about

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292847#comment-14292847 ] Hadoop QA commented on HDFS-49: --- {color:red}-1 overall{color}. Here are the results of testing

[jira] [Commented] (HDFS-3689) Add support for variable length block

[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292877#comment-14292877 ] Tsz Wo Nicholas Sze commented on HDFS-3689: --- - Add an if-statement to check

[jira] [Updated] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7018: --- Attachment: HDFS-7018-pnative.004.patch Implement C interface for libhdfs3

[jira] [Comment Edited] (HDFS-7584) Enable Quota Support for Storage Types

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292891#comment-14292891 ] Arpit Agarwal edited comment on HDFS-7584 at 1/27/15 2:50 AM: --

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292891#comment-14292891 ] Arpit Agarwal commented on HDFS-7584: - [~xyao], considering the size of the patch do

[jira] [Updated] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7353: Attachment: HDFS-7353-v5.patch Updated the patch according to the above review comments. Raw Erasure Coder

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292825#comment-14292825 ] Ravi Prakash commented on HDFS-49: -- Patch looks good to me however the two test failures

[jira] [Updated] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-49: - Status: Open (was: Patch Available) MiniDFSCluster.stopDataNode will always shut down a node in the

[jira] [Updated] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-5796: -- Attachment: HDFS-5796.3.patch The file system browser in the namenode UI requires SPNEGO.

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293051#comment-14293051 ] Xiaoyu Yao commented on HDFS-7584: -- Thanks Arpit again for the feedback. I've fixed your

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293054#comment-14293054 ] Kai Zheng commented on HDFS-7353: - bq. numDataUnits probably sounds a little better. OK,

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292864#comment-14292864 ] Jing Zhao commented on HDFS-7339: - bq. Change the hash function so that consecutive IDs

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292893#comment-14292893 ] Hadoop QA commented on HDFS-7611: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293018#comment-14293018 ] Xiaoyu Yao commented on HDFS-7584: -- Thanks Arpit for the review and feedback. I will

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293092#comment-14293092 ] Konstantin Shvachko commented on HDFS-7677: --- Looks good. Few minor nits on the

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292833#comment-14292833 ] Arpit Agarwal commented on HDFS-49: --- +1 for the v002 patch. The test failures are almost

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7584: Summary: Enable Quota Support for Storage Types (was: Enable Quota Support for Storage Types (SSD)

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292974#comment-14292974 ] Hadoop QA commented on HDFS-49: --- {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293038#comment-14293038 ] Zhe Zhang commented on HDFS-7339: - bq. Back to this jira, maybe we should consider

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292822#comment-14292822 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- I created a Google doc which is

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292894#comment-14292894 ] Kai Zheng commented on HDFS-7285: - It's good to use 'erasure_code' for a c library

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292788#comment-14292788 ] Hadoop QA commented on HDFS-7411: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-49: - Status: Patch Available (was: Open) MiniDFSCluster.stopDataNode will always shut down a node in the

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292899#comment-14292899 ] Kai Zheng commented on HDFS-7285: - The rational to use erasurecoding or erasurecode is

[jira] [Updated] (HDFS-7630) TestConnCache hardcode block size without considering native OS

[ https://issues.apache.org/jira/browse/HDFS-7630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sam liu updated HDFS-7630: -- Attachment: HDFS-7630.002.patch Combined the patches of HDFS-7624 through HDFS-7630 into

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293040#comment-14293040 ] Zhe Zhang commented on HDFS-7353: - bq. how about numDataUnits or dataUnitsCount Both sound

[jira] [Updated] (HDFS-7680) Support dataset-specific choice of short circuit implementation

[ https://issues.apache.org/jira/browse/HDFS-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-7680: - Description: As described in HDFS-5194, the current support for short circuit reading is tightly coupled

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292716#comment-14292716 ] Yi Liu commented on HDFS-7677: -- That's great. So [~shv] and [~cmccabe] please help to take a

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292745#comment-14292745 ] Arpit Agarwal commented on HDFS-7584: - Few more comments to wrap up feedback on API and

[jira] [Commented] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292763#comment-14292763 ] Jing Zhao commented on HDFS-7682: - Thanks for working on this, [~clamb]. One question

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292775#comment-14292775 ] Zhe Zhang commented on HDFS-7285: - I created a Google [doc |

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292887#comment-14292887 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- How about io.erasure_code? Intel

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292904#comment-14292904 ] Hadoop QA commented on HDFS-5796: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7018: --- Attachment: (was: HDFS-7018-pnative.004.patch) Implement C interface for libhdfs3

[jira] [Updated] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7018: --- Attachment: HDFS-7018-pnative.004.patch Implement C interface for libhdfs3

[jira] [Updated] (HDFS-3689) Add support for variable length block

[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: HDFS-3689.010.patch Thanks Nicholas! Update the patch to address the comments. bq. The

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293021#comment-14293021 ] Hadoop QA commented on HDFS-7353: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7353: Attachment: HDFS-7353-v6.patch Hope this resolves the Javadoc warnings finally. Raw Erasure Coder API for

[jira] [Updated] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7677: - Attachment: HDFS-7677.002.patch Thanks [~shv]! Update the patch to address comments.

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293116#comment-14293116 ] Hadoop QA commented on HDFS-7353: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3107) HDFS truncate

[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291559#comment-14291559 ] Yi Liu commented on HDFS-3107: -- Thanks [~shv], I find another two things: *

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291614#comment-14291614 ] Hadoop QA commented on HDFS-7353: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7353: Attachment: HDFS-7353-v4.patch Updated the patch resolving the Javadoc warnings. Raw Erasure Coder API for

[jira] [Commented] (HDFS-7665) Add definition of truncate preconditions/postconditions to filesystem specification

[ https://issues.apache.org/jira/browse/HDFS-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291695#comment-14291695 ] Steve Loughran commented on HDFS-7665: -- The second of those,

[jira] [Commented] (HDFS-7678) Block group reader with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291701#comment-14291701 ] Li Bo commented on HDFS-7678: - This code has not synced with Codec and Namenode code, so I use

[jira] [Created] (HDFS-7678) Block group reader with decode functionality

Li Bo created HDFS-7678: --- Summary: Block group reader with decode functionality Key: HDFS-7678 URL: https://issues.apache.org/jira/browse/HDFS-7678 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-7678) Block group reader with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7678: Attachment: BlockGroupReader.patch Block group reader with decode functionality

[jira] [Created] (HDFS-7679) EC encode/decode framework

Li Bo created HDFS-7679: --- Summary: EC encode/decode framework Key: HDFS-7679 URL: https://issues.apache.org/jira/browse/HDFS-7679 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Li Bo

[jira] [Updated] (HDFS-7679) EC encode/decode framework

[ https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7679: Attachment: ECEncodeDecodeFramework.patch EC encode/decode framework --

[jira] [Updated] (HDFS-7679) EC encode/decode framework

[ https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7679: Assignee: Li Bo EC encode/decode framework -- Key: HDFS-7679

[jira] [Commented] (HDFS-7679) EC encode/decode framework

[ https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291712#comment-14291712 ] Li Bo commented on HDFS-7679: - The first patch shows the idea of EC encode/decode framework.

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291736#comment-14291736 ] Li Bo commented on HDFS-7545: - hi, Zhe Thanks for your patch. I think writing blocks is more

[jira] [Updated] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7545: Attachment: clientStriping.patch Data striping support in HDFS client

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291742#comment-14291742 ] Li Bo commented on HDFS-7545: - The patch is based on HDFS-7679 and HDFS-7678. Zhe's patch is

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291744#comment-14291744 ] Li Bo commented on HDFS-7545: - DFSStripeInputStream is base on DFSInputStream. If directly

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292545#comment-14292545 ] Haohui Mai commented on HDFS-6673: -- bq. I think that the point that Andrew is trying to

[jira] [Commented] (HDFS-42) NetUtils.createSocketAddr NPEs if dfs.datanode.ipc.address is not set for a data node

[ https://issues.apache.org/jira/browse/HDFS-42?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292557#comment-14292557 ] Steve Loughran commented on HDFS-42: HADOOP-5687 duplicated this; it contained the patch

[jira] [Resolved] (HDFS-42) NetUtils.createSocketAddr NPEs if dfs.datanode.ipc.address is not set for a data node

[ https://issues.apache.org/jira/browse/HDFS-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-42. Resolution: Duplicate Fix Version/s: 0.21.0 NetUtils.createSocketAddr NPEs if

[jira] [Resolved] (HDFS-135) TestEditLog assumes that FSNamesystem.getFSNamesystem().dir is non-null, even after the FSNameSystem is closed

[ https://issues.apache.org/jira/browse/HDFS-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-135. - Resolution: Cannot Reproduce TestEditLog assumes that FSNamesystem.getFSNamesystem().dir is

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292580#comment-14292580 ] Zhe Zhang commented on HDFS-7353: - Good work [~drankye]! Please find my comments below: #

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292595#comment-14292595 ] Zhe Zhang commented on HDFS-7339: - bq. It is not true. For a EC-block, the block group

  1   2   >