[jira] [Created] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

2015-07-08 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-8742: Summary: Inotify: Support event for OP_TRUNCATE Key: HDFS-8742 URL: https://issues.apache.org/jira/browse/HDFS-8742 Project: Hadoop HDFS Issu

[jira] [Updated] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

2015-07-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8729: Attachment: HDFS-8729.02.patch bq. In my test looks like the reason of the timeout is a race scenario in the

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619991#comment-14619991 ] Hadoop QA commented on HDFS-8058: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8323) Bump GenerationStamp for write faliure in DFSStripedOutputStream

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619942#comment-14619942 ] Zhe Zhang commented on HDFS-8323: - Thanks Walter! I think that is the cause. I'll do a simp

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8058: Attachment: HDFS-8058-HDFS-7285.004.patch {{TestBlockTokenWithDFS}} and {{TestEncryptedTransfer}} fail withou

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

2015-07-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619929#comment-14619929 ] Akira AJISAKA commented on HDFS-2956: - Hi [~vinayrpet], thank you for taking this issue

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-08 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619925#comment-14619925 ] Raju Bairishetti commented on HDFS-8578: bq. Sequential processing of volumes in pr

[jira] [Commented] (HDFS-8642) Make TestFileTruncate more reliable

2015-07-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619922#comment-14619922 ] Rakesh R commented on HDFS-8642: Thank you [~arpitagarwal] for the reviews and committing t

[jira] [Commented] (HDFS-8721) Add a metric for number of encryption zones

2015-07-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619919#comment-14619919 ] Rakesh R commented on HDFS-8721: Thanks [~cnauroth], [~wheat9] for the reviews and suggesti

[jira] [Commented] (HDFS-8323) Bump GenerationStamp for write faliure in DFSStripedOutputStream

2015-07-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619904#comment-14619904 ] Walter Su commented on HDFS-8323: - bq. I think the new bumpBlockGenerationStamp code is cau

[jira] [Commented] (HDFS-8736) ability to deny access to different filesystems

2015-07-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619894#comment-14619894 ] Owen O'Malley commented on HDFS-8736: - I agree with Allen. Preventing access to the Loc

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619888#comment-14619888 ] Hadoop QA commented on HDFS-8578: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-08 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raju Bairishetti updated HDFS-8578: --- Attachment: HDFS-8578-branch-2.6.0.patch > On upgrade, Datanode should process all storage/data

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-08 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619884#comment-14619884 ] Raju Bairishetti commented on HDFS-8578: Attaching a patch which works with 2.6.0 b

[jira] [Commented] (HDFS-8563) Erasure Coding: fsck handles file smaller than a full stripe

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619868#comment-14619868 ] Hadoop QA commented on HDFS-8563: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619856#comment-14619856 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8323) Bump GenerationStamp for write faliure in DFSStripedOutputStream

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619855#comment-14619855 ] Zhe Zhang commented on HDFS-8323: - [~szetszwo] I think the new {{bumpBlockGenerationStamp}}

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-07-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619854#comment-14619854 ] Yi Liu commented on HDFS-6200: -- It's great to have separate jar for hdfs-client. I have follow

[jira] [Assigned] (HDFS-8741) Proper error msg to be printed when invalid operation type is given to WebHDFS operations.

2015-07-08 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-8741: Assignee: Surendra Singh Lilhore > Proper error msg to be printed when inval

[jira] [Created] (HDFS-8741) Proper error msg to be printed when invalid operation type is given to WebHDFS operations.

2015-07-08 Thread Archana T (JIRA)
Archana T created HDFS-8741: --- Summary: Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Key: HDFS-8741 URL: https://issues.apache.org/jira/browse/HDFS-8741 Project:

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619842#comment-14619842 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2015-07-08 Thread Bing Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619826#comment-14619826 ] Bing Jiang commented on HDFS-8718: -- Meanwhile, there are some DEBUG logs: {code} 2015-07-0

[jira] [Resolved] (HDFS-8740) Move DistributedFileSystem to hadoop-hdfs-client

2015-07-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-8740. -- Resolution: Invalid Assignee: (was: Yi Liu) > Move DistributedFileSystem to hadoop-hdfs-client > --

[jira] [Updated] (HDFS-8739) Move DFSClient to client implementation package

2015-07-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8739: - Assignee: (was: Yi Liu) Summary: Move DFSClient to client implementation package (was: Move DFSClient to

[jira] [Commented] (HDFS-8734) Erasure Coding: fix one cell need two packets

2015-07-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619812#comment-14619812 ] Li Bo commented on HDFS-8734: - We know that the data of a full packet is a little smaller than

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619811#comment-14619811 ] Hadoop QA commented on HDFS-8058: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (HDFS-8740) Move DistributedFileSystem to hadoop-hdfs-client

2015-07-08 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8740: Summary: Move DistributedFileSystem to hadoop-hdfs-client Key: HDFS-8740 URL: https://issues.apache.org/jira/browse/HDFS-8740 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8719: Attachment: HDFS-8719-HDFS-7285-003.patch {{adjustChunkBoundary()}} is move to {{setCurrentStreamer}}. {{TestDFSStri

[jira] [Created] (HDFS-8739) Move DFSClient to hadoop-hdfs-client

2015-07-08 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8739: Summary: Move DFSClient to hadoop-hdfs-client Key: HDFS-8739 URL: https://issues.apache.org/jira/browse/HDFS-8739 Project: Hadoop HDFS Issue Type: Sub-task Compone

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2015-07-08 Thread Bing Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619778#comment-14619778 ] Bing Jiang commented on HDFS-8718: -- [~kanaka] You are right. The two nodes are not in th

[jira] [Updated] (HDFS-8717) OzoneHandler : Add common bucket objects

2015-07-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8717: --- Attachment: hdfs-8717-HDFS-7240.001.patch To be submitted after HDFS-8680 *Add BucketArgs , BucketInfo

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619738#comment-14619738 ] Hadoop QA commented on HDFS-8722: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8670) Better to exclude decommissioned nodes for namenode NodeUsage JMX

2015-07-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619713#comment-14619713 ] Ming Ma commented on HDFS-8670: --- Thanks [~andreina] for the patch! * Maybe we should exclude

[jira] [Updated] (HDFS-8563) Erasure Coding: fsck handles file smaller than a full stripe

2015-07-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8563: Attachment: HDFS-8563-HDFS-7285.02.patch > Erasure Coding: fsck handles file smaller than a full stripe > ---

[jira] [Created] (HDFS-8738) Limit Exceptions thrown by DataNode when a client makes socket connection and sends an empty message

2015-07-08 Thread Rajesh Kartha (JIRA)
Rajesh Kartha created HDFS-8738: --- Summary: Limit Exceptions thrown by DataNode when a client makes socket connection and sends an empty message Key: HDFS-8738 URL: https://issues.apache.org/jira/browse/HDFS-8738

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619618#comment-14619618 ] Hadoop QA commented on HDFS-7314: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

2015-07-08 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619605#comment-14619605 ] Kai Sasaki commented on HDFS-8702: -- This is the initial patch. The logic of deciding wheth

[jira] [Updated] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

2015-07-08 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8702: - Attachment: HDFS-8702-HDFS-7285.00.patch > Erasure coding: update BlockManager.blockHasEnoughRacks(..) logi

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: HDFS-8728.02.patch > Erasure coding: revisit and simplify BlockInfoStriped and INodeFile > --

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Status: Open (was: Patch Available) > Erasure coding: revisit and simplify BlockInfoStriped and INodeFile >

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Status: Patch Available (was: Open) > Erasure coding: revisit and simplify BlockInfoStriped and INodeFile >

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: (was: HDFS-8728.02.patch) > Erasure coding: revisit and simplify BlockInfoStriped and INodeFi

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619588#comment-14619588 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8058: Attachment: HDFS-8058-HDFS-7285.003.patch Updated patch based on the original idea. In general, I think we s

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619560#comment-14619560 ] Hadoop QA commented on HDFS-8058: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Reopened] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-8058: - Per discussion under HDFS-7285 and HDFS-8728, we should revisit the use of {{BlockInfoStriped}} and {{BlockInf

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8058: Status: Patch Available (was: Reopened) > Erasure coding: use BlockInfo[] for both striped and contiguous bl

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619549#comment-14619549 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8736) ability to deny access to different filesystems

2015-07-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619543#comment-14619543 ] Allen Wittenauer commented on HDFS-8736: A) Please see https://wiki.apache.org/had

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: Merge-8-inodeFile.patch > Erasure coding: revisit and simplify BlockInfoStriped and INodeFile > -

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: HDFS-8728.02.patch Updating patch to fix test failures. Most failures are due to patch splitting:

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: (was: Merge-8-inodeFile.patch) > Erasure coding: revisit and simplify BlockInfoStriped and IN

[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619501#comment-14619501 ] Hadoop QA commented on HDFS-7101: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619494#comment-14619494 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8722) Optimize datanode writes for small writes and flushes

2015-07-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8722: - Attachment: HDFS-8722.v1.patch > Optimize datanode writes for small writes and flushes > --

[jira] [Updated] (HDFS-7101) Potential null dereference in DFSck#doWork()

2015-07-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7101: - Description: {code} String lastLine = null; int errCode = -1; try { while ((line = input.readLine

[jira] [Commented] (HDFS-8734) Erasure Coding: fix one cell need two packets

2015-07-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619467#comment-14619467 ] Jing Zhao commented on HDFS-8734: - The analysis makes sense to me. But looks like we cannot

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619376#comment-14619376 ] Jing Zhao commented on HDFS-8719: - Looks like switching streamer and refreshing {{chunksPer

[jira] [Commented] (HDFS-8737) Implement the Hadoop RPC v9 protocol

2015-07-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619325#comment-14619325 ] Haohui Mai commented on HDFS-8737: -- The v0 patch only includes the RPC implementation. I p

[jira] [Updated] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2015-07-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7314: -- Attachment: HDFS-7314-8.patch Here is a slightly different version we have deployed on our production clusters.

[jira] [Updated] (HDFS-8737) Implement the Hadoop RPC v9 protocol

2015-07-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8737: - Attachment: HDFS-8737.000.patch > Implement the Hadoop RPC v9 protocol > --

[jira] [Created] (HDFS-8737) Implement the Hadoop RPC v9 protocol

2015-07-08 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8737: Summary: Implement the Hadoop RPC v9 protocol Key: HDFS-8737 URL: https://issues.apache.org/jira/browse/HDFS-8737 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8680) OzoneHandler : Add Local StorageHandler support for volumes

2015-07-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619285#comment-14619285 ] Arpit Agarwal commented on HDFS-8680: - The test failures are unrelated. Not committing

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

2015-07-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619104#comment-14619104 ] Kihwal Lee commented on HDFS-8722: -- Forgot to remove one line in the patch. > Optimize da

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: HDFS-8728.01.patch Rebased patch. > Erasure coding: revisit and simplify BlockInfoStriped and IN

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619066#comment-14619066 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8563) Erasure Coding: fsck handles file smaller than a full stripe

2015-07-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619056#comment-14619056 ] Jing Zhao commented on HDFS-8563: - Forgot to include the attachment? > Erasure Coding: fsc

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: HDFS-8728.00.patch > Erasure coding: revisit and simplify BlockInfoStriped and INodeFile > --

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619057#comment-14619057 ] Hadoop QA commented on HDFS-8728: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Status: Patch Available (was: Open) Submitting consolidated patches 1~8 to trigger Jenkins. > Erasure codin

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: Merge-8-inodeFile.patch Merge-7-replicationMonitor.patch Merge-6-l

[jira] [Commented] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

2015-07-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619035#comment-14619035 ] Jing Zhao commented on HDFS-8729: - To trigger block report or not before restarting DataNod

[jira] [Commented] (HDFS-8726) Move protobuf files that define the client-sever protocols to hdfs-client

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619033#comment-14619033 ] Hudson commented on HDFS-8726: -- FAILURE: Integrated in Hadoop-trunk-Commit #8133 (See [https:

[jira] [Updated] (HDFS-8726) Move protobuf files that define the client-sever protocols to hdfs-client

2015-07-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8726: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619009#comment-14619009 ] Hadoop QA commented on HDFS-8716: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8736) ability to deny access to different filesystems

2015-07-08 Thread Purvesh Patel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Purvesh Patel updated HDFS-8736: Attachment: Patch.pdf > ability to deny access to different filesystems > ---

[jira] [Created] (HDFS-8736) ability to deny access to different filesystems

2015-07-08 Thread Purvesh Patel (JIRA)
Purvesh Patel created HDFS-8736: --- Summary: ability to deny access to different filesystems Key: HDFS-8736 URL: https://issues.apache.org/jira/browse/HDFS-8736 Project: Hadoop HDFS Issue Type: I

[jira] [Resolved] (HDFS-6672) Regression with hdfs oiv tool

2015-07-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu resolved HDFS-6672. - Resolution: Fixed Fix Version/s: 2.7.0 Hi, [~cnauroth]. Thanks for bring this up. I have a

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618936#comment-14618936 ] Zhe Zhang commented on HDFS-7285: - Thanks Jing for the helpful comments! I've created HDFS-

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Summary: Erasure coding: revisit and simplify BlockInfoStriped and INodeFile (was: Erasure coding: revisit B

[jira] [Commented] (HDFS-6672) Regression with hdfs oiv tool

2015-07-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618927#comment-14618927 ] Chris Nauroth commented on HDFS-6672: - Hi [~eddyxu]. This is a master jira with a sing

[jira] [Commented] (HDFS-8642) Make TestFileTruncate more reliable

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618898#comment-14618898 ] Hudson commented on HDFS-8642: -- FAILURE: Integrated in Hadoop-trunk-Commit #8132 (See [https:

[jira] [Updated] (HDFS-8642) Make TestFileTruncate more reliable

2015-07-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8642: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Target Version/

[jira] [Updated] (HDFS-8642) Make TestFileTruncate more reliable

2015-07-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8642: Summary: Make TestFileTruncate more reliable (was: Improve TestFileTruncate#setup by deleting the sn

[jira] [Commented] (HDFS-8642) Improve TestFileTruncate#setup by deleting the snapshots

2015-07-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618871#comment-14618871 ] Arpit Agarwal commented on HDFS-8642: - +1 for the .02 patch, thanks for for updating it

[jira] [Commented] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618850#comment-14618850 ] Hadoop QA commented on HDFS-8727: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-07-08 Thread Andrew Baptist (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Baptist updated HDFS-8727: - Attachment: hdfs-8728.patch.2 No easy way to add unit tests for this - this requires integration wi

[jira] [Updated] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-07-08 Thread Andrew Baptist (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Baptist updated HDFS-8727: - Attachment: (was: hdfs-8728.patch) > Allow using path style addressing for accessing the s3 end

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2015-07-08 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618740#comment-14618740 ] kanaka kumar avvaru commented on HDFS-8718: --- Hi [~jianbginglover], I think this

[jira] [Commented] (HDFS-8712) Remove "public" and "abstract" modifiers in FsVolumeSpi and FsDatasetSpi

2015-07-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618732#comment-14618732 ] Lei (Eddy) Xu commented on HDFS-8712: - Thanks much for committing this, [~vinayrpet].

[jira] [Commented] (HDFS-8652) Track BlockInfo instead of Block in CorruptReplicasMap

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618701#comment-14618701 ] Hudson commented on HDFS-8652: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #238 (See [htt

[jira] [Commented] (HDFS-8711) setSpaceQuota command should print the available storage type when input storage type is wrong

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618707#comment-14618707 ] Hudson commented on HDFS-8711: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #238 (See [htt

[jira] [Commented] (HDFS-8620) Clean up the checkstyle warinings about ClientProtocol

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618703#comment-14618703 ] Hudson commented on HDFS-8620: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #238 (See [htt

[jira] [Commented] (HDFS-8712) Remove "public" and "abstract" modifiers in FsVolumeSpi and FsDatasetSpi

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618706#comment-14618706 ] Hudson commented on HDFS-8712: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #238 (See [htt

[jira] [Commented] (HDFS-8712) Remove "public" and "abstract" modifiers in FsVolumeSpi and FsDatasetSpi

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618655#comment-14618655 ] Hudson commented on HDFS-8712: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2177 (See [https://

[jira] [Commented] (HDFS-8620) Clean up the checkstyle warinings about ClientProtocol

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618652#comment-14618652 ] Hudson commented on HDFS-8620: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2177 (See [https://

[jira] [Commented] (HDFS-8711) setSpaceQuota command should print the available storage type when input storage type is wrong

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618656#comment-14618656 ] Hudson commented on HDFS-8711: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2177 (See [https://

[jira] [Commented] (HDFS-8652) Track BlockInfo instead of Block in CorruptReplicasMap

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618650#comment-14618650 ] Hudson commented on HDFS-8652: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2177 (See [https://

[jira] [Updated] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-07-08 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-8716: --- Attachment: HDFS-8716.6.patch [~vinayrpet] thanks for review! Just updated my patch with the description of th

[jira] [Commented] (HDFS-8712) Remove "public" and "abstract" modifiers in FsVolumeSpi and FsDatasetSpi

2015-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618584#comment-14618584 ] Hudson commented on HDFS-8712: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2196 (See [htt

  1   2   >