[jira] [Commented] (HDFS-6773) MiniDFSCluster should skip edit log fsync by default

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110360#comment-14110360 ] Hadoop QA commented on HDFS-6773: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Attachment: HDFS-6898.04.patch Thanks for the review. Addressed all your feedback and added a

[jira] [Updated] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6898: Attachment: HDFS-6898.05.patch Fix a typo. DN must reserve space for a full block when an RBW

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Summary: Optimize HDFS Encrypted Transport performance (was: Optimize encryption support in DataTransfer

[jira] [Commented] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-08-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110457#comment-14110457 ] Vinayakumar B commented on HDFS-6921: - I feel, Since current patch did not modify the

[jira] [Commented] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

2014-08-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110469#comment-14110469 ] Vinayakumar B commented on HDFS-6922: - 1. Layout version should be changed in

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110474#comment-14110474 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6945) ExcessBlocks metric may not be decremented if there are no over replicated blocks

2014-08-26 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-6945: --- Summary: ExcessBlocks metric may not be decremented if there are no over replicated blocks Key: HDFS-6945 URL: https://issues.apache.org/jira/browse/HDFS-6945 Project:

[jira] [Updated] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2014-08-26 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6832: Target Version/s: 2.6.0 (was: 2.5.0) Fix the usage of 'hdfs namenode' command

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110554#comment-14110554 ] Hadoop QA commented on HDFS-6898: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110563#comment-14110563 ] Hadoop QA commented on HDFS-6898: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110632#comment-14110632 ] Vinayakumar B commented on HDFS-6898: - Do you think this reservation should be done for

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-26 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110645#comment-14110645 ] Zesheng Wu commented on HDFS-6827: -- [~vinayrpet], I verified your patch of HADOOP-10251 on

[jira] [Updated] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-26 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6827: - Resolution: Duplicate Status: Resolved (was: Patch Available) Duplicate of HADOOP-10251. Both

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Description: In HDFS-3637, [~atm] added support for encrypting the DataTransferProtocol, it was a great work. It

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Attachment: OptimizeHdfsEncryptedTransportperformance.pdf Attach a brief design for this optimization. Our goals

[jira] [Moved] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2014-08-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu moved HBASE-11824 to HDFS-6946: -- Key: HDFS-6946 (was: HBASE-11824) Project: Hadoop HDFS (was: HBase)

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.009.patch distcp from insecure cluster (source) to secure cluster

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: (was: HDFS-6776.009.patch) distcp from insecure cluster (source) to secure cluster

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.009.patch distcp from insecure cluster (source) to secure cluster

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Summary: distcp from insecure cluster (source) to secure cluster (destination) doesn't work via

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110758#comment-14110758 ] Yongjun Zhang commented on HDFS-6776: - Uploaded patch 009. This version passes real

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Attachment: HDFS-6606.001.patch Optimize HDFS Encrypted Transport performance

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Fix Version/s: (was: 3.0.0) Target Version/s: 2.6.0 (was: 3.0.0) Affects Version/s: (was:

[jira] [Commented] (HDFS-6938) Cleanup javac warnings in FSNamesystem.java

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110798#comment-14110798 ] Charles Lamb commented on HDFS-6938: Since the diffs are only fixing unused imports and

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110805#comment-14110805 ] Yongjun Zhang commented on HDFS-6776: - BTW, I'd like to restrict the solution of the

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-26 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110927#comment-14110927 ] Juan Yu commented on HDFS-6908: --- [~jingzhao]] Thanks for reviewing patch and the discussion.

[jira] [Commented] (HDFS-6942) Fix typos in log messages

2014-08-26 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110933#comment-14110933 ] Ray Chiang commented on HDFS-6942: -- Both unit tests failures are unrelated and both tests

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-26 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6826: - Attachment: HDFS-6826v7.4.patch Test failure pass locally, scanning the test output does

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110950#comment-14110950 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110949#comment-14110949 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6773) MiniDFSCluster should skip edit log fsync by default

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110953#comment-14110953 ] Stephen Chu commented on HDFS-6773: --- The above two test failures aren't related to this

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110970#comment-14110970 ] Yongjun Zhang commented on HDFS-6694: - Hi Arpit, thanks for your earlier review, would

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111006#comment-14111006 ] Arpit Agarwal commented on HDFS-6694: - The repo is not open for commits.

[jira] [Commented] (HDFS-6912) HDFS Short-circuit read implementation throws SIGBUS from misc.Unsafe usage

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111022#comment-14111022 ] Colin Patrick McCabe commented on HDFS-6912: bq. Colin Patrick McCabe: this is

[jira] [Updated] (HDFS-6912) HDFS Short-circuit read implementation throws SIGBUS from misc.Unsafe usage

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open) HDFS

[jira] [Updated] (HDFS-6912) HDFS Short-circuit read implementation throws SIGBUS from misc.Unsafe usage

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Attachment: HDFS-6912.001.patch HDFS Short-circuit read implementation throws SIGBUS

[jira] [Updated] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Summary: SharedFileDescriptorFactory should not allocate sparse files (was: HDFS

[jira] [Commented] (HDFS-6902) FileWriter should be closed in finally block in BlockReceiver#receiveBlock()

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111035#comment-14111035 ] Colin Patrick McCabe commented on HDFS-6902: +1. thanks FileWriter should be

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6851: --- Attachment: HDFS-6851.000.patch Posting .000 patch for a testpatch run. Flush EncryptionZoneWithId

[jira] [Updated] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Description: SharedFileDescriptor factory should not allocate sparse files. Sparse

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6851: --- Target Version/s: 3.0.0 (was: fs-encryption (HADOOP-10150 and HDFS-6134)) Affects Version/s:

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111039#comment-14111039 ] Hadoop QA commented on HDFS-6606: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111058#comment-14111058 ] Hadoop QA commented on HDFS-6892: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6947) Enhance HAR integration with encryption zones

2014-08-26 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6947: - Summary: Enhance HAR integration with encryption zones Key: HDFS-6947 URL: https://issues.apache.org/jira/browse/HDFS-6947 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111064#comment-14111064 ] Hadoop QA commented on HDFS-6851: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6922: Attachment: HDFS-6922.02.patch Thanks for reviewing Vinayakumar. Good catch on #1. I updated the

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111072#comment-14111072 ] Arpit Agarwal commented on HDFS-6898: - Yes it may be helpful to have reservation for

[jira] [Commented] (HDFS-6865) Byte array native checksumming on client side (HDFS changes)

2014-08-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111085#comment-14111085 ] Todd Lipcon commented on HDFS-6865: --- Thanks for doing the diligence on the performance

[jira] [Updated] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6923: Attachment: HDFS-6923.02.patch Rebased patch. Propagate LazyPersist flag to DNs via

[jira] [Commented] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1402#comment-1402 ] Haohui Mai commented on HDFS-6892: -- Looks good to me. I think there are multiple places

[jira] [Updated] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6925: Attachment: HDFS-6925.02.patch Thanks for reviewing [~jnp]! Updated patch to remove unnecessary

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1407#comment-1407 ] Todd Lipcon commented on HDFS-6912: --- Hey Colin. Did you verify that tmpfs supports

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1418#comment-1418 ] Hadoop QA commented on HDFS-6912: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6948) DN rejects blocks if it has older UC block

2014-08-26 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6948: - Summary: DN rejects blocks if it has older UC block Key: HDFS-6948 URL: https://issues.apache.org/jira/browse/HDFS-6948 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1495#comment-1495 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6928: Attachment: HDFS-6928.02.patch Rebased patch. 'hdfs put' command should accept lazyPersist flag

[jira] [Commented] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111231#comment-14111231 ] Brandon Li commented on HDFS-6892: -- Uploaded a new patch to address Haohui's comments.

[jira] [Updated] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6892: - Attachment: HDFS-6892.004.patch Add XDR packaging method for each NFS request

[jira] [Updated] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6929: Attachment: HDFS-6929.02.patch Updated patch to allow turning off the scrubber, document the

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6851: --- Attachment: (was: HDFS-6851.000.patch) Flush EncryptionZoneWithId and add an id field to

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6851: --- Attachment: HDFS-6851.000.patch Redo the .000 patch. The last one didn't include the two deleted

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111284#comment-14111284 ] Colin Patrick McCabe commented on HDFS-6912: bq. Hey Colin. Did you verify that

[jira] [Commented] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111299#comment-14111299 ] Hadoop QA commented on HDFS-6892: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Attachment: HDFS-6912.002.patch SharedFileDescriptorFactory should not allocate

[jira] [Updated] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

2014-08-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6911: -- Attachment: h6911_20140827.patch h6911_20140827.patch: adds a new test for

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111370#comment-14111370 ] Hadoop QA commented on HDFS-6912: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6808: Attachment: HDFS-6808.000.combo.patch Add command line option to ask DataNode reload

[jira] [Updated] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6808: Attachment: HDFS-6808.000.patch Update patch to add command line supports. Add command line

[jira] [Updated] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6808: Affects Version/s: (was: 2.4.1) 2.5.0 Status: Patch

[jira] [Commented] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111455#comment-14111455 ] Stephen Chu commented on HDFS-6946: --- Similar to HDFS-5803, where TestBalancer#TIMEOUT was

[jira] [Assigned] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu reassigned HDFS-6946: - Assignee: Stephen Chu TestBalancerWithSaslDataTransfer fails in trunk

[jira] [Updated] (HDFS-6727) Refresh data volumes on DataNode based on configuration changes

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6727: Target Version/s: 3.0.0, 2.6.0 (was: 2.6.0) Affects Version/s: 2.5.0 Status:

[jira] [Updated] (HDFS-6727) Refresh data volumes on DataNode based on configuration changes

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6727: Attachment: HDFS-6727.combo.patch Update a combo patch against trunk. Refresh data volumes on

[jira] [Updated] (HDFS-6894) Add XDR parser method for each NFS response

2014-08-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6894: - Description: This can be an abstract method in NFS3Response to force the subclasses to implement. Add

[jira] [Updated] (HDFS-6894) Add XDR parser method for each NFS response

2014-08-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6894: - Environment: (was: This can be an abstract method in NFS3Response to force the subclasses to

[jira] [Updated] (HDFS-6891) Follow-on work for transparent data at rest encryption

2014-08-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6891: -- Component/s: encryption Follow-on work for transparent data at rest encryption

[jira] [Updated] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Attachment: HDFS-6912.003.patch The unit test was relying on the file position being

[jira] [Created] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-08-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-6950: Summary: Add Additional unit tests for HDFS-6581 Key: HDFS-6950 URL: https://issues.apache.org/jira/browse/HDFS-6950 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6950: Issue Type: Sub-task (was: Bug) Parent: HDFS-6581 Add Additional unit tests for HDFS-6581

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6950: Assignee: Xiaoyu Yao Add Additional unit tests for HDFS-6581

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111530#comment-14111530 ] Yongjun Zhang commented on HDFS-6776: - I'd like to emphasize that with the latest patch

[jira] [Commented] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

2014-08-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111551#comment-14111551 ] Tsz Wo Nicholas Sze commented on HDFS-6911: --- ... , maybe a more efficient way

[jira] [Commented] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

2014-08-26 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111564#comment-14111564 ] Jitendra Nath Pandey commented on HDFS-6929: +1 NN periodically unlinks lazy

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111571#comment-14111571 ] Hadoop QA commented on HDFS-6912: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111578#comment-14111578 ] Alejandro Abdelnur commented on HDFS-6776: -- IMO, enabling to work with an

[jira] [Commented] (HDFS-6920) Archival Storage: check the storage type of delNodeHintStorage when deleting a replica

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111612#comment-14111612 ] Jing Zhao commented on HDFS-6920: - The patch looks good to me. +1 Can we also have a unit

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111634#comment-14111634 ] Colin Patrick McCabe commented on HDFS-6634: The new design doc looks really

[jira] [Commented] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111637#comment-14111637 ] Jing Zhao commented on HDFS-6911: - +1 for the latest patch. Archival Storage: check if a

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111653#comment-14111653 ] Hadoop QA commented on HDFS-6808: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6469) Coordinated replication of the namespace using ConsensusNode

2014-08-26 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111655#comment-14111655 ] Sanjay Radia commented on HDFS-6469: My thoughts: * I do believe that Paxos based NN

[jira] [Commented] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111707#comment-14111707 ] Yi Liu commented on HDFS-6705: -- if the super user is the owner, then it can't access the file?

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6951: -- Attachment: HDFS-6951-testrepo.patch Saving namespace and restarting NameNode will remove existing

[jira] [Created] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-08-26 Thread Stephen Chu (JIRA)
Stephen Chu created HDFS-6951: - Summary: Saving namespace and restarting NameNode will remove existing encryption zones Key: HDFS-6951 URL: https://issues.apache.org/jira/browse/HDFS-6951 Project: Hadoop

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6951: -- Description: Currently, when users save namespace and restart the NameNode, pre-existing encryption

[jira] [Assigned] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb reassigned HDFS-6951: -- Assignee: Charles Lamb Saving namespace and restarting NameNode will remove existing

[jira] [Commented] (HDFS-6727) Refresh data volumes on DataNode based on configuration changes

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111766#comment-14111766 ] Hadoop QA commented on HDFS-6727: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6944) Archival Storage: add a test framework for testing different migration scenarios

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6944: Attachment: HDFS-6944.001.patch Update the patch: # Now for a pendingMove, a target may be scheduled to the

[jira] [Commented] (HDFS-6944) Archival Storage: add a test framework for testing different migration scenarios

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111795#comment-14111795 ] Jing Zhao commented on HDFS-6944: - The patch depends on HDFS-6899 (to be merged from trunk)

[jira] [Updated] (HDFS-6779) hdfs version subcommand is missing

2014-08-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6779: --- Summary: hdfs version subcommand is missing (was: [post-HADOOP-9902] hdfs version subcommand

  1   2   >