[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2014-09-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136853#comment-14136853 ] Zesheng Wu commented on HDFS-7068: -- bq. Indeed, right now the storage policies in

[jira] [Commented] (HDFS-7053) Failed to rollback hdfs version from 2.4.1 to 2.2.0

2014-09-17 Thread sam liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136871#comment-14136871 ] sam liu commented on HDFS-7053: --- Hi Jing, Thanks for your comments! However, I still failed

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136888#comment-14136888 ] Hadoop QA commented on HDFS-6584: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136889#comment-14136889 ] Hadoop QA commented on HDFS-6584: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6990: - Attachment: HDFS-6990.1.patch Update patch based on the feedback. Add unit test for evict/delete

[jira] [Commented] (HDFS-3862) QJM: don't require a fencer to be configured if shared storage has built-in single-writer semantics

2014-09-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136912#comment-14136912 ] Yi Liu commented on HDFS-3862: -- Thanks [~umamaheswararao] for the review. Will respond to you

[jira] [Assigned] (HDFS-6805) NPE is thrown at Namenode , for every block report sent from DN

2014-09-17 Thread Srikanth Upputuri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Upputuri reassigned HDFS-6805: --- Assignee: Srikanth Upputuri NPE is thrown at Namenode , for every block report sent

[jira] [Commented] (HDFS-6805) NPE is thrown at Namenode , for every block report sent from DN

2014-09-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137025#comment-14137025 ] Vinayakumar B commented on HDFS-6805: - Hi [~andreina] Can you specify exactly which

[jira] [Created] (HDFS-7082) When replication factor equals number of data nodes, corrupt replica will never get substituted with good replica

2014-09-17 Thread Srikanth Upputuri (JIRA)
Srikanth Upputuri created HDFS-7082: --- Summary: When replication factor equals number of data nodes, corrupt replica will never get substituted with good replica Key: HDFS-7082 URL:

[jira] [Commented] (HDFS-6851) Refactor EncryptionZoneWithId and EncryptionZone

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137086#comment-14137086 ] Hudson commented on HDFS-6851: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #683 (See

[jira] [Commented] (HDFS-6965) NN continues to issue block locations for DNs with full disks

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137088#comment-14137088 ] Hudson commented on HDFS-6965: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #683 (See

[jira] [Commented] (HDFS-6789) TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137091#comment-14137091 ] Hudson commented on HDFS-6789: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #683 (See

[jira] [Commented] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137081#comment-14137081 ] Hudson commented on HDFS-6880: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #683 (See

[jira] [Commented] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137093#comment-14137093 ] Hudson commented on HDFS-6799: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #683 (See

[jira] [Commented] (HDFS-7006) Test encryption zones with KMS

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137089#comment-14137089 ] Hudson commented on HDFS-7006: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #683 (See

[jira] [Commented] (HDFS-6851) Refactor EncryptionZoneWithId and EncryptionZone

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137237#comment-14137237 ] Hudson commented on HDFS-6851: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1899 (See

[jira] [Commented] (HDFS-7006) Test encryption zones with KMS

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137240#comment-14137240 ] Hudson commented on HDFS-7006: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1899 (See

[jira] [Commented] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137244#comment-14137244 ] Hudson commented on HDFS-6799: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1899 (See

[jira] [Commented] (HDFS-6965) NN continues to issue block locations for DNs with full disks

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137239#comment-14137239 ] Hudson commented on HDFS-6965: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1899 (See

[jira] [Commented] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137232#comment-14137232 ] Hudson commented on HDFS-6880: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1899 (See

[jira] [Commented] (HDFS-6789) TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137242#comment-14137242 ] Hudson commented on HDFS-6789: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1899 (See

[jira] [Commented] (HDFS-6851) Refactor EncryptionZoneWithId and EncryptionZone

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137264#comment-14137264 ] Hudson commented on HDFS-6851: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1874 (See

[jira] [Commented] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137259#comment-14137259 ] Hudson commented on HDFS-6880: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1874 (See

[jira] [Commented] (HDFS-6789) TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137269#comment-14137269 ] Hudson commented on HDFS-6789: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1874 (See

[jira] [Commented] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137271#comment-14137271 ] Hudson commented on HDFS-6799: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1874 (See

[jira] [Commented] (HDFS-7006) Test encryption zones with KMS

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137267#comment-14137267 ] Hudson commented on HDFS-7006: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1874 (See

[jira] [Commented] (HDFS-6965) NN continues to issue block locations for DNs with full disks

2014-09-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137266#comment-14137266 ] Hudson commented on HDFS-6965: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1874 (See

[jira] [Updated] (HDFS-6843) Create FileStatus isEncrypted() method

2014-09-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6843: --- Attachment: HDFS-6843.009.patch [~andrew.wang], That's strange. They (TestLocalFSContractOpen and

[jira] [Created] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

2014-09-17 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7083: Summary: TestDecommission#testIncludeByRegistrationName sometimes fails Key: HDFS-7083 URL: https://issues.apache.org/jira/browse/HDFS-7083 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6705: --- Attachment: HDFS-6705.008.patch [~andrew.wang], I believe this gets rid of any mention of special. I

[jira] [Updated] (HDFS-6864) Archival Storage: add user documentation

2014-09-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6864: -- Attachment: h6864_20140917b.patch Thanks Jitendra for reviewing the doc. I have

[jira] [Work started] (HDFS-7071) Adding Lazy_Persist to editsStored/editsStored.xml to fix TestOfflineEditsViewer#testStored test

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7071 started by Xiaoyu Yao. Adding Lazy_Persist to editsStored/editsStored.xml to fix

[jira] [Commented] (HDFS-6864) Archival Storage: add user documentation

2014-09-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137510#comment-14137510 ] Jing Zhao commented on HDFS-6864: - +1 for the latest patch. I will commit it shortly. We

[jira] [Resolved] (HDFS-6864) Archival Storage: add user documentation

2014-09-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6864. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks for working on this,

[jira] [Updated] (HDFS-6584) Support Archival Storage

2014-09-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6584: Attachment: h6584_20140917.patch Support Archival Storage Key:

[jira] [Commented] (HDFS-6843) Create FileStatus isEncrypted() method

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137601#comment-14137601 ] Hadoop QA commented on HDFS-6843: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6581: - Attachment: Test-Plan-for-HDFS-6581-Memory-Storage.pdf Write to single replica in memory

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137614#comment-14137614 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6843) Create FileStatus isEncrypted() method

2014-09-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6843: --- Attachment: HDFS-6843.010.patch Fixed test to not use absolute pathnames with

[jira] [Commented] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137634#comment-14137634 ] Hadoop QA commented on HDFS-6705: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7004) Update KeyProvider instantiation to create by URI

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7004: -- Attachment: hdfs-7004.002.patch I missed updating MiniKMS to also use the new conf key. The other test

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137679#comment-14137679 ] Zhe Zhang commented on HDFS-6987: - When we move these to the EZ root, what happens when the

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137682#comment-14137682 ] Zhe Zhang commented on HDFS-6987: - Update to the example: at _t1_, /ez/ is made an EZ

[jira] [Commented] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137691#comment-14137691 ] Andrew Wang commented on HDFS-6705: --- These passed for me locally, looks like the num fds

[jira] [Updated] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6705: -- Resolution: Fixed Fix Version/s: 2.6.0 Target Version/s: 2.6.0 Status:

[jira] [Updated] (HDFS-7081) Add new DistributedFileSystem API for getting all the existing storage policies

2014-09-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7081: Attachment: HDFS-7081.000.patch Changes in the patch: 1. Add a new RPC call to get all the storage policies

[jira] [Commented] (HDFS-7073) Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases.

2014-09-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137711#comment-14137711 ] Chris Nauroth commented on HDFS-7073: - [~jnp], thank you for taking a look. Regarding

[jira] [Commented] (HDFS-6843) Create FileStatus isEncrypted() method

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137742#comment-14137742 ] Hadoop QA commented on HDFS-6843: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7084: - Affects Version/s: (was: 2.6.0) HDFS-6581 FsDatasetImpl#copyBlockFiles debug

[jira] [Created] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

2014-09-17 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7084: Summary: FsDatasetImpl#copyBlockFiles debug log can be improved Key: HDFS-7084 URL: https://issues.apache.org/jira/browse/HDFS-7084 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7084: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-6581 FsDatasetImpl#copyBlockFiles debug log

[jira] [Commented] (HDFS-7073) Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases.

2014-09-17 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137762#comment-14137762 ] Jitendra Nath Pandey commented on HDFS-7073: bq. ... Maybe this whole code path

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6581: Attachment: HDFS-6581.merge.02.patch Write to single replica in memory

[jira] [Updated] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-17 Thread Zhe Zhang (JIRA)
Type: Sub-task Components: encryption Reporter: Andrew Wang Assignee: Zhe Zhang Attachments: HDFS-6987-20140917-v1.patch All files within a single EZ need to be encrypted with the same CipherSuite. Because of this, I think we can store the CipherSuite

[jira] [Updated] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-6987: Attachment: HDFS-6987-20140917-v1.patch Move CipherSuite xattr information up to the encryption zone root

[jira] [Commented] (HDFS-6843) Create FileStatus isEncrypted() method

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137855#comment-14137855 ] Colin Patrick McCabe commented on HDFS-6843: +1. Thanks, Charles and Andrew.

[jira] [Assigned] (HDFS-7078) Fix getEZForPath to work correctly with snapshots

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-7078: - Assignee: Andrew Wang Fix getEZForPath to work correctly with snapshots

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137873#comment-14137873 ] Hadoop QA commented on HDFS-6584: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137878#comment-14137878 ] Hadoop QA commented on HDFS-6584: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137882#comment-14137882 ] Colin Patrick McCabe commented on HDFS-3107: bq. The main use case as far as I

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-17 Thread Ryan Maus (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137894#comment-14137894 ] Ryan Maus commented on HDFS-3107: - bq. Most HDFS users have logic to handle partial

[jira] [Updated] (HDFS-6584) Support Archival Storage

2014-09-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6584: Attachment: h6584_20140917b.patch Support Archival Storage Key:

[jira] [Updated] (HDFS-6843) Create FileStatus isEncrypted() method

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6843: --- Resolution: Fixed Fix Version/s: 2.6.0 Target Version/s: 3.0.0, 2.6.0

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137906#comment-14137906 ] Hadoop QA commented on HDFS-6584: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137911#comment-14137911 ] Colin Patrick McCabe commented on HDFS-3107: bq. Using a record-length prefix

[jira] [Commented] (HDFS-7004) Update KeyProvider instantiation to create by URI

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137968#comment-14137968 ] Hadoop QA commented on HDFS-7004: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-7010) boot up libhdfs3 project

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-7010: -- Assignee: Colin Patrick McCabe boot up libhdfs3 project

[jira] [Commented] (HDFS-7075) hadoop-fuse-dfs fails because it cannot find JavaKeyStoreProvider$Factory

2014-09-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138000#comment-14138000 ] Alejandro Abdelnur commented on HDFS-7075: -- +1. hadoop-fuse-dfs fails because it

[jira] [Updated] (HDFS-7075) hadoop-fuse-dfs fails because it cannot find JavaKeyStoreProvider$Factory

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7075: --- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138017#comment-14138017 ] Konstantin Shvachko commented on HDFS-3107: --- Design doc makes sense. Will do.

[jira] [Updated] (HDFS-7080) Fix finalize and upgrade unit test failures

2014-09-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7080: Attachment: HDFS-7080.01.patch The failing tests intentionally create duplicate replicas and were

[jira] [Updated] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-6867: Attachment: HDFS-6867-20140917-v1.patch Future-based implementation. Note that the aforementioned new NN RPC

[jira] [Commented] (HDFS-7080) Fix finalize and upgrade unit test failures

2014-09-17 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138047#comment-14138047 ] Jitendra Nath Pandey commented on HDFS-7080: I think we should put a comment on

[jira] [Updated] (HDFS-7080) Fix finalize and upgrade unit test failures

2014-09-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7080: Attachment: HDFS-7080.02.patch Thanks Jitendra! Added suggested comment to DFSConfigKeys.java. Fix

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138059#comment-14138059 ] Hadoop QA commented on HDFS-6581: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-17 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12669520/HDFS-6867-20140917-v1.patch against trunk revision f230248. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Updated] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-6867: Attachment: HDFS-6867-20140917-v2.patch Rebased again. For DFSOutputStream, do pipeline recovery

[jira] [Commented] (HDFS-7004) Update KeyProvider instantiation to create by URI

2014-09-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138085#comment-14138085 ] Alejandro Abdelnur commented on HDFS-7004: -- one NIT, in the

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-17 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12669484/HDFS-6987-20140917-v1.patch against trunk revision ea4e2e8. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't

[jira] [Updated] (HDFS-7078) Fix getEZForPath to work correctly with snapshots

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7078: -- Attachment: hdfs-7078.001.patch It turns out that my understanding of the EZ map was off. It's actually

[jira] [Updated] (HDFS-7078) Fix listEZs to work correctly with snapshots

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7078: -- Summary: Fix listEZs to work correctly with snapshots (was: Fix getEZForPath to work correctly with

[jira] [Updated] (HDFS-7078) Fix listEZs to work correctly with snapshots

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7078: -- Description: listEZs will list encryption zones that are only present in a snapshot, rather than only

[jira] [Created] (HDFS-7085) Additional information in HDFS audit log

2014-09-17 Thread Alex Shafer (JIRA)
Alex Shafer created HDFS-7085: - Summary: Additional information in HDFS audit log Key: HDFS-7085 URL: https://issues.apache.org/jira/browse/HDFS-7085 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6581: Attachment: HDFS-6581.merge.03.patch Write to single replica in memory

[jira] [Updated] (HDFS-7085) Additional information in HDFS audit log

2014-09-17 Thread Alex Shafer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Shafer updated HDFS-7085: -- Description: cmd=rename lines (and perhaps others) should include the type- directory or regular file,

[jira] [Updated] (HDFS-7004) Update KeyProvider instantiation to create by URI

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7004: -- Attachment: hdfs-7004.004.patch Thanks Tucu, new patch fixing that prefix. I also ticked off a few more

[jira] [Updated] (HDFS-7078) Fix listEZs to work correctly with snapshots

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7078: -- Target Version/s: 2.6.0 Affects Version/s: 2.6.0 Status: Patch Available (was: Open)

[jira] [Resolved] (HDFS-7080) Fix finalize and upgrade unit test failures

2014-09-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7080. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the

[jira] [Commented] (HDFS-7085) Additional information in HDFS audit log

2014-09-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138125#comment-14138125 ] Allen Wittenauer commented on HDFS-7085: We have to be careful about modifying the

[jira] [Commented] (HDFS-6988) Make RAM disk eviction thresholds configurable

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138141#comment-14138141 ] Colin Patrick McCabe commented on HDFS-6988: Hi Arpit, I looked at the patch

[jira] [Reopened] (HDFS-6988) Make RAM disk eviction thresholds configurable

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-6988: Make RAM disk eviction thresholds configurable

[jira] [Commented] (HDFS-7047) Expose FileStatus#isEncrypted in libhdfs

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138152#comment-14138152 ] Andrew Wang commented on HDFS-7047: --- Thanks for taking this Colin, just a few review

[jira] [Commented] (HDFS-7003) Add NFS Gateway support for reading and writing to encryption zones

2014-09-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138160#comment-14138160 ] Andrew Wang commented on HDFS-7003: --- Gave it a quick look, seems fine except for lack of

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138165#comment-14138165 ] Colin Patrick McCabe commented on HDFS-6581: It's exciting to see this making

[jira] [Updated] (HDFS-7073) Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases.

2014-09-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7073: Status: Open (was: Patch Available) Allow falling back to a non-SASL connection on

[jira] [Commented] (HDFS-6727) Refresh data volumes on DataNode based on configuration changes

2014-09-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138208#comment-14138208 ] Aaron T. Myers commented on HDFS-6727: -- The latest patch looks pretty darn good to me,

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-17 Thread Andrew Wang (JIRA)
- Key: HDFS-6987 URL: https://issues.apache.org/jira/browse/HDFS-6987 Project: Hadoop HDFS Issue Type: Sub-task Components: encryption Reporter: Andrew Wang Assignee: Zhe Zhang Attachments: HDFS-6987-20140917

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138223#comment-14138223 ] Arpit Agarwal commented on HDFS-6581: - Thanks for the note. We have been busy getting

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138252#comment-14138252 ] Colin Patrick McCabe commented on HDFS-6581: bq. Benchmark the impact of CRC

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-09-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138267#comment-14138267 ] Colin Patrick McCabe commented on HDFS-6808: Hi Eddy. To summarize our offline

  1   2   >