[jira] [Commented] (HDFS-6665) Add tests for XAttrs in combination with viewfs

2014-07-30 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078956#comment-14078956 ] Stephen Chu commented on HDFS-6665: --- Thank you, Andrew! Add tests for XAttrs in

[jira] [Updated] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6778: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-6665) Add tests for XAttrs in combination with viewfs

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078960#comment-14078960 ] Hudson commented on HDFS-6665: -- FAILURE: Integrated in Hadoop-trunk-Commit #5984 (See

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078961#comment-14078961 ] Hudson commented on HDFS-6778: -- FAILURE: Integrated in Hadoop-trunk-Commit #5984 (See

[jira] [Commented] (HDFS-6767) Cannot remove directory within encryption zone to Trash

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078964#comment-14078964 ] Andrew Wang commented on HDFS-6767: --- Since Stephen's already got this posted to

[jira] [Commented] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078980#comment-14078980 ] Hadoop QA commented on HDFS-6685: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079042#comment-14079042 ] Andrew Wang commented on HDFS-6768: --- +1 TestBlockRecovery, TestRefreshCallQueue and

[jira] [Commented] (HDFS-289) HDFS should blacklist datanodes that are not performing well

2014-07-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079048#comment-14079048 ] Liang Xie commented on HDFS-289: We just hit a HBase write performance degradation several

[jira] [Commented] (HDFS-6692) Add more HDFS encryption tests

2014-07-30 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079049#comment-14079049 ] Stephen Chu commented on HDFS-6692: --- Hi Andrew, nice tests. Nits: Can remove the

[jira] [Assigned] (HDFS-6773) MiniDFSCluster can run dramatically faster

2014-07-30 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu reassigned HDFS-6773: - Assignee: Stephen Chu Hi, [~daryn]. Thanks for filing this. I can take it on. If you were already

[jira] [Created] (HDFS-6780) Batch the encryption zones listing API

2014-07-30 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6780: - Summary: Batch the encryption zones listing API Key: HDFS-6780 URL: https://issues.apache.org/jira/browse/HDFS-6780 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Work started] (HDFS-6692) Add more HDFS encryption tests

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6692 started by Andrew Wang. Add more HDFS encryption tests -- Key: HDFS-6692 URL:

[jira] [Updated] (HDFS-6692) Add more HDFS encryption tests

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6692: -- Attachment: hdfs-6692.002.patch Good ideas, new patch attached. I had my right margin set at 80 chars

[jira] [Created] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

2014-07-30 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-6781: --- Summary: Separate HDFS commands from CommandsManual.apt.vm Key: HDFS-6781 URL: https://issues.apache.org/jira/browse/HDFS-6781 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6782) Improve FS editlog logSync

2014-07-30 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6782: Summary: Improve FS editlog logSync Key: HDFS-6782 URL: https://issues.apache.org/jira/browse/HDFS-6782 Project: Hadoop HDFS Issue Type: Improvement Components:

[jira] [Created] (HDFS-6783) Fix not really wait for rescan in HDFS CacheReplicationModitor

2014-07-30 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6783: Summary: Fix not really wait for rescan in HDFS CacheReplicationModitor Key: HDFS-6783 URL: https://issues.apache.org/jira/browse/HDFS-6783 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-30 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079148#comment-14079148 ] Vinayakumar B commented on HDFS-6685: - One doubt I have. After this patch, Balancer's

[jira] [Created] (HDFS-6785) Should not be able to create encryption zone using path to a non-directory file

2014-07-30 Thread Stephen Chu (JIRA)
Stephen Chu created HDFS-6785: - Summary: Should not be able to create encryption zone using path to a non-directory file Key: HDFS-6785 URL: https://issues.apache.org/jira/browse/HDFS-6785 Project:

[jira] [Created] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-30 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6784: Summary: Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times. Key: HDFS-6784 URL: https://issues.apache.org/jira/browse/HDFS-6784

[jira] [Created] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-30 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6786: Summary: Fix potential issue of cache refresh interval Key: HDFS-6786 URL: https://issues.apache.org/jira/browse/HDFS-6786 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079194#comment-14079194 ] Hudson commented on HDFS-6778: -- FAILURE: Integrated in Hadoop-Yarn-trunk #628 (See

[jira] [Commented] (HDFS-6665) Add tests for XAttrs in combination with viewfs

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079193#comment-14079193 ] Hudson commented on HDFS-6665: -- FAILURE: Integrated in Hadoop-Yarn-trunk #628 (See

[jira] [Created] (HDFS-6787) Remove duplicate code in FSDirectory#unprotectedConcat

2014-07-30 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6787: Summary: Remove duplicate code in FSDirectory#unprotectedConcat Key: HDFS-6787 URL: https://issues.apache.org/jira/browse/HDFS-6787 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6787) Remove duplicate code in FSDirectory#unprotectedConcat

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6787: - Attachment: HDFS-6787.001.patch Remove duplicate code in FSDirectory#unprotectedConcat

[jira] [Updated] (HDFS-6787) Remove duplicate code in FSDirectory#unprotectedConcat

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6787: - Status: Patch Available (was: Open) Remove duplicate code in FSDirectory#unprotectedConcat

[jira] [Assigned] (HDFS-6785) Should not be able to create encryption zone using path to a non-directory file

2014-07-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb reassigned HDFS-6785: -- Assignee: Charles Lamb Should not be able to create encryption zone using path to a

[jira] [Updated] (HDFS-6783) Fix not really wait for rescan in HDFS CacheReplicationModitor

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6783: - Attachment: HDFS-6783.001.patch Fix not really wait for rescan in HDFS CacheReplicationModitor

[jira] [Updated] (HDFS-6783) Fix not really wait for rescan in HDFS CacheReplicationModitor

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6783: - Status: Patch Available (was: Open) Fix not really wait for rescan in HDFS CacheReplicationModitor

[jira] [Updated] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6784: - Attachment: HDFS-6784.001.patch We should set the {{needsRescan}} when real rescan starts and protected by

[jira] [Updated] (HDFS-6782) Improve FS editlog logSync

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6782: - Attachment: HDFS-6782.001.patch Improve FS editlog logSync -- Key:

[jira] [Updated] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6784: - Status: Patch Available (was: Open) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it

[jira] [Updated] (HDFS-6782) Improve FS editlog logSync

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6782: - Status: Patch Available (was: Open) Improve FS editlog logSync --

[jira] [Commented] (HDFS-6665) Add tests for XAttrs in combination with viewfs

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079288#comment-14079288 ] Hudson commented on HDFS-6665: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1821 (See

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079289#comment-14079289 ] Hudson commented on HDFS-6778: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1821 (See

[jira] [Updated] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-07-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-4629: - Resolution: Fixed Fix Version/s: 2.6.0 Target Version/s: 2.0.4-alpha, 3.0.0

[jira] [Commented] (HDFS-6773) MiniDFSCluster can run dramatically faster

2014-07-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079327#comment-14079327 ] Daryn Sharp commented on HDFS-6773: --- Go right ahead! My cycles are extremely limited so

[jira] [Commented] (HDFS-6782) Improve FS editlog logSync

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079326#comment-14079326 ] Hadoop QA commented on HDFS-6782: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6665) Add tests for XAttrs in combination with viewfs

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079336#comment-14079336 ] Hudson commented on HDFS-6665: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1847 (See

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079338#comment-14079338 ] Hudson commented on HDFS-6778: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1847 (See

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079347#comment-14079347 ] Hudson commented on HDFS-4629: -- FAILURE: Integrated in Hadoop-trunk-Commit #5985 (See

[jira] [Created] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-30 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-6788: --- Summary: Improve synchronization in BPOfferService with read write lock Key: HDFS-6788 URL: https://issues.apache.org/jira/browse/HDFS-6788 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6788: Component/s: datanode Improve synchronization in BPOfferService with read write lock

[jira] [Commented] (HDFS-6787) Remove duplicate code in FSDirectory#unprotectedConcat

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079372#comment-14079372 ] Hadoop QA commented on HDFS-6787: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079374#comment-14079374 ] Tsz Wo Nicholas Sze commented on HDFS-6685: --- ... But I haven't seen this

[jira] [Updated] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6685: -- Attachment: h6685_20140730b.patch h6685_20140730b.patch: removes unused

[jira] [Created] (HDFS-6789) TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7

2014-07-30 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-6789: Summary: TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7 Key: HDFS-6789 URL:

[jira] [Commented] (HDFS-6789) TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7

2014-07-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079386#comment-14079386 ] Rushabh S Shah commented on HDFS-6789: -- Running

[jira] [Commented] (HDFS-6783) Fix not really wait for rescan in HDFS CacheReplicationModitor

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079400#comment-14079400 ] Hadoop QA commented on HDFS-6783: - {color:red}-1 overall{color}. Here are the results of

[jira] [Work started] (HDFS-6785) Should not be able to create encryption zone using path to a non-directory file

2014-07-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6785 started by Charles Lamb. Should not be able to create encryption zone using path to a non-directory file

[jira] [Commented] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079457#comment-14079457 ] Hadoop QA commented on HDFS-6784: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

2014-07-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6772: -- Attachment: HDFS-6772.patch Here is the patch. 1. After DN reregistration with NN, Heartbeat will come before

[jira] [Updated] (HDFS-6785) Should not be able to create encryption zone using path to a non-directory file

2014-07-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6785: --- Attachment: HDFS-6785.001.patch Good catch Stephen. Attached is a patch which addresses the issue.

[jira] [Commented] (HDFS-1051) Umbrella Jira for Scaling the HDFS Name Service

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079484#comment-14079484 ] Allen Wittenauer commented on HDFS-1051: I suspect the work here is done, but it

[jira] [Commented] (HDFS-1056) Multi-node RPC deadlocks during block recovery

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079488#comment-14079488 ] Allen Wittenauer commented on HDFS-1056: Ping! I suspect fixed though.

[jira] [Updated] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6788: Description: Threads in DN (DataXceiver, PacketResponder, Async disk worker etc) may block at

[jira] [Updated] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6788: Attachment: HDFS-6788.001.patch Improve synchronization in BPOfferService with read write lock

[jira] [Updated] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6788: Status: Patch Available (was: Open) Upload patch 001. Improve synchronization in BPOfferService

[jira] [Resolved] (HDFS-1060) Append/flush should support concurrent tailer use case

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1060. Resolution: Won't Fix Closing as Won't Fix. If you need append, use 2.x+ Append/flush

[jira] [Resolved] (HDFS-1059) completeFile loops forever if the block's only replica has become corrupt

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1059. Resolution: Cannot Reproduce completeFile loops forever if the block's only replica has

[jira] [Resolved] (HDFS-1064) NN Availability - umbrella Jira

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1064. Resolution: Fixed Closing this as fixed, given HA is in 2.x. NN Availability - umbrella

[jira] [Resolved] (HDFS-1066) Make HDFS tests pass using Avro RPC

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1066. Resolution: Won't Fix Closing as Won't Fix. We've already switched to protobuf. Make

[jira] [Resolved] (HDFS-1069) Write HDFS wire protocols in AVRO IDL

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1069. Resolution: Won't Fix Closing as Won't Fix. We've already switched to protobuf. Write

[jira] [Commented] (HDFS-6692) Add more HDFS encryption tests

2014-07-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079577#comment-14079577 ] Charles Lamb commented on HDFS-6692: This is a nice piece of work. My comments are

[jira] [Resolved] (HDFS-1086) Percentage bar in dfsnodelist.jsp shows wrong values

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1086. Resolution: Incomplete UI has change a lot since this jira. Closing as stale. Percentage

[jira] [Updated] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-07-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6570: Issue Type: Improvement (was: Bug) add api that enables checking if a user has certain

[jira] [Commented] (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079618#comment-14079618 ] Allen Wittenauer commented on HDFS-1094: With pluggable block placement, I'm not

[jira] [Updated] (HDFS-6717) Jira HDFS-5804 breaks default nfs-gateway behavior for unsecured config

2014-07-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6717: - Attachment: HDFS-6717.more-change.patch Jira HDFS-5804 breaks default nfs-gateway behavior for unsecured

[jira] [Commented] (HDFS-5804) HDFS NFS Gateway fails to mount and proxy when using Kerberos

2014-07-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079625#comment-14079625 ] Brandon Li commented on HDFS-5804: -- {quote}... the first time I went through the

[jira] [Resolved] (HDFS-1097) Many allocated memory pointera of libhdfs maybe null, which maybe cause coredump.

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1097. Resolution: Fixed Stale, given how much of libhdfs has been rewritten. Many allocated

[jira] [Updated] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-07-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6570: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079639#comment-14079639 ] Hudson commented on HDFS-6570: -- FAILURE: Integrated in Hadoop-trunk-Commit #5986 (See

[jira] [Updated] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

2014-07-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6772: -- Assignee: Ming Ma Status: Patch Available (was: Open) Get DNs out of blockContentsStale==true state

[jira] [Updated] (HDFS-1105) Balancer improvement

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1105: --- Fix Version/s: (was: 0.24.0) Status: Open (was: Patch Available) Balancer

[jira] [Resolved] (HDFS-1105) Balancer improvement

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1105. Resolution: Incomplete A lot has changed in balancer since this was written up. Closing as

[jira] [Commented] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079686#comment-14079686 ] Hadoop QA commented on HDFS-6685: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6717) Jira HDFS-5804 breaks default nfs-gateway behavior for unsecured config

2014-07-30 Thread Jeff Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079698#comment-14079698 ] Jeff Hansen commented on HDFS-6717: --- Looks good! By the way, when I said I was having

[jira] [Resolved] (HDFS-1113) Allow users with write access to a directory to change ownership of its subdirectories/files

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1113. Resolution: Fixed There are multiple ways to close this one. Pick your preferred option:

[jira] [Updated] (HDFS-6692) Add more HDFS encryption tests

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6692: -- Attachment: hdfs-6692.003.patch Add more HDFS encryption tests --

[jira] [Commented] (HDFS-6692) Add more HDFS encryption tests

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079710#comment-14079710 ] Andrew Wang commented on HDFS-6692: --- The fault injector is a pattern we use elsewhere in

[jira] [Commented] (HDFS-6785) Should not be able to create encryption zone using path to a non-directory file

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079713#comment-14079713 ] Andrew Wang commented on HDFS-6785: --- We should be asserting that the thing is a

[jira] [Commented] (HDFS-6692) Add more HDFS encryption tests

2014-07-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079725#comment-14079725 ] Charles Lamb commented on HDFS-6692: Nice. Thanks for remod'ing it. Nit: extra newline

[jira] [Updated] (HDFS-6768) Fix a few unit tests that use hard-coded port numbers

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Summary: Fix a few unit tests that use hard-coded port numbers (was: TestBlockRecovery,

[jira] [Updated] (HDFS-6768) Fix a few unit tests that use hard-coded port numbers

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6768: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target

[jira] [Resolved] (HDFS-1115) SocketException: Protocol not available for some JVMs

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1115. Resolution: Won't Fix SocketException: Protocol not available for some JVMs

[jira] [Resolved] (HDFS-6692) Add more HDFS encryption tests

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6692. --- Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Thanks for

[jira] [Commented] (HDFS-6768) Fix a few unit tests that use hard-coded port numbers

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079744#comment-14079744 ] Hudson commented on HDFS-6768: -- FAILURE: Integrated in Hadoop-trunk-Commit #5988 (See

[jira] [Updated] (HDFS-6717) Jira HDFS-5804 breaks default nfs-gateway behavior for unsecured config

2014-07-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6717: - Attachment: HDFS-6717.more-change2.patch Jira HDFS-5804 breaks default nfs-gateway behavior for

[jira] [Commented] (HDFS-6717) Jira HDFS-5804 breaks default nfs-gateway behavior for unsecured config

2014-07-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079763#comment-14079763 ] Brandon Li commented on HDFS-6717: -- {quote}Then I realized groups had nothing to do with

[jira] [Created] (HDFS-6790) DFSUtil Should Use configuration.getPassword for SSL passwords

2014-07-30 Thread Larry McCay (JIRA)
Larry McCay created HDFS-6790: - Summary: DFSUtil Should Use configuration.getPassword for SSL passwords Key: HDFS-6790 URL: https://issues.apache.org/jira/browse/HDFS-6790 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-30 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079773#comment-14079773 ] Vinayakumar B commented on HDFS-6685: - Oops. I didn't see it. Thanks for b pointing me

[jira] [Resolved] (HDFS-1128) Allow TestDFSIO to process multiple files for each map

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1128. Resolution: Fixed Allow TestDFSIO to process multiple files for each map

[jira] [Resolved] (HDFS-1139) Forward-port TestFileAppend4 tests from 20-append branch

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1139. Resolution: Fixed Forward-port TestFileAppend4 tests from 20-append branch

[jira] [Updated] (HDFS-1152) appendFile does not recheck lease in second synchronized block

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1152: --- Resolution: Incomplete Status: Resolved (was: Patch Available) Likely stale.

[jira] [Resolved] (HDFS-1137) Name node is using the write-ahead log improperly

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1137. Resolution: Not a Problem Name node is using the write-ahead log improperly

[jira] [Resolved] (HDFS-1135) Please sort the various options alphabetically in the output of hadoop fs -help

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1135. Resolution: Fixed Please sort the various options alphabetically in the output of hadoop

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079826#comment-14079826 ] Arpit Agarwal commented on HDFS-6441: - Benoy, couple of minor issues with your latest

[jira] [Created] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

2014-07-30 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6791: - Summary: A block could remain under replicated if all of its replicas are on decommissioned nodes Key: HDFS-6791 URL: https://issues.apache.org/jira/browse/HDFS-6791 Project:

[jira] [Resolved] (HDFS-1166) 0.21 nightly snapshot build has dependency on 0.22 snapshot

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1166. Resolution: Fixed Likely fixed. 0.21 nightly snapshot build has dependency on 0.22

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079840#comment-14079840 ] Allen Wittenauer commented on HDFS-6634: In conversations I've had around this idea

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079842#comment-14079842 ] Hadoop QA commented on HDFS-6788: - {color:red}-1 overall{color}. Here are the results of

  1   2   >