[jira] [Commented] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851546#comment-13851546 ] Junping Du commented on HDFS-5540: -- I am reviewing this patch which seems a little out of

[jira] [Commented] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851555#comment-13851555 ] Hadoop QA commented on HDFS-4273: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851564#comment-13851564 ] Binglin Chang commented on HDFS-4273: - The test failure TestBlocksWithNotEnoughRacks is

[jira] [Commented] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851576#comment-13851576 ] Steve Loughran commented on HDFS-5675: -- # this is testing depth of directory creation

[jira] [Commented] (HDFS-5312) Generate HTTP / HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy

[ https://issues.apache.org/jira/browse/HDFS-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851594#comment-13851594 ] Hudson commented on HDFS-5312: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5674) Editlog code cleanup

[ https://issues.apache.org/jira/browse/HDFS-5674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851589#comment-13851589 ] Hudson commented on HDFS-5674: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5545) Allow specifying endpoints for listeners in HttpServer

[ https://issues.apache.org/jira/browse/HDFS-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851585#comment-13851585 ] Hudson commented on HDFS-5545: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5538) URLConnectionFactory should pick up the SSL related configuration by default

[ https://issues.apache.org/jira/browse/HDFS-5538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851593#comment-13851593 ] Hudson commented on HDFS-5538: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5536) Implement HTTP policy for Namenode and DataNode

[ https://issues.apache.org/jira/browse/HDFS-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851586#comment-13851586 ] Hudson commented on HDFS-5536: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5629) Support HTTPS in JournalNode and SecondaryNameNode

[ https://issues.apache.org/jira/browse/HDFS-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851591#comment-13851591 ] Hudson commented on HDFS-5629: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5431) support cachepool-based limit management in path-based caching

[ https://issues.apache.org/jira/browse/HDFS-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851597#comment-13851597 ] Hudson commented on HDFS-5431: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5657) race condition causes writeback state error in NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851590#comment-13851590 ] Hudson commented on HDFS-5657: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851587#comment-13851587 ] Hudson commented on HDFS-5634: -- FAILURE: Integrated in Hadoop-Yarn-trunk #425 (See

[jira] [Commented] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851611#comment-13851611 ] Binglin Chang commented on HDFS-5540: - Strange，I try the patch and it applied fine.

[jira] [Commented] (HDFS-5538) URLConnectionFactory should pick up the SSL related configuration by default

[ https://issues.apache.org/jira/browse/HDFS-5538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851705#comment-13851705 ] Hudson commented on HDFS-5538: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5431) support cachepool-based limit management in path-based caching

[ https://issues.apache.org/jira/browse/HDFS-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851710#comment-13851710 ] Hudson commented on HDFS-5431: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5536) Implement HTTP policy for Namenode and DataNode

[ https://issues.apache.org/jira/browse/HDFS-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851698#comment-13851698 ] Hudson commented on HDFS-5536: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5657) race condition causes writeback state error in NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851702#comment-13851702 ] Hudson commented on HDFS-5657: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5545) Allow specifying endpoints for listeners in HttpServer

[ https://issues.apache.org/jira/browse/HDFS-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851697#comment-13851697 ] Hudson commented on HDFS-5545: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5674) Editlog code cleanup

[ https://issues.apache.org/jira/browse/HDFS-5674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851701#comment-13851701 ] Hudson commented on HDFS-5674: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851699#comment-13851699 ] Hudson commented on HDFS-5634: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5312) Generate HTTP / HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy

[ https://issues.apache.org/jira/browse/HDFS-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851706#comment-13851706 ] Hudson commented on HDFS-5312: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5629) Support HTTPS in JournalNode and SecondaryNameNode

[ https://issues.apache.org/jira/browse/HDFS-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851703#comment-13851703 ] Hudson commented on HDFS-5629: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1616 (See

[jira] [Commented] (HDFS-5453) Support fine grain locking in FSNamesystem

[ https://issues.apache.org/jira/browse/HDFS-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851722#comment-13851722 ] Edward Bortnikov commented on HDFS-5453: Fine grained locking will not expected to

[jira] [Updated] (HDFS-5518) HDFS doesn't compile/run against Guava 1.5

[ https://issues.apache.org/jira/browse/HDFS-5518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-5518: - Attachment: HADOOP-10101-004.patch previous patch but current against trunk; CRs stripped HDFS

[jira] [Updated] (HDFS-5518) HDFS doesn't compile/run against Guava 1.5

[ https://issues.apache.org/jira/browse/HDFS-5518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-5518: - Status: Open (was: Patch Available) HDFS doesn't compile/run against Guava 1.5

[jira] [Created] (HDFS-5678) deadlock in MiniDFSCluster caused by logging

Steve Loughran created HDFS-5678: Summary: deadlock in MiniDFSCluster caused by logging Key: HDFS-5678 URL: https://issues.apache.org/jira/browse/HDFS-5678 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-5678) deadlock in MiniDFSCluster caused by logging

[ https://issues.apache.org/jira/browse/HDFS-5678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-5678: - Attachment: HADOOP-10147-001.patch deadlock in MiniDFSCluster caused by logging

[jira] [Updated] (HDFS-5678) deadlock in MiniDFSCluster caused by logging

[ https://issues.apache.org/jira/browse/HDFS-5678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-5678: - Status: Patch Available (was: Open) deadlock in MiniDFSCluster caused by logging

[jira] [Commented] (HDFS-5678) deadlock in MiniDFSCluster caused by logging

[ https://issues.apache.org/jira/browse/HDFS-5678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851769#comment-13851769 ] Hadoop QA commented on HDFS-5678: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5674) Editlog code cleanup

[ https://issues.apache.org/jira/browse/HDFS-5674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851808#comment-13851808 ] Hudson commented on HDFS-5674: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Commented] (HDFS-5657) race condition causes writeback state error in NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851809#comment-13851809 ] Hudson commented on HDFS-5657: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Commented] (HDFS-5431) support cachepool-based limit management in path-based caching

[ https://issues.apache.org/jira/browse/HDFS-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851817#comment-13851817 ] Hudson commented on HDFS-5431: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Commented] (HDFS-5545) Allow specifying endpoints for listeners in HttpServer

[ https://issues.apache.org/jira/browse/HDFS-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851804#comment-13851804 ] Hudson commented on HDFS-5545: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Commented] (HDFS-5538) URLConnectionFactory should pick up the SSL related configuration by default

[ https://issues.apache.org/jira/browse/HDFS-5538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851812#comment-13851812 ] Hudson commented on HDFS-5538: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Commented] (HDFS-5312) Generate HTTP / HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy

[ https://issues.apache.org/jira/browse/HDFS-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851813#comment-13851813 ] Hudson commented on HDFS-5312: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Created] (HDFS-5679) TestCacheDirectives should handle the case where native code is not available

Ted Yu created HDFS-5679: Summary: TestCacheDirectives should handle the case where native code is not available Key: HDFS-5679 URL: https://issues.apache.org/jira/browse/HDFS-5679 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5536) Implement HTTP policy for Namenode and DataNode

[ https://issues.apache.org/jira/browse/HDFS-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851805#comment-13851805 ] Hudson commented on HDFS-5536: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Commented] (HDFS-5629) Support HTTPS in JournalNode and SecondaryNameNode

[ https://issues.apache.org/jira/browse/HDFS-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851810#comment-13851810 ] Hudson commented on HDFS-5629: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851806#comment-13851806 ] Hudson commented on HDFS-5634: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1642 (See

[jira] [Created] (HDFS-5680) Double-JSON-encoding of JMX attributes yields malformed JSON

Eric Sirianni created HDFS-5680: --- Summary: Double-JSON-encoding of JMX attributes yields malformed JSON Key: HDFS-5680 URL: https://issues.apache.org/jira/browse/HDFS-5680 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Buddy updated HDFS-5434: Attachment: BlockPlacementPolicyMinPipelineSizeWithNodeGroup.java

[jira] [Created] (HDFS-5681) renewLease should not hold fsn write lock

Daryn Sharp created HDFS-5681: - Summary: renewLease should not hold fsn write lock Key: HDFS-5681 URL: https://issues.apache.org/jira/browse/HDFS-5681 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-5681) renewLease should not hold fsn write lock

[ https://issues.apache.org/jira/browse/HDFS-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-5681: - Assignee: Daryn Sharp renewLease should not hold fsn write lock

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851872#comment-13851872 ] Kihwal Lee commented on HDFS-5449: -- bq. should we do anything different if ipAddr == null

[jira] [Updated] (HDFS-5681) renewLease should not hold fsn write lock

[ https://issues.apache.org/jira/browse/HDFS-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-5681: -- Status: Patch Available (was: Open) renewLease should not hold fsn write lock

[jira] [Updated] (HDFS-5681) renewLease should not hold fsn write lock

[ https://issues.apache.org/jira/browse/HDFS-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-5681: -- Attachment: HDFS-5681.patch I believe the change is truly as simple as changing to a read lock. The

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851913#comment-13851913 ] Andrew Wang commented on HDFS-5676: --- Sounds good, I'm +1 either way on synchronization if

[jira] [Assigned] (HDFS-5220) Expose group resolution time as metric

[ https://issues.apache.org/jira/browse/HDFS-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang reassigned HDFS-5220: - Assignee: Jimmy Xiang Expose group resolution time as metric

[jira] [Work started] (HDFS-5617) NameNode: enforce maximum number of ACL entries.

[ https://issues.apache.org/jira/browse/HDFS-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5617 started by Chris Nauroth. NameNode: enforce maximum number of ACL entries. Key:

[jira] [Assigned] (HDFS-5617) NameNode: enforce maximum number of ACL entries.

[ https://issues.apache.org/jira/browse/HDFS-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HDFS-5617: --- Assignee: Chris Nauroth It looks easy enough to address this as part of the HDFS-5673 patch,

[jira] [Commented] (HDFS-5681) renewLease should not hold fsn write lock

[ https://issues.apache.org/jira/browse/HDFS-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852002#comment-13852002 ] Hadoop QA commented on HDFS-5681: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5673) Implement logic for modification of ACLs.

[ https://issues.apache.org/jira/browse/HDFS-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852021#comment-13852021 ] Chris Nauroth commented on HDFS-5673: - One more note. From looking at this patch

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Attachment: HDFS-5662.002.patch Can't decommission a DataNode due to file's replication factor larger

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852036#comment-13852036 ] Arpit Agarwal commented on HDFS-5434: - Buddy, I will take a look at the new

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852038#comment-13852038 ] Brandon Li commented on HDFS-5662: -- Thank you, Arpit. The new patch has the indentation

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852055#comment-13852055 ] Arpit Agarwal commented on HDFS-5662: - +1 for the updated patch. Can't decommission a

[jira] [Updated] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5676: --- Attachment: HDFS-5676.003.patch yeah, I think this is a case where AtomicReference is

[jira] [Commented] (HDFS-5483) Make reportDiff resilient to malformed block reports

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852104#comment-13852104 ] Buddy commented on HDFS-5483: - We are hitting this running against trunk with well formed block

[jira] [Created] (HDFS-5682) Heterogeneous Storage phase - APIs to expose Storage Types

Arpit Agarwal created HDFS-5682: --- Summary: Heterogeneous Storage phase - APIs to expose Storage Types Key: HDFS-5682 URL: https://issues.apache.org/jira/browse/HDFS-5682 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5453) Support fine grain locking in FSNamesystem

[ https://issues.apache.org/jira/browse/HDFS-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852114#comment-13852114 ] Suresh Srinivas commented on HDFS-5453: --- I agree with [~shv]. In namenode write

[jira] [Commented] (HDFS-5682) Heterogeneous Storage phase - APIs to expose Storage Types

[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852121#comment-13852121 ] Arpit Agarwal commented on HDFS-5682: - An updated design doc will be posted soon -

[jira] [Commented] (HDFS-5483) Make reportDiff resilient to malformed block reports

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852118#comment-13852118 ] Arpit Agarwal commented on HDFS-5483: - Thanks for reporting, I'll take a look. While

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852126#comment-13852126 ] Arpit Agarwal commented on HDFS-2832: - Phase 2 tasks will be tracked under HDFS-5682.

[jira] [Updated] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5682: Summary: Heterogeneous Storage phase 2 - APIs to expose Storage Types (was: Heterogeneous Storage

[jira] [Updated] (HDFS-4986) Namenode webUI changes to incorporate storage type

[ https://issues.apache.org/jira/browse/HDFS-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4986: Parent Issue: HDFS-5682 (was: HDFS-2832) Namenode webUI changes to incorporate storage type

[jira] [Updated] (HDFS-5391) writeBlock should accept a target storage directory

[ https://issues.apache.org/jira/browse/HDFS-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5391: Parent Issue: HDFS-5682 (was: HDFS-2832) writeBlock should accept a target storage directory

[jira] [Updated] (HDFS-5183) Combine ReplicaPlacementPolicy with VolumeChoosingPolicy together to have a global view in choosing DN storage for replica.

[ https://issues.apache.org/jira/browse/HDFS-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5183: Parent Issue: HDFS-5682 (was: HDFS-2832) Combine ReplicaPlacementPolicy with VolumeChoosingPolicy

[jira] [Updated] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5178: Parent Issue: HDFS-5682 (was: HDFS-2832) DataTransferProtocol changes for supporting mutiple

[jira] [Updated] (HDFS-4989) Balancer needs to consider storage type in balancing

[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4989: Parent Issue: HDFS-5682 (was: HDFS-2832) Balancer needs to consider storage type in balancing

[jira] [Commented] (HDFS-5483) Make reportDiff resilient to malformed block reports

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852131#comment-13852131 ] Buddy commented on HDFS-5483: - I want to clarify. I had the error case wrong in the above

[jira] [Updated] (HDFS-5229) Add a storage type attribute to file

[ https://issues.apache.org/jira/browse/HDFS-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5229: Parent Issue: HDFS-5682 (was: HDFS-2832) Add a storage type attribute to file

[jira] [Updated] (HDFS-5151) Add test case for commitBlockSynchronization with invalid Storage

[ https://issues.apache.org/jira/browse/HDFS-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5151: Parent Issue: HDFS-5682 (was: HDFS-2832) Add test case for commitBlockSynchronization with

[jira] [Updated] (HDFS-5423) Verify initializations of LocatedBlock/RecoveringBlock

[ https://issues.apache.org/jira/browse/HDFS-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5423: Parent Issue: HDFS-5682 (was: HDFS-2832) Verify initializations of LocatedBlock/RecoveringBlock

[jira] [Updated] (HDFS-5264) Consider renaming StorageID

[ https://issues.apache.org/jira/browse/HDFS-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5264: Parent Issue: HDFS-5682 (was: HDFS-2832) Consider renaming StorageID ---

[jira] [Commented] (HDFS-5483) Make reportDiff resilient to malformed block reports

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852142#comment-13852142 ] Arpit Agarwal commented on HDFS-5483: - {quote} It looks like we have two replicas of

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Fix Version/s: 3.0.0 Enable support for heterogeneous storages in HDFS

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Status: Open (was: Patch Available) allow BlockReaderLocal to switch between

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Attachment: HDFS-5634.009.branch-2.patch posted patch for branch-2 allow

[jira] [Updated] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5667: Summary: Include DatanodeStorage in StorageReport (was: StorageType and State in

[jira] [Updated] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5449: - Attachment: HDFS-5449.trunk.patch The new patch throws an IOException if ipAddr or xferPort cannot be set

[jira] [Updated] (HDFS-5496) Make replication queue initialization asynchronous

[ https://issues.apache.org/jira/browse/HDFS-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5496: Resolution: Fixed Fix Version/s: HDFS-5535 (Rolling upgrades) Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852179#comment-13852179 ] Hadoop QA commented on HDFS-5662: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5673) Implement logic for modification of ACLs.

[ https://issues.apache.org/jira/browse/HDFS-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852200#comment-13852200 ] Haohui Mai commented on HDFS-5673: -- Acl: Acl.Builder can initialize the entries field

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852204#comment-13852204 ] Daryn Sharp commented on HDFS-5449: --- Can: {code}xferPort =

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Target Version/s: 2.4.0 (was: 3.0.0) Affects Version/s: (was: 3.0.0)

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852229#comment-13852229 ] Jing Zhao commented on HDFS-5449: - Do we also want to add some javadoc/comment for the

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852227#comment-13852227 ] Brandon Li commented on HDFS-5662: -- The unit test passed in my local test. Can't

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852226#comment-13852226 ] Hadoop QA commented on HDFS-5676: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5220) Expose group resolution time as metric

[ https://issues.apache.org/jira/browse/HDFS-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-5220: -- Attachment: hdfs-5220.patch Add the first version patch. One drawback is that the quantile info is in

[jira] [Updated] (HDFS-5220) Expose group resolution time as metric

[ https://issues.apache.org/jira/browse/HDFS-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-5220: -- Status: Patch Available (was: Open) Expose group resolution time as metric

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Issue Type: Improvement (was: Bug) Can't decommission a DataNode due to file's replication factor

[jira] [Created] (HDFS-5683) Better audit log messages for caching operations

Andrew Wang created HDFS-5683: - Summary: Better audit log messages for caching operations Key: HDFS-5683 URL: https://issues.apache.org/jira/browse/HDFS-5683 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852241#comment-13852241 ] Brandon Li commented on HDFS-5662: -- I've committed the patch. Thank you, Arpit, for

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852245#comment-13852245 ] Hudson commented on HDFS-5662: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4912 (See

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Can't

[jira] [Updated] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5667: Attachment: h5667.02.patch Patch to add DatanodeStorage to storage reports. Also has a couple of

[jira] [Commented] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852254#comment-13852254 ] Arpit Agarwal commented on HDFS-5667: - [~sirianni], I added a test case but would be

[jira] [Commented] (HDFS-5636) Enforce a max TTL per cache pool

[ https://issues.apache.org/jira/browse/HDFS-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852261#comment-13852261 ] Andrew Wang commented on HDFS-5636: --- I actually thought about this a bit more, and in

[jira] [Updated] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5667: Attachment: h5667.03.patch Update patch to remove blank comment lines. Include DatanodeStorage in

  1   2   >