[jira] [Updated] (HDFS-4265) BKJM doesn't take advantage of speculative reads

[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4265: --- Attachment: 0006-HDFS-4265.patch BKJM doesn't take advantage of speculative reads

[jira] [Commented] (HDFS-7603) The background replication queue initialization may not let others run

[ https://issues.apache.org/jira/browse/HDFS-7603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298754#comment-14298754 ] Hudson commented on HDFS-7603: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2040 (See

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298736#comment-14298736 ] Kihwal Lee commented on HDFS-7707: -- How is {{isFileDeleted()}} check defeated? The check

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298796#comment-14298796 ] Yongjun Zhang commented on HDFS-7707: - Hi [~brahmareddy] and [~kihwal], Thanks a lot

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299353#comment-14299353 ] Hadoop QA commented on HDFS-7411: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299229#comment-14299229 ] Xiaoyu Yao commented on HDFS-7684: -- Thanks [~tianyin] for reporting this. The one that you

[jira] [Commented] (HDFS-7710) Remove dead code in BackupImage.java

[ https://issues.apache.org/jira/browse/HDFS-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299260#comment-14299260 ] Hadoop QA commented on HDFS-7710: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7714) Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.

[ https://issues.apache.org/jira/browse/HDFS-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299338#comment-14299338 ] Kihwal Lee commented on HDFS-7714: -- On a related note, I've seen similar symproms when the

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Attachment: hdfs-7712.001.patch Patch attached. [~kihwal] willing to review? Switch

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Status: Patch Available (was: Open) Switch blockStateChangeLog to use slf4j

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7608: Summary: hdfs dfsclient newConnectedPeer has no write timeout (was: hdfs dfsclient

[jira] [Commented] (HDFS-7710) Remove dead code in BackupImage.java

[ https://issues.apache.org/jira/browse/HDFS-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299094#comment-14299094 ] Haohui Mai commented on HDFS-7710: -- +1 pending jenkins. Remove dead code in

[jira] [Commented] (HDFS-7706) Switch BlockManager logging to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299122#comment-14299122 ] Hudson commented on HDFS-7706: -- FAILURE: Integrated in Hadoop-trunk-Commit #6970 (See

[jira] [Assigned] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-7608: Assignee: Xiaoyu Yao hdfs dfsclient newConnectedPeer has no write timeout

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299233#comment-14299233 ] Tianyin Xu commented on HDFS-7684: -- Yes, exactly. It seems that Hadoop has a bunch of such

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7608: - Attachment: HDFS-7608.0.patch Post a patch for DFSClient newConnectedPeer write timeout. hdfs dfsclient

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299227#comment-14299227 ] Chris Nauroth commented on HDFS-2882: - I'm linking this to HDFS-7714, where I reported

[jira] [Created] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

Zhe Zhang created HDFS-7715: --- Summary: Implement the Hitchhiker erasure coding algorithm Key: HDFS-7715 URL: https://issues.apache.org/jira/browse/HDFS-7715 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299300#comment-14299300 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- This statement is false.

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299221#comment-14299221 ] Yongjun Zhang commented on HDFS-7707: - Thank you so much Kihwal! What happened was,

[jira] [Created] (HDFS-7714) Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.

Chris Nauroth created HDFS-7714: --- Summary: Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode. Key: HDFS-7714 URL:

[jira] [Updated] (HDFS-5782) BlockListAsLongs should take lists of Replicas rather than concrete classes

[ https://issues.apache.org/jira/browse/HDFS-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-5782: - Attachment: HDFS-5782-branch-2.patch Added a patch for branch-2. BlockListAsLongs should take lists of

[jira] [Commented] (HDFS-7709) Fix Findbug Warnings

[ https://issues.apache.org/jira/browse/HDFS-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298917#comment-14298917 ] Rakesh R commented on HDFS-7709: I could see lots of findbug warning showing in the

[jira] [Commented] (HDFS-7658) HDFS Space Quota not working as expected

[ https://issues.apache.org/jira/browse/HDFS-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298938#comment-14298938 ] Xiaoyu Yao commented on HDFS-7658: -- bq. HDFS doesnt know the complete size of the file

[jira] [Commented] (HDFS-7658) HDFS Space Quota not working as expected

[ https://issues.apache.org/jira/browse/HDFS-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298936#comment-14298936 ] Xiaoyu Yao commented on HDFS-7658: -- bq. HDFS doesnt know the complete size of the file

[jira] [Created] (HDFS-7710) Remove dead code in BackupImage.java

Xiaoyu Yao created HDFS-7710: Summary: Remove dead code in BackupImage.java Key: HDFS-7710 URL: https://issues.apache.org/jira/browse/HDFS-7710 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7710) Remove dead code in BackupImage.java

[ https://issues.apache.org/jira/browse/HDFS-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7710: - Status: Patch Available (was: Open) Remove dead code in BackupImage.java

[jira] [Commented] (HDFS-7658) HDFS Space Quota not working as expected

[ https://issues.apache.org/jira/browse/HDFS-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298939#comment-14298939 ] Xiaoyu Yao commented on HDFS-7658: -- bq. HDFS doesnt know the complete size of the file

[jira] [Updated] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7711: --- Description: 1) dfs.namenode.hosts / dfs.namenode.hosts.exclude. I did not seen

[jira] [Updated] (HDFS-7706) Switch BlockManager logging to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7706: -- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Created] (HDFS-7713) Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs, and setting replication

Ravi Prakash created HDFS-7713: -- Summary: Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs, and setting replication Key: HDFS-7713 URL: https://issues.apache.org/jira/browse/HDFS-7713

[jira] [Updated] (HDFS-5782) BlockListAsLongs should take lists of Replicas rather than concrete classes

[ https://issues.apache.org/jira/browse/HDFS-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-5782: - Target Version/s: 3.0.0, 2.7.0 (was: 3.0.0) BlockListAsLongs should take lists of Replicas rather than

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299031#comment-14299031 ] Zhe Zhang commented on HDFS-7339: - The build failure is because of the divergence of

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.010.patch Refactor and improve decommissioning logic into DecommissionManager

[jira] [Assigned] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-7684: -- Assignee: Anu Engineer The host:port settings of dfs.namenode.secondary.http-address should be

[jira] [Assigned] (HDFS-7520) checknative should display a nicer error message when openssl support is not compiled in

[ https://issues.apache.org/jira/browse/HDFS-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-7520: -- Assignee: Anu Engineer checknative should display a nicer error message when openssl support

[jira] [Created] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

Brahma Reddy Battula created HDFS-7711: -- Summary: [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements Key: HDFS-7711 URL: https://issues.apache.org/jira/browse/HDFS-7711 Project:

[jira] [Commented] (HDFS-7706) Switch BlockManager logging to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299104#comment-14299104 ] Andrew Wang commented on HDFS-7706: --- Hey Kihwal, I'd like to hit that in a follow-on

[jira] [Created] (HDFS-7709) Fix Findbug Warnings

Rakesh R created HDFS-7709: -- Summary: Fix Findbug Warnings Key: HDFS-7709 URL: https://issues.apache.org/jira/browse/HDFS-7709 Project: Hadoop HDFS Issue Type: Bug Reporter: Rakesh R

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298945#comment-14298945 ] Hadoop QA commented on HDFS-4265: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7710) Remove dead code in BackupImage.java

[ https://issues.apache.org/jira/browse/HDFS-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7710: - Attachment: HDFS-7710.0.patch Remove dead code in BackupImage.java

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299116#comment-14299116 ] Jing Zhao commented on HDFS-7339: - Thanks Zhe! The patch looks good overall. Some comments

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299153#comment-14299153 ] Yongjun Zhang commented on HDFS-7707: - HI Kihwal, Thanks a lot for your further

[jira] [Created] (HDFS-7712) Switch blockStateChangeLog to use slf4j

Andrew Wang created HDFS-7712: - Summary: Switch blockStateChangeLog to use slf4j Key: HDFS-7712 URL: https://issues.apache.org/jira/browse/HDFS-7712 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7658) HDFS Space Quota not working as expected

[ https://issues.apache.org/jira/browse/HDFS-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298921#comment-14298921 ] Xiaoyu Yao commented on HDFS-7658: -- [~putta_jammy], I'm working on a quota related feature

[jira] [Updated] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7711: --- Description: 1) dfs.namenode.hosts / dfs.namenode.hosts.exclude. I did not seen

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299106#comment-14299106 ] Kihwal Lee commented on HDFS-7707: -- {{isFileDeletec()}} is always called with the fsn lock

[jira] [Commented] (HDFS-7697) Document the scope of the PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-7697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299129#comment-14299129 ] Lei (Eddy) Xu commented on HDFS-7697: - [~wheat9] Thank for very much for filling this.

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299128#comment-14299128 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- It's not the goal of

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299158#comment-14299158 ] Andrew Wang commented on HDFS-7411: --- I split the logging changes off to HDFS-7706 which I

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299188#comment-14299188 ] Kihwal Lee commented on HDFS-7707: -- bq. Do you mean that we could get a wrong iFile here?

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299387#comment-14299387 ] Colin Patrick McCabe commented on HDFS-7648: bq. The original design of

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Attachment: hdfs-7712.002.patch Woops missed a file. Switch blockStateChangeLog to use slf4j

[jira] [Created] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

Lei (Eddy) Xu created HDFS-7722: --- Summary: DataNode#checkDiskError should also remove Storage when error is found. Key: HDFS-7722 URL: https://issues.apache.org/jira/browse/HDFS-7722 Project: Hadoop

[jira] [Created] (HDFS-7721) TestBlockScanner.testScanRateLimit may fail

Tsz Wo Nicholas Sze created HDFS-7721: - Summary: TestBlockScanner.testScanRateLimit may fail Key: HDFS-7721 URL: https://issues.apache.org/jira/browse/HDFS-7721 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7720: - Status: Patch Available (was: Open) Quota by Storage Type API, tools and ClientNameNode Protocol changes

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299410#comment-14299410 ] Hadoop QA commented on HDFS-7339: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299413#comment-14299413 ] Andrew Wang commented on HDFS-7411: --- RAT complains about a psd file? seems spurious.

[jira] [Updated] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7339: Hadoop Flags: Reviewed Allocating and persisting block groups in NameNode

[jira] [Resolved] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7339. - Resolution: Fixed Allocating and persisting block groups in NameNode

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299446#comment-14299446 ] Zhe Zhang commented on HDFS-7339: - Thanks [~arpitagarwal]. I feel reserving some block IDs

[jira] [Updated] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-7707: - Target Version/s: 2.7.0 Edit log corruption due to delayed block removal again

[jira] [Commented] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299554#comment-14299554 ] Tsz Wo Nicholas Sze commented on HDFS-5631: --- extdataset is missing in the

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299378#comment-14299378 ] Hadoop QA commented on HDFS-7712: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7339: Attachment: HDFS-7339-008.patch Allocating and persisting block groups in NameNode

[jira] [Created] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

Xiaoyu Yao created HDFS-7720: Summary: Quota by Storage Type API, tools and ClientNameNode Protocol changes Key: HDFS-7720 URL: https://issues.apache.org/jira/browse/HDFS-7720 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-5631: - Target Version/s: 3.0.0, 2.7.0 (was: 3.0.0) Expose interfaces required by FsDatasetSpi implementations

[jira] [Updated] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-5631: - Attachment: HDFS-5631-branch-2.patch Added patch for branch-2. Expose interfaces required by

[jira] [Commented] (HDFS-7696) FsDatasetImpl.getTmpInputStreams(..) may leak file descriptors

[ https://issues.apache.org/jira/browse/HDFS-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299518#comment-14299518 ] Brandon Li commented on HDFS-7696: -- +1. The patch looks good to me.

[jira] [Created] (HDFS-7723) Quota By Storage Type namenode implemenation

Xiaoyu Yao created HDFS-7723: Summary: Quota By Storage Type namenode implemenation Key: HDFS-7723 URL: https://issues.apache.org/jira/browse/HDFS-7723 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7520) checknative should display a nicer error message when openssl support is not compiled in

[ https://issues.apache.org/jira/browse/HDFS-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299407#comment-14299407 ] Anu Engineer commented on HDFS-7520: I looked at this code path and it looks like if

[jira] [Created] (HDFS-7717) Erasure Coding: provide a tool for convert files between replication and erasure coding

Jing Zhao created HDFS-7717: --- Summary: Erasure Coding: provide a tool for convert files between replication and erasure coding Key: HDFS-7717 URL: https://issues.apache.org/jira/browse/HDFS-7717 Project:

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299443#comment-14299443 ] Arpit Agarwal commented on HDFS-7339: - bq. Do you know why we reserve 1 billion block

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299454#comment-14299454 ] Jing Zhao commented on HDFS-7339: - I think not reserving currently should be fine. If we

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Attachment: HDFS-7647-3.patch Thanks [~arpitagarwal] for the review, and sorry about the delay. 1. I

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Status: Patch Available (was: In Progress) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299581#comment-14299581 ] Hadoop QA commented on HDFS-7712: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

Jing Zhao created HDFS-7716: --- Summary: Erasure Coding: extend BlockInfo to handle EC info Key: HDFS-7716 URL: https://issues.apache.org/jira/browse/HDFS-7716 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7339: Status: Open (was: Patch Available) Allocating and persisting block groups in NameNode

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299420#comment-14299420 ] Jing Zhao commented on HDFS-7339: - Thanks for the quick update, Zhe! bq. Do you know why

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299434#comment-14299434 ] Zhe Zhang commented on HDFS-7339: - I just committed the patch to HDFS-EC. Thanks a lot for

[jira] [Created] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

Arun Suresh created HDFS-7718: - Summary: DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage Key: HDFS-7718 URL:

[jira] [Updated] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7718: -- Description: Currently, the {{FileContext}} class used by clients such as (for eg. {{YARNRunner}})

[jira] [Commented] (HDFS-7520) checknative should display a nicer error message when openssl support is not compiled in

[ https://issues.apache.org/jira/browse/HDFS-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299467#comment-14299467 ] Chris Nauroth commented on HDFS-7520: - My best guess is that this happens when the

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299475#comment-14299475 ] Arpit Agarwal commented on HDFS-7339: - Yes I think not reserving will be fine. I guess

[jira] [Updated] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7719: Attachment: HDFS-7719.000.patch This patch checks the targeted directories are parent directories in

[jira] [Moved] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu moved HADOOP-11530 to HDFS-7719: -- Target Version/s: 3.0.0, 2.7.0 (was: 3.0.0, 2.7.0) Affects

[jira] [Updated] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7719: Status: Patch Available (was: Open) BlockPoolSliceStorage could not remove storageDir.

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299493#comment-14299493 ] Zhe Zhang commented on HDFS-7339: - bq. I guess the concern is that with EC we will be going

[jira] [Updated] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7720: - Attachment: HDFS-7720.1.patch Quota by Storage Type API, tools and ClientNameNode Protocol changes

[jira] [Updated] (HDFS-7723) Quota By Storage Type namenode implemenation

[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7723: - Attachment: HDFS-7723.0.patch This patch assumes ClientNameNodeRPC protocol changes (HDFS-7720) is in. I

[jira] [Commented] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299649#comment-14299649 ] Hadoop QA commented on HDFS-7720: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299665#comment-14299665 ] Hadoop QA commented on HDFS-7647: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299664#comment-14299664 ] Hadoop QA commented on HDFS-7719: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299675#comment-14299675 ] Hadoop QA commented on HDFS-7720: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299370#comment-14299370 ] Zhe Zhang commented on HDFS-7339: - Thanks [~jingzhao] for the helpful review! bq. Instead

[jira] [Assigned] (HDFS-7701) Support quota by storage type output with hadoop fs -count -q

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-7701: Assignee: Xiaoyu Yao Support quota by storage type output with hadoop fs -count -q

[jira] [Updated] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7720: - Attachment: HDFS-7720.0.patch Quota by Storage Type API, tools and ClientNameNode Protocol changes

[jira] [Commented] (HDFS-7703) Support favouredNodes for the append for new blocks

[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298645#comment-14298645 ] Hadoop QA commented on HDFS-7703: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7603) The background replication queue initialization may not let others run

[ https://issues.apache.org/jira/browse/HDFS-7603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298660#comment-14298660 ] Hudson commented on HDFS-7603: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2021 (See

  1   2   >