[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707928#comment-15707928 ] Hudson commented on HDFS-10994: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Release Note: After this fix, the value of the following metrics/JMX can be incorrect. * LastWrit

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707967#comment-15707967 ] Akira Ajisaka commented on HDFS-11180: -- {quote} bq. NameNode holds a lock of FSEditLo

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707977#comment-15707977 ] Tsz Wo Nicholas Sze commented on HDFS-11156: The use of underscore in GET_BLOC

[jira] [Created] (HDFS-11192) OOM during Quota Initialization lead to Namenode hang

Brahma Reddy Battula created HDFS-11192: --- Summary: OOM during Quota Initialization lead to Namenode hang Key: HDFS-11192 URL: https://issues.apache.org/jira/browse/HDFS-11192 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11192) OOM during Quota Initialization lead to Namenode hang

[ https://issues.apache.org/jira/browse/HDFS-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11192: Attachment: namenodeThreadDump.out > OOM during Quota Initialization lead to Namenod

[jira] [Created] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

Rakesh R created HDFS-11193: --- Summary: [SPS]: Erasure coded files should be considered for satisfying storage policy Key: HDFS-11193 URL: https://issues.apache.org/jira/browse/HDFS-11193 Project: Hadoop HDF

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708232#comment-15708232 ] SammiChen commented on HDFS-8411: - Hi [~andrew.wang], thanks for review the patch! I will

[jira] [Updated] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8411: Attachment: HDFS-8411-005.patch 1. support partial read/write case 2. add test case for partical read/write c

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v4.patch 1. take care whitespace 2. Improve TestErasureCodingCLI script file testEr

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708354#comment-15708354 ] Steve Loughran commented on HDFS-6262: -- I concur. the newer rename, which in FileSyste

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708492#comment-15708492 ] Hadoop QA commented on HDFS-8411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708657#comment-15708657 ] Hadoop QA commented on HDFS-11072: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708820#comment-15708820 ] Rakesh R commented on HDFS-8411: Thanks [~Sammi] for the work. I've few comments, # Striped

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11156: --- Hadoop Flags: (was: Incompatible change) > Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't compl

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709000#comment-15709000 ] Weiwei Yang commented on HDFS-11156: Hello [~szetszwo] Thanks for the input, I am hap

[jira] [Updated] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7955: --- Fix Version/s: 3.0.0-alpha2 > Improve naming of classes, methods, and variables related to block > replication

[jira] [Resolved] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R resolved HDFS-7955. Resolution: Fixed Target Version/s: 3.0.0-alpha2 Thank you [~zhz], [~andrew.wang], [~szetszwo], [~u

[jira] [Commented] (HDFS-8678) Bring back the feature to view chunks of files in the HDFS file browser

[ https://issues.apache.org/jira/browse/HDFS-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709190#comment-15709190 ] Ravi Prakash commented on HDFS-8678: Thanks Allen! Yeah! Let's do that in a follow up.

[jira] [Updated] (HDFS-8678) Bring back the feature to view chunks of files in the HDFS file browser

[ https://issues.apache.org/jira/browse/HDFS-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-8678: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) > Bri

[jira] [Closed] (HDFS-7588) Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs and uploading files

[ https://issues.apache.org/jira/browse/HDFS-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash closed HDFS-7588. -- > Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs > and uploading files > --

[jira] [Resolved] (HDFS-7588) Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs and uploading files

[ https://issues.apache.org/jira/browse/HDFS-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved HDFS-7588. Resolution: Fixed > Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs > an

[jira] [Updated] (HDFS-7588) Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs and uploading files

[ https://issues.apache.org/jira/browse/HDFS-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7588: --- Fix Version/s: 2.9.0 > Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs > a

[jira] [Commented] (HDFS-7588) Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs and uploading files

[ https://issues.apache.org/jira/browse/HDFS-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709194#comment-15709194 ] Ravi Prakash commented on HDFS-7588: Thanks for all the reviews Allen and Haohui and ot

[jira] [Commented] (HDFS-8678) Bring back the feature to view chunks of files in the HDFS file browser

[ https://issues.apache.org/jira/browse/HDFS-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709226#comment-15709226 ] Hudson commented on HDFS-8678: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1091

[jira] [Updated] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.005.patch > Introduce fault injectors to simulate slow mirrors > --

[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709245#comment-15709245 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: (was: HDFS-10913.005.patch) > Introduce fault injectors to simulate slow mirrors >

[jira] [Updated] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.005.patch > Introduce fault injectors to simulate slow mirrors > --

[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709429#comment-15709429 ] Xiaobing Zhou commented on HDFS-10913: -- Posted v005 patch to address your comments, t

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709564#comment-15709564 ] Taklon Stephen Wu commented on HDFS-10453: -- is this issue still ongoing? > Repli

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709732#comment-15709732 ] Kihwal Lee commented on HDFS-11180: --- +1 for the patch. I am not sure whether it is wort

[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8674: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.8.0, 2.7.4, 3.0.0-alpha2) > Improve performance of postponed

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709744#comment-15709744 ] Kihwal Lee commented on HDFS-8674: -- Looks like {{HDFS-8674.2.patch}} is for branch-2. Can

[jira] [Updated] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11184: Attachment: HDFS-11184-HDFS-7240.004.patch Patch v4: * Added one more test case to make sure that e

[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709767#comment-15709767 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-8674: -- Attachment: HDFS-8674.trunk.patch fix conflicts on trunk stemming from under replicated now being low red

[jira] [Updated] (HDFS-10177) a wrong number of the bytes read are copied into native buffer in hdfsRead()

[ https://issues.apache.org/jira/browse/HDFS-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated HDFS-10177: Assignee: Andres Perez Status: Patch Available (was: Open) > a wrong number of the bytes read

[jira] [Updated] (HDFS-10177) a wrong number of the bytes read are copied into native buffer in hdfsRead()

[ https://issues.apache.org/jira/browse/HDFS-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated HDFS-10177: Attachment: HDFS-10177.patch Simple fix as suggested > a wrong number of the bytes read are copied

[jira] [Commented] (HDFS-10177) a wrong number of the bytes read are copied into native buffer in hdfsRead()

[ https://issues.apache.org/jira/browse/HDFS-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709922#comment-15709922 ] Hadoop QA commented on HDFS-10177: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10177) a wrong number of the bytes read are copied into native buffer in hdfsRead()

[ https://issues.apache.org/jira/browse/HDFS-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated HDFS-10177: Attachment: HDFS-10177.002.patch New patch removing the unused variable of {{noReadBytes}} > a wron

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709995#comment-15709995 ] Hadoop QA commented on HDFS-10453: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710085#comment-15710085 ] Hadoop QA commented on HDFS-11184: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710112#comment-15710112 ] Hadoop QA commented on HDFS-8674: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.barnch-2.00.patch Attach an initial branch-2 patch for review. > Refactor: Wrap

[jira] [Commented] (HDFS-11191) In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710201#comment-15710201 ] Weiwei Yang commented on HDFS-11191: At present the datanode capacity is a simple cumu

[jira] [Assigned] (HDFS-11191) In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11191: -- Assignee: Weiwei Yang > In the command “hdfs dfsadmin -report” The Configured Capacity is misle

[jira] [Commented] (HDFS-11191) In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710206#comment-15710206 ] Weiwei Yang commented on HDFS-11191: Hello [~dchan...@hortonworks.com] Are you workin

[jira] [Comment Edited] (HDFS-11191) In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file sys

[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710206#comment-15710206 ] Weiwei Yang edited comment on HDFS-11191 at 11/30/16 11:35 PM: -

[jira] [Commented] (HDFS-10177) a wrong number of the bytes read are copied into native buffer in hdfsRead()

[ https://issues.apache.org/jira/browse/HDFS-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710230#comment-15710230 ] Hadoop QA commented on HDFS-10177: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710258#comment-15710258 ] Arpit Agarwal commented on HDFS-10913: -- The change looks good. I am reviewing the uni

[jira] [Updated] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5517: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11188) Change min supported DN and NN versions back to 2.x

[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710276#comment-15710276 ] Andrew Wang commented on HDFS-11188: Checkstyle looks ignorable, ready for review. >

[jira] [Commented] (HDFS-11189) WebHDFS and FollowRedirects

[ https://issues.apache.org/jira/browse/HDFS-11189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710288#comment-15710288 ] Weiwei Yang commented on HDFS-11189: Hi [~guadilla] It is not clear what was the prob

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10930: - Attachment: HDFS-10930-branch-2.00.patch Rename Xiaoyu's patch for Jenkins. > Refactor: Wrap Data

[jira] [Reopened] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-10930: -- Reopening for branch-2 Jenkins run. > Refactor: Wrap Datanode IO related operations > -

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10930: - Status: Patch Available (was: Reopened) > Refactor: Wrap Datanode IO related operations > ---

[jira] [Updated] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11194: - Affects Version/s: 2.8.0 > Maintain aggregated peer performance metrics on NameNode >

[jira] [Created] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

Xiaobing Zhou created HDFS-11194: Summary: Maintain aggregated peer performance metrics on NameNode Key: HDFS-11194 URL: https://issues.apache.org/jira/browse/HDFS-11194 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11194: - Component/s: namenode > Maintain aggregated peer performance metrics on NameNode > ---

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710386#comment-15710386 ] Arpit Agarwal commented on HDFS-10930: -- +1 for the branch-2 patch, pending Jenkins. T

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710408#comment-15710408 ] Andrew Wang commented on HDFS-11096: Thanks for the comment Ming, inline: bq. To have

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710418#comment-15710418 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710421#comment-15710421 ] Hudson commented on HDFS-5517: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1092

[jira] [Updated] (HDFS-10917) Maintain various peer performance statistics on DataNode

[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Description: DataNodes already detect if replication pipeline operations are slow and log warnings

[jira] [Updated] (HDFS-10917) Collect peer performance statistics on DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Summary: Collect peer performance statistics on DataNode. (was: Maintain various peer performance

[jira] [Updated] (HDFS-10917) Collect peer performance statistics on DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Description: DataNodes already detect if replication pipeline operations are slow and log warnings

[jira] [Updated] (HDFS-10917) Collect peer performance statistics on DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Description: DataNodes already detect if replication pipeline operations are slow and log warnings

[jira] [Updated] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11194: - Description: These metrics should be reported to NameNode as part of heart beat messages. In addit

[jira] [Updated] (HDFS-11194) Report performance metrics to

[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11194: - Summary: Report performance metrics to (was: Maintain aggregated peer performance metrics on Nam

[jira] [Updated] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11194: - Summary: Maintain aggregated peer performance metrics on NameNode (was: Report performance metric

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930-branch-2.001.patch Rename to trigger Jenkins for branch-2. > Refactor: Wrap Data

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710452#comment-15710452 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710456#comment-15710456 ] Arpit Agarwal commented on HDFS-10930: -- Sigh.. I am not sure how to get Jenkins to st

[jira] [Updated] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11194: - Description: The metrics collected in HDFS-10917 should be reported to and aggregated on NameNode

[jira] [Commented] (HDFS-11112) Journal Nodes should refuse to format non-empty directories

[ https://issues.apache.org/jira/browse/HDFS-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710466#comment-15710466 ] Yiqun Lin commented on HDFS-2: -- HI [~arpitagarwal], would you have a quick look for t

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710484#comment-15710484 ] Andrew Wang commented on HDFS-11156: bq. this API returns BlockLocations[] + FileStatu

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710503#comment-15710503 ] Yiqun Lin commented on HDFS-11178: -- Hi [~brahmareddy], I think we can hold on the commit

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710527#comment-15710527 ] Akira Ajisaka commented on HDFS-11180: -- Thanks [~kihwal] for reviewing my patch. bq.

[jira] [Commented] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710528#comment-15710528 ] Hadoop QA commented on HDFS-11182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Release Note: (was: After this fix, the value of the following metrics/JMX can be incorrect. * L

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Assignee: Wei Zhou (was: SammiChen) > Add create API in filesystem public class to support assign paramet

[jira] [Updated] (HDFS-11192) OOM during Quota Initialization lead to Namenode hang

[ https://issues.apache.org/jira/browse/HDFS-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11192: Description: AFAIK ,In RecurisveTask Execution, When ForkjoinThreadpool's thread die

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710559#comment-15710559 ] SammiChen commented on HDFS-11170: -- THanks [~andrew.wang] for provide such good suggestio

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710576#comment-15710576 ] Brahma Reddy Battula commented on HDFS-11178: - [~linyiqun] thanks for updating

[jira] [Updated] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11184: Attachment: HDFS-11184-HDFS-7240.005.patch Patch v5 : misc cleanup. > Ozone: SCM: Make SCM use cont

[jira] [Commented] (HDFS-11192) OOM during Quota Initialization lead to Namenode hang

[ https://issues.apache.org/jira/browse/HDFS-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710596#comment-15710596 ] Brahma Reddy Battula commented on HDFS-11192: - [~kihwal]/[~xyao]/[~daryn] any

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710643#comment-15710643 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments,

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710641#comment-15710641 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments,

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710645#comment-15710645 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments,

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11160: - Attachment: HDFS-11160.003.patch Hi [~jojochuang], Thanks for your work here. I did a review of y

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710653#comment-15710653 ] Taklon Stephen Wu commented on HDFS-10453: -- +1, could someone please review this

[jira] [Issue Comment Deleted] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Comment: was deleted (was: [~wutak...@amazon.com] Thanks for your comments, The patch is ready, and i

[jira] [Issue Comment Deleted] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Comment: was deleted (was: [~wutak...@amazon.com] Thanks for your comments, The patch is ready, and i

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710657#comment-15710657 ] Yongjun Zhang commented on HDFS-11160: -- About your optimization: {quote} The basic id

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710709#comment-15710709 ] Wei-Chiu Chuang commented on HDFS-11160: Thanks Yongjun. Much appreciate your help

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710712#comment-15710712 ] Brahma Reddy Battula commented on HDFS-10930: - *Regarding Trunk commit.* 1)

[jira] [Comment Edited] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710712#comment-15710712 ] Brahma Reddy Battula edited comment on HDFS-10930 at 12/1/16 3:22 AM: --

[jira] [Commented] (HDFS-11192) OOM during Quota Initialization lead to Namenode hang

[ https://issues.apache.org/jira/browse/HDFS-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710722#comment-15710722 ] Kihwal Lee commented on HDFS-11192: --- Was it hitting its ulimit on # of threads/processes

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710729#comment-15710729 ] Wei-Chiu Chuang commented on HDFS-11160: Hi Yongjun. Thanks for pointing out. I sh

  1   2   >