[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750606#comment-15750606 ] Xiaobing Zhou commented on HDFS-10913: -- v007 removed code that's not related to mirror operations. >

[jira] [Updated] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.007.patch > Introduce fault injectors to simulate slow mirrors >

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Attachment: HDFS-11160.branch-2.patch Attach branch-2 patch. > VolumeScanner reports

[jira] [Commented] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/HDFS-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750542#comment-15750542 ] Allen Wittenauer commented on HDFS-11245: - The problem is here: {code} export

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750518#comment-15750518 ] Wei-Chiu Chuang commented on HDFS-11160: test failures can not be reproduced locally. >

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750220#comment-15750220 ] Rakesh R commented on HDFS-11193: - bq. I would like to review that fix separately than combining with this

[jira] [Created] (HDFS-11248) [SPS]: Handle partial block location movements

Rakesh R created HDFS-11248: --- Summary: [SPS]: Handle partial block location movements Key: HDFS-11248 URL: https://issues.apache.org/jira/browse/HDFS-11248 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11247) Verify NameNodeMXBean#getDecomNodes() and Live/Dead Decom Nodes shown in NameNode WebUI

[ https://issues.apache.org/jira/browse/HDFS-11247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750214#comment-15750214 ] Manoj Govindassamy commented on HDFS-11247: --- Unit test failures doesn't look related to patch.

[jira] [Commented] (HDFS-11195) When appending files by webhdfs rest api fails, it returns 200

[ https://issues.apache.org/jira/browse/HDFS-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750206#comment-15750206 ] Yuanbo Liu commented on HDFS-11195: --- The test failures are not related, some of them have been addressed

[jira] [Commented] (HDFS-11247) Verify NameNodeMXBean#getDecomNodes() and Live/Dead Decom Nodes shown in NameNode WebUI

[ https://issues.apache.org/jira/browse/HDFS-11247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750180#comment-15750180 ] Hadoop QA commented on HDFS-11247: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750073#comment-15750073 ] Yiqun Lin commented on HDFS-11246: -- +1 for the idea. I see we can move {{logAuditEvent(success,

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750003#comment-15750003 ] Mingliang Liu commented on HDFS-11094: -- +1 Failing test is not related. Do we need separate patch

[jira] [Updated] (HDFS-11247) Verify NameNodeMXBean#getDecomNodes() and Live/Dead Decom Nodes shown in NameNode WebUI

[ https://issues.apache.org/jira/browse/HDFS-11247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11247: -- Attachment: HDFS-11247.01.patch Attached a patch to verify

[jira] [Updated] (HDFS-11247) Verify NameNodeMXBean#getDecomNodes() and Live/Dead Decom Nodes shown in NameNode WebUI

[ https://issues.apache.org/jira/browse/HDFS-11247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11247: -- Status: Patch Available (was: Open) > Verify NameNodeMXBean#getDecomNodes() and

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749942#comment-15749942 ] Hadoop QA commented on HDFS-11160: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11247) Verify NameNodeMXBean#getDecomNodes() and Live/Dead Decom Nodes shown in NameNode WebUI

Manoj Govindassamy created HDFS-11247: - Summary: Verify NameNodeMXBean#getDecomNodes() and Live/Dead Decom Nodes shown in NameNode WebUI Key: HDFS-11247 URL: https://issues.apache.org/jira/browse/HDFS-11247

[jira] [Commented] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749840#comment-15749840 ] Hadoop QA commented on HDFS-11182: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749800#comment-15749800 ] Uma Maheswara Rao G commented on HDFS-11193: {quote} While testing I found an issue in when

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Attachment: HDFS-11160.008.patch Oops. my bad, forgot to rebase. Here's v008 > VolumeScanner

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749708#comment-15749708 ] Hadoop QA commented on HDFS-11160: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Attachment: (was: HDFS-11160.branch-2.patch) > VolumeScanner reports write-in-progress

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Attachment: HDFS-11160.007.patch Thanks [~xiaochen] Yes indeed looks like I can remove the

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749667#comment-15749667 ] Mingliang Liu commented on HDFS-11246: -- audit log can be async; anyway logging out of locks is nice

[jira] [Created] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

Kuhu Shukla created HDFS-11246: -- Summary: FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary Key: HDFS-11246 URL:

[jira] [Commented] (HDFS-9391) Update webUI/JMX/fsck to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749531#comment-15749531 ] Manoj Govindassamy commented on HDFS-9391: -- [~mingma], I am trying to extend {{NameNodeMXBean}}

[jira] [Updated] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/HDFS-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11245: --- Affects Version/s: (was: 3.0.0-beta1) 3.0.0-alpha1 > HDFS ignores

[jira] [Commented] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749272#comment-15749272 ] Hudson commented on HDFS-10958: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10997 (See

[jira] [Comment Edited] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737105#comment-15737105 ] Arpit Agarwal edited comment on HDFS-10958 at 12/14/16 7:23 PM: Attached a

[jira] [Updated] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10958: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749130#comment-15749130 ] Xiao Chen commented on HDFS-11160: -- I was pinged to review this as well. Change makes sense to me,

[jira] [Commented] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749075#comment-15749075 ] Xiaoyu Yao commented on HDFS-10958: --- Thanks [~arpitagarwal] for updating the patch. +1 for v6 patch.

[jira] [Commented] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/HDFS-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749062#comment-15749062 ] John Zhuge commented on HDFS-11245: --- Could you check the {{Final CLASSPATH}} in {{--debug}} output? The

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748993#comment-15748993 ] Yongjun Zhang commented on HDFS-11225: -- HI [~manojg], Would you please take a look at

[jira] [Updated] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/HDFS-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11245: -- Description: It seems that HDFS on trunk is ignoring {{HADOOP_CONF_DIR}}. On {{branch-2}} I could

[jira] [Updated] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/HDFS-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11245: -- Description: It seems that HDFS on trunk is ignoring {{HADOOP_CONF_DIR}}. On {{branch-2}} I could

[jira] [Created] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

Ewan Higgs created HDFS-11245: - Summary: HDFS ignores HADOOP_CONF_DIR Key: HDFS-11245 URL: https://issues.apache.org/jira/browse/HDFS-11245 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11123: Resolution: Fixed Fix Version/s: HDFS-10285 Target Version/s: (was: HDFS-10285)

[jira] [Commented] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748185#comment-15748185 ] Rakesh R commented on HDFS-11123: - Thanks [~umamaheswararao] for the work, +1 LGTM. I'll commit this into

[jira] [Commented] (HDFS-9911) TestDataNodeLifeline Fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748137#comment-15748137 ] Hadoop QA commented on HDFS-9911: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747984#comment-15747984 ] Hadoop QA commented on HDFS-11242: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11204) Document the missing options of hdfs zkfc command

[ https://issues.apache.org/jira/browse/HDFS-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747976#comment-15747976 ] Yiqun Lin commented on HDFS-11204: -- Thanks [~ajisakaa] for the review and commit. > Document the missing

[jira] [Commented] (HDFS-11204) Document the missing options of hdfs zkfc command

[ https://issues.apache.org/jira/browse/HDFS-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747926#comment-15747926 ] Hudson commented on HDFS-11204: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10996 (See

[jira] [Updated] (HDFS-9911) TestDataNodeLifeline Fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-9911: Attachment: HDFS-9911.002.patch Thanks [~anu], [~tasanuma0829] and [~cnauroth] for the review! {quote} This

[jira] [Updated] (HDFS-11244) [SPS]: Limit the number satisfyStoragePolicy items at Namenode

[ https://issues.apache.org/jira/browse/HDFS-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11244: Summary: [SPS]: Limit the number satisfyStoragePolicy items at Namenode (was: Limit the number

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11243: Summary: [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues (was: Add a

[jira] [Updated] (HDFS-11204) Document the missing options of hdfs zkfc command

[ https://issues.apache.org/jira/browse/HDFS-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11204: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Updated] (HDFS-11204) Document the missing options of hdfs zkfc command

[ https://issues.apache.org/jira/browse/HDFS-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11204: - Hadoop Flags: Reviewed Summary: Document the missing options of hdfs zkfc command (was:

[jira] [Commented] (HDFS-11204) The usage of formating ZK command should be updated

[ https://issues.apache.org/jira/browse/HDFS-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747841#comment-15747841 ] Akira Ajisaka commented on HDFS-11204: -- +1, checking this in. > The usage of formating ZK command

[jira] [Commented] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747760#comment-15747760 ] Hadoop QA commented on HDFS-11123: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747672#comment-15747672 ] Reid Chan edited comment on HDFS-11242 at 12/14/16 8:39 AM: Fix style

[jira] [Updated] (HDFS-11242) Add refresh cluster network topology operation to dfs admin

[ https://issues.apache.org/jira/browse/HDFS-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reid Chan updated HDFS-11242: - Attachment: HDFS-11242.002.patch Fix style problems, and add the server side proto implementation.

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747656#comment-15747656 ] SammiChen commented on HDFS-8411: - Thanks [~andrew.wang], [~rakeshr] and [~drankye] for the reviewing ! >

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747650#comment-15747650 ] SammiChen commented on HDFS-7859: - Thanks [~surendrasingh] for contributing to this task. Would you please