[jira] [Commented] (HDFS-8031) Follow-on work for erasure coding phase I (striping layout)

[ https://issues.apache.org/jira/browse/HDFS-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827374#comment-15827374 ] Kai Zheng commented on HDFS-8031: - It looks great to move some long-term tasks out of this follow-on

[jira] [Commented] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827357#comment-15827357 ] Manoj Govindassamy commented on HDFS-11340: --- HDFS-11335 pre commit test also has this

[jira] [Commented] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

[ https://issues.apache.org/jira/browse/HDFS-11335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827353#comment-15827353 ] Manoj Govindassamy commented on HDFS-11335: --- TestDataNodeVolumeFailureReporting timeout failure

[jira] [Commented] (HDFS-11287) Storage class member storageDirs should be private to avoid unprotected access by derived classes

[ https://issues.apache.org/jira/browse/HDFS-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827351#comment-15827351 ] Manoj Govindassamy commented on HDFS-11287: --- TestWebHdfsTimeouts test failure is not related to

[jira] [Updated] (HDFS-11259) Update fsck to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11259: -- Attachment: HDFS-11259.03.patch Thanks for the review [~andrew.wang] and [~eddyxu].

[jira] [Commented] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

[ https://issues.apache.org/jira/browse/HDFS-11335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827349#comment-15827349 ] Hadoop QA commented on HDFS-11335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11287) Storage class member storageDirs should be private to avoid unprotected access by derived classes

[ https://issues.apache.org/jira/browse/HDFS-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827345#comment-15827345 ] Hadoop QA commented on HDFS-11287: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8387) Erasure Coding: Revisit the long and int datatypes usage in striping logic

[ https://issues.apache.org/jira/browse/HDFS-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827288#comment-15827288 ] Rakesh R commented on HDFS-8387: Thanks for the reminder, [~andrew.wang]. I will take this jira ahead. >

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827272#comment-15827272 ] Lu Tao commented on HDFS-9455: -- @Jakub Zeman, you have to use swebhdfs schema, eg. hadoop fs -ls

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8498: Attachment: HDFS-8498.000.patch Vinay's proposed solution looks good to me. For the implementation, instead

[jira] [Updated] (HDFS-11287) Storage class member storageDirs should be private to avoid unprotected access by derived classes

[ https://issues.apache.org/jira/browse/HDFS-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11287: -- Attachment: HDFS-11287.02.patch Thanks for the review [~eddyxu]. Sure, and I would also

[jira] [Updated] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

[ https://issues.apache.org/jira/browse/HDFS-11335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11335: -- Attachment: HDFS-11335.02.patch Thanks for the review [~eddyxu]. Sure,

[jira] [Updated] (HDFS-10917) Collect peer performance statistics on DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10917: - Affects Version/s: (was: 2.8.0) Fix Version/s: 2.9.0 Thanks Xiaobing. I've committed

[jira] [Commented] (HDFS-10917) Collect peer performance statistics on DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827027#comment-15827027 ] Xiaobing Zhou commented on HDFS-10917: -- v006 made some changes by removing unnecessary queue

[jira] [Updated] (HDFS-10917) Collect peer performance statistics on DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Attachment: HDFS-10917-branch-2.006.patch > Collect peer performance statistics on DataNode. >

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827020#comment-15827020 ] Andrew Wang commented on HDFS-10636: Thanks [~virajith]! [~eddyxu] could you add a release note to

[jira] [Commented] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827003#comment-15827003 ] Hudson commented on HDFS-11209: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11130 (See

[jira] [Updated] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11209: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826965#comment-15826965 ] Xiaoyu Yao commented on HDFS-11209: --- [~djp], can we add this one to 2.8 as checkpoint is critical to

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826954#comment-15826954 ] Virajith Jalaparti commented on HDFS-10636: --- Hi [~andrew.wang], Yes, you are right in that all

[jira] [Commented] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

[ https://issues.apache.org/jira/browse/HDFS-11285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826934#comment-15826934 ] Andrew Wang commented on HDFS-11285: Yea, this has been a long standing issue in HDFS. This typically

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9574: Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) > Reduce client failures during datanode

[jira] [Commented] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826922#comment-15826922 ] Xiaoyu Yao commented on HDFS-11209: --- Thanks [~arpitagarwal] for the review. It is a good point that we

[jira] [Updated] (HDFS-9063) Correctly handle snapshot path for getContentSummary

[ https://issues.apache.org/jira/browse/HDFS-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9063: Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) > Correctly handle snapshot path for

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826910#comment-15826910 ] Yongjun Zhang commented on HDFS-10943: -- Hi [~zhz], I originally saw it with CDH 5.5.x. Then after

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826898#comment-15826898 ] Zhe Zhang commented on HDFS-10943: -- [~yzhangal] Thanks for reporting the issue. Which version did you use

[jira] [Commented] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826829#comment-15826829 ] Yongjun Zhang commented on HDFS-11306: -- I saw [~jojochuang] has committed to trunk and branch-2 on

[jira] [Updated] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11306: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10917) Collect peer performance statistics on DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Attachment: HDFS-10917-branch-2.005.patch Posted branch-2 patch. > Collect peer performance

[jira] [Commented] (HDFS-11317) Modify DataNodeDescriptor() to not call UpdateHeartBeatState

[ https://issues.apache.org/jira/browse/HDFS-11317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826648#comment-15826648 ] Hadoop QA commented on HDFS-11317: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826619#comment-15826619 ] Arpit Agarwal commented on HDFS-11209: -- +1 for the v04 patch assuming the test failures are

[jira] [Commented] (HDFS-11290) TestFSNameSystemMBean should wait until the cache is cleared

[ https://issues.apache.org/jira/browse/HDFS-11290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826584#comment-15826584 ] Hadoop QA commented on HDFS-11290: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10913: - Component/s: test > Introduce fault injectors to simulate slow mirrors >

[jira] [Updated] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10913: - Affects Version/s: (was: 2.8.0) > Introduce fault injectors to simulate slow mirrors >

[jira] [Updated] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10913: - Fix Version/s: 2.9.0 > Introduce fault injectors to simulate slow mirrors >

[jira] [Updated] (HDFS-11317) Modify DataNodeDescriptor() to not call UpdateHeartBeatState

[ https://issues.apache.org/jira/browse/HDFS-11317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11317: --- Description: HDFS 2.7+ DataNodeDescriptor constructor calls updateHeartBeat which updates only a

[jira] [Updated] (HDFS-11317) Modify DataNodeDescriptor() to not call UpdateHeartBeatState

[ https://issues.apache.org/jira/browse/HDFS-11317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11317: --- Status: Patch Available (was: Open) > Modify DataNodeDescriptor() to not call UpdateHeartBeatState >

[jira] [Updated] (HDFS-11317) Modify DataNodeDescriptor() to not call UpdateHeartBeatState

[ https://issues.apache.org/jira/browse/HDFS-11317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11317: --- Attachment: HDFS-11317.001.patch This moves the only possible operations that come from

[jira] [Updated] (HDFS-11345) Document the configuration key for FSNamesystem lock fairness

[ https://issues.apache.org/jira/browse/HDFS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11345: - Description: Per [earlier |

[jira] [Created] (HDFS-11345) Document the configuration key for FSNamesystem lock fairness

Zhe Zhang created HDFS-11345: Summary: Document the configuration key for FSNamesystem lock fairness Key: HDFS-11345 URL: https://issues.apache.org/jira/browse/HDFS-11345 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11290) TestFSNameSystemMBean should wait until the cache is cleared

[ https://issues.apache.org/jira/browse/HDFS-11290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11290: --- Attachment: HDFS-11290.001.patch Thanks for the pointer [~ajisakaa]! I missed that completely. I've

[jira] [Commented] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826013#comment-15826013 ] Surendra Singh Lilhore commented on HDFS-11291: --- I think this change is not required in

[jira] [Commented] (HDFS-7815) Loop on 'blocks does not belong to any file'

[ https://issues.apache.org/jira/browse/HDFS-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825984#comment-15825984 ] Liang Chen commented on HDFS-7815: -- I met the same problem , turn StateChange level to WARN, it works >

[jira] [Commented] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825980#comment-15825980 ] Vinayakumar B commented on HDFS-11291: -- bq. If we add this check in unprotectedSetReplication() then

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825977#comment-15825977 ] Jakub Zeman commented on HDFS-9455: --- Hi all, would it be possible to increase prioriy of this issue. I

[jira] [Commented] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825893#comment-15825893 ] Surendra Singh Lilhore commented on HDFS-11291: --- Thanks [~vinayrpet] for review.. bq. for

[jira] [Updated] (HDFS-11311) HDFS fsck continues to report all blocks present when DataNode is restarted with empty data directories

[ https://issues.apache.org/jira/browse/HDFS-11311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11311: - Attachment: HDFS-11311.reproduce.patch > HDFS fsck continues to report all blocks present when DataNode

[jira] [Commented] (HDFS-11311) HDFS fsck continues to report all blocks present when DataNode is restarted with empty data directories

[ https://issues.apache.org/jira/browse/HDFS-11311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825890#comment-15825890 ] Yiqun Lin commented on HDFS-11311: -- HI [~afrimberger], thanks for reporting this. It's a interesting case

[jira] [Updated] (HDFS-3302) Review and improve HDFS trash documentation

[ https://issues.apache.org/jira/browse/HDFS-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-3302: -- Assignee: (was: Harsh J) > Review and improve HDFS trash documentation >

[jira] [Commented] (HDFS-3302) Review and improve HDFS trash documentation

[ https://issues.apache.org/jira/browse/HDFS-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825810#comment-15825810 ] Harsh J commented on HDFS-3302: --- Just a short note: This seems to be incorrectly attributed (to me). Actual

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825800#comment-15825800 ] Hadoop QA commented on HDFS-10391: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825748#comment-15825748 ] Vinayakumar B commented on HDFS-11291: -- for setReplication() following check can be added directly

[jira] [Commented] (HDFS-11290) TestFSNameSystemMBean should wait until the cache is cleared

[ https://issues.apache.org/jira/browse/HDFS-11290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825712#comment-15825712 ] Akira Ajisaka commented on HDFS-11290: -- Thanks [~xkrogen] for providing a patch. Mostly looks good to

[jira] [Commented] (HDFS-9884) Use doxia macro to generate in-page TOC of HDFS site documentation

[ https://issues.apache.org/jira/browse/HDFS-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825681#comment-15825681 ] Akira Ajisaka commented on HDFS-9884: - Hi [~iwasakims], would you rebase the patch for the latest

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825649#comment-15825649 ] Akira Ajisaka commented on HDFS-11316: -- +1 > TestDataNodeVolumeFailure fails frequently >

[jira] [Updated] (HDFS-10391) Always enable NameNode service RPC port

[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated HDFS-10391: - Attachment: HDFS-10391.003.patch > Always enable NameNode service RPC port >