[jira] [Commented] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198027#comment-15198027 ] Xiao Chen commented on HDFS-9405: - Thanks for the review Andrew! All comments are addressed in patch 8. I

[jira] [Commented] (HDFS-9923) Datanode disk failure handling should be improved (consistently?)

[ https://issues.apache.org/jira/browse/HDFS-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201988#comment-15201988 ] Wei-Chiu Chuang commented on HDFS-9923: --- HADOOP-8640 is another incidence of the same issue. As Todd

[jira] [Updated] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9952: Attachment: HDFS-9952-02.patch Updated patch for #1 and #2 fixed. > Expose FSNamesystem lock wait

[jira] [Commented] (HDFS-10179) Ozone: Adding logging support

[ https://issues.apache.org/jira/browse/HDFS-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201070#comment-15201070 ] Anu Engineer commented on HDFS-10179: - test failures are not related to this patch. > Ozone: Adding

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Attachment: HDFS-10182-001.patch > Hedged read might overwrite user's buf >

[jira] [Updated] (HDFS-10173) Typo in DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10173: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198465#comment-15198465 ] Hadoop QA commented on HDFS-9952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-1519) HDFS build is broken, ivy-resolve-common does not find hadoop-common

[ https://issues.apache.org/jira/browse/HDFS-1519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1519. Resolution: Won't Fix Stale. > HDFS build is broken, ivy-resolve-common does not find

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198747#comment-15198747 ] Yongjun Zhang commented on HDFS-9940: - HI [~szetszwo], Thanks for the explanation. Currently

[jira] [Commented] (HDFS-10173) Typo in DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197765#comment-15197765 ] John Zhuge commented on HDFS-10173: --- +1 LGTM > Typo in DataXceiverServer > - >

[jira] [Updated] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10178: -- Attachment: HDFS-10178.patch The following is from {{BlockSender}}, added by HDFS-6934. {code:java} //

[jira] [Updated] (HDFS-9405) Warmup NameNode EDEK caches in background thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9405: Attachment: HDFS-9405.13.patch Patch 13 removes the 2 unneeded imports.. > Warmup NameNode EDEK caches in

[jira] [Commented] (HDFS-10179) Ozone: Adding logging support

[ https://issues.apache.org/jira/browse/HDFS-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202010#comment-15202010 ] Chris Nauroth commented on HDFS-10179: -- Hi [~anu]. I like the use of the MDC to provide more context

[jira] [Updated] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7661: -- Component/s: erasure-coding Summary: [umbrella] support hflush and hsync for

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201965#comment-15201965 ] Sangjin Lee commented on HDFS-10183: I am kind of puzzled by this. It is my understanding that static

[jira] [Updated] (HDFS-9709) DiskBalancer : Add tests for disk balancer using a Mock Mover class.

[ https://issues.apache.org/jira/browse/HDFS-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9709: --- Attachment: HDFS-9709-HDFS-1312.004.patch Rebased to the top of the tree > DiskBalancer : Add tests

[jira] [Commented] (HDFS-9949) Testcase for catching DN UUID regeneration regression

[ https://issues.apache.org/jira/browse/HDFS-9949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198022#comment-15198022 ] Colin Patrick McCabe commented on HDFS-9949: Thanks, [~qwertymaniac]. Great find, and great

[jira] [Commented] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198770#comment-15198770 ] Walter Su commented on HDFS-9952: - bq. MutableRate#add is synchronized in an extremely critical code path

[jira] [Updated] (HDFS-9937) Update dfsadmin command line help

[ https://issues.apache.org/jira/browse/HDFS-9937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-9937: - Attachment: HDFS-9937.04.patch > Update dfsadmin command line help > - > >

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Status: Patch Available (was: Open) > BlockManager#createLocatedBlocks can throw NPE for corruptBlocks

[jira] [Created] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

Kihwal Lee created HDFS-10178: - Summary: Permanent write failures can happen if pipeline recoveries occur for the first packet Key: HDFS-10178 URL: https://issues.apache.org/jira/browse/HDFS-10178

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197893#comment-15197893 ] Colin Patrick McCabe commented on HDFS-9668: Arpit wrote: bq. Detecting slow disks is a known

[jira] [Created] (HDFS-10179) Ozone: Adding logging support

Anu Engineer created HDFS-10179: --- Summary: Ozone: Adding logging support Key: HDFS-10179 URL: https://issues.apache.org/jira/browse/HDFS-10179 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9405) Warmup NameNode EDEK caches in background thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202563#comment-15202563 ] Hadoop QA commented on HDFS-9405: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202559#comment-15202559 ] Arpit Agarwal commented on HDFS-9847: - Thank you for updating the patch [~linyiqun]. Few comments for

[jira] [Commented] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202477#comment-15202477 ] Hadoop QA commented on HDFS-10178: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9809) Abstract implementation-specific details from the datanode

[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9809: - Attachment: HDFS-9809.001.patch > Abstract implementation-specific details from the

[jira] [Commented] (HDFS-9809) Abstract implementation-specific details from the datanode

[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202394#comment-15202394 ] Zhe Zhang commented on HDFS-9809: - Thanks [~virajith] for the work. The overall idea sounds good. I wonder

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202424#comment-15202424 ] Hadoop QA commented on HDFS-10183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10181) TestHFlush frequently fails due to theadInterrupt

[ https://issues.apache.org/jira/browse/HDFS-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10181: - Resolution: Duplicate Status: Resolved (was: Patch Available) > TestHFlush frequently fails due

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202456#comment-15202456 ] Lin Yiqun commented on HDFS-9951: - Sorry for [~cmccabe], I tested in my local. There was a actual error. I

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202390#comment-15202390 ] Sangjin Lee commented on HDFS-9579: --- Thanks for the updated patch. I'm +1 pending jenkins. I'll commit it

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202289#comment-15202289 ] Sangjin Lee commented on HDFS-9579: --- The latest patch looks good, but {{ReplicaAccessor}} adds a new

[jira] [Updated] (HDFS-9809) Abstract implementation-specific details from the datanode

[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9809: Assignee: Virajith Jalaparti > Abstract implementation-specific details from the datanode >

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958.001.patch Attaching v1 of the patch which as per a simpler approach, truncates the

[jira] [Updated] (HDFS-10179) Ozone: Adding logging support

[ https://issues.apache.org/jira/browse/HDFS-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10179: Attachment: HDFS-10179-HDFS-7240.001.patch * Add support for logging * Opportunistically sneaks in

[jira] [Updated] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9885: - Hadoop Flags: Reviewed +1 LGTM > In distcp cmd ouput, Display name should be given for >

[jira] [Commented] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198113#comment-15198113 ] Andrew Wang commented on HDFS-9405: --- A couple more review comments, otherwise looks good: Could we use

[jira] [Commented] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200680#comment-15200680 ] Hadoop QA commented on HDFS-9405: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9694: Attachment: HDFS-9694-v7.patch Updated the patch to avoid the findbugs checking on StripedBlockInfo.java

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201971#comment-15201971 ] Sangjin Lee commented on HDFS-10183: To be fair, I'm all for making these static final (which is a

[jira] [Commented] (HDFS-8030) HDFS Erasure Coding Phase II -- EC with contiguous layout

[ https://issues.apache.org/jira/browse/HDFS-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202419#comment-15202419 ] Zhe Zhang commented on HDFS-8030: - Thanks [~umamaheswararao] for the helpful feedback! bq. As this design

[jira] [Updated] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9579: -- Attachment: HDFS-9579-10.patch [~sjlee0] Good point! Sangjin and I had offline discussion and it turns out

[jira] [Commented] (HDFS-9960) OzoneHandler : Add localstorage support for keys

[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202455#comment-15202455 ] Hadoop QA commented on HDFS-9960: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202510#comment-15202510 ] Hadoop QA commented on HDFS-9820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10179) Ozone: Adding logging support

[ https://issues.apache.org/jira/browse/HDFS-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10179: - Target Version/s: HDFS-7240 Hadoop Flags: Reviewed +1 pending pre-commit. > Ozone:

[jira] [Updated] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9951: Attachment: HDFS-9551.004.patch > Use string constants for XML tags in OfflineImageReconstructor >

[jira] [Commented] (HDFS-9938) Support extensions to WebHdfsFileSystem

[ https://issues.apache.org/jira/browse/HDFS-9938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201462#comment-15201462 ] Vishwajeet Dusane commented on HDFS-9938: - Thanks you [~chris.douglas] and [~cnauroth]. > Support

[jira] [Updated] (HDFS-10183) Prevent race condition during class initialization

[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10183: - Assignee: Pavel Avgustinov > Prevent race condition during class initialization >