[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971490#comment-14971490 ] Haohui Mai commented on HDFS-9129: -- {code} + * The state machine is briefly elaborated in the following

[jira] [Commented] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971537#comment-14971537 ] Hadoop QA commented on HDFS-9297: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971586#comment-14971586 ] Yongjun Zhang commented on HDFS-7284: - Hi [~jojochuang], Thanks for the new rev. I noticed that you

[jira] [Updated] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9279: -- Attachment: HDFS-9279-v1.patch The patch in addition to dfsUsed, also updates XceiverCount , and

[jira] [Updated] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-7284: -- Attachment: HDFS-7284.004.patch Thanks [~yzhangal] for the code review. I am attaching a new

[jira] [Updated] (HDFS-9299) Give ReplicationMonitor a readable thread name

[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9299: -- Attachment: HDFS-9299.001.patch > Give ReplicationMonitor a readable thread name >

[jira] [Updated] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-7284: -- Attachment: HDFS-7284.005.patch Thanks for catching my bad English :/ > Add more debug info to

[jira] [Created] (HDFS-9299) Give ReplicationMonitor a readable thread name

Staffan Friberg created HDFS-9299: - Summary: Give ReplicationMonitor a readable thread name Key: HDFS-9299 URL: https://issues.apache.org/jira/browse/HDFS-9299 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971633#comment-14971633 ] Zhe Zhang commented on HDFS-9268: - The patch LGTM. One minor suggestion is maybe we can fold

[jira] [Updated] (HDFS-9266) Avoid unsafe split and append on fields that might be IPv6 literals

[ https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark updated HDFS-9266: Summary: Avoid unsafe split and append on fields that might be IPv6 literals (was: hadoop-hdfs -

[jira] [Assigned] (HDFS-9299) Give ReplicationMonitor a readable thread name

[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg reassigned HDFS-9299: - Assignee: Staffan Friberg > Give ReplicationMonitor a readable thread name >

[jira] [Created] (HDFS-9298) remove replica and not add replica with wrong genStamp

Chang Li created HDFS-9298: -- Summary: remove replica and not add replica with wrong genStamp Key: HDFS-9298 URL: https://issues.apache.org/jira/browse/HDFS-9298 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-7435.005.patch Fix the last todos Handles New NN and Old DN (unsorted

[jira] [Commented] (HDFS-9255) Consolidate block recovery related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971591#comment-14971591 ] Jing Zhao commented on HDFS-9255: - Thanks for working on this, Walter! The patch looks pretty good to me.

[jira] [Commented] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971590#comment-14971590 ] Elliott Clark commented on HDFS-9289: - It had all of the data and the same md5sums when I checked. So

[jira] [Commented] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971600#comment-14971600 ] Yongjun Zhang commented on HDFS-7284: - Sorry one more thing Suggest to change: {code} * A helper method

[jira] [Updated] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 邓飞 updated HDFS-9293: - Description: In our cluster (hadoop 2.2.0-HA,700+ DN),we found standby NN tail editlog slowly,and hold the fsnamesystem

[jira] [Updated] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 邓飞 updated HDFS-9293: - Description: In our cluster (hadoop 2.2.0-HA,700+ DN),we found standby NN tail editlog slowly,and hold the fsnamesystem

[jira] [Commented] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971546#comment-14971546 ] Tony Wu commented on HDFS-9297: --- The failed tests are not related to this change. > Update

[jira] [Updated] (HDFS-9298) remove replica and not add replica with wrong genStamp

[ https://issues.apache.org/jira/browse/HDFS-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9298: --- Attachment: HDFS-9298.1.patch > remove replica and not add replica with wrong genStamp >

[jira] [Updated] (HDFS-9298) remove replica and not add replica with wrong genStamp

[ https://issues.apache.org/jira/browse/HDFS-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9298: --- Status: Patch Available (was: Open) > remove replica and not add replica with wrong genStamp >

[jira] [Updated] (HDFS-9266) Avoid unsafe split and append on fields that might be IPv6 literals

[ https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark updated HDFS-9266: Resolution: Fixed Status: Resolved (was: Patch Available) > Avoid unsafe split and append

[jira] [Commented] (HDFS-9295) Add a thorough test of the full KMS code path

[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971634#comment-14971634 ] Hadoop QA commented on HDFS-9295: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

邓飞 created HDFS-9294: Summary: DFSClient deadlock when close file and failed to renew lease Key: HDFS-9294 URL: https://issues.apache.org/jira/browse/HDFS-9294 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970720#comment-14970720 ] 邓飞 commented on HDFS-9293: -- thank Walter, it's my mistake,that fixed at 2.7.1 > FSEditLog's 'OpInstanceCache'

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970837#comment-14970837 ] Hadoop QA commented on HDFS-9276: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Assigned] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 邓飞 reassigned HDFS-9294: Assignee: 邓飞 > DFSClient deadlock when close file and failed to renew lease >

[jira] [Commented] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970711#comment-14970711 ] Walter Su commented on HDFS-9293: - I checked HDFS-7398. I think ClientId/CallId will be reset after

[jira] [Commented] (HDFS-9255) Consolidate block recovery related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970735#comment-14970735 ] Hadoop QA commented on HDFS-9255: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9290) DFSClient#callAppend() is not backward compatible for slightly older NameNodes

[ https://issues.apache.org/jira/browse/HDFS-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971060#comment-14971060 ] Kihwal Lee commented on HDFS-9290: -- The fix looks good. One minor nit is that logging at {{INFO}} can

[jira] [Commented] (HDFS-9295) Add a thorough test of the full KMS code path

[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971106#comment-14971106 ] Hadoop QA commented on HDFS-9295: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971142#comment-14971142 ] James Clampffer commented on HDFS-9117: --- Thanks for the update Bob! The last patch covered all of my

[jira] [Commented] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971179#comment-14971179 ] Yongjun Zhang commented on HDFS-7284: - Hi [~jojochuang], It's important to have consistent block name

[jira] [Updated] (HDFS-9269) Need to update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9269: -- Attachment: HDFS-9269.001.patch rev1: work in progress. updated doc/README > Need to update the

[jira] [Commented] (HDFS-9290) DFSClient#callAppend() is not backward compatible for slightly older NameNodes

[ https://issues.apache.org/jira/browse/HDFS-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971255#comment-14971255 ] Hadoop QA commented on HDFS-9290: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9296) ShellBasedUnixGroupMapping should support group names with space

[ https://issues.apache.org/jira/browse/HDFS-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971252#comment-14971252 ] Allen Wittenauer commented on HDFS-9296: bq. AD permits group names with space (e.g. "Domain

[jira] [Commented] (HDFS-9272) Implement a unix-like cat utility

[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971177#comment-14971177 ] James Clampffer commented on HDFS-9272: --- Will do. Is there generally a preference in the HDFS

[jira] [Updated] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7284: Labels: supportability (was: ) > Add more debug info to >

[jira] [Created] (HDFS-9296) ShellBasedUnixGroupMapping should support group names with space

Wei-Chiu Chuang created HDFS-9296: - Summary: ShellBasedUnixGroupMapping should support group names with space Key: HDFS-9296 URL: https://issues.apache.org/jira/browse/HDFS-9296 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-9296) ShellBasedUnixGroupMapping should support group names with space

[ https://issues.apache.org/jira/browse/HDFS-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-9296. --- Resolution: Duplicate I filed in the wrong category. A new one is filed as HADOOP-12505 >

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9295: --- Attachment: HDFS-9295.001.patch > Add a thorough test of the full KMS code path >

[jira] [Commented] (HDFS-9243) TestUnderReplicatedBlocks#testSetrepIncWithUnderReplicatedBlocks test timeout

[ https://issues.apache.org/jira/browse/HDFS-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970914#comment-14970914 ] Wei-Chiu Chuang commented on HDFS-9243: --- Thanks for the analysis. Please feel free to assign this

[jira] [Created] (HDFS-9295) Add a thorough test of the full KMS code path

Daniel Templeton created HDFS-9295: -- Summary: Add a thorough test of the full KMS code path Key: HDFS-9295 URL: https://issues.apache.org/jira/browse/HDFS-9295 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9295: --- Affects Version/s: (was: 2.6.1) 2.7.1 Status: Patch

[jira] [Commented] (HDFS-9285) testTruncateWithDataNodesRestartImmediately occasionally fails

[ https://issues.apache.org/jira/browse/HDFS-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970919#comment-14970919 ] Wei-Chiu Chuang commented on HDFS-9285: --- Thanks [~walter.k.su] for the analysis. You have done a fix

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangliang Gu updated HDFS-9276: Attachment: HDFS-9276.02.patch > Failed to Update HDFS Delegation Token for long running application

[jira] [Commented] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970696#comment-14970696 ] 邓飞 commented on HDFS-9293: -- It's dirty reference case on FSEditLog: private ThreadLocal cache = new

[jira] [Commented] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970689#comment-14970689 ] Walter Su commented on HDFS-9293: - relates to HDFS-7609, HDFS-8611 > FSEditLog's 'OpInstanceCache'

[jira] [Resolved] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 邓飞 resolved HDFS-9293. -- Resolution: Fixed Fix Version/s: 2.7.1 > FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangliang Gu updated HDFS-9276: Attachment: HDFS-9276.03.patch > Failed to Update HDFS Delegation Token for long running application

[jira] [Work started] (HDFS-9293) FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty 'rpcId',which may cause standby NN too busy to communicate

[ https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9293 started by 邓飞. > FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty > 'rpcId',which may cause

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970736#comment-14970736 ] Hadoop QA commented on HDFS-9276: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970768#comment-14970768 ] Steve Loughran commented on HDFS-9276: -- give the patch is all to hadoop common -filing a JIRA & patch

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970727#comment-14970727 ] Ravindra Babu commented on HDFS-8914: - Lars Francke : Are you committing this change as we have

[jira] [Comment Edited] (HDFS-9254) HDFS Secure Mode Documentation updates

[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971312#comment-14971312 ] Arpit Agarwal edited comment on HDFS-9254 at 10/23/15 4:37 PM: --- So yes it

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Description: Currently for snapshot files, {{fsck -list-corruptfileblocks}} shows corrupt blocks with the

[jira] [Updated] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9297: -- Status: Patch Available (was: Open) > Update TestBlockMissingException to use >

[jira] [Commented] (HDFS-9272) Implement a unix-like cat utility

[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971367#comment-14971367 ] Haohui Mai commented on HDFS-9272: -- bq. Will do. Is there generally a preference in the HDFS community

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971395#comment-14971395 ] Lars Francke commented on HDFS-8914: I'm not a Hadoop committer, we'll have to wait for one. >

[jira] [Updated] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-7284: -- Attachment: HDFS-7284.003.patch [~yzhangal] Good idea! The output of your suggested change is:

[jira] [Commented] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971302#comment-14971302 ] Chang Li commented on HDFS-9289: [~eclark], block on 10.210.31.38 should be marked as corrupt because it's

[jira] [Updated] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9297: -- Attachment: HDFS-9297.001.patch In this patch: * Use {{corruptBlockOnDataNodesByDeletingBlockFile()}} to corrupt

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9295: --- Attachment: HDFS-9295.002.patch Fixed complier warnings > Add a thorough test of the full KMS

[jira] [Commented] (HDFS-9288) Add RapidXML to third-party

[ https://issues.apache.org/jira/browse/HDFS-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971362#comment-14971362 ] Haohui Mai commented on HDFS-9288: -- I think that requires us to fix pom.xml to exclude these files when

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971412#comment-14971412 ] Zhe Zhang commented on HDFS-9079: - Thanks Nicholas for the comment. bq. > ... => 2) Asks NN for new GS =>

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971418#comment-14971418 ] Jitendra Nath Pandey commented on HDFS-9184: I think any check at the client side can be

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.005.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971469#comment-14971469 ] Xiao Chen commented on HDFS-9231: - Thanks a lot for the review [~yzhangal]! {quote} 1. The description is

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Patch Available (was: Open) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Commented] (HDFS-9254) HDFS Secure Mode Documentation updates

[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971312#comment-14971312 ] Arpit Agarwal commented on HDFS-9254: - So yes it looks like at least the Journal Node doesn't like

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Attachment: HDFS-9077.002.patch > webhdfs client requires SPNEGO to do renew >

[jira] [Commented] (HDFS-9229) Expose size of NameNode directory as a metric

[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971375#comment-14971375 ] Surendra Singh Lilhore commented on HDFS-9229: -- Thanks [~wheat9] for suggestion.. Can I move

[jira] [Commented] (HDFS-8808) dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby

[ https://issues.apache.org/jira/browse/HDFS-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971388#comment-14971388 ] Zhe Zhang commented on HDFS-8808: - Thanks ATM for reviewing again. I just triggered Jenkins since the last

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Open (was: Patch Available) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971441#comment-14971441 ] Anu Engineer commented on HDFS-4015: none of the test failures seem to be related to this patch. >

[jira] [Commented] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971297#comment-14971297 ] Hadoop QA commented on HDFS-7284: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8631) WebHDFS : Support list/setQuota

[ https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8631: - Attachment: HDFS-8631-002.patch Attached updated patch.. Please review >

[jira] [Updated] (HDFS-9289) check genStamp when complete file

[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9289: --- Attachment: HDFS-9289.2.patch .2 patch include test. also include info of encountered genStamp and expected

[jira] [Created] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

Tony Wu created HDFS-9297: - Summary: Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile() Key: HDFS-9297 URL: https://issues.apache.org/jira/browse/HDFS-9297 Project: Hadoop

[jira] [Commented] (HDFS-9290) DFSClient#callAppend() is not backward compatible for slightly older NameNodes

[ https://issues.apache.org/jira/browse/HDFS-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972300#comment-14972300 ] Hudson commented on HDFS-9290: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2522 (See

[jira] [Commented] (HDFS-9301) HDFS clients can't construct HdfsConfiguration instances

[ https://issues.apache.org/jira/browse/HDFS-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972301#comment-14972301 ] Hudson commented on HDFS-9301: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2522 (See

[jira] [Updated] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4015: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972342#comment-14972342 ] Hudson commented on HDFS-4015: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #532 (See

[jira] [Commented] (HDFS-9290) DFSClient#callAppend() is not backward compatible for slightly older NameNodes

[ https://issues.apache.org/jira/browse/HDFS-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972341#comment-14972341 ] Hudson commented on HDFS-9290: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #532 (See

[jira] [Commented] (HDFS-9301) HDFS clients can't construct HdfsConfiguration instances

[ https://issues.apache.org/jira/browse/HDFS-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972343#comment-14972343 ] Hudson commented on HDFS-9301: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #532 (See

[jira] [Commented] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972344#comment-14972344 ] Hudson commented on HDFS-9297: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #532 (See

[jira] [Commented] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972285#comment-14972285 ] Hudson commented on HDFS-9297: -- FAILURE: Integrated in Hadoop-trunk-Commit #8699 (See

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972385#comment-14972385 ] Hudson commented on HDFS-4015: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #578 (See

[jira] [Commented] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972386#comment-14972386 ] Hudson commented on HDFS-9297: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #578 (See

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972284#comment-14972284 ] Hudson commented on HDFS-4015: -- FAILURE: Integrated in Hadoop-trunk-Commit #8699 (See

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972348#comment-14972348 ] Hudson commented on HDFS-4015: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1313 (See

[jira] [Commented] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972349#comment-14972349 ] Hudson commented on HDFS-9297: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1313 (See

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972363#comment-14972363 ] Hudson commented on HDFS-4015: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2523 (See

[jira] [Commented] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972365#comment-14972365 ] Hudson commented on HDFS-9297: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2523 (See

[jira] [Commented] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972426#comment-14972426 ] Hadoop QA commented on HDFS-7284: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Attachment: HDFS-8831.02.patch > Trash Support for deletion in HDFS encryption zone >

[jira] [Commented] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972372#comment-14972372 ] Hudson commented on HDFS-9297: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #591 (See

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972370#comment-14972370 ] Hudson commented on HDFS-4015: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #591 (See

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972367#comment-14972367 ] Arpit Agarwal commented on HDFS-4015: - Committed to trunk. Keeping Jira open for the branch-2 commit.

[jira] [Commented] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972309#comment-14972309 ] Hadoop QA commented on HDFS-9279: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

  1   2   3   >