[jira] [Commented] (HDFS-7037) Using distcp to copy data from insecure to secure cluster via hftp doesn't work (branch-2 only)

[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286085#comment-14286085 ] Haohui Mai commented on HDFS-7037: -- Note that distcp over webhdfs has the same issue as it

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286128#comment-14286128 ] Arpit Agarwal commented on HDFS-7645: - The first restore was by design when the rolling

[jira] [Updated] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances

[ https://issues.apache.org/jira/browse/HDFS-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7496: --- Fix Version/s: (was: 3.0.0) 2.7.0 committed to 2.7. Thanks.

[jira] [Commented] (HDFS-3443) Unable to catch up edits during standby to active switch due to NPE

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286148#comment-14286148 ] Hudson commented on HDFS-3443: -- FAILURE: Integrated in Hadoop-trunk-Commit #6904 (See

[jira] [Commented] (HDFS-7406) SimpleHttpProxyHandler puts incorrect Connection: Close header

[ https://issues.apache.org/jira/browse/HDFS-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286074#comment-14286074 ] Haohui Mai commented on HDFS-7406: -- This is not an incompatible change since it has not

[jira] [Commented] (HDFS-3443) Unable to catch up edits during standby to active switch due to NPE

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286058#comment-14286058 ] Tsz Wo Nicholas Sze commented on HDFS-3443: --- I have intentionally didnt add

[jira] [Updated] (HDFS-3443) Unable to catch up edits during standby to active switch due to NPE

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-3443: -- Hadoop Flags: Reviewed +1 patch looks good Unable to catch up edits during standby to

[jira] [Updated] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances

[ https://issues.apache.org/jira/browse/HDFS-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7496: Attachment: HDFS-7496-branch-2.000.patch Uploaded for branch-2 Fix FsVolume removal race

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286164#comment-14286164 ] Hadoop QA commented on HDFS-7548: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286169#comment-14286169 ] Colin Patrick McCabe commented on HDFS-7575: This patch does change the layout

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286051#comment-14286051 ] Tsz Wo Nicholas Sze commented on HDFS-7575: --- ... we have bumped the layout

[jira] [Commented] (HDFS-4929) [NNBench mark] Lease mismatch error when running with multiple mappers

[ https://issues.apache.org/jira/browse/HDFS-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285996#comment-14285996 ] Hadoop QA commented on HDFS-4929: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-3443) Unable to catch up edits during standby to active switch due to NPE

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-3443: -- Resolution: Fixed Fix Version/s: 2.6.1 Status: Resolved (was: Patch

[jira] [Comment Edited] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286128#comment-14286128 ] Arpit Agarwal edited comment on HDFS-7645 at 1/21/15 7:34 PM: --

[jira] [Resolved] (HDFS-5423) Verify initializations of LocatedBlock/RecoveringBlock

[ https://issues.apache.org/jira/browse/HDFS-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5423. - Resolution: Invalid Resolving as Invalid. I don't believe any work is remaining here. Verify

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeIDs but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286012#comment-14286012 ] Konstantin Shvachko commented on HDFS-7647: --- Yes, I would go with simple. That

[jira] [Updated] (HDFS-7406) SimpleHttpProxyHandler puts incorrect Connection: Close header

[ https://issues.apache.org/jira/browse/HDFS-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7406: - Hadoop Flags: Reviewed (was: Incompatible change,Reviewed) SimpleHttpProxyHandler puts incorrect

[jira] [Commented] (HDFS-7037) Using distcp to copy data from insecure to secure cluster via hftp doesn't work (branch-2 only)

[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285856#comment-14285856 ] Yongjun Zhang commented on HDFS-7037: - Thanks [~qwertymaniac], indeed what you

[jira] [Commented] (HDFS-7610) Fix removal of dynamically added DN volumes

[ https://issues.apache.org/jira/browse/HDFS-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285783#comment-14285783 ] Hudson commented on HDFS-7610: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2031 (See

[jira] [Commented] (HDFS-7641) Update archival storage user doc for list/set/get block storage policies

[ https://issues.apache.org/jira/browse/HDFS-7641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285781#comment-14285781 ] Hudson commented on HDFS-7641: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2031 (See

[jira] [Updated] (HDFS-7406) SimpleHttpProxyHandler puts incorrect Connection: Close header

[ https://issues.apache.org/jira/browse/HDFS-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7406: - Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) SimpleHttpProxyHandler puts incorrect

[jira] [Updated] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7548: - Status: Open (was: Patch Available) Cancelling the patch to address findbugs warning Corrupt

[jira] [Updated] (HDFS-7577) Add additional headers that includes need by Windows

[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thanh Do updated HDFS-7577: --- Attachment: HDFS-7577-branch-HDFS-6994-1.patch Good catch! {{os/windows/cupid.h}} is x86-specific. Attached is

[jira] [Commented] (HDFS-7037) Using distcp to copy data from insecure to secure cluster via hftp doesn't work (branch-2 only)

[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285840#comment-14285840 ] Harsh J commented on HDFS-7037: --- FWIW, this patch is still required in order to get basically

[jira] [Commented] (HDFS-7037) Using distcp to copy data from insecure to secure cluster via hftp doesn't work (branch-2 only)

[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285848#comment-14285848 ] Hadoop QA commented on HDFS-7037: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances

[ https://issues.apache.org/jira/browse/HDFS-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285780#comment-14285780 ] Hudson commented on HDFS-7496: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2031 (See

[jira] [Updated] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7548: - Status: Patch Available (was: Open) Corrupt block reporting delayed until datablock scanner

[jira] [Updated] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7548: - Attachment: HDFS-7548-v5.patch Attachnig a new patch to address findbugs warning. Added

[jira] [Updated] (HDFS-4929) [NNBench mark] Lease mismatch error when running with multiple mappers

[ https://issues.apache.org/jira/browse/HDFS-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-4929: --- Attachment: HDFS4929.patch [NNBench mark] Lease mismatch error when running with

[jira] [Updated] (HDFS-7594) Add isFileClosed and IsInSafeMode APIs in o.a.h.hdfs.client.HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-7594: -- Attachment: HDFS-7594.patch Attached a simple patch. Since this is just api delegation,

[jira] [Updated] (HDFS-4929) [NNBench mark] Lease mismatch error when running with multiple mappers

[ https://issues.apache.org/jira/browse/HDFS-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-4929: --- Status: Patch Available (was: Open) Attached patch with my proposal(having unique

[jira] [Commented] (HDFS-5183) Combine ReplicaPlacementPolicy with VolumeChoosingPolicy together to have a global view in choosing DN storage for replica.

[ https://issues.apache.org/jira/browse/HDFS-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286183#comment-14286183 ] Arpit Agarwal commented on HDFS-5183: - Also thanks for filing this and the suggested

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286264#comment-14286264 ] Tsz Wo Nicholas Sze commented on HDFS-7353: --- ... has potential to contain more

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286390#comment-14286390 ] Tsz Wo Nicholas Sze commented on HDFS-6833: --- Patch looks good in general. Some

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286224#comment-14286224 ] Rushabh S Shah commented on HDFS-7548: -- [~daryn] and [~kihwal] Thanks for the

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286238#comment-14286238 ] Hudson commented on HDFS-7548: -- FAILURE: Integrated in Hadoop-trunk-Commit #6906 (See

[jira] [Resolved] (HDFS-5183) Combine ReplicaPlacementPolicy with VolumeChoosingPolicy together to have a global view in choosing DN storage for replica.

[ https://issues.apache.org/jira/browse/HDFS-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5183. - Resolution: Implemented Hadoop Flags: (was: Incompatible change) Resolving this as

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286230#comment-14286230 ] Tsz Wo Nicholas Sze commented on HDFS-7575: --- Can you response to the practical

[jira] [Created] (HDFS-7652) Process block reports for erasure coded blocks

Zhe Zhang created HDFS-7652: --- Summary: Process block reports for erasure coded blocks Key: HDFS-7652 URL: https://issues.apache.org/jira/browse/HDFS-7652 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286408#comment-14286408 ] Tsz Wo Nicholas Sze commented on HDFS-7430: --- It seems that the entire

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286217#comment-14286217 ] Tsz Wo Nicholas Sze commented on HDFS-7575: --- This patch does change the layout

[jira] [Updated] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7548: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7566) Remove obsolete entries from hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286284#comment-14286284 ] Ray Chiang commented on HDFS-7566: -- RE: findbugs No code changes in this patch. RE:

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286221#comment-14286221 ] Kihwal Lee commented on HDFS-7548: -- +1 the patch looks good. The test case is failing even

[jira] [Updated] (HDFS-3689) Add support for variable length block

[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: HDFS-3689.008.patch Thanks for the comments, Colin. To use CreateFlag is a good suggestion.

[jira] [Commented] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286495#comment-14286495 ] Colin Patrick McCabe commented on HDFS-7430: It is fair to call this a rewrite

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Summary: DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs (was:

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Description: DatanodeManager.sortLocatedBlocks() sorts the array of DatanodeInfos inside each

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286583#comment-14286583 ] Tsz Wo Nicholas Sze commented on HDFS-7575: --- For the so called practical points

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286588#comment-14286588 ] Tsz Wo Nicholas Sze commented on HDFS-7430: --- It is fair to call this a rewrite

[jira] [Resolved] (HDFS-3458) Convert Forrest docs to APT

[ https://issues.apache.org/jira/browse/HDFS-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-3458. Resolution: Fixed Fix Version/s: 2.0.0-alpha Target Version/s: (was: )

[jira] [Commented] (HDFS-3689) Add support for variable length block

[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286436#comment-14286436 ] Hadoop QA commented on HDFS-3689: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7611) TestFileTruncate.testTruncateEditLogLoad times out waiting for Mini HDFS Cluster to start

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286458#comment-14286458 ] Byron Wong commented on HDFS-7611: -- Found it. The problem occurs in how we do

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: HDFS-7584.0.patch Enable Quota Support for Storage Types (SSD)

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Status: Patch Available (was: Open) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not

[jira] [Commented] (HDFS-6874) Add GET_BLOCK_LOCATIONS operation to HttpFS

[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286613#comment-14286613 ] Charles Lamb commented on HDFS-6874: [~lianggz], Thanks for working on this. In

[jira] [Updated] (HDFS-7611) TestFileTruncate.testTruncateEditLogLoad times out waiting for Mini HDFS Cluster to start

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Byron Wong updated HDFS-7611: - Attachment: blocksNotDeletedTest.patch Attached blocksNotDeletedTest.patch. Includes a test that

[jira] [Updated] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7611: -- Component/s: namenode Description: If quotas are enabled a combination of

[jira] [Updated] (HDFS-3519) Checkpoint upload may interfere with a concurrent saveNamespace

[ https://issues.apache.org/jira/browse/HDFS-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-3519: Target Version/s: 2.7.0 Checkpoint upload may interfere with a concurrent saveNamespace

[jira] [Updated] (HDFS-3519) Checkpoint upload may interfere with a concurrent saveNamespace

[ https://issues.apache.org/jira/browse/HDFS-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-3519: Hadoop Flags: Reviewed +1 for the patch. Ming, thank you for incorporating the feedback. Could you

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286617#comment-14286617 ] Colin Patrick McCabe commented on HDFS-7430: bq. Then, could you reuse the old

[jira] [Commented] (HDFS-7611) TestFileTruncate.testTruncateEditLogLoad times out waiting for Mini HDFS Cluster to start

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286697#comment-14286697 ] Konstantin Shvachko commented on HDFS-7611: --- Byron, good job investigating and

[jira] [Assigned] (HDFS-147) Stack trace on spaceQuota excced .

[ https://issues.apache.org/jira/browse/HDFS-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-147: --- Assignee: Xiaoyu Yao Stack trace on spaceQuota excced . --

[jira] [Commented] (HDFS-147) Stack trace on spaceQuota excced .

[ https://issues.apache.org/jira/browse/HDFS-147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286711#comment-14286711 ] Xiaoyu Yao commented on HDFS-147: - I just checked and it still can repro with space quota

[jira] [Updated] (HDFS-3689) Add support for variable length block

[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: HDFS-3689.008.patch Add support for variable length block

[jira] [Updated] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7339: Attachment: HDFS-7339-006.patch Addressing Vinay's comments. Allocating and persisting block groups in

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286473#comment-14286473 ] Zhe Zhang commented on HDFS-7339: - Thanks for review [~vinayrpet], it was very helpful. The

[jira] [Updated] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Attachment: HDFS-7430.012.patch Refactor the BlockScanner to use O(1) memory and use

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286520#comment-14286520 ] Zhe Zhang commented on HDFS-7584: - This is a very useful feature and thanks [~xyao] for

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeIDs but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Attachment: HDFS-7647.patch Thanks [~shv] and [~arpitagarwal]. I was unable to use the index arrays

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286567#comment-14286567 ] Arpit Agarwal commented on HDFS-7647: - Hi Milan, while this solution would work I'd

[jira] [Updated] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7430: -- Summary: Rewrite the BlockScanner to use O(1) memory and use multiple threads (was:

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286527#comment-14286527 ] Colin Patrick McCabe commented on HDFS-7575: bq. So, you claim that the current

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286576#comment-14286576 ] Colin Patrick McCabe commented on HDFS-7645: bq. DN layout changes will be rare

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286574#comment-14286574 ] Tsz Wo Nicholas Sze commented on HDFS-7575: --- What's important is what was

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286594#comment-14286594 ] Milan Desai commented on HDFS-7647: --- Hi [~arpitagarwal], sounds good - I will give it a

[jira] [Commented] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286637#comment-14286637 ] Colin Patrick McCabe commented on HDFS-7575: bq. I disagree. The implementation

[jira] [Updated] (HDFS-4173) If the NameNode has already been formatted, but a QuroumJournal has not, auto-format it on startup

[ https://issues.apache.org/jira/browse/HDFS-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4173: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) We currently

[jira] [Created] (HDFS-7654) TestFileTruncate#testTruncateEditLogLoad fails intermittently

Colin Patrick McCabe created HDFS-7654: -- Summary: TestFileTruncate#testTruncateEditLogLoad fails intermittently Key: HDFS-7654 URL: https://issues.apache.org/jira/browse/HDFS-7654 Project:

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286857#comment-14286857 ] Colin Patrick McCabe commented on HDFS-7430: TestBalancer#testUnknownDatanode

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286858#comment-14286858 ] Hadoop QA commented on HDFS-7647: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7647: -- Status: Open (was: Patch Available) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not

[jira] [Work started] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7647 started by Milan Desai. - DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[jira] [Comment Edited] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286987#comment-14286987 ] Yi Liu edited comment on HDFS-7392 at 1/22/15 5:47 AM: --- [~peschd], I

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287001#comment-14287001 ] Xiaoyu Yao commented on HDFS-7584: -- Thanks [~zhz] for the feedback. bq. 1. This is an

[jira] [Commented] (HDFS-7633) When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime throws IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287002#comment-14287002 ] Hadoop QA commented on HDFS-7633: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286987#comment-14286987 ] Yi Liu commented on HDFS-7392: -- [~peschd], I think this issue is not important, the reasons

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286776#comment-14286776 ] Hadoop QA commented on HDFS-7339: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7653) Block Readers and Writers used in both client side and datanode side

[ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7653: Remaining Estimate: (was: 336h) Original Estimate: (was: 336h) Block Readers and Writers used in both

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286827#comment-14286827 ] Kai Zheng commented on HDFS-7353: - Sure. Let me update my patch. Raw Erasure Coder API

[jira] [Updated] (HDFS-7633) When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime throws IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7633: Attachment: (was: h7633_20150116.patch) When Datanode has too many blocks,

[jira] [Updated] (HDFS-7633) When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime throws IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7633: Attachment: HDFS-7633.patch regenerating patch with 'git diff' When Datanode has too many blocks,

[jira] [Commented] (HDFS-7653) Block Readers and Writers used in both client side and datanode side

[ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286851#comment-14286851 ] Li Bo commented on HDFS-7653: - This patch includes block readers and writers that will be used

[jira] [Updated] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-3107) HDFS truncate

[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-3107: --- Attachment: HDFS-3107.15_branch2.patch Attaching patch for branch-2 port. Ran tests locally

[jira] [Commented] (HDFS-7633) When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime throws IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286901#comment-14286901 ] Walter Su commented on HDFS-7633: - {color:red}-1 overall{color}. {color:green}+1

[jira] [Commented] (HDFS-3443) Unable to catch up edits during standby to active switch due to NPE

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286911#comment-14286911 ] Vinayakumar B commented on HDFS-3443: - Thanks [~szetszwo] for reviews and commit

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286837#comment-14286837 ] Andrew Wang commented on HDFS-7430: --- +1 again if you need it, this patch has been through

[jira] [Updated] (HDFS-3519) Checkpoint upload may interfere with a concurrent saveNamespace

[ https://issues.apache.org/jira/browse/HDFS-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-3519: -- Attachment: HDFS-3519-branch-2.patch Thanks, Chris. Here is the patch for branch-2. Checkpoint upload may

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286896#comment-14286896 ] Yi Liu commented on HDFS-7430: -- {quote} As per Nicholas' suggestion, let's let this soak for a

  1   2   >