[jira] [Commented] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629092#comment-14629092 ] Hadoop QA commented on HDFS-8483: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8202: -- Attachment: HDFS-8202-HDFS-7285.003.patch [~zhz], updated the patch including reading and writing EC

[jira] [Updated] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8483: --- Status: Patch Available (was: Open) Erasure coding: test DataNode reporting bad/corrupted

[jira] [Updated] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8483: --- Attachment: HDFS-8483.0.patch I uploaded an initial patch. Please review it. Erasure coding:

[jira] [Updated] (HDFS-8787) Erasure coding: rename BlockInfoContiguousUC and BlockInfoStripedUC to be consistent with trunk

[ https://issues.apache.org/jira/browse/HDFS-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8787: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629184#comment-14629184 ] kanaka kumar avvaru commented on HDFS-8767: --- Looks fine for me. Thanks for

[jira] [Commented] (HDFS-8688) replace shouldCheckForEnoughRacks with hasClusterEverBeenMultiRack

[ https://issues.apache.org/jira/browse/HDFS-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629210#comment-14629210 ] Ming Ma commented on HDFS-8688: --- Thanks [~walter.k.su]! Overall it looks good.

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629070#comment-14629070 ] Ming Ma commented on HDFS-7613: --- Interesting work. There are couple issues around the

[jira] [Commented] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629094#comment-14629094 ] Xinwei Qin commented on HDFS-8202: --- Hi, [~zhz], thanks for your clarify. I will move

[jira] [Commented] (HDFS-8776) Decom manager should not be active on standby

[ https://issues.apache.org/jira/browse/HDFS-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629236#comment-14629236 ] Ming Ma commented on HDFS-8776: --- Make sense. There might be some operational impact with

[jira] [Resolved] (HDFS-8313) Erasure Coding: DFSStripedOutputStream#close throws NullPointerException exception in some cases

[ https://issues.apache.org/jira/browse/HDFS-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo resolved HDFS-8313. - Resolution: Cannot Reproduce Erasure Coding: DFSStripedOutputStream#close throws NullPointerException exception

[jira] [Commented] (HDFS-8670) Better to exclude decommissioned nodes for namenode NodeUsage JMX

[ https://issues.apache.org/jira/browse/HDFS-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629123#comment-14629123 ] J.Andreina commented on HDFS-8670: -- Testcase failures are not related to this patch.

[jira] [Assigned] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8784: - Assignee: kanaka kumar avvaru BlockInfo#numNodes should be numStorages

[jira] [Commented] (HDFS-8670) Better to exclude decommissioned nodes for namenode NodeUsage JMX

[ https://issues.apache.org/jira/browse/HDFS-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629217#comment-14629217 ] Ming Ma commented on HDFS-8670: --- Thanks [~andreina]. Overall it looks good. The two test

[jira] [Commented] (HDFS-8787) Erasure coding: rename BlockInfoContiguousUC and BlockInfoStripedUC to be consistent with trunk

[ https://issues.apache.org/jira/browse/HDFS-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629075#comment-14629075 ] Hadoop QA commented on HDFS-8787: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8483: --- Status: Open (was: Patch Available) Erasure coding: test DataNode reporting bad/corrupted

[jira] [Updated] (HDFS-6697) Make NN lease soft and hard limits configurable

[ https://issues.apache.org/jira/browse/HDFS-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-6697: - Attachment: HDFS-6697.2.patch Updated the patch. Please review. Make NN lease soft and hard limits

[jira] [Commented] (HDFS-8697) Refactor DecommissionManager: more generic method names and misc cleanup

[ https://issues.apache.org/jira/browse/HDFS-8697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629011#comment-14629011 ] Hadoop QA commented on HDFS-8697: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629017#comment-14629017 ] Takanobu Asanuma commented on HDFS-8483: I'm going to submit a patch today or

[jira] [Updated] (HDFS-7443) Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume

[ https://issues.apache.org/jira/browse/HDFS-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7443: -- Labels: 2.6.1-candidate (was: ) Datanode upgrade to BLOCKID_BASED_LAYOUT fails

[jira] [Updated] (HDFS-7489) Incorrect locking in FsVolumeList#checkDirs can hang datanodes

[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7489: -- Labels: 2.6.1-candidate (was: ) Incorrect locking in FsVolumeList#checkDirs

[jira] [Updated] (HDFS-7425) NameNode block deletion logging uses incorrect appender.

[ https://issues.apache.org/jira/browse/HDFS-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7425: -- Labels: 2.6.1-candidate (was: ) NameNode block deletion logging uses incorrect

[jira] [Updated] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7503: -- Labels: 2.6.1-candidate (was: ) Namenode restart after large deletions can

[jira] [Updated] (HDFS-7575) Upgrade should generate a unique storage ID for each volume

[ https://issues.apache.org/jira/browse/HDFS-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7575: -- Labels: 2.6.1-candidate (was: ) Upgrade should generate a unique storage ID

[jira] [Updated] (HDFS-7579) Improve log reporting during block report rpc failure

[ https://issues.apache.org/jira/browse/HDFS-7579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7579: -- Labels: 2.6.1-candidate supportability (was: supportability) Improve log

[jira] [Updated] (HDFS-7733) NFS: readdir/readdirplus return null directory attribute on failure

[ https://issues.apache.org/jira/browse/HDFS-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7733: -- Labels: 2.6.1-candidate (was: ) NFS: readdir/readdirplus return null directory

[jira] [Updated] (HDFS-7596) NameNode should prune dead storages from storageMap

[ https://issues.apache.org/jira/browse/HDFS-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7596: -- Labels: 2.6.1-candidate (was: ) NameNode should prune dead storages from

[jira] [Updated] (HDFS-7885) Datanode should not trust the generation stamp provided by client

[ https://issues.apache.org/jira/browse/HDFS-7885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7885: -- Labels: 2.6.1-candidate (was: ) Datanode should not trust the generation stamp

[jira] [Updated] (HDFS-7831) Fix the starting index and end condition of the loop in FileDiffList.findEarlierSnapshotBlocks()

[ https://issues.apache.org/jira/browse/HDFS-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7831: -- Labels: 2.6.1-candidate (was: ) Fix the starting index and end condition of

[jira] [Updated] (HDFS-8072) Reserved RBW space is not released if client terminates while writing block

[ https://issues.apache.org/jira/browse/HDFS-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8072: -- Labels: 2.6.1-candidate (was: ) Reserved RBW space is not released if client

[jira] [Updated] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8127: -- Labels: 2.6.1-candidate (was: ) NameNode Failover during HA upgrade can cause

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7960: -- Labels: 2.6.1-candidate (was: ) The full block report should prune zombie

[jira] [Updated] (HDFS-8760) Erasure Coding: reuse BlockReader when reading the same block in pread

[ https://issues.apache.org/jira/browse/HDFS-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8760: Attachment: HDFS-8760.000.patch Erasure Coding: reuse BlockReader when reading the same block in pread

[jira] [Updated] (HDFS-8760) Erasure Coding: reuse BlockReader when reading the same block in pread

[ https://issues.apache.org/jira/browse/HDFS-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8760: Attachment: (was: HDFS-8760.000.patch) Erasure Coding: reuse BlockReader when reading the same block in

[jira] [Commented] (HDFS-8783) enable socket timeout for balancer's target connection

[ https://issues.apache.org/jira/browse/HDFS-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629036#comment-14629036 ] Hadoop QA commented on HDFS-8783: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7483) Display information per tier on the Namenode UI

[ https://issues.apache.org/jira/browse/HDFS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629045#comment-14629045 ] Benoy Antony commented on HDFS-7483: [~wheat9], As I mentioned, there is no good way of

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629048#comment-14629048 ] Zhe Zhang commented on HDFS-8728: - Good point Nicholas. I should perhaps change the title

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627671#comment-14627671 ] Walter Su commented on HDFS-8704: - Hi [~libo-intel]! The test failed. Seems like the issue

[jira] [Updated] (HDFS-8779) WebUI can't display randomly generated block ID

[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8779: Status: Patch Available (was: Open) WebUI can't display randomly generated block ID

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627801#comment-14627801 ] Masatake Iwasaki commented on HDFS-8344: Hi, [~raviprak]. {code} 67private

[jira] [Created] (HDFS-8779) WebUI can't display randomly generated block ID

Walter Su created HDFS-8779: --- Summary: WebUI can't display randomly generated block ID Key: HDFS-8779 URL: https://issues.apache.org/jira/browse/HDFS-8779 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627809#comment-14627809 ] Hadoop QA commented on HDFS-8762: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627827#comment-14627827 ] Duo Zhang commented on HDFS-7966: - Small read using {{PerformanceTest}}. Unit is

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8058: Attachment: HDFS-8058-HDFS-7285.010.patch Thanks Jing for noticing the

[jira] [Updated] (HDFS-8768) Erasure Coding: block group ID displayed in WebUI is not consistent with fsck

[ https://issues.apache.org/jira/browse/HDFS-8768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8768: Attachment: screen-shot-with-HDFS-8779-patch.PNG Erasure Coding: block group ID displayed in WebUI is not

[jira] [Commented] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627666#comment-14627666 ] Li Bo commented on HDFS-8762: - Add {{this}} to log string is also a solution. But it adds too

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627677#comment-14627677 ] Li Bo commented on HDFS-8704: - I am still working on this jira. The error is random and now it

[jira] [Updated] (HDFS-8779) WebUI can't display randomly generated block ID

[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8779: Attachment: HDFS-8779.01.patch WebUI can't display randomly generated block ID

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627589#comment-14627589 ] Hadoop QA commented on HDFS-8716: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8762: Status: Patch Available (was: Open) Erasure Coding: the log of each streamer should show its index

[jira] [Updated] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8762: Attachment: HDFS-8762-HDFS-7285-001.patch Erasure Coding: the log of each streamer should show its index

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627656#comment-14627656 ] Walter Su commented on HDFS-8619: - LGTM. +1 Erasure Coding: revisit replica counting for

[jira] [Created] (HDFS-8784) BlockInfo#numNodes should be numStorages

Zhe Zhang created HDFS-8784: --- Summary: BlockInfo#numNodes should be numStorages Key: HDFS-8784 URL: https://issues.apache.org/jira/browse/HDFS-8784 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8694) Expose the stats of IOErrors on each FsVolume through JMX

[ https://issues.apache.org/jira/browse/HDFS-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628371#comment-14628371 ] Lei (Eddy) Xu commented on HDFS-8694: - Thanks for the reviews, [~andrew.wang] bq. I

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628439#comment-14628439 ] Hadoop QA commented on HDFS-8779: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8433) blockToken is not set in constructInternalBlock and parseStripedBlockGroup in StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628459#comment-14628459 ] Jing Zhao commented on HDFS-8433: - In 03 patch, when checking the block token, the

[jira] [Updated] (HDFS-8783) enable socket timeout for balancer's target connection

[ https://issues.apache.org/jira/browse/HDFS-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-8783: --- Attachment: HDFS-8783.patch enable socket timeout for balancer's target connection

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Attachment: HDFS-8728-HDFS-7285.02.patch Uploading branch-based {{HDFS-8728-HDFS-7285.02.patch}} to address

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8058: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved

[jira] [Updated] (HDFS-8747) Provide Better Scratch Space and Soft Delete Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8747: - Attachment: HDFS-8747-07152015.pdf Provide Better Scratch Space and Soft Delete Support for HDFS

[jira] [Commented] (HDFS-8670) Better to exclude decommissioned nodes for namenode NodeUsage JMX

[ https://issues.apache.org/jira/browse/HDFS-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627934#comment-14627934 ] J.Andreina commented on HDFS-8670: -- Thanks [~mingma] . I have updated the patch as per

[jira] [Updated] (HDFS-8670) Better to exclude decommissioned nodes for namenode NodeUsage JMX

[ https://issues.apache.org/jira/browse/HDFS-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8670: - Attachment: HDFS-8670.3.patch Better to exclude decommissioned nodes for namenode NodeUsage JMX

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627865#comment-14627865 ] Hadoop QA commented on HDFS-8058: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8768) Erasure Coding: block group ID displayed in WebUI is not consistent with fsck

[ https://issues.apache.org/jira/browse/HDFS-8768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-8768: -- Description: This is duplicated by [HDFS-8779]. For example, In WebUI( usually, namenode port: 50070) , one

[jira] [Commented] (HDFS-8768) Erasure Coding: block group ID displayed in WebUI is not consistent with fsck

[ https://issues.apache.org/jira/browse/HDFS-8768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627889#comment-14627889 ] GAO Rui commented on HDFS-8768: --- Thank you [~walter.k.su] very much! Erasure Coding: block

[jira] [Created] (HDFS-8780) Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node.

J.Andreina created HDFS-8780: Summary: Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. Key: HDFS-8780 URL: https://issues.apache.org/jira/browse/HDFS-8780

[jira] [Updated] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8767: -- Attachment: HDFS-8767-02.patch RawLocalFileSystem.listStatus() returns null for UNIX

[jira] [Assigned] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8771: - Assignee: kanaka kumar avvaru If IPCLoggerChannel#purgeLogsOlderThan takes too

[jira] [Commented] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627887#comment-14627887 ] Hudson commented on HDFS-7608: -- FAILURE: Integrated in Hadoop-Yarn-trunk #987 (See

[jira] [Commented] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627884#comment-14627884 ] Hudson commented on HDFS-8742: -- FAILURE: Integrated in Hadoop-Yarn-trunk #987 (See

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627885#comment-14627885 ] Hudson commented on HDFS-8722: -- FAILURE: Integrated in Hadoop-Yarn-trunk #987 (See

[jira] [Commented] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627895#comment-14627895 ] kanaka kumar avvaru commented on HDFS-8771: --- In my view, all the write related

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627877#comment-14627877 ] Hudson commented on HDFS-8722: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #257 (See

[jira] [Commented] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627879#comment-14627879 ] Hudson commented on HDFS-7608: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #257 (See

[jira] [Commented] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627876#comment-14627876 ] Hudson commented on HDFS-8742: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #257 (See

[jira] [Commented] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

[ https://issues.apache.org/jira/browse/HDFS-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628554#comment-14628554 ] Akira AJISAKA commented on HDFS-6290: - Hi [~hapandya], what's going on this issue? I'd

[jira] [Commented] (HDFS-8778) TestBlockReportRateLimiting#testLeaseExpiration can deadlock

[ https://issues.apache.org/jira/browse/HDFS-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628590#comment-14628590 ] Hadoop QA commented on HDFS-8778: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8785) TestDistributedFileSystem is failing in trunk

Arpit Agarwal created HDFS-8785: --- Summary: TestDistributedFileSystem is failing in trunk Key: HDFS-8785 URL: https://issues.apache.org/jira/browse/HDFS-8785 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628601#comment-14628601 ] Chang Li commented on HDFS-8716: those tests failures are not related to my change. I have

[jira] [Commented] (HDFS-8433) blockToken is not set in constructInternalBlock and parseStripedBlockGroup in StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628883#comment-14628883 ] Zhe Zhang commented on HDFS-8433: - Thanks for clarifying, I missed the {{BlockManager}}

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628903#comment-14628903 ] Hadoop QA commented on HDFS-8767: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8787) Erasure coding: rename BlockInfoContiguousUC and BlockInfoStripedUC to be consistent with trunk

[ https://issues.apache.org/jira/browse/HDFS-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628917#comment-14628917 ] Jing Zhao commented on HDFS-8787: - +1 pending Jenkins. Erasure coding: rename

[jira] [Commented] (HDFS-7483) Display information per tier on the Namenode UI

[ https://issues.apache.org/jira/browse/HDFS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628406#comment-14628406 ] Benoy Antony commented on HDFS-7483: To add on, I had tried the approach while working

[jira] [Created] (HDFS-8783) enable socket timeout for balancer's target connection

Chang Li created HDFS-8783: -- Summary: enable socket timeout for balancer's target connection Key: HDFS-8783 URL: https://issues.apache.org/jira/browse/HDFS-8783 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8697) Refactor DecommissionManager: more generic method names and misc cleanup

[ https://issues.apache.org/jira/browse/HDFS-8697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8697: Attachment: HDFS-8697.01.patch Thanks Andrew for pointing out the issue. Uploading new patch to revise

[jira] [Commented] (HDFS-8785) TestDistributedFileSystem is failing in trunk

[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628707#comment-14628707 ] Andrew Wang commented on HDFS-8785: --- Possibly related to HDFS-7608? [~cmccabe] thoughts?

[jira] [Updated] (HDFS-8778) TestBlockReportRateLimiting#testLeaseExpiration can deadlock

[ https://issues.apache.org/jira/browse/HDFS-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8778: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Target

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628756#comment-14628756 ] Haohui Mai commented on HDFS-8767: -- Thanks for the work. The fix looks good. bq. --The

[jira] [Assigned] (HDFS-8785) TestDistributedFileSystem is failing in trunk

[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-8785: Assignee: Xiaoyu Yao TestDistributedFileSystem is failing in trunk

[jira] [Commented] (HDFS-8785) TestDistributedFileSystem is failing in trunk

[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628654#comment-14628654 ] Xiaoyu Yao commented on HDFS-8785: -- Thanks [~arpitagarwal] for reporting this, I will take

[jira] [Commented] (HDFS-8778) TestBlockReportRateLimiting#testLeaseExpiration can deadlock

[ https://issues.apache.org/jira/browse/HDFS-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628703#comment-14628703 ] Andrew Wang commented on HDFS-8778: --- LGTM +1, thanks Arpit for finding and fixing. Test

[jira] [Commented] (HDFS-8666) speedup TestMover

[ https://issues.apache.org/jira/browse/HDFS-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628705#comment-14628705 ] Tsz Wo Nicholas Sze commented on HDFS-8666: --- With the patch, the time reduces

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628709#comment-14628709 ] Andrew Wang commented on HDFS-8779: --- Hi [~walter.k.su], is it possible to add a test for

[jira] [Commented] (HDFS-8778) TestBlockReportRateLimiting#testLeaseExpiration can deadlock

[ https://issues.apache.org/jira/browse/HDFS-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628747#comment-14628747 ] Hudson commented on HDFS-8778: -- FAILURE: Integrated in Hadoop-trunk-Commit #8169 (See

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628763#comment-14628763 ] Elliott Clark commented on HDFS-8078: - PING? HDFS client gets errors trying to to

[jira] [Created] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

Zhe Zhang created HDFS-8786: --- Summary: Erasure coding: DataNode should transfer striped blocks before being decommissioned Key: HDFS-8786 URL: https://issues.apache.org/jira/browse/HDFS-8786 Project:

[jira] [Assigned] (HDFS-8738) Limit Exceptions thrown by DataNode when a client makes socket connection and sends an empty message

[ https://issues.apache.org/jira/browse/HDFS-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Kartha reassigned HDFS-8738: --- Assignee: Rajesh Kartha Limit Exceptions thrown by DataNode when a client makes socket

[jira] [Updated] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8728: Status: Open (was: Patch Available) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[jira] [Commented] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628965#comment-14628965 ] Zhe Zhang commented on HDFS-8728: - Yes it does On Wed, Jul 15, 2015 at 4:53 PM Tsz Wo

[jira] [Updated] (HDFS-8788) Implement unit tests for remote block reader in libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8788: - Attachment: HDFS-8788.000.patch Implement unit tests for remote block reader in libhdfspp

  1   2   >