[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089685#comment-16089685 ] Jiandan Yang commented on HDFS-9668: - [~jingcheng.du] OK, Thank you for answering me so soon. >

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089699#comment-16089699 ] Jiandan Yang commented on HDFS-9668: - [~jingcheng.du] This problem has been resolved more than six

[jira] [Comment Edited] (HDFS-12132) Both two NameNodes become Standby because the ZKFC exception

[ https://issues.apache.org/jira/browse/HDFS-12132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086799#comment-16086799 ] Jiandan Yang edited comment on HDFS-12132 at 7/17/17 11:49 AM: Thank you

[jira] [Commented] (HDFS-12132) Both two NameNodes become Standby because the ZKFC exception

[ https://issues.apache.org/jira/browse/HDFS-12132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089705#comment-16089705 ] Jiandan Yang commented on HDFS-12132: -- [~surendrasingh] What do you think of the above idea？ >

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089605#comment-16089605 ] Jiandan Yang commented on HDFS-9668: - [~jingcheng.du] I have a question to ask you about test test

[jira] [Commented] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091150#comment-16091150 ] Jiandan Yang commented on HDFS-10733: -- [~redvine] I would like to ask you a question for the

[jira] [Created] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

Jiandan Yang created HDFS-12177: Summary: NameNode exits due to setting BlockPlacementPolicy loglevel to Debug Key: HDFS-12177 URL: https://issues.apache.org/jira/browse/HDFS-12177 Project: Hadoop

[jira] [Updated] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

[ https://issues.apache.org/jira/browse/HDFS-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12177: - Attachment: HDFS_9668_1.patch > NameNode exits due to setting BlockPlacementPolicy loglevel to

[jira] [Commented] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

[ https://issues.apache.org/jira/browse/HDFS-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095717#comment-16095717 ] Jiandan Yang commented on HDFS-12177: -- [~brahmareddy] Thanks for your quick response > NameNode

[jira] [Updated] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

[ https://issues.apache.org/jira/browse/HDFS-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12177: - Resolution: Duplicate Status: Resolved (was: Patch Available) > NameNode exits due to

[jira] [Reopened] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

[ https://issues.apache.org/jira/browse/HDFS-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang reopened HDFS-12177: -- > NameNode exits due to setting BlockPlacementPolicy loglevel to Debug >

[jira] [Updated] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

[ https://issues.apache.org/jira/browse/HDFS-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12177: - Attachment: HDFS-12177-001-branch-2.7.patch > NameNode exits due to setting BlockPlacementPolicy

[jira] [Updated] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

[ https://issues.apache.org/jira/browse/HDFS-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12177: - Attachment: HDFS-12177-001-branch-2.8.patch > NameNode exits due to setting BlockPlacementPolicy

[jira] [Commented] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

[ https://issues.apache.org/jira/browse/HDFS-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095832#comment-16095832 ] Jiandan Yang commented on HDFS-12177: -- OK, I have uploaded patch with branch-2.8 and branch-2.7 >

[jira] [Commented] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102983#comment-16102983 ] Jiandan Yang commented on HDFS-12200: -- ut and findbugs error is not introduced by this patch >

[jira] [Commented] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102989#comment-16102989 ] Jiandan Yang commented on HDFS-12200: -- [~brahmareddy] Please help me review it. Thanks a log. >

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid cpu utilization too high

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Summary: Optimize CachedDNSToSwitchMapping to avoid cpu utilization too high (was: Optimize

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Attachment: (was: HDFS-12200-002.patch) > Optimize CachedDNSToSwitchMapping to avoid high cpu

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Attachment: HDFS-12200-002.patch > Optimize CachedDNSToSwitchMapping to avoid high cpu

[jira] [Created] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid cpu utilization is too high

Jiandan Yang created HDFS-12200: Summary: Optimize CachedDNSToSwitchMapping to avoid cpu utilization is too high Key: HDFS-12200 URL: https://issues.apache.org/jira/browse/HDFS-12200 Project: Hadoop

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid cpu utilization is too high

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Attachment: HDFS-12200-001.patch > Optimize CachedDNSToSwitchMapping to avoid cpu utilization is

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid cpu utilization is too high

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Description: 1. Background : Our hadoop cluster is disaggregated storage and compute, HDFS is

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Description: 1. Background : Our hadoop cluster is disaggregated storage and compute, HDFS is

[jira] [Work started] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12200 started by Jiandan Yang . > Optimize CachedDNSToSwitchMapping to avoid high cpu utilization >

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Status: Patch Available (was: In Progress) > Optimize CachedDNSToSwitchMapping to avoid high cpu

[jira] [Assigned] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang reassigned HDFS-12200: Assignee: Jiandan Yang > Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Summary: Optimize CachedDNSToSwitchMapping to avoid high cpu utilization (was: Optimize

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Summary: Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization (was: Optimize

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid cpu utilization is too high

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Attachment: cpu_ utilization.png nn_thread_num.png > Optimize

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Attachment: HDFS-12200-002.patch > Optimize CachedDNSToSwitchMapping to avoid high cpu

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid high cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Description: 1. Background : Our hadoop cluster is disaggregated storage and compute, HDFS is

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Attachment: HDFS-12200-003.patch > Optimize CachedDNSToSwitchMapping to avoid 100% cpu

[jira] [Commented] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102642#comment-16102642 ] Jiandan Yang commented on HDFS-12200: -- upload HDFS-12200-003.patch, fix ut and checkstyle >

[jira] [Comment Edited] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102989#comment-16102989 ] Jiandan Yang edited comment on HDFS-12200 at 7/31/17 1:38 AM: ---

[jira] [Commented] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169546#comment-16169546 ] Jiandan Yang commented on HDFS-12446: -- NN log exception info as description. this because

[jira] [Comment Edited] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169546#comment-16169546 ] Jiandan Yang edited comment on HDFS-12446 at 9/18/17 3:43 AM: --- NN log

[jira] [Created] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

Jiandan Yang created HDFS-12446: Summary: FSNamesystem#internalReleaseLease throw IllegalStateException Key: HDFS-12446 URL: https://issues.apache.org/jira/browse/HDFS-12446 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12446: - Description: NameNonde log always print following logs. {code:java} 2017-09-14 10:21:32,042 INFO

[jira] [Updated] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12446: - Description: NameNode always print following logs. {code:java} 2017-09-14 10:21:32,042 INFO

[jira] [Updated] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12446: - Description: NameNode always print following logs. {code:java} 2017-09-14 10:21:32,042 INFO

[jira] [Updated] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12446: - Description: NameNode log always print following logs. {code:java} 2017-09-14 10:21:32,042 INFO

[jira] [Updated] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12446: - Description: NameNode always print following logs. {code:java} 2017-09-14 10:21:32,042 INFO

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203501#comment-16203501 ] Jiandan Yang commented on HDFS-12638: -- I find another block with the same problem, and the

[jira] [Comment Edited] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201540#comment-16201540 ] Jiandan Yang edited comment on HDFS-12638 at 10/13/17 9:48 AM: datanode

[jira] [Comment Edited] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205739#comment-16205739 ] Jiandan Yang edited comment on HDFS-12638 at 10/16/17 11:15 AM: - Doing

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Attachment: HDFS-12638-branch-2.8.2.001.patch > NameNode exits due to ReplicationMonitor thread

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205739#comment-16205739 ] Jiandan Yang commented on HDFS-12638: -- Doing truncate & delete files when cluster is RollingUpgrade

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Status: Patch Available (was: Open) > NameNode exits due to ReplicationMonitor thread received

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203022#comment-16203022 ] Jiandan Yang commented on HDFS-12638: -- [~daryn] NN audit log lost some, and we did not find truncate

[jira] [Comment Edited] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203501#comment-16203501 ] Jiandan Yang edited comment on HDFS-12638 at 10/13/17 12:39 PM: - I find

[jira] [Updated] (HDFS-12638) NameNode exit due to NPE

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Description: Active NamNode exit due to NPE, I can confirm that the BlockCollection passed in

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Summary: NameNode exits due to ReplicationMonitor thread received Runtime exception in

[jira] [Updated] (HDFS-12638) NameNode exit due to ReplicationMonitor thread received Runtime exception in

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Summary: NameNode exit due to ReplicationMonitor thread received Runtime exception in (was:

[jira] [Updated] (HDFS-12638) NameNode exit due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Summary: NameNode exit due to ReplicationMonitor thread received Runtime exception in

[jira] [Created] (HDFS-12638) NameNode exit due to NPE

Jiandan Yang created HDFS-12638: Summary: NameNode exit due to NPE Key: HDFS-12638 URL: https://issues.apache.org/jira/browse/HDFS-12638 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-12390) Supporting refresh DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12390: - Summary: Supporting refresh DNS to switch mapping (was: Supporting DNS to switch mapping) >

[jira] [Updated] (HDFS-12390) Support to refresh DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12390: - Summary: Support to refresh DNS to switch mapping (was: Supporting refresh DNS to switch

[jira] [Updated] (HDFS-12390) Supporting DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12390: - Attachment: HDFS-12390.002.patch fix whitespace > Supporting DNS to switch mapping >

[jira] [Commented] (HDFS-12348) disable removing blocks to trash while rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153267#comment-16153267 ] Jiandan Yang commented on HDFS-12348: -- [~kihwal] How about adding dfs.datanode.trash.enable to

[jira] [Commented] (HDFS-12390) Support to refresh DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153273#comment-16153273 ] Jiandan Yang commented on HDFS-12390: -- [~djp] please review it and give me some comment. > Support

[jira] [Comment Edited] (HDFS-12390) Support to refresh DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156311#comment-16156311 ] Jiandan Yang edited comment on HDFS-12390 at 9/7/17 1:54 AM: -- [~aw]

[jira] [Updated] (HDFS-12403) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

[ https://issues.apache.org/jira/browse/HDFS-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12403: - Description: In our cluster, when found NodeManager frequently FullGC when decommissioning

[jira] [Commented] (HDFS-12403) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

[ https://issues.apache.org/jira/browse/HDFS-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158004#comment-16158004 ] Jiandan Yang commented on HDFS-12403: -- Every version has this issue, the code above is

[jira] [Commented] (HDFS-12390) Support to refresh DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156311#comment-16156311 ] Jiandan Yang commented on HDFS-12390: -- [~aw] Rewriting the script to Java will not starts child

[jira] [Created] (HDFS-12364) Compile Error：TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg

Jiandan Yang created HDFS-12364: Summary: Compile Error：TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg Key: HDFS-12364 URL: https://issues.apache.org/jira/browse/HDFS-12364

[jira] [Updated] (HDFS-12364) Compile Error：TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg

[ https://issues.apache.org/jira/browse/HDFS-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12364: - Status: Patch Available (was: Open) > Compile >

[jira] [Updated] (HDFS-12364) Compile Error：TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg

[ https://issues.apache.org/jira/browse/HDFS-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12364: - Attachment: HDFS-12364-branch-2.8.2.001.patch > Compile >

[jira] [Updated] (HDFS-12364) Compile Error：TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg

[ https://issues.apache.org/jira/browse/HDFS-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12364: - Description: error line ：dn1.setHeartbeatsDisabledForTests(true) use

[jira] [Commented] (HDFS-12348) disable removing blocks to trash while rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139523#comment-16139523 ] Jiandan Yang commented on HDFS-12348: -- add dfs.datanode.trash.enable in configuration, default

[jira] [Updated] (HDFS-12348) disable removing blocks to trash while rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12348: - Summary: disable removing blocks to trash while rolling upgrade (was: disable removing block to

[jira] [Created] (HDFS-12348) disable removing block to trash while rolling upgrade

Jiandan Yang created HDFS-12348: Summary: disable removing block to trash while rolling upgrade Key: HDFS-12348 URL: https://issues.apache.org/jira/browse/HDFS-12348 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12348) disable removing block to trash while rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12348: - Description: DataNode remove block file and meta file to trash while rolling upgrade，and do

[jira] [Updated] (HDFS-12348) disable removing blocks to trash while rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12348: - Attachment: HDFS-12348.001.patch > disable removing blocks to trash while rolling upgrade >

[jira] [Updated] (HDFS-12348) disable removing blocks to trash while rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12348: - Status: Patch Available (was: Open) > disable removing blocks to trash while rolling upgrade >

[jira] [Updated] (HDFS-12348) disable removing blocks to trash while rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12348: - Attachment: HDFS-12348.002.patch > disable removing blocks to trash while rolling upgrade >

[jira] [Updated] (HDFS-12348) disable removing blocks to trash while rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12348: - Attachment: HDFS-12348.003.patch > disable removing blocks to trash while rolling upgrade >

[jira] [Updated] (HDFS-12390) Supporting DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12390: - Fix Version/s: (was: 2.8.2) > Supporting DNS to switch mapping >

[jira] [Updated] (HDFS-12390) Supporting DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12390: - Attachment: HDFS-12390.001.patch > Supporting DNS to switch mapping >

[jira] [Updated] (HDFS-12390) Supporting DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12390: - Description: As described in [HDFS-12200|https://issues.apache.org/jira/browse/HDFS-12200],

[jira] [Updated] (HDFS-12390) Supporting DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12390: - Fix Version/s: 2.8.2 Status: Patch Available (was: Open) > Supporting DNS to switch

[jira] [Updated] (HDFS-12390) Supporting DNS to switch mapping

[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12390: - Attachment: HDFS-12390-branch-2.8.2.001.patch > Supporting DNS to switch mapping >

[jira] [Created] (HDFS-12390) Supporting DNS to switch mapping

Jiandan Yang created HDFS-12390: Summary: Supporting DNS to switch mapping Key: HDFS-12390 URL: https://issues.apache.org/jira/browse/HDFS-12390 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Comment Edited] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201343#comment-16201343 ] Jiandan Yang edited comment on HDFS-12638 at 10/12/17 2:21 AM: [~daryn]

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201343#comment-16201343 ] Jiandan Yang commented on HDFS-12638: -- [~daryn] There is no snapshot directory in cluster, and we

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201413#comment-16201413 ] Jiandan Yang commented on HDFS-12638: -- We found missing blockId by metasave, and did fsck -blockId,

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201540#comment-16201540 ] Jiandan Yang commented on HDFS-12638: -- datanode revover failed because new blocksize is Long.MAX

[jira] [Comment Edited] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201540#comment-16201540 ] Jiandan Yang edited comment on HDFS-12638 at 10/12/17 7:03 AM: datanode

[jira] [Created] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

Jiandan Yang created HDFS-12814: Summary: Add blockId when warning slow mirror/disk in BlockReceiver Key: HDFS-12814 URL: https://issues.apache.org/jira/browse/HDFS-12814 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252859#comment-16252859 ] Jiandan Yang edited comment on HDFS-12754 at 11/15/17 2:35 AM:

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252859#comment-16252859 ] Jiandan Yang commented on HDFS-12754: -- [~xiaochen] Thank you for reviewing. The fix here is to

[jira] [Comment Edited] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252859#comment-16252859 ] Jiandan Yang edited comment on HDFS-12754 at 11/15/17 2:34 AM:

[jira] [Comment Edited] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252859#comment-16252859 ] Jiandan Yang edited comment on HDFS-12754 at 11/15/17 2:41 AM:

[jira] [Updated] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12814: - Status: Patch Available (was: Open) > Add blockId when warning slow mirror/disk in BlockReceiver

[jira] [Updated] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12814: - Attachment: HDFS-12814.001.patch > Add blockId when warning slow mirror/disk in BlockReceiver >

[jira] [Updated] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12814: - Attachment: HDFS-12814.002.patch > Add blockId when warning slow mirror/disk in BlockReceiver >

[jira] [Commented] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254631#comment-16254631 ] Jiandan Yang commented on HDFS-12814: -- Thanks [~cheersyang] and [~msingh] for review. I will add the

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243633#comment-16243633 ] Jiandan Yang commented on HDFS-12754: -- v2 patch fixes dead lock and looks good to me, [~elgoiri]

[jira] [Created] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

Jiandan Yang created HDFS-12757: Summary: DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException Key: HDFS-12757 URL:

[jira] [Updated] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12757: - Attachment: HDFS-12757.patch upload a UT to reproduce issue > DeadLock Happened Between

[jira] [Updated] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12757: - Description: Java stack is : {code:java} Found one Java-level deadlock:

  1   2   >