[jira] [Commented] (HDFS-14208) A large number missingblocks happend after failover to active.
[ https://issues.apache.org/jira/browse/HDFS-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910814#comment-16910814 ] Wei-Chiu Chuang commented on HDFS-14208: This is exactly the same as HDFS-12914. The code path overlapped. I'll resolve this one as a dup. > A large number missingblocks happend after failover to active. > -- > > Key: HDFS-14208 > URL: https://issues.apache.org/jira/browse/HDFS-14208 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs >Affects Versions: 3.0.2, 3.1.1, 3.0.3 >Reporter: xuzq >Priority: Major > > When cluster is very large, Standby startup takes about 1 hours. After > Standby starts and exits SafeMode, a large number of missingblocks often > appeared after failover from standby to active. And the missingblocks will > gradually disappear after 6 hours(block report interval). > According the log and find only half the blocks of one DataNode be processed > in SaftMode. > > Because the lease expired after processed some blocks of one DataNode. > [MergeRequest|https://github.com/apache/hadoop/pull/467] -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14208) A large number missingblocks happend after failover to active.
[ https://issues.apache.org/jira/browse/HDFS-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899388#comment-16899388 ] Wei-Chiu Chuang commented on HDFS-14208: HDFS-10399? > A large number missingblocks happend after failover to active. > -- > > Key: HDFS-14208 > URL: https://issues.apache.org/jira/browse/HDFS-14208 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs >Affects Versions: 3.0.2, 3.1.1, 3.0.3 >Reporter: xuzq >Priority: Major > > When cluster is very large, Standby startup takes about 1 hours. After > Standby starts and exits SafeMode, a large number of missingblocks often > appeared after failover from standby to active. And the missingblocks will > gradually disappear after 6 hours(block report interval). > According the log and find only half the blocks of one DataNode be processed > in SaftMode. > > Because the lease expired after processed some blocks of one DataNode. > [MergeRequest|https://github.com/apache/hadoop/pull/467] -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14208) A large number missingblocks happend after failover to active.
[ https://issues.apache.org/jira/browse/HDFS-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888725#comment-16888725 ] He Xiaoqiao commented on HDFS-14208: [~xuzq_zander] Would you like to check if HDFS-12914 could help you? > A large number missingblocks happend after failover to active. > -- > > Key: HDFS-14208 > URL: https://issues.apache.org/jira/browse/HDFS-14208 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs >Affects Versions: 3.0.2, 3.1.1, 3.0.3 >Reporter: xuzq >Priority: Major > > When cluster is very large, Standby startup takes about 1 hours. After > Standby starts and exits SafeMode, a large number of missingblocks often > appeared after failover from standby to active. And the missingblocks will > gradually disappear after 6 hours(block report interval). > According the log and find only half the blocks of one DataNode be processed > in SaftMode. > > Because the lease expired after processed some blocks of one DataNode. > [MergeRequest|https://github.com/apache/hadoop/pull/467] -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
