[ 
https://issues.apache.org/jira/browse/HDFS-16676?focusedWorklogId=794862&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794862
 ]

ASF GitHub Bot logged work on HDFS-16676:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 25/Jul/22 12:01
            Start Date: 25/Jul/22 12:01
    Worklog Time Spent: 10m 
      Work Description: ashutoshcipher opened a new pull request, #4626:
URL: https://github.com/apache/hadoop/pull/4626

   ### Description of PR
   
   DatanodeAdminManager$Monitor reports a node as invalid continuously
   
   JIRA - HDFS-16676
   
   
   ### For code changes:
   
   - [X] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the 
endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, 
`NOTICE-binary` files?
   
   




Issue Time Tracking
-------------------

            Worklog Id:     (was: 794862)
    Remaining Estimate: 0h
            Time Spent: 10m

> DatanodeAdminManager$Monitor reports a node as invalid continuously
> -------------------------------------------------------------------
>
>                 Key: HDFS-16676
>                 URL: https://issues.apache.org/jira/browse/HDFS-16676
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 3.2.1
>            Reporter: Prabhu Joseph
>            Assignee: groot
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> DatanodeAdminManager$Monitor reports a node as invalid continuously
> {code}
> 2022-07-21 06:54:38,562 WARN 
> org.apache.hadoop.hdfs.server.blockmanagement.DatanodeAdminManager 
> (DatanodeAdminMonitor-0): DatanodeAdminMonitor caught exception when 
> processing node 1.2.3.4:9866.
> java.lang.IllegalStateException: Node 1.2.3.4:9866 is in an invalid state! 
> Invalid state: In Service 0 blocks are on this dn.
>         at 
> com.google.common.base.Preconditions.checkState(Preconditions.java:172)
>         at 
> org.apache.hadoop.hdfs.server.blockmanagement.DatanodeAdminManager$Monitor.check(DatanodeAdminManager.java:601)
>         at 
> org.apache.hadoop.hdfs.server.blockmanagement.DatanodeAdminManager$Monitor.run(DatanodeAdminManager.java:504)
>         at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>         at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>         at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:750)
> {code}
> A node goes into invalid state when stopDecommission sets the node to 
> IN-Service and misses to remove from pendingNodes queues (HDFS-16675). This 
> will be corrected only when user triggers startDecommission. Till then we 
> need not keep the invalid state node in the queue as anyway startDecommission 
> will add it back.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to