[jira] [Work logged] (HDFS-16521) DFS API to retrieve slow datanodes

Fri, 25 Mar 2022 09:35:06 -0700 


     [ 
https://issues.apache.org/jira/browse/HDFS-16521?focusedWorklogId=747862&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747862
 ]

ASF GitHub Bot logged work on HDFS-16521:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 25/Mar/22 16:34
            Start Date: 25/Mar/22 16:34
    Worklog Time Spent: 10m 
      Work Description: virajjasani opened a new pull request #4107:
URL: https://github.com/apache/hadoop/pull/4107


   ### Description of PR
   In order to build some automation around slow datanodes that regularly show 
up in the slow peer tracking report, e.g. decommission such nodes and queue 
them up for external processing and add them back later to the cluster after 
fixing issues etc, we should expose DFS API to retrieve all slow nodes at a 
given time.
   
   Providing such API would also help add an additional option to "dfsadmin 
-report" that lists slow datanodes info for operators to take a look, 
specifically useful filter for larger clusters.
   
   ### How was this patch tested?
   Dev cluster:
   <img width="506" alt="Screenshot 2022-03-25 at 8 44 42 PM" 
src="https://user-images.githubusercontent.com/34790606/160162198-f7629df2-81a2-48f8-97bd-14d16855d03b.png";>
   
   <img width="524" alt="Screenshot 2022-03-25 at 9 12 58 PM" 
src="https://user-images.githubusercontent.com/34790606/160162218-b76f62eb-0f32-4d92-bc58-c2cbbe2c4848.png";>
   
   
   ### For code changes:
   
   - [X] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Issue Time Tracking
-------------------

            Worklog Id:     (was: 747862)
    Remaining Estimate: 0h
            Time Spent: 10m

> DFS API to retrieve slow datanodes
> ----------------------------------
>
>                 Key: HDFS-16521
>                 URL: https://issues.apache.org/jira/browse/HDFS-16521
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Viraj Jasani
>            Assignee: Viraj Jasani
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> In order to build some automation around slow datanodes that regularly show 
> up in the slow peer tracking report, e.g. decommission such nodes and queue 
> them up for external processing and add them back later to the cluster after 
> fixing issues etc, we should expose DFS API to retrieve all slow nodes at a 
> given time.
> Providing such API would also help add an additional option to "dfsadmin 
> -report" that lists slow datanodes info for operators to take a look, 
> specifically useful filter for larger clusters.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to