Tejaskriya opened a new pull request, #7813:
URL: https://github.com/apache/ozone/pull/7813

   ## What changes were proposed in this pull request?
   
   A system-wise deletion dashboard to track deletion progress is created in 
this PR. The following metrics are covered:
   SCM:
   Deletion commands:
   - No. of commands sent (numBlockDeletionCommandSent)
   - No. of commands successful (numBlockDeletionCommandSuccess)
   - No. of commands failed (numBlockDeletionCommandFailure)
   
   Delete transactions:
   - No. of transactions created (numBlockDeletionTransactionCreated)
   - No. of transactions sent (numBlockDeletionTransactionSent)
   - No. of transactions completed (numBlockDeletionTransactionCompleted)
   - No. of transactions successful (numBlockDeletionTransactionSuccess)
   - No. of transactions failed (numBlockDeletionTransactionFailure) 
   - No. of  transactions skipped (numSkippedTransactions)
   - Success percentage of delete
   (numBlockDeletionTransactionSuccess/numBlockDeletionTransactionSent*100) 
   
   DN:
   No. of transactions received (receivedTransactionCount) 
   No. of successful transactions 
(block_deleting_service_metrics_processed_transaction_success_count)
   No. of bytes successfully deleted (successBytes)
   No. of block deletion request received (receivedBlockCount)
   No. of blocks chosen for deletion (totalBlockChosenCount)
   No. of blocks successfully deleted (successCount)
   No. of blocks pending for processing (totalPendingBlockCount)
   Success percentage of delete
   successCount/receivedBlockCount*100
   
   OM:
   KeyDeletion service:
   - Deleting_service_metrics_num_keys_processed
   - Deleting_service_metrics_num_keys_sent_for_purge
   
   DirectoryDeletingService:
   - Deleting_service_metrics_num_dirs_sent_for_purge
   - Deleting_service_metrics_num_sub_files_sent_for_purge
   - Deleting_service_metrics_num_sub_dirs_sent_for_purge
   
   PurgeRequest:
   - Deleting_service_metrics_num_keys_purged
   - Deleting_service_metrics_num_dirs_purged
   - Deleting_service_metrics_num_sub_files_moved_to_deleted_table
   - Deleting_service_metrics_num_sub_dirs_moved_to_deleted_dir_table
   
   OpenKeyDeletion:
   - Om_metrics_num_open_keys_deleted
   - Om_metrics_num_open_keys_cleaned
   - Om_metrics_num_open_keys_h_sync_cleaned
   - Om_metrics_num_open_key_delete_requests
   - Om_metrics_num_open_key_delete_request_fails
   
   
   ## What is the link to the Apache JIRA
   
   https://issues.apache.org/jira/browse/HDDS-11512
   
   ## How was this patch tested?
   
   Grafana with docker:
   <img width="1420" alt="Screenshot 2025-02-05 at 1 29 38 PM" 
src="https://github.com/user-attachments/assets/c6e84b30-243d-4a7d-b7db-d0702f0fe204";
 />
   <img width="1417" alt="Screenshot 2025-02-05 at 1 37 06 PM" 
src="https://github.com/user-attachments/assets/7ae6febc-8c29-4514-a41f-f809496121eb";
 />
   <img width="1420" alt="Screenshot 2025-02-05 at 1 38 47 PM" 
src="https://github.com/user-attachments/assets/09cb5990-966c-4fb5-b01e-08864d118f43";
 />
   <img width="1422" alt="Screenshot 2025-02-05 at 1 38 14 PM" 
src="https://github.com/user-attachments/assets/b257b192-0627-44d3-81bc-bb6ed79d6172";
 />
   <img width="1417" alt="Screenshot 2025-02-05 at 1 39 30 PM" 
src="https://github.com/user-attachments/assets/acb9df45-d2a3-46e3-ba9c-98b1ad472c7a";
 />
   <img width="1423" alt="Screenshot 2025-02-05 at 1 39 53 PM" 
src="https://github.com/user-attachments/assets/fa074137-a6ce-49b1-b74e-adb38a227334";
 />
   <img width="1420" alt="Screenshot 2025-02-05 at 1 44 34 PM" 
src="https://github.com/user-attachments/assets/27fb1990-ddcf-445a-947c-654fc2be50c1";
 />
   <img width="1422" alt="Screenshot 2025-02-05 at 1 45 35 PM" 
src="https://github.com/user-attachments/assets/3564961a-eb4f-4962-bb62-202882147768";
 />
   <img width="1426" alt="Screenshot 2025-02-05 at 1 45 54 PM" 
src="https://github.com/user-attachments/assets/f1df1a03-5481-4582-95c2-9df1117d8463";
 />
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to