reele opened a new pull request #8290:
URL: https://github.com/apache/dolphinscheduler/pull/8290


   ## Purpose of the pull request
   
   Some database optimizations about scheduling
   
   When a project contains 2k of processes and 3k of dependent nodes, the data 
volume of 
t_ds_task_instance/t_ds_relation_process_instance/t_ds_process_task_relation_log
 grows very fast, and running for a few days shows performance issues. Because 
of the lack of indexes, MasterServer scans dependent nodes and sub_process 
nodes It will cause serious performance problems in the database (eg: 
t_ds_task_instance has 200k records caused the 8c16g postgresql server CPU 
occupies 100%).
   
   After optimization, the CPU usage of the database server is reduced to less 
than 10%.
   
   ## Brief change log
   
   Add 3 indexes to the scheduler's database
   
   ## Verify this pull request
   
   These changes have been validated in the production environment
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to