[GitHub] [incubator-dolphinscheduler] lenboo opened a new issue #4083: [Improvement][Master]Master improvement, less thread consumption, less time consumption

Wed, 18 Nov 2020 23:46:51 -0800 


lenboo opened a new issue #4083:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4083


   *For better global communication, please give priority to using English 
description, thx! *
   
   improvement for master
   
   
![image](https://user-images.githubusercontent.com/29528966/99616759-c70def80-2a58-11eb-9661-f8f0012354f5.png)
   
   At present, the problems of master:
   
   1. There are many polling, that result in unnecessary time-cost
   
   2. The distributed lock is used when the command is taken, that result in 
the bottleneck of concurrency
   
   3. Too many threads(nProcessInstance*nTaskInstances) are used, that result 
in the waste of system resources
   
   4. Polling database result in database query pressure bottleneck
   
   
   
   Master模块优化：
   目前的master：
   
   
![image](https://user-images.githubusercontent.com/29528966/99615188-ea836b00-2a55-11eb-8fde-0b7bf7af91ca.png)
   
   目前发现master的问题：
   1.  出现比较多的轮询，造成不必要的耗时
   2.  取command的时候使用了分布式锁，造成并发数量的瓶颈
   3.  线程使用过多(nProcessInstance*nTaskInstances) ，造成系统资源浪费的现象
   4.  轮询数据库，数据量大的情况下，造成数据库查询压力瓶颈
   
   
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to