xiashao1980 opened a new issue #5364:
URL: https://github.com/apache/dolphinscheduler/issues/5364


   **Describe the bug**
   When I add thousands of process instances to DS by API, sometimes the newest 
process could not be found in the process instance list. I had researched the 
tables in the ds database, and I found that all new instance requests were 
saved in 'ds_command'. I dumped the stack of the ds master service process, but 
the information of the 'MasterSchedulerService' thread did not exist in the log 
file.
   It seemed that the core thread 'MasterSchedulerService' has been terminated 
accidentally.
   Then, I had to restart the ds master service, and all blocked commands had 
been executed soon.
   
   Please download the 'jstack' log file by the following URL:
   URL:https://pan.baidu.com/s/1NL2mM2s9ud7rqMM0It3pOw 
   code:ttn5 
   
   Thanks.
   
   **To Reproduce**
   1. Set 'worker.exec.threads' to 1
   2. Set 'master.exec.threads' to 4000
   3. Add two thousand process instances to DS by API in 1 minute.
   4. If it is not blocked, add more instances and try again.
   
   **Expected behavior**
   Anyway, the 'MasterSchedulerService' thread should not be terminated 
accidentally.
   
   **Screenshots**
   No.
   
   **Which version of Dolphin [Scheduler:**]
   1.3.4
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to