YutingZhang edited a comment on issue #13318: Improving multi-processing reliability for gluon DataLoader URL: https://github.com/apache/incubator-mxnet/pull/13318#issuecomment-440783824 @zhreshold Right. If the `shutdown()` does not wait for process to join, the queue can be destroyed first. As to the "daemon processes" thing, I think the whole program is the parent process of the workers. As long as the program runs, the deamon progresses will keep staying there. So for each epoch, there is a possibility to add a few dangling processes.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
