[GitHub] [incubator-mxnet] xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode?
xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode? URL: https://github.com/apache/incubator-mxnet/issues/15275#issuecomment-503901791 ``` compile mxnet with OPENMP=0 export OMP_NUM_THREADS=1 export MXNET_ENGINE_TYPE=NaiveEngine ``` solve it! Other environment variables are as follows: http://mxnet.incubator.apache.org/versions/master/faq/env_var.html?highlight=naive thanks @pengzhao-intel This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-mxnet] xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode?
xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode? URL: https://github.com/apache/incubator-mxnet/issues/15275#issuecomment-503820927 @ElaineBao yes, it works, but sometimes the number of threads increased, I'm retesting if it was an error caused by my test. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-mxnet] xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode?
xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode? URL: https://github.com/apache/incubator-mxnet/issues/15275#issuecomment-503444586 @pengzhao-intel Here are my test results. - From 1 and 2, By recompiling mxnet with ```OPENMP=0```, the number of threads reduced from 33 to 11. - From 3 and 4, Adding ```export KMP_AFFINITY=granularity=fine,noduplicates,compact,1,0 export OMP_NUM_THREADS=1```, and there was no significant change in the results. - From 5 and 6, Adding ```export MXNET_ENGINE_TYPE=NaiveEngine```, the result changed significant and the result of 6 is what I need. But throughout the testing process, the number of processes will suddenly increase at the beginning and end of the test . 1. Compile mxnet with ```OPENMP=1``` and ```USE_CPP_PACKAGE = 1``` ``` ubuntu@ubuntu-MW50-SV0:~/xxj$ top -H -b -n1 | grep validat | wc -l 33 ``` 2. Compile mxnet with ```OPENMP=0``` and ```USE_CPP_PACKAGE = 1``` ``` ubuntu@ubuntu-MW50-SV0:~/xxj$ top -H -b -n1 | grep validat | wc -l 11 ``` 3. ```export KMP_AFFINITY=granularity=fine,noduplicates,compact,1,0``` ```export OMP_NUM_THREADS=1``` Compile mxnet with ```OPENMP=1``` and ```USE_CPP_PACKAGE = 1``` ``` ubuntu@ubuntu-MW50-SV0:~/xxj$ top -H -b -n1 | grep validat | wc -l 22 ``` 4. ```export KMP_AFFINITY=granularity=fine,noduplicates,compact,1,0``` ```export OMP_NUM_THREADS=1``` Compile mxnet with ```OPENMP=0``` and ```USE_CPP_PACKAGE = 1``` ``` ubuntu@ubuntu-MW50-SV0:~/xxj$ top -H -b -n1 | grep validat | wc -l 11 ``` 5. ```export MXNET_ENGINE_TYPE=NaiveEngine``` Compile mxnet with ```OPENMP=1``` and ```USE_CPP_PACKAGE = 1``` ``` ubuntu@ubuntu-MW50-SV0:~/xxj$ top -H -b -n1 | grep validat | wc -l 13 ``` 6. ```export MXNET_ENGINE_TYPE=NaiveEngine``` Compile mxnet with ```OPENMP=0``` and ```USE_CPP_PACKAGE = 1``` ``` ubuntu@ubuntu-MW50-SV0:~/xxj$ top -H -b -n1 | grep validat | wc -l 2 ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-mxnet] xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode?
xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode? URL: https://github.com/apache/incubator-mxnet/issues/15275#issuecomment-503418919 @pengzhao-intel I tried, and it's still multi-threads. By recompiling mxnet with OPENMP=0, the number of threads reduced from 33 to 11. It does not completely prohibit multi-threads. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-mxnet] xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode?
xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode? URL: https://github.com/apache/incubator-mxnet/issues/15275#issuecomment-50340 I want to take part in the FRVT competition. Here are some requirements: ``` Implementations must run in single-threaded mode, because NIST will parallelize the test by dividing the workload across many cores and many machines. Implementations must ensure that there are no issues with their software being parallelized via the fork() function. Developers should take caution with checking threading when using third-party frameworks (e.g., TensorFlow, MXNet, etc.). ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-mxnet] xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode?
xianyujie commented on issue #15275: How to run mxnet(C++) in single-thread mode? URL: https://github.com/apache/incubator-mxnet/issues/15275#issuecomment-503387579 @pengzhao-intel do you have some tips? many thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
