(I don't know if people prefer bottom-posting or top-posting, so I'm just going with GMail's default)
As usually happens, 10 minutes (ok, an hour) after I post a problem, I find a solution. The problem was that, in Cactus/configs/sim/config-data/make.config.defn, the following code block existed: # OpenMP flags export CPP_OPENMP_FLAGS = -openmp <----This was the problem export FPP_OPENMP_FLAGS = -fopenmp export C_OPENMP_FLAGS = -fopenmp export CXX_OPENMP_FLAGS = -fopenmp export CUCC_OPENMP_FLAGS = export F90_OPENMP_FLAGS = -fopenmp export F77_OPENMP_FLAGS = -fopenmp I removed "-openmp" from the CPP_OPENMP_FLAGS variable and now hwloc compiles. Much thanks to @bgoglin who was sitting on irc.freenode.net/#hwloc and caught the error for me. (And I thought IRC died in 2005 or so :-) .... took about 40 minutes to compile. But I am now running static_tov and... I'm at 740% cpu usage (Irix mode) Another hurdle surmounted. On Wed, Apr 12, 2017 at 4:58 PM, David Gore <[email protected]> wrote: > Hello, > > I am having difficulty compiling simfactory with OpenMP on a RHEL6.5 and > RHEL6.8 machine. > > The compilation goes well if I set "CCTK_OPENMP_MODE = no" I get a > working version of simfactory and can run the static_tov example. HOWEVER, > it will only run on one core. > > > When I set ppn = 8, max-num-threads=8, num-threads=8, and nodes=1 I get > the following errors: > > $ ./simfactory/bin/sim submit static_tov1 --parfile=par/static_tov.par > > Warning: Too many threads per process specified: specified num-threads=8 > (ppn-used is 8) > Warning: Total number of threads and number of threads per process are > inconsistent: procs=1, num-threads=8 (procs*num-smt must be an integer > multiple of num-threads) > Warning: Total number of threads and number of cores per node are > inconsistent: procs=1, ppn-used=8 (procs must be an integer multiple of > ppn-used) > > $ ./simfactory/bin/sim submit static_tov1 --parfile=par/static_tov.par > --procs=8 > > WARNING[L1,P0] (Carpet): Although OpenMP is disabled, the environment > variable OMP_NUM_THREADS is set to 8. It will be ignored. > WARNING level 0 from host jlabdaq.pcs.cnu.edu process 0 > while executing schedule bin (none), routine (no thorn)::(no routine) > in thorn Carpet, file /home/dgore/Cactus/Cactus/conf > igs/sim/build/Carpet/SetupGH.cc:222: > -> Although OpenMP is disabled, the environment variable > CACTUS_NUM_THREADS is set to 8. This may indicate a severe problem with the > Cactus startup mechanism. > cactus_sim: /home/dgore/Cactus/Cactus/configs/sim/build/Carpet/helpers.cc:275: > int Carpet::Abort(const cGH*, int): Assertion `0' failed. > Rank 0 with PID 32440 received signal 6 > Writing backtrace to static_tov/backtrace.0.txt > /home/dgore/simulations/static_tov2/output-0000/SIMFACTORY/RunScript: > line 26: 32440 Aborted (core dumped) > > $./simfactory/bin/sim submit static_tov1 --parfile=par/static_tov.par > --procs=1 > > -- Warning: Too many threads per process specified: specified > num-threads=8 (ppn-used is 8) > Warning: Total number of threads and number of threads per process are > inconsistent: procs=1, num-threads=8 (procs*num-smt must be an integer > multiple of num-threads) > Warning: Total number of threads and number of cores per node are > inconsistent: procs=1, ppn-used=8 (procs must be an integer multiple of > ppn-used) > > When I set all the .ini variables to 1, > > $ ./simfactory/bin/sim submit static_tov5 --parfile=par/static_tov.par > > This works and runs properly on a SINGLE core. > > When I try and use OpenMP, hwloc refuses to compile when I set > "CCTK_OPENMP_MODE = yes" The error is that "C compiler does not generate > executables" (or something similar). > > If ayone can provide any light on this, I'd be very appreciative. > > > -- > David Gore, Ph.D., Lecturer in Physics > Department of Physics, Computer Science and Engineering > Christopher Newport University > Office: 309 Luter Hall > Voice: 757 594 7827 <(757)%20594-7827> > > > -- David Gore, Ph.D., Lecturer in Physics Department of Physics, Computer Science and Engineering Christopher Newport University Office: 309 Luter Hall Voice: 757 594 7827
_______________________________________________ Users mailing list [email protected] http://cactuscode.org/mailman/listinfo/users
