Hi Mark, Take a look at the example template I've put together on Cori and see if it is helpful to you:
/global/homes/r/rmills/proj/petsc/config/arch-cray-xc40-knl-opt.py (I note that the optimization levels for the different compilers were chosen after a fair amount of testing.) I'm about to check this into the config/examples directory in the PETSc repo, so I'll appreciate any comments you might have on this. Also, I note that I looked at your configure options, and it looks like you are mixing Intel compiler options (e.g., "-qopenmp-simd") with Cray compiler options (e.g., "-hcpu=mic-knl"; you want "-xMIC-AVX512" for Intel). Which compiler are you using? It's easy to get confused since the same compiler wrappers are used for the Intel, Cray, and GCC compilers. Best regards, Richard On Fri, Jun 30, 2017 at 6:44 AM, Mark Adams <[email protected]> wrote: > Argh, thanks, that is the/a problem. > > On Fri, Jun 30, 2017 at 2:16 PM, Satish Balay <[email protected]> wrote: > >> https://www.nersc.gov/users/computational-systems/cori/runni >> ng-jobs/running-jobs-on-cori-faq/ >> >> Perhaps you need to specify the knl partition to srun? >> >> Satish >> >> On Fri, 30 Jun 2017, Mark Adams wrote: >> >> > I am getting this error when I configure on KNL in with-batch. It is >> not >> > clear to me what compile line is being used in here. I've sent a bug >> report >> > to NERSC. Any ideas? >> > >> > Thanks, >> > >> > 05:13 nid00444 master= ~/petsc$ srun -n 1 ./conftest-arch-cori-knl-opt-c >> c >> > >> > Please verify that both the operating system and the processor support >> > Intel(R) AVX512F, ADX, RDSEED, AVX512ER, AVX512PF and AVX512CD >> instructions. >> > >> > srun: error: nid00444: task 0: Exited with exit code 1 >> > >> >> >
