That would be great and early Feb would be perfect. Not having LU in Kokkos is not perfect but having a GPU ILU would be much much better than the current CPU LU.
I am now suspecting that I am not running the job correctly for OMP at NERSc. I am going to read the docs more carefully. On Tue, Jan 19, 2021 at 10:27 AM Junchao Zhang <[email protected]> wrote: > Mark, > I hope I can take up the Kokkos work in early February once we have the > ecp-tpds paper done. > --Junchao Zhang > > > On Mon, Jan 18, 2021 at 8:16 AM Mark Adams <[email protected]> wrote: > >> OK, this running and using OMP Fieldsplit/additive. >> >> Kokkos does not have any solvers hooked up yet, but I have added an LU >> interface that just uses AIJ's LU. >> >> Junchao, I asked Kokkos about adding LU and they said that it is on the >> todo list. Until they do that I can't use it for the paper, but if you want >> to work on integrating solvers into aijkokkos I can do that and test with >> GMRES/Jacobi. >> >> Thanks, >> Mark >> >> On Mon, Jan 18, 2021 at 1:00 AM Barry Smith <[email protected]> wrote: >> >>> >>> Mark, >>> >>> Looks like you tried to do two things at once, you removed the fopenmp >>> and put back the --with-cuda. >>> >>> >>> >>> Like I said if you want PETSc to build OpenMP and CUDA you need to >>> remove this line (and some others) from kokkos.py >>> >>> >>> >>> if self.openmp.found + pthreadfound + self.cuda.found > 1: >>> raise RuntimeError("Kokkos only supports a single parallel system >>> during its configuration") >>> >>> >>> >>> On Jan 17, 2021, at 9:39 PM, Mark Adams <[email protected]> wrote: >>> >>> >>>> >>>> Here is the problem. You set --CXXOPTFLAGS="-g -O0 -fPIC -fopenmp" to >>>> indicate how to compile for OpenMP but when ./configure checks the >>>> installed KokkosKernel include files it uses CXXPPFLAGS. (Since you >>>> provided the flag CXXOPTFLAGS ./configure never determines the flag to put >>>> into CXXPPFLAGS. >>>> >>>> It is more desirable if you do not provide -fPIC -fopenmp. >>>> ./configure will figure them out for you. >>>> >>> >>> :( >>> <configure.log> >>> >>> >>>
