Sorry, this error was with MKL matrices. It is still an error inside of Plex. My non-Plex tests (KSP) now work in a branch (pushed).
On Tue, Jul 3, 2018 at 7:24 PM Mark Adams <[email protected]> wrote: > > > On Tue, Jul 3, 2018 at 6:26 PM Jed Brown <[email protected]> wrote: > >> "Smith, Barry F." <[email protected]> writes: >> >> > Runs fine in the master branch; do you really need it to work in >> maint. >> >> Uh, many users work with releases. If this is a "regression" it implies >> that it worked at some point in the past. In that case, we should fix >> it in 'maint' even if some new feature in 'master' has also fixed it. >> Note that Mark's prompt says he's on 'master', not 'maint'. >> > > Yea, let me double check this. > > >> >> > Barry >> > >> > >> >> On Jul 3, 2018, at 6:39 AM, Mark Adams <[email protected]> wrote: >> >> >> >> SNES ex56 seems to have regressed: >> >> >> >> 04:35 nid02516 master *= >> ~/petsc_install/petsc/src/snes/examples/tutorials$ make >> PETSC_DIR=/global/homes/m/madams/petsc_install/petsc-cori-knl-opt-intel-omp >> PETSC_ARCH="" runex56 >> >> srun -n 1 ./ex56 -cells 2,2,1 -max_conv_its 3 -petscspace_order 2 >> -snes_max_it 2 -ksp_max_it 100 -ksp_type cg -ksp_rtol 1.e-11 -ksp_norm_type >> unpreconditioned -snes_rtol 1.e-10 -pc_type gamg -pc_gamg_type agg >> -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 1000 >> -pc_gamg_reuse_interpolation true -pc_gamg_square_graph 1 >> -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .0 -ksp_converged_reason >> -snes_monitor_short -ksp_monitor_short -snes_converged_reason >> -use_mat_nearnullspace true -mg_levels_ksp_max_it 1 -mg_levels_ksp_type >> chebyshev -mg_levels_esteig_ksp_type cg -mg_levels_esteig_ksp_max_it 10 >> -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_pc_type jacobi >> -petscpartitioner_type simple -mat_block_size 3 -matptap_via scalable >> -ex56_dm_view -run_type 1 >> >> OMP: Warning #239: KMP_AFFINITY: granularity=fine will be used. >> >> >> >> [0]PETSC ERROR: --------------------- Error Message >> -------------------------------------------------------------- >> >> >> [0]PETSC ERROR: Object is in wrong state >> >> >> >> [0]PETSC ERROR: Not for unassembled matrix >> >> >> >> [0]PETSC ERROR: See >> http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble >> shooting. >> >> >> [0]PETSC ERROR: Petsc Development GIT revision: >> v3.9.2-825-g3a11c7608d GIT Date: 2018-07-01 06:15:09 +0200 >> >> >> [0]PETSC ERROR: >> /global/u2/m/madams/petsc_install/petsc/src/snes/examples/tutorials/./ex56 >> on a named nid02516 by madams Tue Jul 3 04:35:52 2018 >> >> >> [0]PETSC ERROR: Configure options --known-level1-dcache-size=32768 >> --known-level1-dcache-linesize=64 --known-level1-dcache-assoc=8 >> --known-sizeof-char=1 --known-sizeof-void-p=8 --known-sizeof-short=2 >> --known-sizeof-int=4 --known-sizeof-long=8 --known-sizeof-long-long=8 >> --known-sizeof-float=4 --known-sizeof-double=8 --known-sizeof-size_t=8 >> --known-bits-per-byte=8 --known-memcmp-ok=1 --known-sizeof-MPI_Comm=4 >> --known-sizeof-MPI_Fint=4 --known-mpi-long-double=1 --known-mpi-int64_t=1 >> --known-mpi-c-double-complex=1 --known-mklspblas-supports-zero-based=0 >> --known-has-attribute-aligned=1 --with-cc=cc --with-cxx=CC --with-fc=ftn >> COPTFLAGS=" -g -O0 -mkl -static-intel" CXXOPTFLAGS="-g -O0 -mkl >> -static-intel" FOPTFLAGS=" -g -O0 -mkl -static-intel" --download-metis=1 >> --with-hypre-dir=/global/homes/m/madams/tmp/hypre32-2.14.0 >> --download-parmetis=1 >> LIBS="-L/opt/intel/compilers_and_libraries_2018.1.163/linux/mkl/lib/intel64 >> -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -liomp5 -lpthread" >> --with-blaslapack-include=/opt/intel/compilers_and_libraries_2018.1.163/linux/mkl/include >> --with-debugging=1 --with-mpiexec=srun --with-batch=1 >> --known-mpi-shared-libraries=1 --known-64-bit-blas-indices=0 >> --with-64-bit-indices=0 PETSC_ARCH=arch-cori-knl-opt-intel-omp >> --with-openmp=1 --download-p4est=0 --with-x=0 >> --prefix=/global/homes/m/madams/petsc_install/petsc-cori-knl-opt-intel-omp >> PETSC_DIR=/global/homes/m/madams/petsc_install/petsc >> >> [0]PETSC ERROR: #1 MatConvert() line 4066 in >> /global/u2/m/madams/petsc_install/petsc/src/mat/interface/matrix.c >> >> [0]PETSC ERROR: #2 MatSetType() line 67 in >> /global/u2/m/madams/petsc_install/petsc/src/mat/interface/matreg.c >> >> [0]PETSC ERROR: #3 MatSetFromOptions() line 229 in >> /global/u2/m/madams/petsc_install/petsc/src/mat/utils/gcreate.c >> >> [0]PETSC ERROR: #4 DMCreateMatrix_Plex() line 1137 in >> /global/u2/m/madams/petsc_install/petsc/src/dm/impls/plex/plex.c >> >> [0]PETSC ERROR: #5 DMCreateMatrix() line 1266 in >> /global/u2/m/madams/petsc_install/petsc/src/dm/interface/dm.c >> >> [0]PETSC ERROR: #6 main() line 428 in >> /global/homes/m/madams/petsc_install/petsc/src/snes/examples/tutorials/ex56.c >> >> [0]PETSC ERROR: PETSc Option Table entries: >> >> [0]PETSC ERROR: -cells 2,2,1 >> >> [0]PETSC ERROR: -ex56_dm_refine 0 >> >> [0]PETSC ERROR: -ex56_dm_view >> >> [0]PETSC ERROR: -ksp_converged_reason >> >> [0]PETSC ERROR: -ksp_max_it 100 >> >> [0]PETSC ERROR: -ksp_monitor_short >> >> [0]PETSC ERROR: -ksp_norm_type unpreconditioned >> >> [0]PETSC ERROR: -ksp_rtol 1.e-11 >> >> [0]PETSC ERROR: -ksp_type cg >> >> [0]PETSC ERROR: -mat_block_size 3 >> >> [0]PETSC ERROR: -mat_type aijmkl >> >> [0]PETSC ERROR: -matptap_via scalable >> >> [0]PETSC ERROR: -max_conv_its 3 >> >> [0]PETSC ERROR: -mg_levels_esteig_ksp_max_it 10 >> >> [0]PETSC ERROR: -mg_levels_esteig_ksp_type cg >> >> [0]PETSC ERROR: -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 >> >> [0]PETSC ERROR: -mg_levels_ksp_max_it 1 >> >> [0]PETSC ERROR: -mg_levels_ksp_type chebyshev >> >> [0]PETSC ERROR: -mg_levels_pc_type jacobi >> >> [0]PETSC ERROR: -pc_gamg_agg_nsmooths 1 >> >> [0]PETSC ERROR: -pc_gamg_coarse_eq_limit 1000 >> >> [0]PETSC ERROR: -pc_gamg_reuse_interpolation true >> >> [0]PETSC ERROR: -pc_gamg_square_graph 1 >> >> >> >
