Have you tried options '-mat_superlu_dist_equil NO -mat_superlu_dist_rowperm NATURAL -mat_superlu_dist_colperm NATURAL '?
In addition, how do you know mumps is not as fast as superlu_dist? Hong On Fri, Jul 29, 2011 at 1:11 PM, Barry Smith <bsmith at mcs.anl.gov> wrote: > > ?Ok, next step is valgrind > http://www.mcs.anl.gov/petsc/petsc-as/documentation/faq.html#valgrind > > ? valgrind is an amazing tool (and I don't say the easily) to help track down > memory corruption problems that otherwise are difficult to find. ?It is > likely that valgrind can resolve this issue in a few minutes. > > ? Barry > > > > On Jul 29, 2011, at 12:52 PM, Travis C. Fisher wrote: > >> Barry, >> >> I added the line, >> call MatSetOption(pcmat,MAT_NEW_NONZERO_LOCATION_ERR,PETSC_TRUE,ierr), >> after the call to matrix assembly and do not get an error associated with >> the nonzero locations. >> >> Here is the error running superlu_dist with one processor. >> >> 0 SNES Function norm 9.448256037271e+02 >> ? ? ? Nonzeros in L ? ? ? 21005940 >> ? ? ? Nonzeros in U ? ? ? 21018240 >> ? ? ? nonzeros in L+U ? ? 41958975 >> ? ? ? nonzeros in LSUB ? ?3914621 >> [0]PETSC ERROR: >> ------------------------------------------------------------------------ >> [0]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, >> probably memory access out of range >> [0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger >> [0]PETSC ERROR: or see >> http://www.mcs.anl.gov/petsc/petsc-as/documentation/faq.html#valgrind[0]PETSC >> ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find >> memory corruption errors >> [0]PETSC ERROR: likely location of problem given in stack below >> [0]PETSC ERROR: --------------------- ?Stack Frames >> ------------------------------------ >> [0]PETSC ERROR: Note: The EXACT line numbers in the stack are not available, >> [0]PETSC ERROR: ? ? ? INSTEAD the line number of the start of the function >> [0]PETSC ERROR: ? ? ? is given. >> [0]PETSC ERROR: [0] MatSolve_SuperLU_DIST line 117 >> /scratch/tfisher/petsc-dev/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c >> [0]PETSC ERROR: [0] MatSolve line 3039 >> /scratch/tfisher/petsc-dev/src/mat/interface/matrix.c >> [0]PETSC ERROR: [0] PCApply_LU line 202 >> /scratch/tfisher/petsc-dev/src/ksp/pc/impls/factor/lu/lu.c >> [0]PETSC ERROR: [0] PCApply line 373 >> /scratch/tfisher/petsc-dev/src/ksp/pc/interface/precon.c >> [0]PETSC ERROR: [0] KSPInitialResidual line 45 >> /scratch/tfisher/petsc-dev/src/ksp/ksp/interface/itres.c >> [0]PETSC ERROR: [0] KSPSolve_LGMRES line 354 >> /scratch/tfisher/petsc-dev/src/ksp/ksp/impls/gmres/lgmres/lgmres.c >> [0]PETSC ERROR: [0] KSPSolve line 330 >> /scratch/tfisher/petsc-dev/src/ksp/ksp/interface/itfunc.c >> [0]PETSC ERROR: [0] SNES_KSPSolve line 3364 >> /scratch/tfisher/petsc-dev/src/snes/interface/snes.c >> [0]PETSC ERROR: [0] SNESSolve_LS line 142 >> /scratch/tfisher/petsc-dev/src/snes/impls/ls/ls.c >> [0]PETSC ERROR: [0] SNESSolve line 2617 >> /scratch/tfisher/petsc-dev/src/snes/interface/snes.c >> [0]PETSC ERROR: --------------------- Error Message >> ------------------------------------ >> [0]PETSC ERROR: Signal received! >> [0]PETSC ERROR: >> ------------------------------------------------------------------------ >> [0]PETSC ERROR: Petsc Development HG revision: >> 77f4001db099d653cddbbaf61d75c0cf8cf833fd ?HG Date: Fri Jul 29 13:41:12 2011 >> +0200 >> [0]PETSC ERROR: See docs/changes/index.html for recent updates. >> [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting. >> [0]PETSC ERROR: See docs/index.html for manual pages. >> [0]PETSC ERROR: >> ------------------------------------------------------------------------ >> [0]PETSC ERROR: ./HFCFS on a arch-linu named larss-nad by tcfishe1 Fri Jul >> 29 13:47:04 2011 >> [0]PETSC ERROR: Libraries linked from >> /ump/fldmd/home/tcfishe1/gnucompiled/lib >> [0]PETSC ERROR: Configure run at Fri Jul 29 11:37:36 2011 >> [0]PETSC ERROR: Configure options >> --prefix=/ump/fldmd/home/tcfishe1/gnucompiled --download-fblas-lapack=yes >> --download-superlu_dist=yes --download-parmetis=yes --download-hypre=yes >> --download-mumps=yes --download-blacs=yes --download-scalapack=yes >> [0]PETSC ERROR: >> ------------------------------------------------------------------------ >> [0]PETSC ERROR: User provided function() line 0 in unknown directory unknown >> file >> -------------------------------------------------------------------------- >> MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD >> with errorcode 59. >> >> Thanks, >> >> Travis >> > >
