On Wed, 4 Sep 2013, Satish Balay wrote: > On Wed, 4 Sep 2013, Mark F. Adams wrote: > > > > > On Sep 4, 2013, at 12:34 PM, Barry Smith <[email protected]> wrote: > > > > > > > > Mark, > > > > > > Is this problem resolved. > > > > No. You said: > > > > > > > > Hmm, from hypre.py I see > > > > > > self.requires32bitint = 0 > > > > > > but then in the rest of hypre.py I don't see any different flag being > > > set to compile hypre to use 64 bit integers nor do I see any test that > > > hypre has 64 bit integers enabled. > > > > > > The hypre configure flag for 64 bit integers is --enable_bigint > > > > > > Thus I conclude we have a buggy set up in that regard. We should > > > > > > 1) when doing a hypre install pass the configure flag --enable_bigint to > > > hypre when 64 bit indices are used > > > > > > 2) add an additional test to hypre configure when 64 bit indices to make > > > sure hypre is using 64 indices. Will need to figure out a portable way to > > > do this test. > > > > > > It doesn't sound like you want me to dive into .py land and do this. > > Should I do something? > > Hm - petsc-3.4 hypre.py [and master & maint] does have the following code: > > if self.libraryOptions.integerSize == 64: > args.append('--enable-bigint') > > So --download-hypre should be doing the correct thing.. What does > configure.log say? [if --enable-bigint used for hypre build or not..]
Mark, I attempted a build on my linuxbox - and I see hypre gets correctly built with --enable-bigint ./configure --download-hypre=1 --with-64-bit-indices=1 PETSC_ARCH=arch-hypre-idx64 <configure.log> Executing: cd /home/balay/petsc.clone/externalpackages/hypre-2.9.1a/src && touch config/Makefile.config && make distclean && ./configure --prefix=/home/balay/petsc.clone/arch-hypre-idx64 --libdir=/home/balay/petsc.clone/arch-hypre-idx64/lib CC="mpicc" CFLAGS=" -fPIC -Wall -Wwrite-strings -Wno-strict-aliasing -Wno-unknown-pragmas -g3 -fno-inline -O0 " CXX="mpicxx -Wall -Wwrite-strings -Wno-strict-aliasing -Wno-unknown-pragmas -g -fPIC " F77="mpif90 -fPIC -Wall -Wno-unused-variable -Wno-unused-dummy-argument -g " --with-MPI-include="/home/balay/soft/mpich2-1.5/include" --with-MPI-lib-dirs="" --with-MPI-libs="" --with-blas-libs= --with-blas-lib-dir= --with-lapack-libs= --with-lapack-lib-dir= --with-blas=yes --with-lapack=yes --with-fmangle-blas=one-underscore --with-fmangle-lapack=one-underscore --without-babel --without-mli --without-fei --without-superlu --enable-bigint Also - does this error come with a petsc example? [if so - I can try reproducing] Satish > > Satish > > > > > > Mark > > > > > I haven't heard back from you. > > > > > > Barry > > > > > > Do they have valgrind on this machine? > > > > > > On Aug 25, 2013, at 1:04 PM, Mark F. Adams <[email protected]> wrote: > > > > > >> I'm getting these memory error in hypre on the new Cray XC30 at NERSC > > >> (Edison) with 64 bit ints. I found two different stacks in looking > > >> around processors. > > >> > > >> Any ideas? > > >> > > >> Mark > > >> > > >> #10 KSPSolve () (at 0x00000000012f121a) > > >> #9 KSPSetUp () (at 0x00000000012f5abb) > > >> #8 PCSetUp () (at 0x00000000011f7f0e) > > >> #7 PCSetUp_HYPRE () (at 0x0000000001254ab2) > > >> #6 HYPRE_BoomerAMGSetup () (at 0x00000000018a9cf6) > > >> #5 hypre_BoomerAMGSetup () (at 0x00000000018b1493) > > >> #4 hypre_BoomerAMGCreateS () (at 0x0000000001921952) > > >> #3 hypre_MatvecCommPkgCreate () (at 0x000000000194a0c0) > > >> #2 hypre_Free () (at 0x0000000001a0ee1b) > > >> #1 __libc_free (mem=<value optimized out>) at > > >> /usr/src/packages/BUILD/glibc-2.11.3/malloc/malloc.c:3733 (at > > >> 0x0000000002474a87) > > >> #0 _int_free (av=0x324a7e0, p=0x593b120) at > > >> /usr/src/packages/BUILD/glibc-2.11.3/malloc/malloc.c:4951 (at > > >> 0x00000000024714fa) > > >> > > >> > > >> > > >> #12 KSPSolve () (at 0x00000000012f121a) > > >> #11 KSPSetUp () (at 0x00000000012f5abb) > > >> #10 PCSetUp () (at 0x00000000011f7f0e) > > >> #9 PCSetUp_HYPRE () (at 0x0000000001254ab2) > > >> #8 HYPRE_BoomerAMGSetup () (at 0x00000000018a9cf6) > > >> #7 hypre_BoomerAMGSetup () (at 0x00000000018b1493) > > >> #6 hypre_BoomerAMGCreateS () (at 0x0000000001921952) > > >> #5 hypre_MatvecCommPkgCreate () (at 0x000000000194a0c0) > > >> #4 hypre_Free () (at 0x0000000001a0ee1b) > > >> #3 __libc_free (mem=<value optimized out>) at > > >> /usr/src/packages/BUILD/glibc-2.11.3/malloc/malloc.c:3733 (at > > >> 0x0000000002474a87) > > >> #2 malloc_printerr (action=2, str=0x26cf880 "double free or corruption > > >> (!prev)", ptr=<value optimized out>) at > > >> /usr/src/packages/BUILD/glibc-2.11.3/malloc/malloc.c:6261 (at > > >> 0x000000000246fd14) > > >> #1 __libc_message (do_abort=2, fmt=0x26cf6b8 "*** glibc detected *** %s: > > >> %s: 0x%s ***\n") at > > >> /usr/src/packages/BUILD/glibc-2.11.3/libio/../sysdeps/unix/sysv/linux/libc_fatal.c:186 > > >> (at 0x000000000246a5ef) > > >> #0 abort () at /usr/src/packages/BUILD/glibc-2.11.3/stdlib/abort.c:59 > > >> > > > > > > > > >
