We have a code that is failing on large scale runs on Edison at NERSC. We ran with a debug version and we got this error message that I assume is from a check that is done in debug. Is this a false positive? This is a 64 bit integer build. Thanks, Mark
[5]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [5]PETSC ERROR: Argument out of range [5]PETSC ERROR: A really huge hash is being requested.. cannot process: 4294967296 [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 GIT Date: 2016-12-21 13:19:16 -0600 [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named nid00008 by u6338 Sat Jan 7 16:39:16 2017 [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo" --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo" --download-parmetis --download-metis --download-hypre --with-ssl=0 --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0 --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC ERROR: ---- using: PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc30-dbg64-intel/ maybe go back to opt version? On 12/22/2016 03:22 PM, Mark Adams wrote: > You configure with the size of an integer explicitly, ie, > --with-64-bit-integers. I can't imagine there is anything bigger, but it > would not be hard to do. > > On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <[email protected]> > wrote: > > i just committed changes to SPMD that Brian needed for signed long long. >> Evidently petsc is now handling bigger matrices? >> >> >> On 12/22/2016 2:57 PM, Mark Adams wrote: >> >> There are a few hits on stack exchange, google: >> >> "error: expression must have class type" >> >> I think intputT is a templated type and it is templated with a PetscInt. >> You are calling the linearSize() method on a primitive type. That is my >> best guess. >> >> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <[email protected]> >> wrote: >> >> building with dbg looks same: >>> >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression must >>> have class type >>> return inputT.linearSize(); >>> ^ >>> detected during: >>> instantiation of "int linearSize(const T &) [with >>> T=PetscInt={PetscInt64={long long}}]" at line 128 of >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>> instantiation of "int MiniIVFAB<T>::size(const Box &, const >>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at line 155 >>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>> instantiation of "int BaseEBCellFAB<T>::size(const Box &, >>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at >>> line >>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" >>> instantiation of "int LDOperator<T>::size(const T &, const >>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets >>> cInt64={long >>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> implicit generation of "LDOperator<T>::LDOperator() [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> instantiation of class "LDOperator<T> [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> instantiation of "void LevelData<T>::copyTo(const Interval &, >>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T> >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>> instantiation of "void LevelData<T>::copyTo(const Interval &, >>> BoxLayoutData<T> &, const Interval &) const [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>> instantiation of "LevelData<T>::LevelData() [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of >>> "../srcLib/EBPetscSolver.cpp" >>> >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression must >>> have class type >>> inputT.linearOut(a_outBuf); >>> ^ >>> detected during: >>> instantiation of "void linearOut(void *, const T &) [with >>> T=PetscInt={PetscInt64={long long}}]" at line 155 of >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>> instantiation of "void MiniIVFAB<T>::linearOut(void *, const >>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long >>> long}}]" >>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>> instantiation of "void BaseEBCellFAB<T>::linearOut(void *, >>> const Box &, const Interval &) const [with T=PetscInt={PetscInt64={long >>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo >>> ols/BoxLayoutData.H" >>> instantiation of "void LDOperator<T>::linearOut(const T &, >>> void *, const Box &, const Interval &) const [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> implicit generation of "LDOperator<T>::LDOperator() [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> instantiation of class "LDOperator<T> [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> instantiation of "void LevelData<T>::copyTo(const Interval &, >>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T> >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>> instantiation of "void LevelData<T>::copyTo(const Interval &, >>> BoxLayoutData<T> &, const Interval &) const [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>> instantiation of "LevelData<T>::LevelData() [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of >>> "../srcLib/EBPetscSolver.cpp" >>> >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression must >>> have class type >>> a_outputT.linearIn(inBuf); >>> ^ >>> detected during: >>> instantiation of "void linearIn(T &, const void *) [with >>> T=PetscInt={PetscInt64={long long}}]" at line 181 of >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>> instantiation of "void MiniIVFAB<T>::linearIn(void *, const >>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long long}}]" at >>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>> instantiation of "void BaseEBCellFAB<T>::linearIn(void *, >>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long >>> long}}]" >>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" >>> instantiation of "void LDOperator<T>::linearIn(T &, void *, >>> const Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets >>> cInt64={long >>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> implicit generation of "LDOperator<T>::LDOperator() [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> instantiation of class "LDOperator<T> [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>> instantiation of "void LevelData<T>::copyTo(const Interval &, >>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T> >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>> instantiation of "void LevelData<T>::copyTo(const Interval &, >>> BoxLayoutData<T> &, const Interval &) const [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>> instantiation of "LevelData<T>::LevelData() [with >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of >>> "../srcLib/EBPetscSolver.cpp" >>> >>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) >>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MPI.PETSC/EBPetscSolver.o] >>> Error 2 >>> >>> >>> On 12/22/2016 09:42 AM, Mark Adams wrote: >>> >>> I have build a debug version (opt64 --> dbg64). You might try that. >>>> >>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <[email protected]> wrote: >>>> >>>> >>>> >>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich <[email protected]> >>>>> wrote: >>>>> >>>>> This wasn't happening until after you rebuilt petsc. So I am wondering >>>>> >>>>>> if you upgraded or changed something?? >>>>>> >>>>>> >>>>> >>>>> Humm, let me rebuild. This is on Edison I assume. >>>>> >>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3 >>>>> 0-opt64-intel >>>>> (again) >>>>> >>>>> This is a new build. I would also do a deep clean on your end, of >>>>> course. >>>>> >>>>> I see a DCH_USE_COMPLEX ... >>>>> >>>>> Also, I would try a debug build just to get some data. This is some >>>>> strange problem of something is out of synch. >>>>> >>>>> >>>>> >>>>> On 12/19/2016 05:05 PM, Mark Adams wrote: >>>>>> >>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich <[email protected]> >>>>>> >>>>>>> wrote: >>>>>>> >>>>>>> I am sorry, you mean I need to add that to environment variables? >>>>>>> >>>>>>> >>>>>>>> >>>>>>>> >>>>>>> The PETSC_ARCH is hardwired for the size of integers so you would use >>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know of >>>>>>> this >>>>>>> installation ever being used). But now that I think about it you >>>>>>> always >>>>>>> use >>>>>>> 64 bit ints and you need to. >>>>>>> >>>>>>> So what is going on here ... it looks like an object has been >>>>>>> templated >>>>>>> on >>>>>>> a PetscInt and is getting mixed up. I don't think you ever use 32 bit >>>>>>> ints >>>>>>> in PETSc so it looks like you regressed here... I don't have a lot of >>>>>>> experience with templates. I'd ask Brian or Dan. >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote: >>>>>>>> >>>>>>>> There is a: arch-xc30-opt-intel >>>>>>>> >>>>>>>> >>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich < >>>>>>>>> [email protected]> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>> Hey Mark- >>>>>>>>> >>>>>>>>> We have had this issue recently and am wondering if you know what >>>>>>>>> >>>>>>>>>> the >>>>>>>>>> problem is. Maybe an int vs. PetscInt vs. PetscInt64 kind of >>>>>>>>>> thing? >>>>>>>>>> >>>>>>>>>> CC -O2 -fast -no-ipo -std=c++11 -O3 -m64 >>>>>>>>>> -qopt-multi-version-aggressive >>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable 3180 >>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux -DNDEBUG -DCH_MPI >>>>>>>>>> -DMPICH_SKIP_MPICXX >>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND -DCH_USE_COMPLEX >>>>>>>>>> -DCH_USE_EB >>>>>>>>>> -DCH_USE_MEMORY_TRACKING -DCH_USE_64 -DCH_USE_DOUBLE >>>>>>>>>> -DCH_USE_HDF5 >>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include -I. >>>>>>>>>> -I../srcBCG >>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG >>>>>>>>>> -I../srcCrunchFlow_BCG >>>>>>>>>> -I../srcCrunchFlow_BCG/modules -DCH_USE_PETSC >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- >>>>>>>>>> intel/include >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- >>>>>>>>>> intel/include >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- >>>>>>>>>> intel/include >>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAMRTimeDependent >>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic >>>>>>>>>> -I../../../Chombo/lib/src/EBAM >>>>>>>>>> RTools >>>>>>>>>> -I../../../Chombo/lib/src/Workshop -I../../../Chombo/lib/src/EBTo >>>>>>>>>> ols >>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent >>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic >>>>>>>>>> -I../../../Chombo/lib/src/AMRTools -I../../../Chombo/lib/src/BoxT >>>>>>>>>> ools >>>>>>>>>> -I../../../Chombo/lib/src/BaseTools -DCH_LANG_CC -c >>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M >>>>>>>>>> PI.PETSC/EBPetscSolver.o >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression >>>>>>>>>> must >>>>>>>>>> have class type >>>>>>>>>> return inputT.linearSize(); >>>>>>>>>> ^ >>>>>>>>>> detected during: >>>>>>>>>> instantiation of "int linearSize(const T &) [with >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>>>>>>>> instantiation of "int MiniIVFAB<T>::size(const Box &, >>>>>>>>>> const >>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at >>>>>>>>>> line >>>>>>>>>> 155 >>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>>>>>>>>> instantiation of "int BaseEBCellFAB<T>::size(const Box >>>>>>>>>> &, >>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long >>>>>>>>>> long}}]" at >>>>>>>>>> line >>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" >>>>>>>>>> instantiation of "int LDOperator<T>::size(const T &, >>>>>>>>>> const >>>>>>>>>> Box >>>>>>>>>> &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets >>>>>>>>>> cInt64={long >>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo >>>>>>>>>> ols/LevelData.H" >>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() >>>>>>>>>> [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>> instantiation of class "LDOperator<T> [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>> Interval &, >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>>>>>>>> LDOperator<T> >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long >>>>>>>>>> long}}>]" >>>>>>>>>> at >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>> Interval &, >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 >>>>>>>>>> of >>>>>>>>>> "../srcLib/EBPetscSolver.cpp" >>>>>>>>>> >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression >>>>>>>>>> must >>>>>>>>>> have class type >>>>>>>>>> inputT.linearOut(a_outBuf); >>>>>>>>>> ^ >>>>>>>>>> detected during: >>>>>>>>>> instantiation of "void linearOut(void *, const T &) >>>>>>>>>> [with >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearOut(void *, >>>>>>>>>> const >>>>>>>>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long >>>>>>>>>> long}}]" >>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearOut(vo >>>>>>>>>> id >>>>>>>>>> *, >>>>>>>>>> const Box &, const Interval &) const [with >>>>>>>>>> T=PetscInt={PetscInt64={long >>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo >>>>>>>>>> ols/BoxLayoutData.H" >>>>>>>>>> instantiation of "void LDOperator<T>::linearOut(const >>>>>>>>>> T &, >>>>>>>>>> void *, const Box &, const Interval &) const [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() >>>>>>>>>> [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>> instantiation of class "LDOperator<T> [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>> Interval &, >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>>>>>>>> LDOperator<T> >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long >>>>>>>>>> long}}>]" >>>>>>>>>> at >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>> Interval &, >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 >>>>>>>>>> of >>>>>>>>>> "../srcLib/EBPetscSolver.cpp" >>>>>>>>>> >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression >>>>>>>>>> must >>>>>>>>>> have class type >>>>>>>>>> a_outputT.linearIn(inBuf); >>>>>>>>>> ^ >>>>>>>>>> detected during: >>>>>>>>>> instantiation of "void linearIn(T &, const void *) >>>>>>>>>> [with >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearIn(void *, >>>>>>>>>> const >>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long >>>>>>>>>> long}}]" >>>>>>>>>> at >>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearIn(voi >>>>>>>>>> d >>>>>>>>>> *, >>>>>>>>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long >>>>>>>>>> long}}]" >>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" >>>>>>>>>> instantiation of "void LDOperator<T>::linearIn(T &, >>>>>>>>>> void >>>>>>>>>> *, >>>>>>>>>> const Box &, const Interval &) const [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets >>>>>>>>>> cInt64={long >>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo >>>>>>>>>> ols/LevelData.H" >>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() >>>>>>>>>> [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>> instantiation of class "LDOperator<T> [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>> Interval &, >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>>>>>>>> LDOperator<T> >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long >>>>>>>>>> long}}>]" >>>>>>>>>> at >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>> Interval &, >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 >>>>>>>>>> of >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 >>>>>>>>>> of >>>>>>>>>> "../srcLib/EBPetscSolver.cpp" >>>>>>>>>> >>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) >>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH. >>>>>>>>>> MPI.PETSC/EBPetscSolver.o] >>>>>>>>>> Error 2 >>>>>>>>>> make: *** [all-example] Error 2 >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote: >>>>>>>>>> >>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path: "...madams/ >>>>>>>>>> >>>>>>>>>> petsc_install/petscv3.6..." >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich < >>>>>>>>>>> [email protected] >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Hey Mark- >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> I seem to have lost contact with petsc over the weekend: >>>>>>>>>>> >>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/ >>>>>>>>>>>> petsc/conf/variables: >>>>>>>>>>>> No such file or directory >>>>>>>>>>>> Last chance .ex rule for target /global/homes/m/madams/petscv3 >>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables >>>>>>>>>>>> >>>>>>>>>>>> setenv | grep petsc: >>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGCONFIG_PATH=/opt/cray/petsc/3. >>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_ >>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig >>>>>>>>>>>> PETSC_DIR=/global/homes/m/madams/petscv3.6-xc30-opt64-intel/ >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Currently Loaded Modulefiles: >>>>>>>>>>>> 1) modules/3.2.10.4 8) intel/15.0.1.133 >>>>>>>>>>>> 15) xpmem/0.1-2.0502.57015.1.15.ari 22) >>>>>>>>>>>> cray-mpich/7.4.1 >>>>>>>>>>>> 2) nsg/1.2.0 9) >>>>>>>>>>>> cray-libsci/16.07.1 >>>>>>>>>>>> 16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari 23) >>>>>>>>>>>> slurm/edison >>>>>>>>>>>> 3) eswrap/1.3.3-1.020200.1278.0 10) >>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari 17) >>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a >>>>>>>>>>>> ri >>>>>>>>>>>> 24) altd/2.0 >>>>>>>>>>>> 4) switch/1.0-1.0502.57058.1.58.ari 11) >>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari 18) rca/ >>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar >>>>>>>>>>>> i >>>>>>>>>>>> 25) darshan/2.3.1 >>>>>>>>>>>> 5) craype-ivybridge 12) pmi/ >>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari 19) atp/2.0.2 26) >>>>>>>>>>>> emacs/24.2 >>>>>>>>>>>> 6) craype-network-aries 13) >>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari 20) PrgEnv-intel/5.2.56 >>>>>>>>>>>> 27) >>>>>>>>>>>> cray-hdf5-parallel/1.8.16 >>>>>>>>>>>> 7) craype/2.4.2 14) >>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari 21) cray-shmem/7.4.1 >>>>>>>>>>>> >>>>>>>>>>>> Thanks. >>>>>>>>>>>> >>>>>>>>>>>> treb >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> David Trebotich >>>>>>>>>>>> Applied Numerical Algorithms Group >>>>>>>>>>>> Lawrence Berkeley National Laboratory >>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office >>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> David Trebotich >>>>>>>>>>> >>>>>>>>>> Applied Numerical Algorithms Group >>>>>>>>>> Lawrence Berkeley National Laboratory >>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office >>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> >>>>>>>>> >>>>>>>>> David Trebotich >>>>>>>> Applied Numerical Algorithms Group >>>>>>>> Lawrence Berkeley National Laboratory >>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office >>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>> >>>>>> David Trebotich >>>>>> Applied Numerical Algorithms Group >>>>>> Lawrence Berkeley National Laboratory >>>>>> (510) 486-5984 <%28510%29%20486-5984> office >>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile >>>>>> >>>>>> >>>>>> >>>>>> >>>>> >>>> -- >>> David Trebotich >>> Applied Numerical Algorithms Group >>> Lawrence Berkeley National Laboratory >>> (510) 486-5984 office >>> (510) 384-6868 mobile >>> >>> >>> >> -- >> David Trebotich >> Applied Numerical Algorithms Group >> Computational Research Division >> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) 384-6868 >> mobile >> >> >> > -- David Trebotich Applied Numerical Algorithms Group Lawrence Berkeley National Laboratory (510) 486-5984 office (510) 384-6868 mobile
