Yup. Thats 4294967296*8bytes 34GB RAM - just for this one hash table? Satish
On Tue, 10 Jan 2017, Kong, Fande wrote: > On Tue, Jan 10, 2017 at 1:47 PM, Mark Adams <[email protected]> wrote: > > > We have a code that is failing on large scale runs on Edison at NERSC. We > > ran with a debug version and we got this error message that I assume is > > from a check that is done in debug. Is this a false positive? This is a 64 > > bit integer build. > > Thanks, > > Mark > > > > [5]PETSC ERROR: --------------------- Error Message > > -------------------------------------------------------------- > > [5]PETSC ERROR: Argument out of range > > [5]PETSC ERROR: A really huge hash is being requested.. cannot process: > > 4294967296 > > > > Satish, > > The number "4294967296" is larger than the maximum number (2147321881) you > put in the lookup. > > I guess your fixes do not help this one. > > > Fande, > > > > > > [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html > > <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.mcs.anl.gov_petsc_documentation_faq.html&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=BdTH9phOP3ipZiM21mw_gZrxPjWTeVcpXw9n-y7GECo&e=> > > for trouble shooting. > > [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 GIT > > Date: 2016-12-21 13:19:16 -0600 > > [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named nid00008 > > by u6338 Sat Jan 7 16:39:16 2017 > > [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo" > > --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo" > > --download-parmetis --download-metis --download-hypre --with-ssl=0 > > --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC > > --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn > > --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0 > > --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices > > --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC > > ERROR: ---- > > > > using: > > PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc30-dbg64-intel/ > > > > maybe go back to opt version? > > > > > > On 12/22/2016 03:22 PM, Mark Adams wrote: > > > >> You configure with the size of an integer explicitly, ie, > >> --with-64-bit-integers. I can't imagine there is anything bigger, but it > >> would not be hard to do. > >> > >> On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <[email protected]> > >> wrote: > >> > >> i just committed changes to SPMD that Brian needed for signed long long. > >>> Evidently petsc is now handling bigger matrices? > >>> > >>> > >>> On 12/22/2016 2:57 PM, Mark Adams wrote: > >>> > >>> There are a few hits on stack exchange, google: > >>> > >>> "error: expression must have class type" > >>> > >>> I think intputT is a templated type and it is templated with a PetscInt. > >>> You are calling the linearSize() method on a primitive type. That is my > >>> best guess. > >>> > >>> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <[email protected]> > >>> wrote: > >>> > >>> building with dbg looks same: > >>>> > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression must > >>>> have class type > >>>> return inputT.linearSize(); > >>>> ^ > >>>> detected during: > >>>> instantiation of "int linearSize(const T &) [with > >>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > >>>> instantiation of "int MiniIVFAB<T>::size(const Box &, const > >>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at line > >>>> 155 > >>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > >>>> instantiation of "int BaseEBCellFAB<T>::size(const Box &, > >>>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at > >>>> line > >>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > >>>> instantiation of "int LDOperator<T>::size(const T &, const > >>>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets > >>>> cInt64={long > >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> implicit generation of "LDOperator<T>::LDOperator() [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> instantiation of class "LDOperator<T> [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> instantiation of "void LevelData<T>::copyTo(const Interval > >>>> &, > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > >>>> LDOperator<T> > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>> instantiation of "void LevelData<T>::copyTo(const Interval > >>>> &, > >>>> BoxLayoutData<T> &, const Interval &) const [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>> instantiation of "LevelData<T>::LevelData() [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > >>>> "../srcLib/EBPetscSolver.cpp" > >>>> > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression must > >>>> have class type > >>>> inputT.linearOut(a_outBuf); > >>>> ^ > >>>> detected during: > >>>> instantiation of "void linearOut(void *, const T &) [with > >>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > >>>> instantiation of "void MiniIVFAB<T>::linearOut(void *, const > >>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long > >>>> long}}]" > >>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > >>>> instantiation of "void BaseEBCellFAB<T>::linearOut(void *, > >>>> const Box &, const Interval &) const [with T=PetscInt={PetscInt64={long > >>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo > >>>> ols/BoxLayoutData.H" > >>>> instantiation of "void LDOperator<T>::linearOut(const T &, > >>>> void *, const Box &, const Interval &) const [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> implicit generation of "LDOperator<T>::LDOperator() [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> instantiation of class "LDOperator<T> [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> instantiation of "void LevelData<T>::copyTo(const Interval > >>>> &, > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > >>>> LDOperator<T> > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>> instantiation of "void LevelData<T>::copyTo(const Interval > >>>> &, > >>>> BoxLayoutData<T> &, const Interval &) const [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>> instantiation of "LevelData<T>::LevelData() [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > >>>> "../srcLib/EBPetscSolver.cpp" > >>>> > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression must > >>>> have class type > >>>> a_outputT.linearIn(inBuf); > >>>> ^ > >>>> detected during: > >>>> instantiation of "void linearIn(T &, const void *) [with > >>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > >>>> instantiation of "void MiniIVFAB<T>::linearIn(void *, const > >>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long long}}]" at > >>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > >>>> instantiation of "void BaseEBCellFAB<T>::linearIn(void *, > >>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long > >>>> long}}]" > >>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > >>>> instantiation of "void LDOperator<T>::linearIn(T &, void *, > >>>> const Box &, const Interval &) const [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long > >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> implicit generation of "LDOperator<T>::LDOperator() [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> instantiation of class "LDOperator<T> [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>> instantiation of "void LevelData<T>::copyTo(const Interval > >>>> &, > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > >>>> LDOperator<T> > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>> instantiation of "void LevelData<T>::copyTo(const Interval > >>>> &, > >>>> BoxLayoutData<T> &, const Interval &) const [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>> instantiation of "LevelData<T>::LevelData() [with > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > >>>> "../srcLib/EBPetscSolver.cpp" > >>>> > >>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) > >>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MP > >>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__3d.Linux.64.CC.ftn.DEBUG.MP&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=HAhvWGeoB7HMK7Clyrfh_x-R465qxP-CNXK4zqhrCuE&e=> > >>>> I.PETSC/EBPetscSolver.o] > >>>> Error 2 > >>>> > >>>> > >>>> On 12/22/2016 09:42 AM, Mark Adams wrote: > >>>> > >>>> I have build a debug version (opt64 --> dbg64). You might try that. > >>>>> > >>>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <[email protected]> wrote: > >>>>> > >>>>> > >>>>> > >>>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich <[email protected]> > >>>>>> wrote: > >>>>>> > >>>>>> This wasn't happening until after you rebuilt petsc. So I am > >>>>>> wondering > >>>>>> > >>>>>>> if you upgraded or changed something?? > >>>>>>> > >>>>>>> > >>>>>> > >>>>>> Humm, let me rebuild. This is on Edison I assume. > >>>>>> > >>>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3 > >>>>>> 0-opt64-intel > >>>>>> (again) > >>>>>> > >>>>>> This is a new build. I would also do a deep clean on your end, of > >>>>>> course. > >>>>>> > >>>>>> I see a DCH_USE_COMPLEX ... > >>>>>> > >>>>>> Also, I would try a debug build just to get some data. This is some > >>>>>> strange problem of something is out of synch. > >>>>>> > >>>>>> > >>>>>> > >>>>>> On 12/19/2016 05:05 PM, Mark Adams wrote: > >>>>>>> > >>>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich <[email protected] > >>>>>>> > > >>>>>>> > >>>>>>>> wrote: > >>>>>>>> > >>>>>>>> I am sorry, you mean I need to add that to environment variables? > >>>>>>>> > >>>>>>>> > >>>>>>>>> > >>>>>>>>> > >>>>>>>> The PETSC_ARCH is hardwired for the size of integers so you would > >>>>>>>> use > >>>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know of > >>>>>>>> this > >>>>>>>> installation ever being used). But now that I think about it you > >>>>>>>> always > >>>>>>>> use > >>>>>>>> 64 bit ints and you need to. > >>>>>>>> > >>>>>>>> So what is going on here ... it looks like an object has been > >>>>>>>> templated > >>>>>>>> on > >>>>>>>> a PetscInt and is getting mixed up. I don't think you ever use 32 > >>>>>>>> bit > >>>>>>>> ints > >>>>>>>> in PETSc so it looks like you regressed here... I don't have a lot > >>>>>>>> of > >>>>>>>> experience with templates. I'd ask Brian or Dan. > >>>>>>>> > >>>>>>>> > >>>>>>>> > >>>>>>>> > >>>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote: > >>>>>>>>> > >>>>>>>>> There is a: arch-xc30-opt-intel > >>>>>>>>> > >>>>>>>>> > >>>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich < > >>>>>>>>>> [email protected]> > >>>>>>>>>> wrote: > >>>>>>>>>> > >>>>>>>>>> Hey Mark- > >>>>>>>>>> > >>>>>>>>>> We have had this issue recently and am wondering if you know what > >>>>>>>>>> > >>>>>>>>>>> the > >>>>>>>>>>> problem is. Maybe an int vs. PetscInt vs. PetscInt64 kind of > >>>>>>>>>>> thing? > >>>>>>>>>>> > >>>>>>>>>>> CC -O2 -fast -no-ipo -std=c++11 -O3 -m64 > >>>>>>>>>>> -qopt-multi-version-aggressive > >>>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable 3180 > >>>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux -DNDEBUG -DCH_MPI > >>>>>>>>>>> -DMPICH_SKIP_MPICXX > >>>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND -DCH_USE_COMPLEX > >>>>>>>>>>> -DCH_USE_EB > >>>>>>>>>>> -DCH_USE_MEMORY_TRACKING -DCH_USE_64 -DCH_USE_DOUBLE > >>>>>>>>>>> -DCH_USE_HDF5 > >>>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include -I. > >>>>>>>>>>> -I../srcBCG > >>>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG > >>>>>>>>>>> -I../srcCrunchFlow_BCG > >>>>>>>>>>> -I../srcCrunchFlow_BCG/modules -DCH_USE_PETSC > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > >>>>>>>>>>> intel/include > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > >>>>>>>>>>> intel/include > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > >>>>>>>>>>> intel/include > >>>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAM > >>>>>>>>>>> RTimeDependent > >>>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic > >>>>>>>>>>> -I../../../Chombo/lib/src/EBAM > >>>>>>>>>>> RTools > >>>>>>>>>>> -I../../../Chombo/lib/src/Workshop > >>>>>>>>>>> -I../../../Chombo/lib/src/EBTo > >>>>>>>>>>> ols > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTools > >>>>>>>>>>> -I../../../Chombo/lib/src/BoxT > >>>>>>>>>>> ools > >>>>>>>>>>> -I../../../Chombo/lib/src/BaseTools -DCH_LANG_CC -c > >>>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M > >>>>>>>>>>> PI.PETSC/EBPetscSolver.o > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression > >>>>>>>>>>> must > >>>>>>>>>>> have class type > >>>>>>>>>>> return inputT.linearSize(); > >>>>>>>>>>> ^ > >>>>>>>>>>> detected during: > >>>>>>>>>>> instantiation of "int linearSize(const T &) [with > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > >>>>>>>>>>> instantiation of "int MiniIVFAB<T>::size(const Box &, > >>>>>>>>>>> const > >>>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at > >>>>>>>>>>> line > >>>>>>>>>>> 155 > >>>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > >>>>>>>>>>> instantiation of "int BaseEBCellFAB<T>::size(const > >>>>>>>>>>> Box > >>>>>>>>>>> &, > >>>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long > >>>>>>>>>>> long}}]" at > >>>>>>>>>>> line > >>>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > >>>>>>>>>>> instantiation of "int LDOperator<T>::size(const T &, > >>>>>>>>>>> const > >>>>>>>>>>> Box > >>>>>>>>>>> &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets > >>>>>>>>>>> cInt64={long > >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo > >>>>>>>>>>> ols/LevelData.H" > >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() > >>>>>>>>>>> [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>>>>>>>>> instantiation of class "LDOperator<T> [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > >>>>>>>>>>> Interval &, > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > >>>>>>>>>>> LDOperator<T> > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > >>>>>>>>>>> long}}>]" > >>>>>>>>>>> at > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > >>>>>>>>>>> Interval &, > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 > >>>>>>>>>>> of > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > >>>>>>>>>>> > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression > >>>>>>>>>>> must > >>>>>>>>>>> have class type > >>>>>>>>>>> inputT.linearOut(a_outBuf); > >>>>>>>>>>> ^ > >>>>>>>>>>> detected during: > >>>>>>>>>>> instantiation of "void linearOut(void *, const T &) > >>>>>>>>>>> [with > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > >>>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearOut(void > >>>>>>>>>>> *, > >>>>>>>>>>> const > >>>>>>>>>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long > >>>>>>>>>>> long}}]" > >>>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBToo > >>>>>>>>>>> ls/BaseEBCellFABI.H" > >>>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearOut(vo > >>>>>>>>>>> id > >>>>>>>>>>> *, > >>>>>>>>>>> const Box &, const Interval &) const [with > >>>>>>>>>>> T=PetscInt={PetscInt64={long > >>>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo > >>>>>>>>>>> ols/BoxLayoutData.H" > >>>>>>>>>>> instantiation of "void LDOperator<T>::linearOut(const > >>>>>>>>>>> T &, > >>>>>>>>>>> void *, const Box &, const Interval &) const [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() > >>>>>>>>>>> [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>>>>>>>>> instantiation of class "LDOperator<T> [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > >>>>>>>>>>> Interval &, > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > >>>>>>>>>>> LDOperator<T> > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > >>>>>>>>>>> long}}>]" > >>>>>>>>>>> at > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > >>>>>>>>>>> Interval &, > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 > >>>>>>>>>>> of > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > >>>>>>>>>>> > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression > >>>>>>>>>>> must > >>>>>>>>>>> have class type > >>>>>>>>>>> a_outputT.linearIn(inBuf); > >>>>>>>>>>> ^ > >>>>>>>>>>> detected during: > >>>>>>>>>>> instantiation of "void linearIn(T &, const void *) > >>>>>>>>>>> [with > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > >>>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearIn(void *, > >>>>>>>>>>> const > >>>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long > >>>>>>>>>>> long}}]" > >>>>>>>>>>> at > >>>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > >>>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearIn(voi > >>>>>>>>>>> d > >>>>>>>>>>> *, > >>>>>>>>>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long > >>>>>>>>>>> long}}]" > >>>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTo > >>>>>>>>>>> ols/BoxLayoutData.H" > >>>>>>>>>>> instantiation of "void LDOperator<T>::linearIn(T &, > >>>>>>>>>>> void > >>>>>>>>>>> *, > >>>>>>>>>>> const Box &, const Interval &) const [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets > >>>>>>>>>>> cInt64={long > >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo > >>>>>>>>>>> ols/LevelData.H" > >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() > >>>>>>>>>>> [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>>>>>>>>> instantiation of class "LDOperator<T> [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > >>>>>>>>>>> Interval &, > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > >>>>>>>>>>> LDOperator<T> > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > >>>>>>>>>>> long}}>]" > >>>>>>>>>>> at > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > >>>>>>>>>>> Interval &, > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 > >>>>>>>>>>> of > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 > >>>>>>>>>>> of > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > >>>>>>>>>>> > >>>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) > >>>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH. > >>>>>>>>>>> MPI.PETSC/EBPetscSolver.o] > >>>>>>>>>>> Error 2 > >>>>>>>>>>> make: *** [all-example] Error 2 > >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote: > >>>>>>>>>>> > >>>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path: > >>>>>>>>>>> "...madams/ > >>>>>>>>>>> > >>>>>>>>>>> petsc_install/petscv3.6..." > >>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich < > >>>>>>>>>>>> [email protected] > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>>> wrote: > >>>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> Hey Mark- > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> I seem to have lost contact with petsc over the weekend: > >>>>>>>>>>>> > >>>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/ > >>>>>>>>>>>>> petsc/conf/variables: > >>>>>>>>>>>>> No such file or directory > >>>>>>>>>>>>> Last chance .ex rule for target /global/homes/m/madams/petscv3 > >>>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables > >>>>>>>>>>>>> > >>>>>>>>>>>>> setenv | grep petsc: > >>>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGCONFIG_PATH=/opt/cray/petsc/3. > >>>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_ > >>>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig > >>>>>>>>>>>>> PETSC_DIR=/global/homes/m/madams/petscv3.6-xc30-opt64-intel/ > >>>>>>>>>>>>> > >>>>>>>>>>>>> > >>>>>>>>>>>>> Currently Loaded Modulefiles: > >>>>>>>>>>>>> 1) modules/3.2.10.4 > >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__3.2.10.4&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=UN73DjcLzn6LGQKK_kwoLCLWgyM5YEeKwwHYYCHe1nw&e=> > >>>>>>>>>>>>> 8) intel/15.0.1.133 > >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__15.0.1.133&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=Gix6rgPxH5UFQeKmDN6zAXMAmFezfJ1qY-723XuYrUE&e=> > >>>>>>>>>>>>> 15) xpmem/0.1-2.0502.57015.1.15.ar > >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__0.1-2D2.0502.57015.1.15.ar&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=DcDHbf2qyi7t-rquIoqAdDx5HPEa3BXjxxWGpgLVhBU&e=>i > >>>>>>>>>>>>> 22) > >>>>>>>>>>>>> cray-mpich/7.4.1 > >>>>>>>>>>>>> 2) nsg/1.2.0 9) > >>>>>>>>>>>>> cray-libsci/16.07.1 > >>>>>>>>>>>>> 16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari 23) > >>>>>>>>>>>>> slurm/edison > >>>>>>>>>>>>> 3) eswrap/1.3.3-1.020200.1278.0 10) > >>>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari 17) > >>>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a > >>>>>>>>>>>>> ri > >>>>>>>>>>>>> 24) altd/2.0 > >>>>>>>>>>>>> 4) switch/1.0-1.0502.57058.1.58.ari 11) > >>>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari 18) rca/ > >>>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar > >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__1.0.0-2D2.0502.57212.2.56.ar&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=KaOFCQYgi4MV721r1zVhLb666-2L2dmTfExdbRrrB1s&e=> > >>>>>>>>>>>>> i > >>>>>>>>>>>>> 25) darshan/2.3.1 > >>>>>>>>>>>>> 5) craype-ivybridge 12) pmi/ > >>>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari 19) atp/2.0.2 26) > >>>>>>>>>>>>> emacs/24.2 > >>>>>>>>>>>>> 6) craype-network-aries 13) > >>>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari 20) PrgEnv-intel/5.2.56 > >>>>>>>>>>>>> 27) > >>>>>>>>>>>>> cray-hdf5-parallel/1.8.16 > >>>>>>>>>>>>> 7) craype/2.4.2 14) > >>>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari 21) cray-shmem/7.4.1 > >>>>>>>>>>>>> > >>>>>>>>>>>>> Thanks. > >>>>>>>>>>>>> > >>>>>>>>>>>>> treb > >>>>>>>>>>>>> > >>>>>>>>>>>>> -- > >>>>>>>>>>>>> David Trebotich > >>>>>>>>>>>>> Applied Numerical Algorithms Group > >>>>>>>>>>>>> Lawrence Berkeley National Laboratory > >>>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > >>>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > >>>>>>>>>>>>> > >>>>>>>>>>>>> > >>>>>>>>>>>>> > >>>>>>>>>>>>> > >>>>>>>>>>>>> -- > >>>>>>>>>>>>> > >>>>>>>>>>>>> > >>>>>>>>>>>> David Trebotich > >>>>>>>>>>>> > >>>>>>>>>>> Applied Numerical Algorithms Group > >>>>>>>>>>> Lawrence Berkeley National Laboratory > >>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > >>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>> -- > >>>>>>>>>>> > >>>>>>>>>> > >>>>>>>>>> David Trebotich > >>>>>>>>> Applied Numerical Algorithms Group > >>>>>>>>> Lawrence Berkeley National Laboratory > >>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > >>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > >>>>>>>>> > >>>>>>>>> > >>>>>>>>> > >>>>>>>>> > >>>>>>>>> -- > >>>>>>>> > >>>>>>> David Trebotich > >>>>>>> Applied Numerical Algorithms Group > >>>>>>> Lawrence Berkeley National Laboratory > >>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > >>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>> > >>>>> -- > >>>> David Trebotich > >>>> Applied Numerical Algorithms Group > >>>> Lawrence Berkeley National Laboratory > >>>> (510) 486-5984 office > >>>> (510) 384-6868 mobile > >>>> > >>>> > >>>> > >>> -- > >>> David Trebotich > >>> Applied Numerical Algorithms Group > >>> Computational Research Division > >>> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) 384-6868 > >>> mobile > >>> > >>> > >>> > >> > > -- > > David Trebotich > > Applied Numerical Algorithms Group > > Lawrence Berkeley National Laboratory > > (510) 486-5984 office > > (510) 384-6868 mobile > > > > > > >
