On Tue, Jan 10, 2017 at 1:47 PM, Mark Adams <[email protected]> wrote: > We have a code that is failing on large scale runs on Edison at NERSC. We > ran with a debug version and we got this error message that I assume is > from a check that is done in debug. Is this a false positive? This is a 64 > bit integer build. > Thanks, > Mark > > [5]PETSC ERROR: --------------------- Error Message > -------------------------------------------------------------- > [5]PETSC ERROR: Argument out of range > [5]PETSC ERROR: A really huge hash is being requested.. cannot process: > 4294967296 >
Satish, The number "4294967296" is larger than the maximum number (2147321881) you put in the lookup. I guess your fixes do not help this one. Fande, > [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html > <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.mcs.anl.gov_petsc_documentation_faq.html&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=BdTH9phOP3ipZiM21mw_gZrxPjWTeVcpXw9n-y7GECo&e=> > for trouble shooting. > [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 GIT > Date: 2016-12-21 13:19:16 -0600 > [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named nid00008 > by u6338 Sat Jan 7 16:39:16 2017 > [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo" > --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo" > --download-parmetis --download-metis --download-hypre --with-ssl=0 > --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC > --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn > --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0 > --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices > --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC > ERROR: ---- > > using: > PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc30-dbg64-intel/ > > maybe go back to opt version? > > > On 12/22/2016 03:22 PM, Mark Adams wrote: > >> You configure with the size of an integer explicitly, ie, >> --with-64-bit-integers. I can't imagine there is anything bigger, but it >> would not be hard to do. >> >> On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <[email protected]> >> wrote: >> >> i just committed changes to SPMD that Brian needed for signed long long. >>> Evidently petsc is now handling bigger matrices? >>> >>> >>> On 12/22/2016 2:57 PM, Mark Adams wrote: >>> >>> There are a few hits on stack exchange, google: >>> >>> "error: expression must have class type" >>> >>> I think intputT is a templated type and it is templated with a PetscInt. >>> You are calling the linearSize() method on a primitive type. That is my >>> best guess. >>> >>> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <[email protected]> >>> wrote: >>> >>> building with dbg looks same: >>>> >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression must >>>> have class type >>>> return inputT.linearSize(); >>>> ^ >>>> detected during: >>>> instantiation of "int linearSize(const T &) [with >>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>> instantiation of "int MiniIVFAB<T>::size(const Box &, const >>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at line >>>> 155 >>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>>> instantiation of "int BaseEBCellFAB<T>::size(const Box &, >>>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at >>>> line >>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" >>>> instantiation of "int LDOperator<T>::size(const T &, const >>>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets >>>> cInt64={long >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> implicit generation of "LDOperator<T>::LDOperator() [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> instantiation of class "LDOperator<T> [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> instantiation of "void LevelData<T>::copyTo(const Interval >>>> &, >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>> LDOperator<T> >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>> instantiation of "void LevelData<T>::copyTo(const Interval >>>> &, >>>> BoxLayoutData<T> &, const Interval &) const [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>> instantiation of "LevelData<T>::LevelData() [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of >>>> "../srcLib/EBPetscSolver.cpp" >>>> >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression must >>>> have class type >>>> inputT.linearOut(a_outBuf); >>>> ^ >>>> detected during: >>>> instantiation of "void linearOut(void *, const T &) [with >>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>> instantiation of "void MiniIVFAB<T>::linearOut(void *, const >>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long >>>> long}}]" >>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>>> instantiation of "void BaseEBCellFAB<T>::linearOut(void *, >>>> const Box &, const Interval &) const [with T=PetscInt={PetscInt64={long >>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo >>>> ols/BoxLayoutData.H" >>>> instantiation of "void LDOperator<T>::linearOut(const T &, >>>> void *, const Box &, const Interval &) const [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> implicit generation of "LDOperator<T>::LDOperator() [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> instantiation of class "LDOperator<T> [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> instantiation of "void LevelData<T>::copyTo(const Interval >>>> &, >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>> LDOperator<T> >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>> instantiation of "void LevelData<T>::copyTo(const Interval >>>> &, >>>> BoxLayoutData<T> &, const Interval &) const [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>> instantiation of "LevelData<T>::LevelData() [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of >>>> "../srcLib/EBPetscSolver.cpp" >>>> >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression must >>>> have class type >>>> a_outputT.linearIn(inBuf); >>>> ^ >>>> detected during: >>>> instantiation of "void linearIn(T &, const void *) [with >>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>> instantiation of "void MiniIVFAB<T>::linearIn(void *, const >>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long long}}]" at >>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>>> instantiation of "void BaseEBCellFAB<T>::linearIn(void *, >>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long >>>> long}}]" >>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" >>>> instantiation of "void LDOperator<T>::linearIn(T &, void *, >>>> const Box &, const Interval &) const [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> implicit generation of "LDOperator<T>::LDOperator() [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> instantiation of class "LDOperator<T> [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>> instantiation of "void LevelData<T>::copyTo(const Interval >>>> &, >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>> LDOperator<T> >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>> instantiation of "void LevelData<T>::copyTo(const Interval >>>> &, >>>> BoxLayoutData<T> &, const Interval &) const [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>> instantiation of "LevelData<T>::LevelData() [with >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of >>>> "../srcLib/EBPetscSolver.cpp" >>>> >>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) >>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MP >>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__3d.Linux.64.CC.ftn.DEBUG.MP&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=HAhvWGeoB7HMK7Clyrfh_x-R465qxP-CNXK4zqhrCuE&e=> >>>> I.PETSC/EBPetscSolver.o] >>>> Error 2 >>>> >>>> >>>> On 12/22/2016 09:42 AM, Mark Adams wrote: >>>> >>>> I have build a debug version (opt64 --> dbg64). You might try that. >>>>> >>>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <[email protected]> wrote: >>>>> >>>>> >>>>> >>>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich <[email protected]> >>>>>> wrote: >>>>>> >>>>>> This wasn't happening until after you rebuilt petsc. So I am >>>>>> wondering >>>>>> >>>>>>> if you upgraded or changed something?? >>>>>>> >>>>>>> >>>>>> >>>>>> Humm, let me rebuild. This is on Edison I assume. >>>>>> >>>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3 >>>>>> 0-opt64-intel >>>>>> (again) >>>>>> >>>>>> This is a new build. I would also do a deep clean on your end, of >>>>>> course. >>>>>> >>>>>> I see a DCH_USE_COMPLEX ... >>>>>> >>>>>> Also, I would try a debug build just to get some data. This is some >>>>>> strange problem of something is out of synch. >>>>>> >>>>>> >>>>>> >>>>>> On 12/19/2016 05:05 PM, Mark Adams wrote: >>>>>>> >>>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich <[email protected] >>>>>>> > >>>>>>> >>>>>>>> wrote: >>>>>>>> >>>>>>>> I am sorry, you mean I need to add that to environment variables? >>>>>>>> >>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> The PETSC_ARCH is hardwired for the size of integers so you would >>>>>>>> use >>>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know of >>>>>>>> this >>>>>>>> installation ever being used). But now that I think about it you >>>>>>>> always >>>>>>>> use >>>>>>>> 64 bit ints and you need to. >>>>>>>> >>>>>>>> So what is going on here ... it looks like an object has been >>>>>>>> templated >>>>>>>> on >>>>>>>> a PetscInt and is getting mixed up. I don't think you ever use 32 >>>>>>>> bit >>>>>>>> ints >>>>>>>> in PETSc so it looks like you regressed here... I don't have a lot >>>>>>>> of >>>>>>>> experience with templates. I'd ask Brian or Dan. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote: >>>>>>>>> >>>>>>>>> There is a: arch-xc30-opt-intel >>>>>>>>> >>>>>>>>> >>>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich < >>>>>>>>>> [email protected]> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> Hey Mark- >>>>>>>>>> >>>>>>>>>> We have had this issue recently and am wondering if you know what >>>>>>>>>> >>>>>>>>>>> the >>>>>>>>>>> problem is. Maybe an int vs. PetscInt vs. PetscInt64 kind of >>>>>>>>>>> thing? >>>>>>>>>>> >>>>>>>>>>> CC -O2 -fast -no-ipo -std=c++11 -O3 -m64 >>>>>>>>>>> -qopt-multi-version-aggressive >>>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable 3180 >>>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux -DNDEBUG -DCH_MPI >>>>>>>>>>> -DMPICH_SKIP_MPICXX >>>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND -DCH_USE_COMPLEX >>>>>>>>>>> -DCH_USE_EB >>>>>>>>>>> -DCH_USE_MEMORY_TRACKING -DCH_USE_64 -DCH_USE_DOUBLE >>>>>>>>>>> -DCH_USE_HDF5 >>>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include -I. >>>>>>>>>>> -I../srcBCG >>>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG >>>>>>>>>>> -I../srcCrunchFlow_BCG >>>>>>>>>>> -I../srcCrunchFlow_BCG/modules -DCH_USE_PETSC >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- >>>>>>>>>>> intel/include >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- >>>>>>>>>>> intel/include >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- >>>>>>>>>>> intel/include >>>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAM >>>>>>>>>>> RTimeDependent >>>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic >>>>>>>>>>> -I../../../Chombo/lib/src/EBAM >>>>>>>>>>> RTools >>>>>>>>>>> -I../../../Chombo/lib/src/Workshop >>>>>>>>>>> -I../../../Chombo/lib/src/EBTo >>>>>>>>>>> ols >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent >>>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTools >>>>>>>>>>> -I../../../Chombo/lib/src/BoxT >>>>>>>>>>> ools >>>>>>>>>>> -I../../../Chombo/lib/src/BaseTools -DCH_LANG_CC -c >>>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M >>>>>>>>>>> PI.PETSC/EBPetscSolver.o >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression >>>>>>>>>>> must >>>>>>>>>>> have class type >>>>>>>>>>> return inputT.linearSize(); >>>>>>>>>>> ^ >>>>>>>>>>> detected during: >>>>>>>>>>> instantiation of "int linearSize(const T &) [with >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>>>>>>>>> instantiation of "int MiniIVFAB<T>::size(const Box &, >>>>>>>>>>> const >>>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at >>>>>>>>>>> line >>>>>>>>>>> 155 >>>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>>>>>>>>>> instantiation of "int BaseEBCellFAB<T>::size(const >>>>>>>>>>> Box >>>>>>>>>>> &, >>>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long >>>>>>>>>>> long}}]" at >>>>>>>>>>> line >>>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" >>>>>>>>>>> instantiation of "int LDOperator<T>::size(const T &, >>>>>>>>>>> const >>>>>>>>>>> Box >>>>>>>>>>> &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets >>>>>>>>>>> cInt64={long >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo >>>>>>>>>>> ols/LevelData.H" >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() >>>>>>>>>>> [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>>> instantiation of class "LDOperator<T> [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>>> Interval &, >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>>>>>>>>> LDOperator<T> >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long >>>>>>>>>>> long}}>]" >>>>>>>>>>> at >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>>> Interval &, >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 >>>>>>>>>>> of >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" >>>>>>>>>>> >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression >>>>>>>>>>> must >>>>>>>>>>> have class type >>>>>>>>>>> inputT.linearOut(a_outBuf); >>>>>>>>>>> ^ >>>>>>>>>>> detected during: >>>>>>>>>>> instantiation of "void linearOut(void *, const T &) >>>>>>>>>>> [with >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearOut(void >>>>>>>>>>> *, >>>>>>>>>>> const >>>>>>>>>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long >>>>>>>>>>> long}}]" >>>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBToo >>>>>>>>>>> ls/BaseEBCellFABI.H" >>>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearOut(vo >>>>>>>>>>> id >>>>>>>>>>> *, >>>>>>>>>>> const Box &, const Interval &) const [with >>>>>>>>>>> T=PetscInt={PetscInt64={long >>>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo >>>>>>>>>>> ols/BoxLayoutData.H" >>>>>>>>>>> instantiation of "void LDOperator<T>::linearOut(const >>>>>>>>>>> T &, >>>>>>>>>>> void *, const Box &, const Interval &) const [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() >>>>>>>>>>> [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>>> instantiation of class "LDOperator<T> [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>>> Interval &, >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>>>>>>>>> LDOperator<T> >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long >>>>>>>>>>> long}}>]" >>>>>>>>>>> at >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>>> Interval &, >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 >>>>>>>>>>> of >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" >>>>>>>>>>> >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression >>>>>>>>>>> must >>>>>>>>>>> have class type >>>>>>>>>>> a_outputT.linearIn(inBuf); >>>>>>>>>>> ^ >>>>>>>>>>> detected during: >>>>>>>>>>> instantiation of "void linearIn(T &, const void *) >>>>>>>>>>> [with >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" >>>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearIn(void *, >>>>>>>>>>> const >>>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long >>>>>>>>>>> long}}]" >>>>>>>>>>> at >>>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" >>>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearIn(voi >>>>>>>>>>> d >>>>>>>>>>> *, >>>>>>>>>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long >>>>>>>>>>> long}}]" >>>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTo >>>>>>>>>>> ols/BoxLayoutData.H" >>>>>>>>>>> instantiation of "void LDOperator<T>::linearIn(T &, >>>>>>>>>>> void >>>>>>>>>>> *, >>>>>>>>>>> const Box &, const Interval &) const [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets >>>>>>>>>>> cInt64={long >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo >>>>>>>>>>> ols/LevelData.H" >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() >>>>>>>>>>> [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>>> instantiation of class "LDOperator<T> [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>>> Interval &, >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const >>>>>>>>>>> LDOperator<T> >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long >>>>>>>>>>> long}}>]" >>>>>>>>>>> at >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const >>>>>>>>>>> Interval &, >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 >>>>>>>>>>> of >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 >>>>>>>>>>> of >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" >>>>>>>>>>> >>>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) >>>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH. >>>>>>>>>>> MPI.PETSC/EBPetscSolver.o] >>>>>>>>>>> Error 2 >>>>>>>>>>> make: *** [all-example] Error 2 >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote: >>>>>>>>>>> >>>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path: >>>>>>>>>>> "...madams/ >>>>>>>>>>> >>>>>>>>>>> petsc_install/petscv3.6..." >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich < >>>>>>>>>>>> [email protected] >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Hey Mark- >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> I seem to have lost contact with petsc over the weekend: >>>>>>>>>>>> >>>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/ >>>>>>>>>>>>> petsc/conf/variables: >>>>>>>>>>>>> No such file or directory >>>>>>>>>>>>> Last chance .ex rule for target /global/homes/m/madams/petscv3 >>>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables >>>>>>>>>>>>> >>>>>>>>>>>>> setenv | grep petsc: >>>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGCONFIG_PATH=/opt/cray/petsc/3. >>>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_ >>>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig >>>>>>>>>>>>> PETSC_DIR=/global/homes/m/madams/petscv3.6-xc30-opt64-intel/ >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Currently Loaded Modulefiles: >>>>>>>>>>>>> 1) modules/3.2.10.4 >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__3.2.10.4&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=UN73DjcLzn6LGQKK_kwoLCLWgyM5YEeKwwHYYCHe1nw&e=> >>>>>>>>>>>>> 8) intel/15.0.1.133 >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__15.0.1.133&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=Gix6rgPxH5UFQeKmDN6zAXMAmFezfJ1qY-723XuYrUE&e=> >>>>>>>>>>>>> 15) xpmem/0.1-2.0502.57015.1.15.ar >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__0.1-2D2.0502.57015.1.15.ar&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=DcDHbf2qyi7t-rquIoqAdDx5HPEa3BXjxxWGpgLVhBU&e=>i >>>>>>>>>>>>> 22) >>>>>>>>>>>>> cray-mpich/7.4.1 >>>>>>>>>>>>> 2) nsg/1.2.0 9) >>>>>>>>>>>>> cray-libsci/16.07.1 >>>>>>>>>>>>> 16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari 23) >>>>>>>>>>>>> slurm/edison >>>>>>>>>>>>> 3) eswrap/1.3.3-1.020200.1278.0 10) >>>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari 17) >>>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a >>>>>>>>>>>>> ri >>>>>>>>>>>>> 24) altd/2.0 >>>>>>>>>>>>> 4) switch/1.0-1.0502.57058.1.58.ari 11) >>>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari 18) rca/ >>>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__1.0.0-2D2.0502.57212.2.56.ar&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=KaOFCQYgi4MV721r1zVhLb666-2L2dmTfExdbRrrB1s&e=> >>>>>>>>>>>>> i >>>>>>>>>>>>> 25) darshan/2.3.1 >>>>>>>>>>>>> 5) craype-ivybridge 12) pmi/ >>>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari 19) atp/2.0.2 26) >>>>>>>>>>>>> emacs/24.2 >>>>>>>>>>>>> 6) craype-network-aries 13) >>>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari 20) PrgEnv-intel/5.2.56 >>>>>>>>>>>>> 27) >>>>>>>>>>>>> cray-hdf5-parallel/1.8.16 >>>>>>>>>>>>> 7) craype/2.4.2 14) >>>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari 21) cray-shmem/7.4.1 >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks. >>>>>>>>>>>>> >>>>>>>>>>>>> treb >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> David Trebotich >>>>>>>>>>>>> Applied Numerical Algorithms Group >>>>>>>>>>>>> Lawrence Berkeley National Laboratory >>>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office >>>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> David Trebotich >>>>>>>>>>>> >>>>>>>>>>> Applied Numerical Algorithms Group >>>>>>>>>>> Lawrence Berkeley National Laboratory >>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office >>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> David Trebotich >>>>>>>>> Applied Numerical Algorithms Group >>>>>>>>> Lawrence Berkeley National Laboratory >>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office >>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>> >>>>>>> David Trebotich >>>>>>> Applied Numerical Algorithms Group >>>>>>> Lawrence Berkeley National Laboratory >>>>>>> (510) 486-5984 <%28510%29%20486-5984> office >>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> -- >>>> David Trebotich >>>> Applied Numerical Algorithms Group >>>> Lawrence Berkeley National Laboratory >>>> (510) 486-5984 office >>>> (510) 384-6868 mobile >>>> >>>> >>>> >>> -- >>> David Trebotich >>> Applied Numerical Algorithms Group >>> Computational Research Division >>> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) 384-6868 >>> mobile >>> >>> >>> >> > -- > David Trebotich > Applied Numerical Algorithms Group > Lawrence Berkeley National Laboratory > (510) 486-5984 office > (510) 384-6868 mobile > > >
