On Tue, Jan 10, 2017 at 4:28 PM, Satish Balay <[email protected]> wrote:
> Yup. Thats 4294967296*8bytes 34GB RAM - just for this one hash table? > Humm, that is crazy large. Treb: I would like to get the stack trace. Can you please send the whole output or grep on "[5]" (or any proc that fails) to get a stack trace. And can you tell me how many global equations you have here. > Satish > > On Tue, 10 Jan 2017, Kong, Fande wrote: > > > On Tue, Jan 10, 2017 at 1:47 PM, Mark Adams <[email protected]> wrote: > > > > > We have a code that is failing on large scale runs on Edison at NERSC. > We > > > ran with a debug version and we got this error message that I assume is > > > from a check that is done in debug. Is this a false positive? This is > a 64 > > > bit integer build. > > > Thanks, > > > Mark > > > > > > [5]PETSC ERROR: --------------------- Error Message > > > -------------------------------------------------------------- > > > [5]PETSC ERROR: Argument out of range > > > [5]PETSC ERROR: A really huge hash is being requested.. cannot process: > > > 4294967296 > > > > > > > Satish, > > > > The number "4294967296" is larger than the maximum number (2147321881) > you > > put in the lookup. > > > > I guess your fixes do not help this one. > > > > > > Fande, > > > > > > > > > > > [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/d > ocumentation/faq.html > > > <https://urldefense.proofpoint.com/v2/url?u=http-3A__www. > mcs.anl.gov_petsc_documentation_faq.html&d=DQMFaQ&c=54IZrppP > QZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtN > aS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVt > sFIoN1ABdechuuE&s=BdTH9phOP3ipZiM21mw_gZrxPjWTeVcpXw9n-y7GECo&e=> > > > for trouble shooting. > > > [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 > GIT > > > Date: 2016-12-21 13:19:16 -0600 > > > [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named > nid00008 > > > by u6338 Sat Jan 7 16:39:16 2017 > > > [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo" > > > --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo" > > > --download-parmetis --download-metis --download-hypre --with-ssl=0 > > > --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC > > > --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn > > > --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0 > > > --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices > > > --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC > > > ERROR: ---- > > > > > > using: > > > PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7- > xc30-dbg64-intel/ > > > > > > maybe go back to opt version? > > > > > > > > > On 12/22/2016 03:22 PM, Mark Adams wrote: > > > > > >> You configure with the size of an integer explicitly, ie, > > >> --with-64-bit-integers. I can't imagine there is anything bigger, but > it > > >> would not be hard to do. > > >> > > >> On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <[email protected] > > > > >> wrote: > > >> > > >> i just committed changes to SPMD that Brian needed for signed long > long. > > >>> Evidently petsc is now handling bigger matrices? > > >>> > > >>> > > >>> On 12/22/2016 2:57 PM, Mark Adams wrote: > > >>> > > >>> There are a few hits on stack exchange, google: > > >>> > > >>> "error: expression must have class type" > > >>> > > >>> I think intputT is a templated type and it is templated with a > PetscInt. > > >>> You are calling the linearSize() method on a primitive type. That is > my > > >>> best guess. > > >>> > > >>> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <[email protected] > > > > >>> wrote: > > >>> > > >>> building with dbg looks same: > > >>>> > > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression > must > > >>>> have class type > > >>>> return inputT.linearSize(); > > >>>> ^ > > >>>> detected during: > > >>>> instantiation of "int linearSize(const T &) [with > > >>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of > > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > >>>> instantiation of "int MiniIVFAB<T>::size(const Box &, > const > > >>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at > line > > >>>> 155 > > >>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > >>>> instantiation of "int BaseEBCellFAB<T>::size(const Box > &, > > >>>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" > at > > >>>> line > > >>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > > >>>> instantiation of "int LDOperator<T>::size(const T &, > const > > >>>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets > > >>>> cInt64={long > > >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo > ols/LevelData.H" > > >>>> implicit generation of "LDOperator<T>::LDOperator() > [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>> instantiation of class "LDOperator<T> [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>> instantiation of "void LevelData<T>::copyTo(const > Interval > > >>>> &, > > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > >>>> LDOperator<T> > > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > long}}>]" at > > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>> instantiation of "void LevelData<T>::copyTo(const > Interval > > >>>> &, > > >>>> BoxLayoutData<T> &, const Interval &) const [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>> instantiation of "LevelData<T>::LevelData() [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > > >>>> "../srcLib/EBPetscSolver.cpp" > > >>>> > > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression > must > > >>>> have class type > > >>>> inputT.linearOut(a_outBuf); > > >>>> ^ > > >>>> detected during: > > >>>> instantiation of "void linearOut(void *, const T &) > [with > > >>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of > > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > >>>> instantiation of "void MiniIVFAB<T>::linearOut(void *, > const > > >>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long > > >>>> long}}]" > > >>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > >>>> instantiation of "void BaseEBCellFAB<T>::linearOut(void > *, > > >>>> const Box &, const Interval &) const [with > T=PetscInt={PetscInt64={long > > >>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo > > >>>> ols/BoxLayoutData.H" > > >>>> instantiation of "void LDOperator<T>::linearOut(const T > &, > > >>>> void *, const Box &, const Interval &) const [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>> implicit generation of "LDOperator<T>::LDOperator() > [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>> instantiation of class "LDOperator<T> [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>> instantiation of "void LevelData<T>::copyTo(const > Interval > > >>>> &, > > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > >>>> LDOperator<T> > > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > long}}>]" at > > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>> instantiation of "void LevelData<T>::copyTo(const > Interval > > >>>> &, > > >>>> BoxLayoutData<T> &, const Interval &) const [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>> instantiation of "LevelData<T>::LevelData() [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > > >>>> "../srcLib/EBPetscSolver.cpp" > > >>>> > > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression > must > > >>>> have class type > > >>>> a_outputT.linearIn(inBuf); > > >>>> ^ > > >>>> detected during: > > >>>> instantiation of "void linearIn(T &, const void *) [with > > >>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of > > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > >>>> instantiation of "void MiniIVFAB<T>::linearIn(void *, > const > > >>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long > long}}]" at > > >>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > >>>> instantiation of "void BaseEBCellFAB<T>::linearIn(void > *, > > >>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long > > >>>> long}}]" > > >>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > > >>>> instantiation of "void LDOperator<T>::linearIn(T &, > void *, > > >>>> const Box &, const Interval &) const [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long > > >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo > ols/LevelData.H" > > >>>> implicit generation of "LDOperator<T>::LDOperator() > [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>> instantiation of class "LDOperator<T> [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>> instantiation of "void LevelData<T>::copyTo(const > Interval > > >>>> &, > > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > >>>> LDOperator<T> > > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > long}}>]" at > > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>> instantiation of "void LevelData<T>::copyTo(const > Interval > > >>>> &, > > >>>> BoxLayoutData<T> &, const Interval &) const [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>> instantiation of "LevelData<T>::LevelData() [with > > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > > >>>> "../srcLib/EBPetscSolver.cpp" > > >>>> > > >>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) > > >>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MP > > >>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__3d. > Linux.64.CC.ftn.DEBUG.MP&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPf > FD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4t > s7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE& > s=HAhvWGeoB7HMK7Clyrfh_x-R465qxP-CNXK4zqhrCuE&e=> > > >>>> I.PETSC/EBPetscSolver.o] > > >>>> Error 2 > > >>>> > > >>>> > > >>>> On 12/22/2016 09:42 AM, Mark Adams wrote: > > >>>> > > >>>> I have build a debug version (opt64 --> dbg64). You might try that. > > >>>>> > > >>>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <[email protected]> > wrote: > > >>>>> > > >>>>> > > >>>>> > > >>>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich < > [email protected]> > > >>>>>> wrote: > > >>>>>> > > >>>>>> This wasn't happening until after you rebuilt petsc. So I am > > >>>>>> wondering > > >>>>>> > > >>>>>>> if you upgraded or changed something?? > > >>>>>>> > > >>>>>>> > > >>>>>> > > >>>>>> Humm, let me rebuild. This is on Edison I assume. > > >>>>>> > > >>>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3 > > >>>>>> 0-opt64-intel > > >>>>>> (again) > > >>>>>> > > >>>>>> This is a new build. I would also do a deep clean on your end, of > > >>>>>> course. > > >>>>>> > > >>>>>> I see a DCH_USE_COMPLEX ... > > >>>>>> > > >>>>>> Also, I would try a debug build just to get some data. This is > some > > >>>>>> strange problem of something is out of synch. > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> On 12/19/2016 05:05 PM, Mark Adams wrote: > > >>>>>>> > > >>>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich < > [email protected] > > >>>>>>> > > > >>>>>>> > > >>>>>>>> wrote: > > >>>>>>>> > > >>>>>>>> I am sorry, you mean I need to add that to environment > variables? > > >>>>>>>> > > >>>>>>>> > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>> The PETSC_ARCH is hardwired for the size of integers so you > would > > >>>>>>>> use > > >>>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know > of > > >>>>>>>> this > > >>>>>>>> installation ever being used). But now that I think about it you > > >>>>>>>> always > > >>>>>>>> use > > >>>>>>>> 64 bit ints and you need to. > > >>>>>>>> > > >>>>>>>> So what is going on here ... it looks like an object has been > > >>>>>>>> templated > > >>>>>>>> on > > >>>>>>>> a PetscInt and is getting mixed up. I don't think you ever use > 32 > > >>>>>>>> bit > > >>>>>>>> ints > > >>>>>>>> in PETSc so it looks like you regressed here... I don't have a > lot > > >>>>>>>> of > > >>>>>>>> experience with templates. I'd ask Brian or Dan. > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote: > > >>>>>>>>> > > >>>>>>>>> There is a: arch-xc30-opt-intel > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich < > > >>>>>>>>>> [email protected]> > > >>>>>>>>>> wrote: > > >>>>>>>>>> > > >>>>>>>>>> Hey Mark- > > >>>>>>>>>> > > >>>>>>>>>> We have had this issue recently and am wondering if you know > what > > >>>>>>>>>> > > >>>>>>>>>>> the > > >>>>>>>>>>> problem is. Maybe an int vs. PetscInt vs. PetscInt64 kind of > > >>>>>>>>>>> thing? > > >>>>>>>>>>> > > >>>>>>>>>>> CC -O2 -fast -no-ipo -std=c++11 -O3 -m64 > > >>>>>>>>>>> -qopt-multi-version-aggressive > > >>>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable > 3180 > > >>>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux -DNDEBUG -DCH_MPI > > >>>>>>>>>>> -DMPICH_SKIP_MPICXX > > >>>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND -DCH_USE_COMPLEX > > >>>>>>>>>>> -DCH_USE_EB > > >>>>>>>>>>> -DCH_USE_MEMORY_TRACKING -DCH_USE_64 -DCH_USE_DOUBLE > > >>>>>>>>>>> -DCH_USE_HDF5 > > >>>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include -I. > > >>>>>>>>>>> -I../srcBCG > > >>>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG > > >>>>>>>>>>> -I../srcCrunchFlow_BCG > > >>>>>>>>>>> -I../srcCrunchFlow_BCG/modules -DCH_USE_PETSC > > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > > >>>>>>>>>>> intel/include > > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > > >>>>>>>>>>> intel/include > > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > > >>>>>>>>>>> intel/include > > >>>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAM > > >>>>>>>>>>> RTimeDependent > > >>>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic > > >>>>>>>>>>> -I../../../Chombo/lib/src/EBAM > > >>>>>>>>>>> RTools > > >>>>>>>>>>> -I../../../Chombo/lib/src/Workshop > > >>>>>>>>>>> -I../../../Chombo/lib/src/EBTo > > >>>>>>>>>>> ols > > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent > > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic > > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTools > > >>>>>>>>>>> -I../../../Chombo/lib/src/BoxT > > >>>>>>>>>>> ools > > >>>>>>>>>>> -I../../../Chombo/lib/src/BaseTools -DCH_LANG_CC -c > > >>>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M > > >>>>>>>>>>> PI.PETSC/EBPetscSolver.o > > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: > expression > > >>>>>>>>>>> must > > >>>>>>>>>>> have class type > > >>>>>>>>>>> return inputT.linearSize(); > > >>>>>>>>>>> ^ > > >>>>>>>>>>> detected during: > > >>>>>>>>>>> instantiation of "int linearSize(const T &) [with > > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of > > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > >>>>>>>>>>> instantiation of "int MiniIVFAB<T>::size(const > Box &, > > >>>>>>>>>>> const > > >>>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long > long}}]" at > > >>>>>>>>>>> line > > >>>>>>>>>>> 155 > > >>>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > >>>>>>>>>>> instantiation of "int > BaseEBCellFAB<T>::size(const > > >>>>>>>>>>> Box > > >>>>>>>>>>> &, > > >>>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long > > >>>>>>>>>>> long}}]" at > > >>>>>>>>>>> line > > >>>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > > >>>>>>>>>>> instantiation of "int LDOperator<T>::size(const > T &, > > >>>>>>>>>>> const > > >>>>>>>>>>> Box > > >>>>>>>>>>> &, const Interval &) const [with > T=BaseEBCellFAB<PetscInt={Pets > > >>>>>>>>>>> cInt64={long > > >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo > > >>>>>>>>>>> ols/LevelData.H" > > >>>>>>>>>>> implicit generation of > "LDOperator<T>::LDOperator() > > >>>>>>>>>>> [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 114 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>>>>>>>>> instantiation of class "LDOperator<T> [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 114 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > >>>>>>>>>>> Interval &, > > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > >>>>>>>>>>> LDOperator<T> > > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > > >>>>>>>>>>> long}}>]" > > >>>>>>>>>>> at > > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > >>>>>>>>>>> Interval &, > > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 32 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 41 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > > >>>>>>>>>>> > > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: > expression > > >>>>>>>>>>> must > > >>>>>>>>>>> have class type > > >>>>>>>>>>> inputT.linearOut(a_outBuf); > > >>>>>>>>>>> ^ > > >>>>>>>>>>> detected during: > > >>>>>>>>>>> instantiation of "void linearOut(void *, const T > &) > > >>>>>>>>>>> [with > > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of > > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > >>>>>>>>>>> instantiation of "void > MiniIVFAB<T>::linearOut(void > > >>>>>>>>>>> *, > > >>>>>>>>>>> const > > >>>>>>>>>>> Box &, const Interval &) const [with > T=PetscInt={PetscInt64={long > > >>>>>>>>>>> long}}]" > > >>>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBToo > > >>>>>>>>>>> ls/BaseEBCellFABI.H" > > >>>>>>>>>>> instantiation of "void > BaseEBCellFAB<T>::linearOut(vo > > >>>>>>>>>>> id > > >>>>>>>>>>> *, > > >>>>>>>>>>> const Box &, const Interval &) const [with > > >>>>>>>>>>> T=PetscInt={PetscInt64={long > > >>>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo > > >>>>>>>>>>> ols/BoxLayoutData.H" > > >>>>>>>>>>> instantiation of "void > LDOperator<T>::linearOut(const > > >>>>>>>>>>> T &, > > >>>>>>>>>>> void *, const Box &, const Interval &) const [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 114 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>>>>>>>>> implicit generation of > "LDOperator<T>::LDOperator() > > >>>>>>>>>>> [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 114 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>>>>>>>>> instantiation of class "LDOperator<T> [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 114 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > >>>>>>>>>>> Interval &, > > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > >>>>>>>>>>> LDOperator<T> > > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > > >>>>>>>>>>> long}}>]" > > >>>>>>>>>>> at > > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > >>>>>>>>>>> Interval &, > > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 32 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 41 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > > >>>>>>>>>>> > > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: > expression > > >>>>>>>>>>> must > > >>>>>>>>>>> have class type > > >>>>>>>>>>> a_outputT.linearIn(inBuf); > > >>>>>>>>>>> ^ > > >>>>>>>>>>> detected during: > > >>>>>>>>>>> instantiation of "void linearIn(T &, const void > *) > > >>>>>>>>>>> [with > > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of > > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > >>>>>>>>>>> instantiation of "void > MiniIVFAB<T>::linearIn(void *, > > >>>>>>>>>>> const > > >>>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long > > >>>>>>>>>>> long}}]" > > >>>>>>>>>>> at > > >>>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBToo > ls/BaseEBCellFABI.H" > > >>>>>>>>>>> instantiation of "void > BaseEBCellFAB<T>::linearIn(voi > > >>>>>>>>>>> d > > >>>>>>>>>>> *, > > >>>>>>>>>>> const Box &, const Interval &) [with > T=PetscInt={PetscInt64={long > > >>>>>>>>>>> long}}]" > > >>>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTo > > >>>>>>>>>>> ols/BoxLayoutData.H" > > >>>>>>>>>>> instantiation of "void LDOperator<T>::linearIn(T > &, > > >>>>>>>>>>> void > > >>>>>>>>>>> *, > > >>>>>>>>>>> const Box &, const Interval &) const [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets > > >>>>>>>>>>> cInt64={long > > >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo > > >>>>>>>>>>> ols/LevelData.H" > > >>>>>>>>>>> implicit generation of > "LDOperator<T>::LDOperator() > > >>>>>>>>>>> [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 114 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>>>>>>>>> instantiation of class "LDOperator<T> [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 114 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > >>>>>>>>>>> Interval &, > > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > >>>>>>>>>>> LDOperator<T> > > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > > >>>>>>>>>>> long}}>]" > > >>>>>>>>>>> at > > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > >>>>>>>>>>> Interval &, > > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 32 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > line 41 > > >>>>>>>>>>> of > > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > > >>>>>>>>>>> > > >>>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) > > >>>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH. > > >>>>>>>>>>> MPI.PETSC/EBPetscSolver.o] > > >>>>>>>>>>> Error 2 > > >>>>>>>>>>> make: *** [all-example] Error 2 > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote: > > >>>>>>>>>>> > > >>>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path: > > >>>>>>>>>>> "...madams/ > > >>>>>>>>>>> > > >>>>>>>>>>> petsc_install/petscv3.6..." > > >>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich < > > >>>>>>>>>>>> [email protected] > > >>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>>> Hey Mark- > > >>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>>> I seem to have lost contact with petsc over the weekend: > > >>>>>>>>>>>> > > >>>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/ > > >>>>>>>>>>>>> petsc/conf/variables: > > >>>>>>>>>>>>> No such file or directory > > >>>>>>>>>>>>> Last chance .ex rule for target > /global/homes/m/madams/petscv3 > > >>>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> setenv | grep petsc: > > >>>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGC > ONFIG_PATH=/opt/cray/petsc/3. > > >>>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_ > > >>>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig > > >>>>>>>>>>>>> PETSC_DIR=/global/homes/m/mada > ms/petscv3.6-xc30-opt64-intel/ > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> Currently Loaded Modulefiles: > > >>>>>>>>>>>>> 1) modules/3.2.10.4 > > >>>>>>>>>>>>> <https://urldefense.proofpoint > .com/v2/url?u=http-3A__3.2.10.4&d=DQMFaQ&c=54IZrppPQZKX9mLzc > GdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4t > s7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE& > s=UN73DjcLzn6LGQKK_kwoLCLWgyM5YEeKwwHYYCHe1nw&e=> > > >>>>>>>>>>>>> 8) intel/15.0.1.133 > > >>>>>>>>>>>>> <https://urldefense.proofpoint > .com/v2/url?u=http-3A__15.0.1.133&d=DQMFaQ&c=54IZrppPQZKX9mL > zcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV > 4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuu > E&s=Gix6rgPxH5UFQeKmDN6zAXMAmFezfJ1qY-723XuYrUE&e=> > > >>>>>>>>>>>>> 15) xpmem/0.1-2.0502.57015.1.15.ar > > >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__0.1- > 2D2.0502.57015.1.15.ar&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPf > FD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4t > s7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE& > s=DcDHbf2qyi7t-rquIoqAdDx5HPEa3BXjxxWGpgLVhBU&e=>i > > >>>>>>>>>>>>> 22) > > >>>>>>>>>>>>> cray-mpich/7.4.1 > > >>>>>>>>>>>>> 2) nsg/1.2.0 9) > > >>>>>>>>>>>>> cray-libsci/16.07.1 > > >>>>>>>>>>>>> 16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari 23) > > >>>>>>>>>>>>> slurm/edison > > >>>>>>>>>>>>> 3) eswrap/1.3.3-1.020200.1278.0 10) > > >>>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari 17) > > >>>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a > > >>>>>>>>>>>>> ri > > >>>>>>>>>>>>> 24) altd/2.0 > > >>>>>>>>>>>>> 4) switch/1.0-1.0502.57058.1.58.ari 11) > > >>>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari 18) rca/ > > >>>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar > > >>>>>>>>>>>>> <https://urldefense.proofpoint > .com/v2/url?u=http-3A__1.0.0-2D2.0502.57212.2.56.ar&d= > DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r= > DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5Om > oJe38KFIo29VVtsFIoN1ABdechuuE&s=KaOFCQYgi4MV721r1zVhLb666-2L > 2dmTfExdbRrrB1s&e=> > > >>>>>>>>>>>>> i > > >>>>>>>>>>>>> 25) darshan/2.3.1 > > >>>>>>>>>>>>> 5) craype-ivybridge 12) pmi/ > > >>>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari 19) atp/2.0.2 26) > > >>>>>>>>>>>>> emacs/24.2 > > >>>>>>>>>>>>> 6) craype-network-aries 13) > > >>>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari 20) > PrgEnv-intel/5.2.56 > > >>>>>>>>>>>>> 27) > > >>>>>>>>>>>>> cray-hdf5-parallel/1.8.16 > > >>>>>>>>>>>>> 7) craype/2.4.2 14) > > >>>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari 21) cray-shmem/7.4.1 > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> Thanks. > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> treb > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> -- > > >>>>>>>>>>>>> David Trebotich > > >>>>>>>>>>>>> Applied Numerical Algorithms Group > > >>>>>>>>>>>>> Lawrence Berkeley National Laboratory > > >>>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > > >>>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> -- > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>> David Trebotich > > >>>>>>>>>>>> > > >>>>>>>>>>> Applied Numerical Algorithms Group > > >>>>>>>>>>> Lawrence Berkeley National Laboratory > > >>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > > >>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>>> -- > > >>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> David Trebotich > > >>>>>>>>> Applied Numerical Algorithms Group > > >>>>>>>>> Lawrence Berkeley National Laboratory > > >>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > > >>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> -- > > >>>>>>>> > > >>>>>>> David Trebotich > > >>>>>>> Applied Numerical Algorithms Group > > >>>>>>> Lawrence Berkeley National Laboratory > > >>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > > >>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > > >>>>>>> > > >>>>>>> > > >>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> -- > > >>>> David Trebotich > > >>>> Applied Numerical Algorithms Group > > >>>> Lawrence Berkeley National Laboratory > > >>>> (510) 486-5984 office > > >>>> (510) 384-6868 mobile > > >>>> > > >>>> > > >>>> > > >>> -- > > >>> David Trebotich > > >>> Applied Numerical Algorithms Group > > >>> Computational Research Division > > >>> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) > 384-6868 > > >>> mobile > > >>> > > >>> > > >>> > > >> > > > -- > > > David Trebotich > > > Applied Numerical Algorithms Group > > > Lawrence Berkeley National Laboratory > > > (510) 486-5984 office > > > (510) 384-6868 mobile > > > > > > > > > > > > >
