Ok - pushed https://bitbucket.org/petsc/petsc/commits/4587ae78d1b1d48e29f160114ed454b0c5f862f2
Can you retry with latest master? Satish On Tue, 10 Jan 2017, Satish Balay wrote: > > cannot process: 4294967296 > > I need to add more entries for this size. > > BTW: this is the ctable code that you added long time ago.. > > Satish > > On Tue, 10 Jan 2017, Satish Balay wrote: > > > Are you on master? If so can you try with latest? > > > > or use these patches. > > https://bitbucket.org/petsc/petsc/commits/d742c75fd0d514f7fa1873d5b10984bc3f363031 > > https://bitbucket.org/petsc/petsc/commits/952da9c592908439a79849c624703c9c85ef4977 > > And see if you still encounter problems. > > > > Satish > > > > On Tue, 10 Jan 2017, Mark Adams wrote: > > > > > We have a code that is failing on large scale runs on Edison at NERSC. We > > > ran with a debug version and we got this error message that I assume is > > > from a check that is done in debug. Is this a false positive? This is a 64 > > > bit integer build. > > > Thanks, > > > Mark > > > > > > [5]PETSC ERROR: --------------------- Error Message > > > -------------------------------------------------------------- > > > [5]PETSC ERROR: Argument out of range > > > [5]PETSC ERROR: A really huge hash is being requested.. cannot process: > > > 4294967296 > > > [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html > > > for > > > trouble shooting. > > > [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 GIT > > > Date: 2016-12-21 13:19:16 -0600 > > > [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named nid00008 > > > by u6338 Sat Jan 7 16:39:16 2017 > > > [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo" > > > --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo" > > > --download-parmetis --download-metis --download-hypre --with-ssl=0 > > > --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC > > > --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn > > > --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0 > > > --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices > > > --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC > > > ERROR: ---- > > > > > > using: > > > PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc30-dbg64-intel/ > > > > > > maybe go back to opt version? > > > > > > > > > On 12/22/2016 03:22 PM, Mark Adams wrote: > > > > > > > You configure with the size of an integer explicitly, ie, > > > > --with-64-bit-integers. I can't imagine there is anything bigger, but it > > > > would not be hard to do. > > > > > > > > On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <[email protected]> > > > > wrote: > > > > > > > > i just committed changes to SPMD that Brian needed for signed long long. > > > >> Evidently petsc is now handling bigger matrices? > > > >> > > > >> > > > >> On 12/22/2016 2:57 PM, Mark Adams wrote: > > > >> > > > >> There are a few hits on stack exchange, google: > > > >> > > > >> "error: expression must have class type" > > > >> > > > >> I think intputT is a templated type and it is templated with a > > > >> PetscInt. > > > >> You are calling the linearSize() method on a primitive type. That is my > > > >> best guess. > > > >> > > > >> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <[email protected]> > > > >> wrote: > > > >> > > > >> building with dbg looks same: > > > >>> > > > >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression must > > > >>> have class type > > > >>> return inputT.linearSize(); > > > >>> ^ > > > >>> detected during: > > > >>> instantiation of "int linearSize(const T &) [with > > > >>> T=PetscInt={PetscInt64={long long}}]" at line 128 of > > > >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > > >>> instantiation of "int MiniIVFAB<T>::size(const Box &, > > > >>> const > > > >>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at line > > > >>> 155 > > > >>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > > >>> instantiation of "int BaseEBCellFAB<T>::size(const Box &, > > > >>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at > > > >>> line > > > >>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > > > >>> instantiation of "int LDOperator<T>::size(const T &, const > > > >>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets > > > >>> cInt64={long > > > >>> long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> implicit generation of "LDOperator<T>::LDOperator() [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> instantiation of class "LDOperator<T> [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> instantiation of "void LevelData<T>::copyTo(const > > > >>> Interval &, > > > >>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > > >>> LDOperator<T> > > > >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > > > >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>> instantiation of "void LevelData<T>::copyTo(const > > > >>> Interval &, > > > >>> BoxLayoutData<T> &, const Interval &) const [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>> instantiation of "LevelData<T>::LevelData() [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > > > >>> "../srcLib/EBPetscSolver.cpp" > > > >>> > > > >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression must > > > >>> have class type > > > >>> inputT.linearOut(a_outBuf); > > > >>> ^ > > > >>> detected during: > > > >>> instantiation of "void linearOut(void *, const T &) [with > > > >>> T=PetscInt={PetscInt64={long long}}]" at line 155 of > > > >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > > >>> instantiation of "void MiniIVFAB<T>::linearOut(void *, > > > >>> const > > > >>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long > > > >>> long}}]" > > > >>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > > >>> instantiation of "void BaseEBCellFAB<T>::linearOut(void *, > > > >>> const Box &, const Interval &) const [with > > > >>> T=PetscInt={PetscInt64={long > > > >>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo > > > >>> ols/BoxLayoutData.H" > > > >>> instantiation of "void LDOperator<T>::linearOut(const T &, > > > >>> void *, const Box &, const Interval &) const [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> implicit generation of "LDOperator<T>::LDOperator() [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> instantiation of class "LDOperator<T> [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> instantiation of "void LevelData<T>::copyTo(const > > > >>> Interval &, > > > >>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > > >>> LDOperator<T> > > > >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > > > >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>> instantiation of "void LevelData<T>::copyTo(const > > > >>> Interval &, > > > >>> BoxLayoutData<T> &, const Interval &) const [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>> instantiation of "LevelData<T>::LevelData() [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > > > >>> "../srcLib/EBPetscSolver.cpp" > > > >>> > > > >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression must > > > >>> have class type > > > >>> a_outputT.linearIn(inBuf); > > > >>> ^ > > > >>> detected during: > > > >>> instantiation of "void linearIn(T &, const void *) [with > > > >>> T=PetscInt={PetscInt64={long long}}]" at line 181 of > > > >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > > >>> instantiation of "void MiniIVFAB<T>::linearIn(void *, > > > >>> const > > > >>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long long}}]" > > > >>> at > > > >>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > > >>> instantiation of "void BaseEBCellFAB<T>::linearIn(void *, > > > >>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long > > > >>> long}}]" > > > >>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > > > >>> instantiation of "void LDOperator<T>::linearIn(T &, void > > > >>> *, > > > >>> const Box &, const Interval &) const [with > > > >>> T=BaseEBCellFAB<PetscInt={Pets > > > >>> cInt64={long > > > >>> long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> implicit generation of "LDOperator<T>::LDOperator() [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> instantiation of class "LDOperator<T> [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>> instantiation of "void LevelData<T>::copyTo(const > > > >>> Interval &, > > > >>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > > >>> LDOperator<T> > > > >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at > > > >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>> instantiation of "void LevelData<T>::copyTo(const > > > >>> Interval &, > > > >>> BoxLayoutData<T> &, const Interval &) const [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of > > > >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>> instantiation of "LevelData<T>::LevelData() [with > > > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of > > > >>> "../srcLib/EBPetscSolver.cpp" > > > >>> > > > >>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) > > > >>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MPI.PETSC/EBPetscSolver.o] > > > >>> Error 2 > > > >>> > > > >>> > > > >>> On 12/22/2016 09:42 AM, Mark Adams wrote: > > > >>> > > > >>> I have build a debug version (opt64 --> dbg64). You might try that. > > > >>>> > > > >>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <[email protected]> wrote: > > > >>>> > > > >>>> > > > >>>> > > > >>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich > > > >>>>> <[email protected]> > > > >>>>> wrote: > > > >>>>> > > > >>>>> This wasn't happening until after you rebuilt petsc. So I am > > > >>>>> wondering > > > >>>>> > > > >>>>>> if you upgraded or changed something?? > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> Humm, let me rebuild. This is on Edison I assume. > > > >>>>> > > > >>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3 > > > >>>>> 0-opt64-intel > > > >>>>> (again) > > > >>>>> > > > >>>>> This is a new build. I would also do a deep clean on your end, of > > > >>>>> course. > > > >>>>> > > > >>>>> I see a DCH_USE_COMPLEX ... > > > >>>>> > > > >>>>> Also, I would try a debug build just to get some data. This is some > > > >>>>> strange problem of something is out of synch. > > > >>>>> > > > >>>>> > > > >>>>> > > > >>>>> On 12/19/2016 05:05 PM, Mark Adams wrote: > > > >>>>>> > > > >>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich > > > >>>>>> <[email protected]> > > > >>>>>> > > > >>>>>>> wrote: > > > >>>>>>> > > > >>>>>>> I am sorry, you mean I need to add that to environment variables? > > > >>>>>>> > > > >>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>> The PETSC_ARCH is hardwired for the size of integers so you would > > > >>>>>>> use > > > >>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know of > > > >>>>>>> this > > > >>>>>>> installation ever being used). But now that I think about it you > > > >>>>>>> always > > > >>>>>>> use > > > >>>>>>> 64 bit ints and you need to. > > > >>>>>>> > > > >>>>>>> So what is going on here ... it looks like an object has been > > > >>>>>>> templated > > > >>>>>>> on > > > >>>>>>> a PetscInt and is getting mixed up. I don't think you ever use 32 > > > >>>>>>> bit > > > >>>>>>> ints > > > >>>>>>> in PETSc so it looks like you regressed here... I don't have a > > > >>>>>>> lot of > > > >>>>>>> experience with templates. I'd ask Brian or Dan. > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote: > > > >>>>>>>> > > > >>>>>>>> There is a: arch-xc30-opt-intel > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich < > > > >>>>>>>>> [email protected]> > > > >>>>>>>>> wrote: > > > >>>>>>>>> > > > >>>>>>>>> Hey Mark- > > > >>>>>>>>> > > > >>>>>>>>> We have had this issue recently and am wondering if you know > > > >>>>>>>>> what > > > >>>>>>>>> > > > >>>>>>>>>> the > > > >>>>>>>>>> problem is. Maybe an int vs. PetscInt vs. PetscInt64 kind of > > > >>>>>>>>>> thing? > > > >>>>>>>>>> > > > >>>>>>>>>> CC -O2 -fast -no-ipo -std=c++11 -O3 -m64 > > > >>>>>>>>>> -qopt-multi-version-aggressive > > > >>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable > > > >>>>>>>>>> 3180 > > > >>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux -DNDEBUG -DCH_MPI > > > >>>>>>>>>> -DMPICH_SKIP_MPICXX > > > >>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND -DCH_USE_COMPLEX > > > >>>>>>>>>> -DCH_USE_EB > > > >>>>>>>>>> -DCH_USE_MEMORY_TRACKING -DCH_USE_64 -DCH_USE_DOUBLE > > > >>>>>>>>>> -DCH_USE_HDF5 > > > >>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include -I. > > > >>>>>>>>>> -I../srcBCG > > > >>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG > > > >>>>>>>>>> -I../srcCrunchFlow_BCG > > > >>>>>>>>>> -I../srcCrunchFlow_BCG/modules -DCH_USE_PETSC > > > >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > > > >>>>>>>>>> intel/include > > > >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > > > >>>>>>>>>> intel/include > > > >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64- > > > >>>>>>>>>> intel/include > > > >>>>>>>>>> -DCH_FORT_UNDERSCORE > > > >>>>>>>>>> -I../../../Chombo/lib/src/EBAMRTimeDependent > > > >>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic > > > >>>>>>>>>> -I../../../Chombo/lib/src/EBAM > > > >>>>>>>>>> RTools > > > >>>>>>>>>> -I../../../Chombo/lib/src/Workshop > > > >>>>>>>>>> -I../../../Chombo/lib/src/EBTo > > > >>>>>>>>>> ols > > > >>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent > > > >>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic > > > >>>>>>>>>> -I../../../Chombo/lib/src/AMRTools > > > >>>>>>>>>> -I../../../Chombo/lib/src/BoxT > > > >>>>>>>>>> ools > > > >>>>>>>>>> -I../../../Chombo/lib/src/BaseTools -DCH_LANG_CC -c > > > >>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M > > > >>>>>>>>>> PI.PETSC/EBPetscSolver.o > > > >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: > > > >>>>>>>>>> expression > > > >>>>>>>>>> must > > > >>>>>>>>>> have class type > > > >>>>>>>>>> return inputT.linearSize(); > > > >>>>>>>>>> ^ > > > >>>>>>>>>> detected during: > > > >>>>>>>>>> instantiation of "int linearSize(const T &) [with > > > >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of > > > >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > > >>>>>>>>>> instantiation of "int MiniIVFAB<T>::size(const Box > > > >>>>>>>>>> &, > > > >>>>>>>>>> const > > > >>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" > > > >>>>>>>>>> at > > > >>>>>>>>>> line > > > >>>>>>>>>> 155 > > > >>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > > >>>>>>>>>> instantiation of "int BaseEBCellFAB<T>::size(const > > > >>>>>>>>>> Box > > > >>>>>>>>>> &, > > > >>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long > > > >>>>>>>>>> long}}]" at > > > >>>>>>>>>> line > > > >>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > > > >>>>>>>>>> instantiation of "int LDOperator<T>::size(const T > > > >>>>>>>>>> &, > > > >>>>>>>>>> const > > > >>>>>>>>>> Box > > > >>>>>>>>>> &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets > > > >>>>>>>>>> cInt64={long > > > >>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo > > > >>>>>>>>>> ols/LevelData.H" > > > >>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() > > > >>>>>>>>>> [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line > > > >>>>>>>>>> 114 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>>>>>>>>> instantiation of class "LDOperator<T> [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line > > > >>>>>>>>>> 114 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > > >>>>>>>>>> Interval &, > > > >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > > >>>>>>>>>> LDOperator<T> > > > >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > > > >>>>>>>>>> long}}>]" > > > >>>>>>>>>> at > > > >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > > >>>>>>>>>> Interval &, > > > >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > > > >>>>>>>>>> > > > >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: > > > >>>>>>>>>> expression > > > >>>>>>>>>> must > > > >>>>>>>>>> have class type > > > >>>>>>>>>> inputT.linearOut(a_outBuf); > > > >>>>>>>>>> ^ > > > >>>>>>>>>> detected during: > > > >>>>>>>>>> instantiation of "void linearOut(void *, const T &) > > > >>>>>>>>>> [with > > > >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of > > > >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > > >>>>>>>>>> instantiation of "void > > > >>>>>>>>>> MiniIVFAB<T>::linearOut(void *, > > > >>>>>>>>>> const > > > >>>>>>>>>> Box &, const Interval &) const [with > > > >>>>>>>>>> T=PetscInt={PetscInt64={long > > > >>>>>>>>>> long}}]" > > > >>>>>>>>>> at line 169 of > > > >>>>>>>>>> "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > > >>>>>>>>>> instantiation of "void > > > >>>>>>>>>> BaseEBCellFAB<T>::linearOut(vo > > > >>>>>>>>>> id > > > >>>>>>>>>> *, > > > >>>>>>>>>> const Box &, const Interval &) const [with > > > >>>>>>>>>> T=PetscInt={PetscInt64={long > > > >>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo > > > >>>>>>>>>> ols/BoxLayoutData.H" > > > >>>>>>>>>> instantiation of "void > > > >>>>>>>>>> LDOperator<T>::linearOut(const > > > >>>>>>>>>> T &, > > > >>>>>>>>>> void *, const Box &, const Interval &) const [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line > > > >>>>>>>>>> 114 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() > > > >>>>>>>>>> [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line > > > >>>>>>>>>> 114 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>>>>>>>>> instantiation of class "LDOperator<T> [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line > > > >>>>>>>>>> 114 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > > >>>>>>>>>> Interval &, > > > >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > > >>>>>>>>>> LDOperator<T> > > > >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > > > >>>>>>>>>> long}}>]" > > > >>>>>>>>>> at > > > >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > > >>>>>>>>>> Interval &, > > > >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > > > >>>>>>>>>> > > > >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: > > > >>>>>>>>>> expression > > > >>>>>>>>>> must > > > >>>>>>>>>> have class type > > > >>>>>>>>>> a_outputT.linearIn(inBuf); > > > >>>>>>>>>> ^ > > > >>>>>>>>>> detected during: > > > >>>>>>>>>> instantiation of "void linearIn(T &, const void *) > > > >>>>>>>>>> [with > > > >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of > > > >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H" > > > >>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearIn(void > > > >>>>>>>>>> *, > > > >>>>>>>>>> const > > > >>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long > > > >>>>>>>>>> long}}]" > > > >>>>>>>>>> at > > > >>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H" > > > >>>>>>>>>> instantiation of "void > > > >>>>>>>>>> BaseEBCellFAB<T>::linearIn(voi > > > >>>>>>>>>> d > > > >>>>>>>>>> *, > > > >>>>>>>>>> const Box &, const Interval &) [with > > > >>>>>>>>>> T=PetscInt={PetscInt64={long > > > >>>>>>>>>> long}}]" > > > >>>>>>>>>> at line 159 of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H" > > > >>>>>>>>>> instantiation of "void LDOperator<T>::linearIn(T &, > > > >>>>>>>>>> void > > > >>>>>>>>>> *, > > > >>>>>>>>>> const Box &, const Interval &) const [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets > > > >>>>>>>>>> cInt64={long > > > >>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo > > > >>>>>>>>>> ols/LevelData.H" > > > >>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator() > > > >>>>>>>>>> [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line > > > >>>>>>>>>> 114 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>>>>>>>>> instantiation of class "LDOperator<T> [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line > > > >>>>>>>>>> 114 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H" > > > >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > > >>>>>>>>>> Interval &, > > > >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const > > > >>>>>>>>>> LDOperator<T> > > > >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long > > > >>>>>>>>>> long}}>]" > > > >>>>>>>>>> at > > > >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const > > > >>>>>>>>>> Interval &, > > > >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H" > > > >>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with > > > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 > > > >>>>>>>>>> of > > > >>>>>>>>>> "../srcLib/EBPetscSolver.cpp" > > > >>>>>>>>>> > > > >>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2) > > > >>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH. > > > >>>>>>>>>> MPI.PETSC/EBPetscSolver.o] > > > >>>>>>>>>> Error 2 > > > >>>>>>>>>> make: *** [all-example] Error 2 > > > >>>>>>>>>> > > > >>>>>>>>>> > > > >>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote: > > > >>>>>>>>>> > > > >>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path: > > > >>>>>>>>>> "...madams/ > > > >>>>>>>>>> > > > >>>>>>>>>> petsc_install/petscv3.6..." > > > >>>>>>>>>> > > > >>>>>>>>>>> > > > >>>>>>>>>>> > > > >>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich < > > > >>>>>>>>>>> [email protected] > > > >>>>>>>>>>> > > > >>>>>>>>>>> > > > >>>>>>>>>>>> wrote: > > > >>>>>>>>>>>> > > > >>>>>>>>>>> > > > >>>>>>>>>>> Hey Mark- > > > >>>>>>>>>>> > > > >>>>>>>>>>> > > > >>>>>>>>>>> I seem to have lost contact with petsc over the weekend: > > > >>>>>>>>>>> > > > >>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/ > > > >>>>>>>>>>>> petsc/conf/variables: > > > >>>>>>>>>>>> No such file or directory > > > >>>>>>>>>>>> Last chance .ex rule for target > > > >>>>>>>>>>>> /global/homes/m/madams/petscv3 > > > >>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> setenv | grep petsc: > > > >>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGCONFIG_PATH=/opt/cray/petsc/3. > > > >>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_ > > > >>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig > > > >>>>>>>>>>>> PETSC_DIR=/global/homes/m/madams/petscv3.6-xc30-opt64-intel/ > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> Currently Loaded Modulefiles: > > > >>>>>>>>>>>> 1) modules/3.2.10.4 8) > > > >>>>>>>>>>>> intel/15.0.1.133 > > > >>>>>>>>>>>> 15) xpmem/0.1-2.0502.57015.1.15.ari 22) > > > >>>>>>>>>>>> cray-mpich/7.4.1 > > > >>>>>>>>>>>> 2) nsg/1.2.0 9) > > > >>>>>>>>>>>> cray-libsci/16.07.1 > > > >>>>>>>>>>>> 16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari 23) > > > >>>>>>>>>>>> slurm/edison > > > >>>>>>>>>>>> 3) eswrap/1.3.3-1.020200.1278.0 10) > > > >>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari 17) > > > >>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a > > > >>>>>>>>>>>> ri > > > >>>>>>>>>>>> 24) altd/2.0 > > > >>>>>>>>>>>> 4) switch/1.0-1.0502.57058.1.58.ari 11) > > > >>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari 18) rca/ > > > >>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar > > > >>>>>>>>>>>> i > > > >>>>>>>>>>>> 25) darshan/2.3.1 > > > >>>>>>>>>>>> 5) craype-ivybridge 12) pmi/ > > > >>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari 19) atp/2.0.2 26) > > > >>>>>>>>>>>> emacs/24.2 > > > >>>>>>>>>>>> 6) craype-network-aries 13) > > > >>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari 20) PrgEnv-intel/5.2.56 > > > >>>>>>>>>>>> 27) > > > >>>>>>>>>>>> cray-hdf5-parallel/1.8.16 > > > >>>>>>>>>>>> 7) craype/2.4.2 14) > > > >>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari 21) cray-shmem/7.4.1 > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> Thanks. > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> treb > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> -- > > > >>>>>>>>>>>> David Trebotich > > > >>>>>>>>>>>> Applied Numerical Algorithms Group > > > >>>>>>>>>>>> Lawrence Berkeley National Laboratory > > > >>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > > > >>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> -- > > > >>>>>>>>>>>> > > > >>>>>>>>>>>> > > > >>>>>>>>>>> David Trebotich > > > >>>>>>>>>>> > > > >>>>>>>>>> Applied Numerical Algorithms Group > > > >>>>>>>>>> Lawrence Berkeley National Laboratory > > > >>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > > > >>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > > > >>>>>>>>>> > > > >>>>>>>>>> > > > >>>>>>>>>> > > > >>>>>>>>>> > > > >>>>>>>>>> -- > > > >>>>>>>>>> > > > >>>>>>>>> > > > >>>>>>>>> David Trebotich > > > >>>>>>>> Applied Numerical Algorithms Group > > > >>>>>>>> Lawrence Berkeley National Laboratory > > > >>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office > > > >>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> -- > > > >>>>>>> > > > >>>>>> David Trebotich > > > >>>>>> Applied Numerical Algorithms Group > > > >>>>>> Lawrence Berkeley National Laboratory > > > >>>>>> (510) 486-5984 <%28510%29%20486-5984> office > > > >>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>> -- > > > >>> David Trebotich > > > >>> Applied Numerical Algorithms Group > > > >>> Lawrence Berkeley National Laboratory > > > >>> (510) 486-5984 office > > > >>> (510) 384-6868 mobile > > > >>> > > > >>> > > > >>> > > > >> -- > > > >> David Trebotich > > > >> Applied Numerical Algorithms Group > > > >> Computational Research Division > > > >> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) > > > >> 384-6868 > > > >> mobile > > > >> > > > >> > > > >> > > > > > > > > > > > > >
