On Wed, Jul 14, 2021 at 4:58 PM Eric Chamberland < [email protected]> wrote:
> Hi Matthew, > > Ok, I did that but it segfault now. Here are the order of the calls: > > DMPlexCreate > > DMSetDimension > > DMPlexBuildFromCellListParallel(...) > > DMPlexInterpolate > > PetscPartitioner lPart; > DMPlexGetPartitioner(lDMSansOverlap, &lPart); > PetscPartitionerSetFromOptions(lPart); > > DMSetUseNatural(lDMSansOverlap, PETSC_TRUE) > > DMPlexDistribute > > DMPlexGlobalToNaturalBegin > > DMPlexGlobalToNaturalEnd > > > But it gives me the following error: > > 0]PETSC ERROR: --------------------- Error Message > -------------------------------------------------------------- > [0]PETSC ERROR: Petsc has generated inconsistent data > [0]PETSC ERROR: DM global to natural SF not present. > If DMPlexDistribute() was called and a section was defined, report to > [email protected]. > > [0]PETSC ERROR: See https://www.mcs.anl.gov/petsc/documentation/faq.html > for trouble shooting. > [0]PETSC ERROR: Petsc Release Version 3.15.0, Mar 30, 2021 > [0]PETSC ERROR: MEF++.dev on a named rohan by ericc Wed Jul 14 16:57:48 > 2021 > [0]PETSC ERROR: Configure options > --prefix=/opt/petsc-3.15.0_debug_openmpi-4.1.0_gcc7 --with-mpi-compilers=1 > --with-mpi-dir=/opt/openmpi-4.1.0_gcc7 --with-cxx-dialect=C++14 > --with-make-np=12 --with-shared-libraries=1 --with-debugging=yes > --with-memalign=64 --with-visibility=0 --with-64-bit-indices=0 > --download-ml=yes --download-mumps=yes --download-superlu=yes > --download-hpddm=yes --download-slepc=yes --download-superlu_dist=yes > --download-parmetis=yes --download-ptscotch=yes --download-metis=yes > --download-strumpack=yes --download-suitesparse=yes --download-hypre=yes > --with-blaslapack-dir=/opt/intel/oneapi/mkl/2021.1.1/env/../lib/intel64 > --with-mkl_pardiso-dir=/opt/intel/oneapi/mkl/2021.1.1/env/.. > --with-mkl_cpardiso-dir=/opt/intel/oneapi/mkl/2021.1.1/env/.. > --with-scalapack=1 > --with-scalapack-include=/opt/intel/oneapi/mkl/2021.1.1/env/../include > --with-scalapack-lib="-L/opt/intel/oneapi/mkl/2021.1.1/env/../lib/intel64 > -lmkl_scalapack_lp64 -lmkl_blacs_openmpi_lp64" > [0]PETSC ERROR: #1 DMPlexGlobalToNaturalBegin() at > /tmp/ompi-opt/petsc-3.15.0-debug/src/dm/impls/plex/plexnatural.c:245 > > What did I missed? > > Ah, there was a confusion of intent. GlobalToNatural() is for people that want data transformed back into the original order. I thought that was what you wanted. If you just want mesh points in the original order, we give you the transformation as part of the output of DMPlexDistribute(). The migrationSF that is output maps the original point to the distributed point. You run it backwards to get the original ordering. Thanks, Matt > Thanks a lot! > > Eric > On 2021-07-14 3:09 p.m., Matthew Knepley wrote: > > On Wed, Jul 14, 2021 at 1:18 PM Eric Chamberland < > [email protected]> wrote: > >> Hi, >> >> I want to use DMPlexDistribute from PETSc for computing overlapping and >> play with the different partitioners supported. >> >> However, after calling DMPlexDistribute, I noticed the elements are >> renumbered and then the original number is lost. >> >> What would be the best way to keep track of the element renumbering? >> >> a) Adding an optional parameter to let the user retrieve a vector or >> "IS" giving the old number? >> >> b) Adding a DMLabel (seems a wrong good solution) >> >> c) Other idea? >> >> Of course, I don't want to loose performances with the need of this >> "mapping"... >> > > You need to call > > https://petsc.org/release/docs/manualpages/DM/DMSetUseNatural.html > > before call DMPlexDistribute(). Then you can call > > > https://petsc.org/release/docs/manualpages/DMPLEX/DMPlexGlobalToNaturalBegin.html > > to map back to the original numbering if you want. This is the same thing > that DMDA is doing. > > Thanks, > > Matt > > >> Thanks, >> >> Eric >> >> -- >> Eric Chamberland, ing., M. Ing >> Professionnel de recherche >> GIREF/Université Laval >> (418) 656-2131 poste 41 22 42 >> >> > > -- > What most experimenters take for granted before they begin their > experiments is infinitely more interesting than any results to which their > experiments lead. > -- Norbert Wiener > > https://www.cse.buffalo.edu/~knepley/ > <http://www.cse.buffalo.edu/~knepley/> > > -- > Eric Chamberland, ing., M. Ing > Professionnel de recherche > GIREF/Université Laval > (418) 656-2131 poste 41 22 42 > > -- What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. -- Norbert Wiener https://www.cse.buffalo.edu/~knepley/ <http://www.cse.buffalo.edu/~knepley/>
