Hi Francesco,
Ok, I can confirm that your test runs fine for me with the latest master
branch. I'm attaching the log for two processes up to overlap 7, where
the entire mesh is effectively replicated on each partition. The command
I ran was:
for OL in 1 2 3 4 5 6 7; do mpiexec -np 2 python overlay-test.py -o $OL;
done
Looks like this might be a problem with your local build. Can you please
try and update to the latest master?
Hope this helps,
Michael
On 06/04/17 10:25, Francesco Caimmi wrote:
Dear Matt,
thanks for your reply.
On mercoledì 5 aprile 2017 21:09:43 CEST Matthew Knepley wrote:
On Wed, Apr 5, 2017 at 6:03 AM, Francesco Caimmi <[email protected]
[...]
the program fails with the error message captured in the attached file
error.log. Changing the number of processors does not alter the behavior.
Note
also that the same holds if I use a mesh generated by DMPlexCreateBoxMesh.
Francesco, I will reproduce your problem, but it may take me a few days.
Thank you very much for your time.
It is strange since we have tests for overlap > 1 that do use
CreateBoxMesh. For example,
cd src/dm/impls/plex/examples/tests
make ex12
mpiexec -n 8 -test_partition -overlap 2 -dm_view ::ascii_info_detail
Anyway, there might be something related to my install: for the records, if I
do
$cd src/dm/impls/plex/examples/tests
$make ex12
I get
/home/fcaimmi/Packages/petsc/my-linux-petsc/bin/mpicc ex12.c -o ex12
ex12.c:3:25: fatal error: petscdmplex.h: No such file or directory
#include <petscdmplex.h>
^
compilation terminated.
<builtin>: recipe for target 'ex12' failed
make: *** [ex12] Error 1
I get this error I cannot explain ( I am not that much into PETSc build
system, I mostly use the python bindings), since for example I can
successfully build ex1.c or ex3.c which of course contain the same include
statement...
I don't know if this is useful to track the issue, but hope it helps.
Thank you again,
FC
DM Object: 2 MPI processes
type: plex
DM_0x2e16f70_0 in 2 dimensions:
0-cells: 64 0
1-cells: 108 0
2-cells: 45 0
Labels:
Vertex Sets: 3 strata of sizes (4, 1, 36)
Cell Sets: 1 strata of sizes (45)
depth: 3 strata of sizes (64, 108, 45)
DM after distribution with overlap 1
DM Object: Parallel Mesh 2 MPI processes
type: plex
Parallel Mesh in 2 dimensions:
0-cells: 39 40
1-cells: 64 66
2-cells: 26 27
Labels:
Vertex Sets: 2 strata of sizes (4, 21)
Cell Sets: 1 strata of sizes (26)
depth: 3 strata of sizes (39, 64, 26)
Local vector length distribution with overlap 1
39
40
DM Object: 2 MPI processes
type: plex
DM_0x142ff80_0 in 2 dimensions:
0-cells: 64 0
1-cells: 108 0
2-cells: 45 0
Labels:
Vertex Sets: 3 strata of sizes (4, 1, 36)
Cell Sets: 1 strata of sizes (45)
depth: 3 strata of sizes (64, 108, 45)
DM after distribution with overlap 2
DM Object: Parallel Mesh 2 MPI processes
type: plex
Parallel Mesh in 2 dimensions:
0-cells: 44 44
1-cells: 73 73
2-cells: 30 30
Labels:
Vertex Sets: 2 strata of sizes (4, 24)
Cell Sets: 1 strata of sizes (30)
depth: 3 strata of sizes (44, 73, 30)
Local vector length distribution with overlap 2
44
44
DM Object: 2 MPI processes
type: plex
DM_0x3052f80_0 in 2 dimensions:
0-cells: 64 0
1-cells: 108 0
2-cells: 45 0
Labels:
Vertex Sets: 3 strata of sizes (4, 1, 36)
Cell Sets: 1 strata of sizes (45)
depth: 3 strata of sizes (64, 108, 45)
DM after distribution with overlap 3
DM Object: Parallel Mesh 2 MPI processes
type: plex
Parallel Mesh in 2 dimensions:
0-cells: 48 48
1-cells: 80 80
2-cells: 33 33
Labels:
Vertex Sets: 2 strata of sizes (4, 26)
Cell Sets: 1 strata of sizes (33)
depth: 3 strata of sizes (48, 80, 33)
Local vector length distribution with overlap 3
48
48
DM Object: 2 MPI processes
type: plex
DM_0x16caf30_0 in 2 dimensions:
0-cells: 64 0
1-cells: 108 0
2-cells: 45 0
Labels:
Vertex Sets: 3 strata of sizes (4, 1, 36)
Cell Sets: 1 strata of sizes (45)
depth: 3 strata of sizes (64, 108, 45)
DM after distribution with overlap 4
DM Object: Parallel Mesh 2 MPI processes
type: plex
Parallel Mesh in 2 dimensions:
0-cells: 52 52
1-cells: 87 87
2-cells: 36 36
Labels:
Vertex Sets: 2 strata of sizes (4, 28)
Cell Sets: 1 strata of sizes (36)
depth: 3 strata of sizes (52, 87, 36)
Local vector length distribution with overlap 4
52
52
DM Object: 2 MPI processes
type: plex
DM_0x2846f70_0 in 2 dimensions:
0-cells: 64 0
1-cells: 108 0
2-cells: 45 0
Labels:
Vertex Sets: 3 strata of sizes (4, 1, 36)
Cell Sets: 1 strata of sizes (45)
depth: 3 strata of sizes (64, 108, 45)
DM after distribution with overlap 5
DM Object: Parallel Mesh 2 MPI processes
type: plex
Parallel Mesh in 2 dimensions:
0-cells: 56 56
1-cells: 94 94
2-cells: 39 39
Labels:
Vertex Sets: 2 strata of sizes (4, 30)
Cell Sets: 1 strata of sizes (39)
depth: 3 strata of sizes (56, 94, 39)
Local vector length distribution with overlap 5
56
56
DM Object: 2 MPI processes
type: plex
DM_0x29fcf60_0 in 2 dimensions:
0-cells: 64 0
1-cells: 108 0
2-cells: 45 0
Labels:
Vertex Sets: 3 strata of sizes (4, 1, 36)
Cell Sets: 1 strata of sizes (45)
depth: 3 strata of sizes (64, 108, 45)
DM after distribution with overlap 6
DM Object: Parallel Mesh 2 MPI processes
type: plex
Parallel Mesh in 2 dimensions:
0-cells: 60 60
1-cells: 101 101
2-cells: 42 42
Labels:
Vertex Sets: 2 strata of sizes (4, 32)
Cell Sets: 1 strata of sizes (42)
depth: 3 strata of sizes (60, 101, 42)
Local vector length distribution with overlap 6
60
60
DM Object: 2 MPI processes
type: plex
DM_0x17dff60_0 in 2 dimensions:
0-cells: 64 0
1-cells: 108 0
2-cells: 45 0
Labels:
Vertex Sets: 3 strata of sizes (4, 1, 36)
Cell Sets: 1 strata of sizes (45)
depth: 3 strata of sizes (64, 108, 45)
DM after distribution with overlap 7
DM Object: Parallel Mesh 2 MPI processes
type: plex
Parallel Mesh in 2 dimensions:
0-cells: 64 64
1-cells: 108 108
2-cells: 45 45
Labels:
Vertex Sets: 3 strata of sizes (4, 1, 36)
Cell Sets: 1 strata of sizes (45)
depth: 3 strata of sizes (64, 108, 45)
Local vector length distribution with overlap 7
64
64