On Mon, Jul 25, 2016 at 2:30 PM, Manav Bhatia <[email protected]> wrote:
> > On Jul 25, 2016, at 3:43 PM, Matthew Knepley <[email protected]> wrote: > > Yes. I think the confusion here is between the problem you are trying to > solve, and the tool for doing it. > > Disparate size of subsystems seems to me to be a _load balancing_ problem. > Here you can use data layout to alleviate this. > On the global comm, you can put all the fluid unknowns on ranks 0..N-2, > and the structural unknowns on N-1. You can have > more general splits than that. > > > Ok. So, if I do that, then there would still be one comm? If yes, then the > distribution would be by specifying the number of local fluid dofs on N-1 > to be zero? > Yes. If all you want is good load balance, I think this is the best way. Thanks, Matt > Sorry that this such is a basic question. > > > IF for some reason in the structural assembly you used a large number of > collective operations (like say did artificial timestepping > to get to some steady state property), then it might make sense to pull > out a subcomm of only the occupied ranks, but only above > 1000 procs, and only on a non-BlueGene machine. This is also easily > measure before you do this work. > > > > -- What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. -- Norbert Wiener
