<snip> On Tue, 3 Jul 2018 at 09:31, Charles R Harris <[email protected]> wrote:
> > ISTR that some parallel processing applications sent pickled arrays around > to different processes, I don't know if that is still the case, but if so, > no copy might be a big gain for them. > That is very much correct. One example is using MCMC, which is massively parallel. I do parallelisation with mpi4py, and this requires distribution of pickled data of a reasonable size to the entire MPI world. This pickling introduces quite a bit of overhead.
_______________________________________________ NumPy-Discussion mailing list [email protected] https://mail.python.org/mailman/listinfo/numpy-discussion
