I think what is meant is that in HPC typically this is done via MPI which is just a low level approach where you explicitely have to specify all the data communication (compared to Hadoop & Spark where it is implicit).
> > > The only codes that really nail it are carefully handcrafted HPC codes. > > > Could you please elaborate on this? I think I know Spark code quite well, > but can't connect it to the notion of handcrafted HPC code. > > > > >>
