Take a look at Graphs.jl. The patterns used there should make it possible to parallelize some of the routines. I doubt that on a small cluster, there will be much difference with MPI.
Many problems do not have non-trivial communication requirements, and using tcp/ip point to point as Julia does is sufficient. With graph algorithms and such, the communication patterns are quite irregular, and MPI may not always have the right abstraction. In any case, we can always use MPI as the underlying transport in Julia as an alternative. A good project would be to implement the http://graph500.org/ benchmark in Julia in parallel and try to achieve the highest performance. You will have lots of things to compare against. -viral On Wednesday, October 1, 2014 6:48:56 PM UTC+5:30, Kapil Agarwal wrote: > > Hi > > On Tuesday, 30 September 2014 08:23:05 UTC-4, Erik Schnetter wrote: >> >> There is a package "MPI.jl" that allows calling MPI from Julia. With >> this, any MPI-based algorithm can be translated to Julia, and the >> speed of MPI should be the same as for any other language. >> >> -erik >> > > I thought Julia has its own message passing paradigm which provides > functionality similar to MPI but in a different way. So, I wanted to > benchmark it against a native MPI implementation. If no such benchmarks > exist, would it be a good idea to compare MPI and Julia performance ? After > all, you would want users to use the Julia parallel computing API rather > than port existing libraries to Julia ? > > >> >> On Tue, Sep 30, 2014 at 12:12 AM, Tony Kelman <[email protected]> wrote: >> > I'm not aware of any such data comparing Julia on large-scale parallel >> tasks >> > with nontrivial communication patterns vs a more conventional HPC >> cluster >> > approach using MPI. There are some benchmark problems (generally >> intended >> > for serial or small-scale parallel execution, I believe) under >> test/perf, >> > but it might be more interesting if you have your own parallel >> application >> > you want to test with. >> > >> > Keep us posted as you get further into this. >> > >> > > I checked out test/perf and I could not find any parallel implementations, > so I believe it would be a good idea to benchmark highly parallel > applications with Julia. > Actually, I am looking at Julia for a college project and have access to a > HPC cluster and am thinking to implement graph algorithms. I would > appreciate if you could give me some suggestions on my idea. > > > > Thanks > Kapil > > > >> > On Monday, September 29, 2014 11:58:33 AM UTC-7, Kapil Agarwal wrote: >> >> >> >> Hi >> >> >> >> I am looking to benchmark some standard parallel algorithms using >> Julia. I >> >> am thinking of comparing its performance with MPI and other parallel >> >> programming paradigms. Although I couldn't find much on any existing >> >> benchmarks, I was looking forward to any benchmarks that may have been >> done >> >> by the julia-dev team or in case any one is aware of any such >> benchmarks >> >> that could help me go about it. >> >> >> >> Thanks >> >> >> >> Kapil >> >> >> >> -- >> Erik Schnetter <[email protected]> >> http://www.perimeterinstitute.ca/personal/eschnetter/ >> >
