I guess you could go for a middle ground where you run a JVM instance per 8 cores or so, which would minimise your intercommunication but still reduce your GC contention. Of course as soon as (> num-jvms 1) you have to write all the communication and deployment code anyway so it might not be a big win, but if you decide to go that way it would probably be more efficient and minimise your JVM memory overhead.
Cheers, Colin On 30 April 2013 03:50, Lee Spector <lspec...@hampshire.edu> wrote: > > > On Apr 29, 2013, at 11:25 AM, Konrad Hinsen wrote: > >> Is there evidence that code written/run this way will perform > >> particularly well? > > > > No. The Python VM has a global interpreter lock that prevents parallel > execution of Python bytecode. If you want to parallel processing in Python > (more precisely, the CPython implementation), you must either port > CPU-intensive stuff to C or Cython, or run multiple communicating CPython > instances. > > Ah. Well we could do that in Clojure without dealing with Python, and our > tests show that we'd get the multicore speedups that we want. But I'm not > eager to re-engineer everything to launch and use and deal with multiple > JVM instances and the necessary intercommunication. I'd like to use the > built-in Clojure concurrency support, which is elegant but isn't giving us > reasonable multicore utilization. > > Thanks, > > -Lee > > -- > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to clojure@googlegroups.com > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > clojure+unsubscr...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to clojure+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > > > -- -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
