On Dec 28, 7:50 pm, Piotr 'Qertoip' Włodarek <qert...@gmail.com> wrote: > On 38MB file it takes 28s, compared to 38s of similar but sequential > version.
Another good thing is to make a simple performance model, perhaps aided by timings of individual components, before you start parallelizing everything ;-) How long does it take just to read in the file (with or without mmap)? How long does it take one agent to finish its count? How long does the reduction over agents' counts at the end take? If you're concerned about the latter being a sequential sum, how does its performance vary as a function of the number of agents? The total performance of your implementation should be (time for slurp) + (time for one agent to count its words) + (time for reduction over agents), not counting the time to start up the agents. Unless you have a RAID array or a serious parallel filesystem, (time for slurp) is just a fixed overhead you have to eat. btw how many processors do you have? mfh --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en -~----------~----~----~----~------~----~------~--~---
