You can use agents in combination with the send function which will operate on a fixed size thread pool. I'm sure there are other ways as well, but I've found agents very easy to work with.
Travis On Aug 10, 2:18 pm, Tom Emerson <tremer...@gmail.com> wrote: > Hello Clojurians, > > I want to process approximately 74K XML files that are stored on disk > in a series of nested directories, each of which contains upto 1000 > files. For example, > > rootdir > 0 > file1.xml > file2.xml > 1 > file3.xml > file4.xml > > and so on. > > file-seq gives me a convenient way to get a seq of all these files. > What I would like to do is process elements in this sequence in > parallel. My first thought was to process the seq with pmap, but this > is suboptimal because I'm not interested in saving the return value of > function called on each file. > > Assuming I want bounded parallelism (such as pmap gives you, 2 + > number of cores) how would you approach this problem in Clojure? > > Thanks in advance for your insights, > > -tree > > -- > Tom Emerson > tremer...@gmail.comhttp://treerex.blogspot.com/ --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en -~----------~----~----~----~------~----~------~--~---
