Re: advice needed converting large files to xml

2009-03-16 Thread Brian Doyle
On Mon, Mar 16, 2009 at 4:29 PM, Mark Volkmann wrote: > > On Mon, Mar 16, 2009 at 4:56 PM, Brian Doyle > wrote: > > I've been using Clojure for about 6 months now and really like it. I am > > somewhat new to multi-threading > > and using any of the parallel features in Clojure though. I have a

Re: advice needed converting large files to xml

2009-03-16 Thread Stu Hood
Yea, that would work. I don't think the (fn) should be defined anonymously though, because I could see it being useful on its own. Give it a name! Thanks, Stu On Mon, Mar 16, 2009 at 6:53 PM, Brian Doyle wrote: > > > On Mon, Mar 16, 2009 at 4:21 PM, Stu Hood wrote: > >> If you write your CSV -

Re: advice needed converting large files to xml

2009-03-16 Thread Brian Doyle
On Mon, Mar 16, 2009 at 4:21 PM, Stu Hood wrote: > If you write your CSV -> XML processing as a function, you could pmap ( > http://clojure.org/api#pmap) that function across the list of input > files. pmap will transparently create the threads as needed, and it will > probably be enough to satu

Re: advice needed converting large files to xml

2009-03-16 Thread Mark Volkmann
On Mon, Mar 16, 2009 at 4:56 PM, Brian Doyle wrote: > I've been using Clojure for about 6 months now and really like it.  I am > somewhat new to multi-threading > and using any of the parallel features in Clojure though.   I have a > situation where I need to convert > 7 files from CSV to XML.  E

Re: advice needed converting large files to xml

2009-03-16 Thread Stu Hood
If you write your CSV -> XML processing as a function, you could pmap ( http://clojure.org/api#pmap) that function across the list of input files. pmap will transparently create the threads as needed, and it will probably be enough to saturate your disk. Thanks, Stu On Mon, Mar 16, 2009 at 5:56