On Nov 1, 2012, at 11:13 PM, Peter Karman <[email protected]> wrote: > [email protected] wrote on 11/1/12 10:50 PM: >> I haven't started writing code yet, but wanted input on where to start. >> >> What I want to do is read in an input file, splice the input into >> configurable amount of chunks. Create a number of workers also configurable >> that go off and do work returning results or maybe even saving results to a >> database. After finishing wait for more work until all work is done and the >> last worker is finished and exit. >> > > lots of ways to approach this, depending on how you want to define "worker." > > Gearman (and its ilk) is one way.
Reading: http://www.slideshare.net/andy.sh/gearman-and-perl Gearman setup sounds interesting, but is really overkill for what I want. > For less-heavy infrastructure, I like Parallel::Iterator. I have a threads/thread::queue hack "working". But I want most of the code to be reusable so I am not copying and pasting code around. Really the only think that will ever change is a worker() function most of the other stuff will be static. Jonathan Otsuka _______________________________________________ kc mailing list [email protected] http://mail.pm.org/mailman/listinfo/kc
