The problem with the example in the manual is that you can't use a "producer" for the parallel map (pmap assumes the input has a fixed length).
In my case, I would like to produce a list of files that may be very large (300k+) and I'd prefer not to wait until all filenames have been recursively discovered from disk before starting the work. On Wed, Oct 15, 2014 at 1:21 PM, Steven G. Johnson <[email protected]> wrote: > There is an example in the manual of how to create a parallel work queue: > > http://docs.julialang.org/en/latest/manual/parallel-computing/#scheduling > > (It would be nice to have cleaner built-in support for work queues and > work stealing [the advantage of work stealing is that it scales better > because there isn't a single queue as a bottleneck].) > > >
