I was poking around the julia parallel tutorial and source, it looks like
if you spin up a cluster using a --machinefile, (where every process is on
it's own machine), that the remote workers would not be able to spin up
additional local processes.
For example, if you spin up a 4 machine cluster, and each worker has 4
cores, you can't run addprocs() on the workers to utilize the 4 locally
available worker cores.
Is there something on the julia roadmap to be able to leverage free cores
on a worker? Or is this something that can be done with the current julia
implementation?
As an example, here is a quick script I wrote to test this:
#run this function from the master node
function dostuff()
@everywhere include("parallel/testworkers.jl")
for worker in workers()
remotecall(worker, testworkers, 12)
end
end
#each workers executes this
function testworkers(numberofinterns::Int)
addprocs(numberofinterns)
nheads = @parallel (+) for i=1:20000000000
Int(rand(Bool))
end
println("finished")
end
