Re: [Fab-user] Launch many parallel tasks against a single (local) host

2012-03-27 Thread Tyler Pirtle
On Tue, Mar 27, 2012 at 1:13 PM, Morgan Goose morgan.go...@gmail.comwrote: What is it you even mean by staging? You might be over looking GNU commands that will do exactly what you need. If you give us some more information, we might be able to assist. -goose Hi goose - let me try and

Re: [Fab-user] Launch many parallel tasks against a single (local) host

2012-03-27 Thread Morgan Goose
Use xargs: def parallel_local(cmd, list_of_args, procs=4): local(echo '%s' | xargs -P %d -n1 %s % ( .join(list_of_args), num_of_procs, cmd)) I find that most everything you wanna do has a gnu command or flag for it already. thankfully. -goose On Tue, Mar 27, 2012 at 2:57 PM, Tyler Pirtle

Re: [Fab-user] Launch many parallel tasks against a single (local) host

2012-03-27 Thread Tyler Pirtle
On Tue, Mar 27, 2012 at 3:24 PM, Morgan Goose morgan.go...@gmail.comwrote: Use xargs: def parallel_local(cmd, list_of_args, procs=4): local(echo '%s' | xargs -P %d -n1 %s % ( .join(list_of_args), num_of_procs, cmd)) I find that most everything you wanna do has a gnu command or flag for

Re: [Fab-user] Launch many parallel tasks against a single (local) host

2012-03-27 Thread Morgan Goose
Nah, Fabric's meant to make remote stuff easier. If you're doing local stuff it's encouraged to shell out or use the native python you have, so that every single command in the fabric api doesn't have to have local mode. Also if you used Fabric to make multiple runs of the same task with

Re: [Fab-user] Launch many parallel tasks against a single (local) host

2012-03-27 Thread Tyler Pirtle
On Tue, Mar 27, 2012 at 4:08 PM, Morgan Goose morgan.go...@gmail.comwrote: Nah, Fabric's meant to make remote stuff easier. If you're doing local stuff it's encouraged to shell out or use the native python you have, so that every single command in the fabric api doesn't have to have local

Re: [Fab-user] Launch many parallel tasks against a single (local) host

2012-03-27 Thread Jeff Forcier
On Tue, Mar 27, 2012 at 4:08 PM, Morgan Goose morgan.go...@gmail.com wrote: Nah, Fabric's meant to make remote stuff easier. This is currently true -- Fabric's normal use case is focused on the remote end, and few users have had the do something in parallel locally too need. So the internal

Re: [Fab-user] Launch many parallel tasks against a single (local) host

2012-03-27 Thread Jeff Forcier
On Tue, Mar 27, 2012 at 5:18 PM, Tyler Pirtle tee...@gmail.com wrote: Thanks for the heads up Jeff. Any docs or other things available about Invoke? It's in the very very early stages of development, but: https://github.com/fabric/fabric/issues/565 If you want, perhaps stick a detailed