Re: [galaxy-dev] Best practices with data on clusters

2012-01-04 Thread Cittaro Davide
Hi Nate, On Jan 3, 2012, at 10:15 PM, Nate Coraor wrote: That said, if you have a lot interim steps that produce large data that then get merged via some process back to final outputs, it absolutely makes sense to use local disk for those steps (assuming local disk is large enough - another

Re: [galaxy-dev] Best practices with data on clusters

2012-01-04 Thread Nate Coraor
On Jan 4, 2012, at 6:03 AM, Cittaro Davide wrote: Hi Nate, On Jan 3, 2012, at 10:15 PM, Nate Coraor wrote: That said, if you have a lot interim steps that produce large data that then get merged via some process back to final outputs, it absolutely makes sense to use local disk for

Re: [galaxy-dev] Best practices with data on clusters

2012-01-03 Thread Nate Coraor
On Dec 20, 2011, at 5:04 AM, Cittaro Davide wrote: Hi developers, I have a question that may be an OT, but since galaxy can work in a clustered environment withh queueing system, I'll try to ask here. Is there anibody here who copies data in a local temporary directory before performing any

[galaxy-dev] Best practices with data on clusters

2011-12-20 Thread Cittaro Davide
Hi developers, I have a question that may be an OT, but since galaxy can work in a clustered environment withh queueing system, I'll try to ask here. Is there anibody here who copies data in a local temporary directory before performing any analysis step and copy it back into the final results?