Hi , I have a workflow (which is a simple one at the moment) that will execute on a remote environment in several stages. Actually I have registered a command line application on Airavata that will use SSH provider to run them in a pipeline. For a single step this works fine but i am having trouble connecting them to execute one after the other.
My requirement is like this , first step of the workflow will take several inputs and generate an output file (using a remote load leveler script OR/AND MPI application ) and we need to block/wait until a result is generated and we take the this result plus some more inputs and execute the second. Likewise this process will continue for several stages on a remote grid environment (ie:- Bigred) and final result will be copied back to our staged servers. How can we achieve a blocking wait in a workflow with Airavata specially with load leveler/mpi application job submission being asynchronous ? Is there any special constuct that support this out of the box or do we have to write extensions ? Even if we can create multiple command line application/s easily with Airavata i don't see a way to link them in a pipeline manner. I would very much appreciate your thoughts on this and possible way to approach this. Thanks Udayanga -- http://www.udayangawiki.blogspot.com
