Re: Partial results of an application run

2014-09-19 Thread Raminderjeet Singh
Size of the those intermediate files were in gigabytes and some of them were removed on successful completion, e.g. restart file for checkpointing the application etc. For the gadget run, user was manually managing the data transfer using Globus online. Reason was, it used to take a week or more to

RE: Partial results of an application run

2014-09-19 Thread Miller, Mark
Aha, Very interesting, I was not thinking about the full span of possibilities. You make a good point. In fact, CIPRES has a special system that manages files above a certain size, because otherwise they just gum up our whole app and bring the server down. These are regular result files. I agree

Re: Selenium Test Scripts Available in GitHub

2014-09-19 Thread Marlon Pierce
You clone the PHP gateway from https://github.com/SciGaP/PHP-Reference-Gateway. This still needs an application catalog interface. The tests in the selenium folder run inside Selenium's IDE in Firefox. The seleniumjava tests currently run in IntelliJ. With some more work, they can be made to

Re: Partial results of an application run

2014-09-19 Thread Raminder Singh
Thanks Mark for the feedback. I agree with you that SciGap should provide all the information to the gateway to debug a job. Followup question is, we should make this a default behavior or gateway configured behavior? I had worked with codes like Gadget in the past which produce huge intermediat

Re: Selenium Test Scripts Available in GitHub

2014-09-19 Thread K Yoshimoto
How does this get accessed? Will it come with the clone of the PHP-Reference-Gateway? Thanks, Kenneth On Fri, Sep 19, 2014 at 03:34:11PM -0400, Marlon Pierce wrote: > Thanks, Eroma. While we are upgrading XBaya, the PHP Reference Gateway > is the best user interface for playing with Airavata

Re: Evaluate Suitable Scientific Workflow Language for Airavata.

2014-09-19 Thread Aleksander Slominski (NY)
Hi, it is not dataflow instead focused on orchestrating REST services but you may find it useful datapoint - we created worfklow service that uses natively JavaScript and JSON to describe what happens during workflow execution: https://www.ng.bluemix.net/docs/#services/workflow/index.html#coewf002

Re: Reg: Version for Thrift

2014-09-19 Thread Chathuri Wimalasena
HI Nipurn, We are using 0.9.1 version of thrift. On Fri, Sep 19, 2014 at 3:54 PM, Nipurn Doshi wrote: > Hi, > > I am currently working on improving the PHP Reference Gateway for SciGap. > I was wondering which version of Thrift Libraries should I be using right > now. The latest version I can s

Reg: Version for Thrift

2014-09-19 Thread Nipurn Doshi
Hi, I am currently working on improving the PHP Reference Gateway for SciGap. I was wondering which version of Thrift Libraries should I be using right now. The latest version I can see right now is 1.0.x. If I should be using a lower version, kindly let me know. -- -Sincerely, Nipurn Doshi Univ

Re: Selenium Test Scripts Available in GitHub

2014-09-19 Thread Marlon Pierce
Thanks, Eroma. While we are upgrading XBaya, the PHP Reference Gateway is the best user interface for playing with Airavata services out of the box. Marlon On 9/19/14, 3:14 PM, Eroma Abeysinghe wrote: Hello, I used Selenium Test tool (http://www.seleniumhq.org/) for test case automation in

Selenium Test Scripts Available in GitHub

2014-09-19 Thread Eroma Abeysinghe
Hello, I used Selenium Test tool (http://www.seleniumhq.org/) for test case automation in PHP-Reference-Gateway forAiravata. The initial set of test cases are in GitHub. There are two sets 1. Run the test through Selenium IDE UI. Scripts are in https://github.com/SciGaP/PHP-Reference-Gateway/tree

RE: Evaluate Suitable Scientific Workflow Language for Airavata.

2014-09-19 Thread Miller, Mark
Very interesting thoughts Bruce. The issue of sustainability is certainly a key one, and building dependencies on another platform always brings risk. Going back to Lavanya’s comment, I think this thought is critical. What workflow tools in use really have big uptake by users? At CIPRES we have

Re: Evaluate Suitable Scientific Workflow Language for Airavata.

2014-09-19 Thread Mattmann, Chris A (3980)
Great Bruce - these are amazing insights and I hope this in the Airavata and OODT community check this out. ++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Labora

Re: Evaluate Suitable Scientific Workflow Language for Airavata.

2014-09-19 Thread Bruce Barkstrom
One factor that should be included in the group's deliberations on adding a workflow language to the other things in OODT is the impact on long-term maintenance. While there's a lot of enthusiasm in the developer community right now, we need to think about what happens when development turns into

Re: Partial results of an application run

2014-09-19 Thread Marlon Pierce
Great feedback, Mark-- Marlon On 9/19/14, 12:03 PM, Miller, Mark wrote: Hi Raminder, If I understand the issue, I have a comment. The stdout/stderr files are absolutely critical to a gateway runner and the every end user for debugging issues, even simple ones like a typo that breaks the inf

RE: Partial results of an application run

2014-09-19 Thread Miller, Mark
Hi Raminder, If I understand the issue, I have a comment. The stdout/stderr files are absolutely critical to a gateway runner and the every end user for debugging issues, even simple ones like a typo that breaks the infile formatting. There are two levels of benefit: first, the savvy user reads

Partial results of an application run

2014-09-19 Thread Raminder Singh
Hi Dev, Currently we are not moving partial results (stdout/stderr and other files) to the gateway incase of application failure (failed to produce output). This can be fixed but question is do we want it to be the default behavior or based on some user flag in experiment. To make it work prope