User Defined Workflow Execution Framework

2018-03-25 Thread Yasas Gunarathne
Hi All, I have few questions to be clarified regarding the user-defined workflow execution in Apache Airavata. Here I am talking about the high level workflows that are used to chain together multiple applications. This related to the issue - Airavata-2717 [1]. In this [2] documentation it says

Re-architect Output Data Parsing into Airavata

2018-03-25 Thread Lahiru Jayathilake
Hi Everyone, With the resources mentioned in Airavata-2718 [1] and with the help of Dimuthu I came up with this [2] architecture for data parsers to act as Airavata tasks and execute them as Helix DAG's. Any guidance and comments would be very helpful to improve it [1]

Re: [GSOC] Apache Airavata Google Summer of Code Projects

2018-03-25 Thread Yasas Gunarathne
I have uploaded a draft proposal [1] for the project [GSoC] Resurrect User-Defined Airavata Workflows [2]. Kindly give your feedbacks. [1] https://docs.google.com/document/d/1z5N_YOOdau8yiAfzfJ6xjRE75FLplA3BdIN6dtOeFRc/edit?usp=sharing [2] https://issues.apache.org/jira/browse/AIRAVATA-2717

Re: [GSOC] Apache Airavata Google Summer of Code Projects

2018-03-25 Thread DImuthu Upeksha
Hi Yasas, Good writeup. As a feedback, can you please elaborate more on the design of the new orchestrator and how it fits to the overall system? Some diagrams will be very helpful. Thanks Dimuthu On Sun, Mar 25, 2018 at 4:04 AM, Yasas Gunarathne wrote: > I have

Re: [GSoC] Re-architect Output Data Parsing into Airavata core

2018-03-25 Thread DImuthu Upeksha
Hi Lahiru, Nice document. And I like how you illustrate the systems through diagrams. However try to address how you are going to expose parsed data to outside through thrift APIs and how to design those data APIs in application specific manner. And in the persisting task, you have to make sure

Re: User Defined Workflow Execution Framework

2018-03-25 Thread DImuthu Upeksha
Hi Yasas, I'm not a expert in XBaya design and use cases but I think Suresh can shed some light about it. However we no longer use XBaya for workflow interpretation. So don't get confused with the workflows defined in XBaya with the description provided in the JIRA ticket. Let's try to make the

summer of code

2018-03-25 Thread Connor True
Hello, My name is Connor and I am interested in proposing a project to airavata.

[GSoC] Re-architect Output Data Parsing into Airavata core

2018-03-25 Thread Lahiru Jayathilake
Hi Everyone, I have shared a draft proposal [1] for the GSoC project, AIRAVATA-2718 [2]. Any comments would be very helpful to improve it. [1] https://docs.google.com/document/d/1xhgL1w9Yn_c1d5PpabxJJNNLTbkgggasMBM-GsBjVHM/edit?usp=sharing [2] https://issues.apache.org/jira/browse/AIRAVATA-2718