Suresh Marru created AIRAVATA-2718:
--------------------------------------
Summary: [GSoC] Re-architect Output Data Parsing into Airavata core
Key: AIRAVATA-2718
URL: https://issues.apache.org/jira/browse/AIRAVATA-2718
Project: Airavata
Issue Type: Epic
Reporter: Suresh Marru
As discussed in this paper [1] Airavata based SEAGrid gateway has prototyped a
data catalog system [2]. [3] and [4] are also related references. The new
airavata execution architecture in develop branch is based on Apache Helix.
This provides an opportunity to re-architect the data catalog and build it on
new Helix DAG based execution within Airavata.
This project involves
* the data parsers as Airavata tasks and execute them as Helix DAG's.
* Incorporate the MongoDB based search and catalog registry and explore Thrift
API's.
* Modify the current simple UI into the new Django portal.
* Generalize the data catalog.
* Publish a paper [optional]
[1] -
[https://pdfs.semanticscholar.org/2938/686c5c7eecb1b82ce8064b30555298bd649e.pdf]
[2] - https://github.com/SciGaP/seagrid-data
[[3] -
https://www.researchgate.net/profile/Suresh_Marru/publication/275948320_Scientific_Data_Cataloging_System/links/554a05680cf2e859ce18afb4.pdf|https://www.researchgate.net/profile/Suresh_Marru/publication/275948320_Scientific_Data_Cataloging_System/links/554a05680cf2e859ce18afb4.pdf]
[[4] -
https://www.researchgate.net/profile/Dilum_Bandara/publication/282989239_Schema-independent_scientific_data_cataloging_framework/links/5653a40508aeafc2aabb59e8/Schema-independent-scientific-data-cataloging-framework.pdf|https://www.researchgate.net/profile/Dilum_Bandara/publication/282989239_Schema-independent_scientific_data_cataloging_framework/links/5653a40508aeafc2aabb59e8/Schema-independent-scientific-data-cataloging-framework.pdf]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
