Async Agents to handle long running jobs

Hi folks, I have implemented the support to Async Job Submission with the callback workflows on top of the proposed task execution framework. This supports to both Async Job Submission in remote compute resources using Agents and event driven job monitoring. Using this approach, I'm going to

Re: Project for Assignment 6 and 7

Hi Shubham, Please replace the python samples with Python 3 instead. Please refer to airavata python client code in Django portal for reference - https://github.com/apache/airavata-django-portal Suresh > On Dec 3, 2017, at 1:35 PM, Shubham

CI/CD pipeline integration for Airavata Microservices

Hi Folks, This [1] document describes how I have implemented an end to end CI/CD pipeline for Airavata Microservices using Jenkins pipeline scripts and Kubernetes container orchestration framework. Sources for Jenkins scripts and Kubernetes deployment scripts can be found from [2] Please share

Re: Async Agents to handle long running jobs

Hi Dimuthu, This is neat design. Few questions to understand your implementation: * Since the Async command monitor needs to be persistent high available service, is it advisable to run it as a Helix Participant or should we run this outside of helix system like a API gateway? * On a related

Re: CI/CD pipeline integration for Airavata Microservices

Hi Dimuthu, This is very nice summary. Why are you running Kafka cluster outside and not through kubernetes? Suresh > On Dec 4, 2017, at 1:49 PM, DImuthu Upeksha > wrote: > > Hi Folks, > > This [1] document describes how I have implemented an end to end CI/CD