New to the community

Hello there, I am new here and my first attempt to work for an OS community, I am a dev/(undergrad in CSE at PESIT) good at java,php,python I also used to design UI before. You can view my portfolio in LinkedIn. Please guide me where I should start off from and how to keep my self indulged

Re: launching a job through Airavata to Mesos cluster

Hi Pankaj, Wich version of Airavata you are working on? what is the data transfer protocol? What is the job submission protocol? Short answer: if you are using Airavata 0.15 then you need to write new Provider implementation to submit the request to Mesos/Marathon cluster. But if you are using

Re: launching a job through Airavata to Mesos cluster

Pankaj can you clarify the following: Do you want an Airavata instance to run some dockerized applications scheduled by Mesos? Or do you just need a client which will connect to Airavata hosted and managed by Mesos/Marathon? Suresh > On Oct 28, 2015, at 10:50 AM, Shameera Rathnayaka

Re: launching a job through Airavata to Mesos cluster

Hi Pankaj, You cannot do this out of the box now, but with some guidance you can easily write a task to run Dockerized application on a Mesos cluster, please use 0.16 for this. As Shameera explained this is a improvised architecture and any contributions you will make will carry forward.

Re: launching a job through Airavata to Mesos cluster

Hi Suresh, My initial understanding is, I have to launch a dockerized job through Airavata which will be run in the Mesos cluster. I was looking for the code which submits jobs and wanted to make changes such a way that it can submit docker containers to Mesos/Marathon cluster. I can use 0.15

Re: launching a job through Airavata to Mesos cluster

I’ll add: if submitting a job to (for example) a SLURM queuing system, we need to create the correct SLURM submission script and submit it by executing the correct command line operation (sbatch). From: Marlon Pierce > Reply-To: Airavata Dev

Re: launching a job through Airavata to Mesos cluster

Hi Pankaj— I may not have the full background on what you want to do, but we more typically use Airavata to run scientific applications on clusters. This goes through a scheduling and queuing system (Torque/MOAB or SLURM). If you want to do this, you would first need to say how you would

Re: launching a job through Airavata to Mesos cluster

Hi Marlon, "we more typically use Airavata to run scientific applications on clusters" - Our plan is to run dockerized scientific application through Airavata. Definitely our target is not to run a Tomcat webserver, I just said that as an example. Give me some time, after I discuss with Prof.

Re: launching a job through Airavata to Mesos cluster

Hi Pankaj, can you say more about what you mean by “launch a dockerized job”? Marlon From: Pankaj Saha > Reply-To: Airavata Dev > Date: Wednesday, October 28, 2015 at 11:56 AM To: Suresh

Re: launching a job through Airavata to Mesos cluster

Pankaj: If mesos is a scheduler, perhaps Airavata could be enhanced to submit jobs to using mesos scheduler ( similar to slurm/pbs/lsf scheduler). Is this what you are referring to? Thanks, Sudhakar. On Oct 28, 2015, at 11:11 AM, Pierce, Marlon > wrote:

Re: launching a job through Airavata to Mesos cluster

Yes Suresh that's the plan. On Wed, Oct 28, 2015 at 12:25 PM, Suresh Marru wrote: > Hi Pankaj, > > You cannot do this out of the box now, but with some guidance you can > easily write a task to run Dockerized application on a Mesos cluster, > please use 0.16 for this. As

Re: launching a job through Airavata to Mesos cluster

The “hello world” for us is usually to just run some linux command on the remote queuing system. So that is something you could easily wrap via docker and submit via Mesos (I hope it is easy…). Related to this is determining that the job has gone through various states (queued, executing,

Re: launching a job through Airavata to Mesos cluster

As Suresh said I think this is the time when I have to understand under the hood details of Airavata Architecture, which I could not gain much during GSoC. On Wed, Oct 28, 2015 at 1:00 PM, Pierce, Marlon wrote: > The “hello world” for us is usually to just run some linux