Re: Airavata installation to submit a job in Mesos/Maraton cluster

[Pankaj Saha]

Hi Supun,
I have pointed to 'airavata-server' => 'gw56.iu.xsede.org', to start
working with.As you have already provided all the required previleges to my
new userid, I am able to see all computer resources and applications in it.
So it was not a problem with PGA but Airavata server installation in my
local machine.

Now can anyone please guide me for launching a hello world application
through this portal so that it can launch a job in a mesos cluster. I know
that I can not use the "gw56.iu.xsede.org" server, as I want to launch a
job in my local mesos/marathon cluster. But if I get some clue how to start
with I can possible fix my local Airavata server installation and will try
to launch a job in local resource.

Thanks
Pankaj

On Fri, Dec 4, 2015 at 5:41 PM, Supun Nakandala 
wrote:

> We haven't done any changes to 0.15 branches recently. So if it worked for
> you previously it should still work without any issue. I suggest that you
> first try to setup your pga to work with SciGaP hosted airavata and then
> try to connect it to your own airavata. But we don't have any active
> deployments of 0.15. In that case you may want to use master branch
>
> On Fri, Dec 4, 2015 at 5:36 PM, Pankaj Saha  wrote:
>
>> While running server, no error messages. But while creating projects its
>> throws the error message which I have posted.
>> On 04-Dec-2015 4:55 PM, "Supun Nakandala" 
>> wrote:
>>
>>> do you get any airavata error messages?
>>>
>>> On Fri, Dec 4, 2015 at 4:51 PM, Pankaj Saha 
>>> wrote:
>>>
 I am using 15 branch
 yes I could not even create a project.

 On Fri, Dec 4, 2015 at 4:49 PM, Supun Nakandala <
 supun.nakand...@gmail.com> wrote:

> Which Airavata/PGA version are you using?
>
> Looking at your error message I see even the project is also not set.
>
> On Fri, Dec 4, 2015 at 12:16 PM, Pankaj Saha 
> wrote:
>
>> Hello Devs,
>> I have a requirement to launch a job (simple hello world kind of) on
>> mesos/marathon cluster through Airavata client (PGA preferable ). I have
>> tried installing a local Aiaravata PGA with hosted Airavata server on my
>> machine. Now the problem is with PGA installation, its not allowing me
>> create or explore any project/experiment.
>> Its saying:
>> *Required field 'gatewayId' was not present! Struct:
>> createProject_args(gatewayId:null, project:null)*
>>
>> I always used the default  gateway-Id which is "default" and the same
>> is mentioned in the server configuration properties file too. This 
>> problem
>> I have never faced earlier and Airavata installation used to be very 
>> simple.
>>
>> Second challenge is to run a job through Airavata client, so that it
>> can launch a job in a Mesos cluster through Marathon. So Airavata should 
>> be
>> able to invoke a rest API based client of Marathon to do the job.
>> I seek help to resolve the first issue and then need to find a way
>> for launching jobs.
>>
>>
>> Thanks
>> Pankaj
>>
>>
>>
>
>
> --
> Thank you
> Supun Nakandala
> Dept. Computer Science and Engineering
> University of Moratuwa
>


>>>
>>>
>>> --
>>> Thank you
>>> Supun Nakandala
>>> Dept. Computer Science and Engineering
>>> University of Moratuwa
>>>
>>
>
>
> --
> Thank you
> Supun Nakandala
> Dept. Computer Science and Engineering
> University of Moratuwa
>

Re: Airavata installation to submit a job in Mesos/Maraton cluster

[Pamidighantam, Sudhakar V]

Pankaj;
is your mesos cluster registered in the PGA as computer resource. Is the hello 
world application catalog entries made. Can you do this in a PGA using the gw56 
( I assume you have admin privileges). If not somebody can do this for you.

Thanks,
Sudhakar.
On Dec 5, 2015, at 1:26 PM, Pankaj Saha 
> wrote:

Hi Supun,
I have pointed to 'airavata-server' => 
'gw56.iu.xsede.org',
 to start working with.As you have already provided all the required previleges 
to my new userid, I am able to see all computer resources and applications in 
it. So it was not a problem with PGA but Airavata server installation in my 
local machine.

Now can anyone please guide me for launching a hello world application through 
this portal so that it can launch a job in a mesos cluster. I know that I can 
not use the 
"gw56.iu.xsede.org"
 server, as I want to launch a job in my local mesos/marathon cluster. But if I 
get some clue how to start with I can possible fix my local Airavata server 
installation and will try to launch a job in local resource.

Thanks
Pankaj

On Fri, Dec 4, 2015 at 5:41 PM, Supun Nakandala 
> wrote:
We haven't done any changes to 0.15 branches recently. So if it worked for you 
previously it should still work without any issue. I suggest that you first try 
to setup your pga to work with SciGaP hosted airavata and then try to connect 
it to your own airavata. But we don't have any active deployments of 0.15. In 
that case you may want to use master branch

On Fri, Dec 4, 2015 at 5:36 PM, Pankaj Saha 
> wrote:

While running server, no error messages. But while creating projects its throws 
the error message which I have posted.

On 04-Dec-2015 4:55 PM, "Supun Nakandala" 
> wrote:
do you get any airavata error messages?

On Fri, Dec 4, 2015 at 4:51 PM, Pankaj Saha 
> wrote:
I am using 15 branch
yes I could not even create a project.

On Fri, Dec 4, 2015 at 4:49 PM, Supun Nakandala 
> wrote:
Which Airavata/PGA version are you using?

Looking at your error message I see even the project is also not set.

On Fri, Dec 4, 2015 at 12:16 PM, Pankaj Saha 
> wrote:
Hello Devs,
I have a requirement to launch a job (simple hello world kind of) on 
mesos/marathon cluster through Airavata client (PGA preferable ). I have tried 
installing a local Aiaravata PGA with hosted Airavata server on my machine. Now 
the problem is with PGA installation, its not allowing me create or explore any 
project/experiment.
Its saying:
Required field 'gatewayId' was not present! Struct: 
createProject_args(gatewayId:null, project:null)

I always used the default  gateway-Id which is "default" and the same is 
mentioned in the server configuration properties file too. This problem I have 
never faced earlier and Airavata installation used to be very simple.

Second challenge is to run a job through Airavata client, so that it can launch 
a job in a Mesos cluster through Marathon. So Airavata should be able to invoke 
a rest API based client of Marathon to do the job.
I seek help to resolve the first issue and then need to find a way for 
launching jobs.


Thanks
Pankaj





--
Thank you
Supun Nakandala
Dept. Computer Science and Engineering
University of Moratuwa




--
Thank you
Supun Nakandala
Dept. Computer Science and Engineering
University of Moratuwa



--
Thank you
Supun Nakandala
Dept. Computer Science and Engineering
University of Moratuwa

Re: Airavata installation to submit a job in Mesos/Maraton cluster

[Suresh Marru]

Hi Pankaj,

You probably already know this, there is no Mesos submission in Airavata out of 
the box or in the version deployed on GW56?. Did you add that implementation in 
your local version? 

Suresh

> On Dec 5, 2015, at 2:53 PM, Pankaj Saha  wrote:
> 
> is your mesos cluster registered in the PGA as computer resource.
> - No
> Is the hello world application catalog entries made. 
> -No
> Can you do this in a PGA using the gw56 ( I assume you have admin 
> privileges). 
> - I dont see any option for creating that. But I remember during GSoC, Erom 
> explained those PGA pages through which admin can do this.
> 
> On Sat, Dec 5, 2015 at 2:49 PM, Pamidighantam, Sudhakar V 
> > wrote:
> Pankaj;
> is your mesos cluster registered in the PGA as computer resource. Is the 
> hello world application catalog entries made. Can you do this in a PGA using 
> the gw56 ( I assume you have admin privileges). If not somebody can do this 
> for you. 
> 
> Thanks,
> Sudhakar.
> 
> On Dec 5, 2015, at 1:26 PM, Pankaj Saha  > wrote:
> 
>> Hi Supun, 
>> I have pointed to 'airavata-server' => 'gw56.iu.xsede.org 
>> ',
>>  to start working with.As you have already provided all the required 
>> previleges to my new userid, I am able to see all computer resources and 
>> applications in it. So it was not a problem with PGA but Airavata server 
>> installation in my local machine.
>> 
>> Now can anyone please guide me for launching a hello world application 
>> through this portal so that it can launch a job in a mesos cluster. I know 
>> that I can not use the "gw56.iu.xsede.org 
>> "
>>  server, as I want to launch a job in my local mesos/marathon cluster. But 
>> if I get some clue how to start with I can possible fix my local Airavata 
>> server installation and will try to launch a job in local resource.
>> 
>> Thanks
>> Pankaj
>> 
>> On Fri, Dec 4, 2015 at 5:41 PM, Supun Nakandala > > wrote:
>> We haven't done any changes to 0.15 branches recently. So if it worked for 
>> you previously it should still work without any issue. I suggest that you 
>> first try to setup your pga to work with SciGaP hosted airavata and then try 
>> to connect it to your own airavata. But we don't have any active deployments 
>> of 0.15. In that case you may want to use master branch
>> 
>> On Fri, Dec 4, 2015 at 5:36 PM, Pankaj Saha > > wrote:
>> While running server, no error messages. But while creating projects its 
>> throws the error message which I have posted.
>> 
>> On 04-Dec-2015 4:55 PM, "Supun Nakandala" > > wrote:
>> do you get any airavata error messages?
>> 
>> On Fri, Dec 4, 2015 at 4:51 PM, Pankaj Saha > > wrote:
>> I am using 15 branch
>> yes I could not even create a project.
>> 
>> On Fri, Dec 4, 2015 at 4:49 PM, Supun Nakandala > > wrote:
>> Which Airavata/PGA version are you using?
>> 
>> Looking at your error message I see even the project is also not set.
>> 
>> On Fri, Dec 4, 2015 at 12:16 PM, Pankaj Saha > > wrote:
>> Hello Devs,
>> I have a requirement to launch a job (simple hello world kind of) on 
>> mesos/marathon cluster through Airavata client (PGA preferable ). I have 
>> tried installing a local Aiaravata PGA with hosted Airavata server on my 
>> machine. Now the problem is with PGA installation, its not allowing me 
>> create or explore any project/experiment.
>> Its saying:
>> Required field 'gatewayId' was not present! Struct: 
>> createProject_args(gatewayId:null, project:null)
>> 
>> I always used the default  gateway-Id which is "default" and the same is 
>> mentioned in the server configuration properties file too. This problem I 
>> have never faced earlier and Airavata installation used to be very simple.
>> 
>> Second challenge is to run a job through Airavata client, so that it can 
>> launch a job in a Mesos cluster through Marathon. So Airavata should be able 
>> to invoke a rest API based client of Marathon to do the job.
>> I seek help to resolve the first issue and then need to find a way for 
>> launching jobs.
>> 
>> 
>> Thanks
>> Pankaj
>>  
>> 
>> 
>> 
>> 

Re: Airavata installation to submit a job in Mesos/Maraton cluster

[Pankaj Saha]

HI Suresh,
Yes Now airavata can not submit mesos jobs directl. Here is the plan I was
trying to implement.
my local system has Marathon client installed which is connected to Mesos a
cluster. If I can configure my system as an available computer resource in
the Airavata PGA then I can start an experiment on this. Now that
experiment will run on my local computer which eventually launch a marathon
job through a command with help of marathon rest API.

Do you think that will work?

Thanks
Pankaj



On Sat, Dec 5, 2015 at 3:25 PM, Suresh Marru  wrote:

> Hi Pankaj,
>
> You probably already know this, there is no Mesos submission in Airavata
> out of the box or in the version deployed on GW56?. Did you add that
> implementation in your local version?
>
> Suresh
>
> On Dec 5, 2015, at 2:53 PM, Pankaj Saha  wrote:
>
> is your mesos cluster registered in the PGA as computer resource.
> - No
> Is the hello world application catalog entries made.
> -No
> Can you do this in a PGA using the gw56 ( I assume you have admin
> privileges).
> - I dont see any option for creating that. But I remember during GSoC,
> Erom explained those PGA pages through which admin can do this.
>
> On Sat, Dec 5, 2015 at 2:49 PM, Pamidighantam, Sudhakar V <
> spami...@illinois.edu> wrote:
>
>> Pankaj;
>> is your mesos cluster registered in the PGA as computer resource. Is the
>> hello world application catalog entries made. Can you do this in a PGA
>> using the gw56 ( I assume you have admin privileges). If not somebody can
>> do this for you.
>>
>> Thanks,
>> Sudhakar.
>>
>> On Dec 5, 2015, at 1:26 PM, Pankaj Saha  wrote:
>>
>> Hi Supun,
>> I have pointed to 'airavata-server' => 'gw56.iu.xsede.org
>> ',
>> to start working with.As you have already provided all the required
>> previleges to my new userid, I am able to see all computer resources and
>> applications in it. So it was not a problem with PGA but Airavata server
>> installation in my local machine.
>>
>> Now can anyone please guide me for launching a hello world application
>> through this portal so that it can launch a job in a mesos cluster. I know
>> that I can not use the "gw56.iu.xsede.org
>> "
>> server, as I want to launch a job in my local mesos/marathon cluster. But
>> if I get some clue how to start with I can possible fix my local Airavata
>> server installation and will try to launch a job in local resource.
>>
>> Thanks
>> Pankaj
>>
>> On Fri, Dec 4, 2015 at 5:41 PM, Supun Nakandala <
>> supun.nakand...@gmail.com> wrote:
>>
>>> We haven't done any changes to 0.15 branches recently. So if it worked
>>> for you previously it should still work without any issue. I suggest that
>>> you first try to setup your pga to work with SciGaP hosted airavata and
>>> then try to connect it to your own airavata. But we don't have any active
>>> deployments of 0.15. In that case you may want to use master branch
>>>
>>> On Fri, Dec 4, 2015 at 5:36 PM, Pankaj Saha 
>>> wrote:
>>>
 While running server, no error messages. But while creating projects
 its throws the error message which I have posted.
 On 04-Dec-2015 4:55 PM, "Supun Nakandala" 
 wrote:

> do you get any airavata error messages?
>
> On Fri, Dec 4, 2015 at 4:51 PM, Pankaj Saha 
> wrote:
>
>> I am using 15 branch
>> yes I could not even create a project.
>>
>> On Fri, Dec 4, 2015 at 4:49 PM, Supun Nakandala <
>> supun.nakand...@gmail.com> wrote:
>>
>>> Which Airavata/PGA version are you using?
>>>
>>> Looking at your error message I see even the project is also not set.
>>>
>>> On Fri, Dec 4, 2015 at 12:16 PM, Pankaj Saha 
>>> wrote:
>>>
 Hello Devs,
 I have a requirement to launch a job (simple hello world kind of)
 on mesos/marathon cluster through Airavata client (PGA preferable ). I 
 have
 tried installing a local Aiaravata PGA with hosted Airavata server on 
 my
 machine. Now the problem is with PGA installation, its not allowing me
 create or explore any project/experiment.
 Its saying:
 *Required field 'gatewayId' was not present! Struct:
 createProject_args(gatewayId:null, project:null)*

 I always used the default  gateway-Id which is "default" and the
 same is mentioned in the server 

Re: Airavata installation to submit a job in Mesos/Maraton cluster

[Pankaj Saha]

is your mesos cluster registered in the PGA as computer resource.
- No
Is the hello world application catalog entries made.
-No
Can you do this in a PGA using the gw56 ( I assume you have admin
privileges).
- I dont see any option for creating that. But I remember during GSoC, Erom
explained those PGA pages through which admin can do this.

On Sat, Dec 5, 2015 at 2:49 PM, Pamidighantam, Sudhakar V <
spami...@illinois.edu> wrote:

> Pankaj;
> is your mesos cluster registered in the PGA as computer resource. Is the
> hello world application catalog entries made. Can you do this in a PGA
> using the gw56 ( I assume you have admin privileges). If not somebody can
> do this for you.
>
> Thanks,
> Sudhakar.
>
> On Dec 5, 2015, at 1:26 PM, Pankaj Saha  wrote:
>
> Hi Supun,
> I have pointed to 'airavata-server' => 'gw56.iu.xsede.org
> ',
> to start working with.As you have already provided all the required
> previleges to my new userid, I am able to see all computer resources and
> applications in it. So it was not a problem with PGA but Airavata server
> installation in my local machine.
>
> Now can anyone please guide me for launching a hello world application
> through this portal so that it can launch a job in a mesos cluster. I know
> that I can not use the "gw56.iu.xsede.org
> "
> server, as I want to launch a job in my local mesos/marathon cluster. But
> if I get some clue how to start with I can possible fix my local Airavata
> server installation and will try to launch a job in local resource.
>
> Thanks
> Pankaj
>
> On Fri, Dec 4, 2015 at 5:41 PM, Supun Nakandala  > wrote:
>
>> We haven't done any changes to 0.15 branches recently. So if it worked
>> for you previously it should still work without any issue. I suggest that
>> you first try to setup your pga to work with SciGaP hosted airavata and
>> then try to connect it to your own airavata. But we don't have any active
>> deployments of 0.15. In that case you may want to use master branch
>>
>> On Fri, Dec 4, 2015 at 5:36 PM, Pankaj Saha 
>> wrote:
>>
>>> While running server, no error messages. But while creating projects its
>>> throws the error message which I have posted.
>>> On 04-Dec-2015 4:55 PM, "Supun Nakandala" 
>>> wrote:
>>>
 do you get any airavata error messages?

 On Fri, Dec 4, 2015 at 4:51 PM, Pankaj Saha 
 wrote:

> I am using 15 branch
> yes I could not even create a project.
>
> On Fri, Dec 4, 2015 at 4:49 PM, Supun Nakandala <
> supun.nakand...@gmail.com> wrote:
>
>> Which Airavata/PGA version are you using?
>>
>> Looking at your error message I see even the project is also not set.
>>
>> On Fri, Dec 4, 2015 at 12:16 PM, Pankaj Saha 
>> wrote:
>>
>>> Hello Devs,
>>> I have a requirement to launch a job (simple hello world kind of) on
>>> mesos/marathon cluster through Airavata client (PGA preferable ). I have
>>> tried installing a local Aiaravata PGA with hosted Airavata server on my
>>> machine. Now the problem is with PGA installation, its not allowing me
>>> create or explore any project/experiment.
>>> Its saying:
>>> *Required field 'gatewayId' was not present! Struct:
>>> createProject_args(gatewayId:null, project:null)*
>>>
>>> I always used the default  gateway-Id which is "default" and the
>>> same is mentioned in the server configuration properties file too. This
>>> problem I have never faced earlier and Airavata installation used to be
>>> very simple.
>>>
>>> Second challenge is to run a job through Airavata client, so that it
>>> can launch a job in a Mesos cluster through Marathon. So Airavata 
>>> should be
>>> able to invoke a rest API based client of Marathon to do the job.
>>> I seek help to resolve the first issue and then need to find a way
>>> for launching jobs.
>>>
>>>
>>> Thanks
>>> Pankaj
>>>
>>>
>>>
>>
>>
>> --
>> Thank you
>> Supun Nakandala
>> Dept. Computer Science and Engineering
>> University of Moratuwa
>>
>
>


 --
 Thank you
 Supun Nakandala
 Dept. Computer Science and Engineering
 University of Moratuwa

>>>
>>
>>
>> --
>> Thank you
>> Supun Nakandala
>> Dept. Computer Science and Engineering
>> University of Moratuwa
>>
>
>
>