Re: Airavata MetaSchedular

r the implementation. Thanks, Eroma On Thu, Dec 8, 2022 at 9:07 AM Emre Brookes <mailto:emre.broo...@mso.umt.edu>> wrote: Hi Isuru, Thanks for the updates. Great to see progress is being made. I plan to dive into the UltraScan side of this starting in January, perhap

Re: Airavata MetaSchedular

Hi Isuru, Thanks for the updates. Great to see progress is being made. I plan to dive into the UltraScan side of this starting in January, perhaps we can setup a meeting early January to see what is implemented, how the new UltraScan microservice can be integrated & begin planning/running some t

Re: Jetstream VM creation through Airavata

tutorial. Emre Suresh Marru wrote: On Apr 29, 2016, at 10:00 PM, Emre Brookes wrote: FYI - I think this effects other users also. I have had odd issues with Jetstream after you mentioned these tests. Hi Emre, Is this now? If you are referring to network issues few days ago, there were

Re: Jetstream VM creation through Airavata

FYI - I think this effects other users also. I have had odd issues with Jetstream after you mentioned these tests. Emre Suresh Marru wrote: How many instances do you need to test? I have about 1200 instances running for a stress test and I am exhausting quotes at various levels, hence these

Re: Design of Mesos/Aurora integration with Airavata on Jetstream

ny of your applications? On 4/27/16, 1:21 PM, "Emre Brookes" wrote: Pierce, Marlon wrote: Thanks, Gourav, this is great. How will the design differ in the two cases? Since installing the applications is not a simple task and there aren’t good docker libraries (for example) for many of them, I

Re: Design of Mesos/Aurora integration with Airavata on Jetstream

Pierce, Marlon wrote: Thanks, Gourav, this is great. How will the design differ in the two cases? Since installing the applications is not a simple task and there aren’t good docker libraries (for example) for many of them, I would assume that we would have a collection of VMs that have the c

Re: Jetstream VM creation through Airavata

Or are you working on creating dynamic VM's to run jobs via Airavata ? both that and getting an Airavata server VM or docker version running there would be of benefit. -e. Emre Brookes wrote: Hi Suresh, Just FYI - Glad to hear you are getting Airavata easy to deploy on Jetstream.

Re: Jetstream VM creation through Airavata

Hi Suresh, Just FYI - Glad to hear you are getting Airavata easy to deploy on Jetstream. I am currently working on getting GenApp easy to deploy on the standard Ubuntu & CentOS images there. I should be ready in the next month or two to revisit Airavata with a focus on Jestream ... Cheers,

Airavata 0.15.0 patch

Airavata 0.15.0 current git pull Comment: I believe you want to check if the data movement protocol is null not the job submission protocol before setting the data movement protocol. Also, the .get(0) will throw an NPE if you don't check that the getHostPrioritizedDataMovementInterfaces() has

experiments and modules

In the airavata experiment data structure, it seems the "applicationId" is the "applicationInterfaceId", correct? So the launched experiment runs the module associated with the applicationInterface ? How is this handled when there are multiple modules listed in applicationInterface:applica

thrift register application interface not assigning GUID

Using airavata 0.15.0, php thrift interface $appInterfaceId = $client->registerApplicationInterface( $gatewayId, $appInterfaceDescription ); returns an Id which has no GUID suffix, simply a duplicate of $appInterfaceDescription->applicationName inconsistently with all other register...()'s a

Reference compute resource definitions

Are there any reference example compute resource definitions for XSEDE resources available ? e.g. stampede, comet, etc ... I logged into to http://testdrive.airavata.org , but of course, I don't have admin access to view resources. The explanation here https://cwiki.apache.org/confluence/disp

Re: GSoC Hangout Friday 9 am eastern

Suresh, Are we going to have a GSoC hangout this Friday? I'd like to get an update on the file manager (OODT?)... Thanks, Emre Suresh Marru wrote: Hi All, We had a good tutorial about Airavata at the XSEDE 15 conference. We will now have more time to help with the GSoC projects. Lets resume

GSoC weekly

Suresh, Are we going to have a GSoC hangout today? It is a federal holiday here in the states, so I was wondering. Thanks, Emre

Re: [GSoC] Midterm Evaluation and Weekly Hangout

Suresh, I am not sure if you want to schedule them sequentially as one hangout or separately. Priyanshu's GSoC demo could be also be Thursday or Friday morning. Thanks, Emre Emre Brookes wrote: Suresh, Will you have time to schedule Abhishek's GSoC demo for Thursday or Frid

Re: [GSoC] Midterm Evaluation and Weekly Hangout

Suresh, Will you have time to schedule Abhishek's GSoC demo for Thursday or Friday morning ? Thanks, Emre Suresh Marru wrote: GSoC Students, You might have received email from google about GSoC mid-term evaluations due to be filled starting next friday. In preparation for this, please upd

Re: Create Experiment in PHP

Hi Abhishek, If you are still using Airavata .14, move to .15. If you are using .15: One option: The php reference gateway itself should be a good php client reference (it appears to be working to create and launch experiments) airavata-php-gateway $ find . -type f | xargs grep -l createExp

Re: Undefined reference to Workflow::read/write(TProtocol*) error in Airavata-0.15

kflow& workflow) = 0; ^ ../lib/airavata/Workflow.h:38:74: error: ISO C++ forbids declaration of ‘workflow’ with no type [-fpermissive] virtual void registerWorkflow(std::string& _return, const ::Workflow& workflow) = 0; On Sat, Jun 6, 2015 at 4:56 PM, Emre Brookes mailto:e...@b

Re: Undefined reference to Workflow::read/write(TProtocol*) error in Airavata-0.15

aration of ‘workflow’ with no type [-fpermissive] virtual void registerWorkflow(std::string& _return, const ::Workflow& workflow) = 0; On Sat, Jun 6, 2015 at 4:56 PM, Emre Brookes <mailto:e...@biochem.uthscsa.edu>> wrote: Does any one know where: `Workflow::read(apache:

Re: Undefined reference to Workflow::read/write(TProtocol*) error in Airavata-0.15

Priyanshu, Have you seen this http://wiki.apache.org/thrift/ThriftUsageC%2B%2B ? Perhaps it has some information you need. It appears to have some extra .o files generated by thrift. Note the 2 stage client compiling & linking lines (which could be combined into one) esp. the client linking h

Re: Undefined reference to Workflow::read/write(TProtocol*) error in Airavata-0.15

Does any one know where: `Workflow::read(apache::thrift::protocol::TProtocol*)' is defined ? This seems to me to be thrift generated cpp from a Airavata Workflow class... but I'm guessing. -Emre Emre Brookes wrote: All, Does anyone have a complete set of libraries required to l

Re: Undefined reference to Workflow::read/write(TProtocol*) error in Airavata-0.15

All, Does anyone have a complete set of libraries required to link apache thrift to airavata cpp ? Priyanshu, Undefined reference generally means some library or other source file is missing from the compile line. This may help you think through it (not an exact fit, but similar) http://sta

Re: [GSoC] Weekly hangout

Hi Suresh, Do we use the same link as last week ? Thanks, Emre Suresh Marru wrote: Hi All, As we agreed last week, lets do a brief hangout Friday 9 eastern (6.30pm IST) and do a project round up. This week we can keep it brief and get updates from every one and address any impediments. Su

Re: Error while adding localSubmissionDetails to airavata

Anyone have any suggestions to debug this? Priyanshu, My minimal digging finds the this returned $ find . -type f -name "*.cpp" | xargs grep "addLocalSubmissionDetails failed" ./airavata/airavata-api/airavata-client-sdks/airavata-cpp-sdk/src/main/resources/lib/airavata/Airavata.cpp: throw ::a

Re: Airavata Output

Hi Chathuri, How do we define correctly the stdout and stderr of the experiment as outputs ? Thanks, Emre Abhishek Kapoor wrote: Hey Chathuri, In the experimen, I defined output as List exOut = new ArrayList(); OutputDataObjectType output = new OutputDataObjectType();

Re: Airavata Output

Yes, this is a good question. Anyone - What are the client API calls to retrieve stdout & stderr ? -E. Abhishek Kapoor wrote: Hello, I am trying to run experiments in airavata via xbaya-gui and and java-client api. The output that I am getting in /tmp/ExpId contains input - folder(empty) ou

RegisterApplication

Is there a recommended way to register a module that may or may not already exist ? should one just try registering it again (does it throw an understandable error?) (e.g. registerApplicationModule ) or validate against an application module list ? (e.g. getAllAppModules ) -E.

Re: Registry API for Genapp

Airavata is using git and GenApp is currently using svn. Abhishek - yes, you are going to have to use both git and svn. You should see if you can use git following Suresh's recommendations so you don't have to always rsync to your git clone on gw106.iu.xsede.org and can keep it locally. -Emre

Re: Registry API for Genapp

Abhishek Kapoor wrote: Sir, Due to some reasons, I am unable to checkout the repository. My network is blocking it abhishek@abhishek-notebook:~/Desktop/gsoc2015$ git clone https://github.com/abhikgp/airavata-sandbox.git Cloning into 'airavata-sandbox'... fatal: unable to access 'https://gith

Re: Registry API for Genapp

Abhishek, You should from this point forward put all code in the sandbox Suresh setup. Suresh wrote: Please check in your code into sandbox repository to Emre and rest of us can use the github tools to review and make suggestions. Checkout - and check in your code into genapp-airavata-gsoc201

Re: Registry API for Genapp

guage (php, c++, java). -E. priyanshu patra wrote: Sir, how to proceed after registering the modules so as to run them on server via genapp? On Mon, Jun 1, 2015 at 3:14 PM, Emre Brookes <mailto:e...@biochem.uthscsa.edu>> wrote: Abhishek Kapoor wrote: Sir, I was

Re: Get StandAlone Registry API

Suresh, If someone wants to run a client calling an Airavata server, what are the dependencies? Do they need a complete Airavata and Thrift installation or are the client sdks "stand alone" or "stand alone + Thrift" ? It is likely one could figure out minimum requirements by doing a local in

Re: Get StandAlone Registry API

Abhishek Kapoor wrote: Sir, We should not register the executables again and again. what we can do is we can register it via genapp.pl that should be the best way Right, but people will also run genapp.pl many times during development, so the code should really check to se

Re: Get StandAlone Registry API

Abhishek Kapoor wrote: Sir, As far as I understood, we have to first register all our executable modules(present in genapptest/bin) in Airavata like the one registered in samples of Airavata and this has no relation with language apis present. So there must be some library or online api prese

Re: Get StandAlone Registry API

Abhishek Kapoor wrote: Hello, From Where can I download standalone Registry API to register modules. -- Regards, *Abhishek Kapoor* *Under Graduate Student* *Indian Institute of Technology Kharagpur.* Do you mean Airavata "experiments" which is the equivalent to GenApp "modules" or do you mea

Re: [GSoC] Hangout - Airavata and PGA Overview

I'm available then. -E. Pamidighantam, Sudhakar V wrote: 8 CT is fine for me. Sudhakar. On May 28, 2015, at 7:05 AM, Suresh Marru > wrote: Hi All, Will 9 am eastern time (6.30 pm IST) tomorrow (Friday 29th May) work for every one for a google hangout? After a

GSoC GenApp / Airavata integration and Experiment Registry

Suresh, Raminder - Can we start a discussion here about what needs to be done to register an application from the command line? In the simplest form, all 'genapp' modules currently have the same inputs and outputs. They take a single command line argument (a JSON formatted string) and produc

Re: Exception while launching experiment using Genapp

Hi Priyanshu, I have redirected this to the Airavata developers list because this is really more of an Airavata question. One of the key things Nadeem Anjum did with GSoC 2014 was to setup an automatic registry of the applications with Airavata within GenApp as part of the application generati

Re:

Hi Abhishek, The "Could not listen on port 1527, address already in use" errors makes me think there is already some service running. (Anyone - This isn't normal, is it ?) If this is the problem, you could try and track it down, by finding the PID with something like # lsof -i :1527 and then kil

Re: Steps to install Airavata and lanch Workflow

Good job Priyanshu & Abhishek, You have produced a useful benefit to the community by writing this up. -Emre. Spiro Mihalakopoulos wrote: Hi guys, I just followed the build instructions and it worked like a dream. Much easier than what I had to do to get it working a few months ago :-) Th

Re: Steps to install Airavata and lanch Workflow

Hi, That could be quite helpful. When I have time, I will try working through the steps myself and make suggestions then. Thanks, Emre priyanshu patra wrote: Hi everyone, We have created a document specifying the steps required to successfully install Airavata, providing the solutions to

Re: [jira] [Commented] (AIRAVATA-1649) [GSoC] Airavata Java SDK Integration with GenApp

Hi Abhishek, I think the important thing is to get a working instance of Airavata and then to focus on your deliverables. Suresh had suggested: "Can you make sure you have the initial deliverable of contributing good examples to register applications, create and monitor executions into Airavat

[jira] [Commented] (AIRAVATA-1649) [GSoC] Airavata Java SDK Integration with GenApp

[ https://issues.apache.org/jira/browse/AIRAVATA-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491007#comment-14491007 ] Emre Brookes commented on AIRAVATA-1649: Abhishek, Airavata provides

Re: [DISCUSS] Accept GenApp into Apache Airavata

From: , Suresh Reply-To: "dev@airavata.apache.org" Date: Wednesday, March 25, 2015 at 11:14 AM To: Emre Brookes Cc: Airavata Dev Subject: [DISCUSS] Accept GenApp into Apache Airavata Hi All, Since there is not much discussion on this thread, I will make it more explicit on one option (

Re: [DISCUSS] Accept GenApp into Apache Airavata

resh Reply-To:"dev@airavata.apache.org" Date: Wednesday, March 25, 2015 at 11:14 AM To: Emre Brookes Cc: Airavata Dev Subject: [DISCUSS] Accept GenApp into Apache Airavata Hi All, Since there is not much discussion on this thread, I will make it more explicit on one option (which is Em

Re: [GSoC] Status Update

Nadeem Anjum wrote: Hello Everyone, I have almost been able to complete the implementation to enable GenApp submit jobs to Airavata, while assuming that the modules are already registered (i.e. by doing the registration manually). I am currently stuck at an issue (hence "almost") related to p

Re: genapp airavata integration

d that scenario where we run airavata in the resource and basically talking to localhost, but ideally if you specify some dummy cert files or empty some random password it might work. Can you please let us know if you get any errors Thanks Lahiru On Mon, Apr 28, 2014 at 4:09 PM, Emre Broo

Re: genapp airavata integration

Lahiru Gunathilake wrote: What do you mean by DIRECT job submission to SGE ? But I know we can submit to SGE and monitor the jobs. Regards Lahiru I mean Airavata would be running in a vm on the cluster and will be able to directly submit (via ssh) to the queue without certificates etc. Ramin

genapp airavata integration

Hi Suresh, The CCP-SAS cluster is installed at University of Texas Knoxville. Rocks, head node and 2 compute nodes: 64 core 128 GB ram + Tesla GPU's (not sure how many per node, at least 2). SGE grid engine, openmpi. 1 June, there is to be a workshop utilizing this resource :( I just found out

Re: Airavata EC2 GenApp

-us.apache.org/repos/asf?p=airavata.git;a=tree;f=modules/gfac/gfac-ec2;hb=HEAD On Sat, Apr 19, 2014 at 10:34 AM, Emre Brookes mailto:e...@biochem.uthscsa.edu>> wrote: Hi All, I was curious to know the status of Airavata support for job submission to EC2 resources ? I found He

Airavata EC2 GenApp

Hi All, I was curious to know the status of Airavata support for job submission to EC2 resources ? I found Heshan's blog here: http://heshans.blogspot.com/2013/04/run-ec2-jobs-with-airavata-part-i.html and the wiki here: https://cwiki.apache.org/confluence/display/AIRAVATA/Amazon+EC2+Integra

Re: Suppress Jira update messages

Marlon Pierce wrote: Can we suppress the Jira update messages? Marlon +1 ;)

Re: [GSoC 2014] Integration of GenApp with Apache Airavata

Hi Nadeem, I am fine with this, I just wanted to verify you understood the situation. I think it would be good to have the Java/FX2 working, so this may motivate me to do it. Thanks, Emrer Nadeem Anjum wrote: Hi Emre, I think it will be good to have Java interfaces integrated as well, so I

Re: [GSoC 2014] Integration of GenApp with Apache Airavata

Nadeem, Note: iOS, Android and Java are possible, but not currently active target languages. I may knock out a Java/FX2 version in time for you to utilize. Seeing some of the discussion on identity, this may be another piece to integrate. I was looking at Open ID connect as a possibility, but

Re: Retrieving Experiment Summaries

You might want to have a look at mongodb's methods of find()ing distinct() and aggregate() data. Similar, but different, layout and it provides some nice json such as { $in : { Experiment.Owner : ["bob","alice", ... ] } and $gt : { Experiment.Runtime : 100 } etc so that logical operators could b

Re: [GSoC 2014] Integration of GenApp with Apache Airavata

Nadeem Anjum wrote: Hi All, Here is my proposal for GSoC 2014: Integration of GenApp with Apache Airavata: http://www.google-melange.com/gsoc/proposal/public/google/gsoc2014/nadeemanjum/5632763709358080 Please provide your feedback and suggestions. Thanks, Nadeem. Hi Nadeem, Nice write-up.