Requirements for an updated portal architecture

Dev, I’ve been taking feedback from other Airavata developers and working on requirements for a next generation architecture for the PGA. First I’ll list out the requirements as I see them. Then I will propose what I feel is a best fit for these requirements. Feedback on all of this is much

User Profile Service database

Anuj, Supun, This is just a heads up that I’m going to work on moving the database tables for the User Profile Service out of the registry database and into it’s own database. Thanks, Marcus

Re: User Profile Service database

in identity server to a different DB in airavata. I will be in lab soon, we can discuss about it more. Regards, Anuj Bhandar On Feb 6, 2017 10:53 AM, "Christie, Marcus Aaron" <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Anuj, Supun, This is just a heads up that I’m go

Re: Requirements for an updated portal architecture

TI Cyberinfrastructure & Service Center. > > > From: Christie, Marcus Aaron <machr...@iu.edu> > Sent: Friday, February 3, 2017 4:31 PM > To: dev@airavata.apache.org > Subject: Requirements for an updated portal architecture >

Re: Requirements for an updated portal architecture

On Feb 7, 2017, at 11:09 AM, Amila Jayasekara > wrote: Sorry, mistakenly pressed "Send" button before I finish typing :-). Oops I answered your first question in the other email :) Further replies below. On Tue, Feb 7, 2017 at 11:01 AM,

Re: [#Spring17-Airavata-Courses] : Distributed Workload Management for Airavata

Vidya, I’m not sure how relevant it is, but it occurs to me that a microservice that executes jobs on a cloud requires very little in terms of resources to submit and monitor that job on the cloud. It doesn’t really matter if the job is a “big” or a “small” job. So I’m not sure what heuristic

Re: UI Portal - Load Balancing & High availability

On Jan 21, 2017, at 9:40 PM, Ameya Advankar > wrote: Hi Airavata Developers, As a part of the ongoing Advanced Science Gateway Architectures course at IU, we are working on load balancing the UI Portal. This mail chain is intended to be

Re: Is 'server-allowed-file-size' in pga_config.php needed?

On Jan 25, 2017, at 10:53 AM, Supun Nakandala > wrote: @Marcus As I can see 'server-allowed-file-size' is an outdated property in the pga_config.php which is already removed from the pga_config.php.temlate. We can remove that

Re: UI Portal - Load Balancing & High availability

Vidya, Thanks. Response are below. On Jan 26, 2017, at 4:01 PM, Vidya Sagar Kalvakunta > wrote: Hi Marcus, Using a service registry such as Consul as the backend for the load balancer automatically ensures the service that is currently down

Re: Improving the PGA Install

On Feb 2, 2017, at 9:34 AM, Eric Coulter > wrote: Meant to sent this to dev as well... updates on my scripts for the PGA follow! Thanks, Shameera! 1. I did mean only the PGA for now. Thanks for the link; I've got a version up extended for Ubuntu at

Re: Airavata Output Processing Doubt

Ajinkya, I think an example of what you are trying to accomplish would be helpful for me. I’m not quite understanding what problem you are trying to solve nor the proposed solution. Are you trying to turn the STDOUT of an application into an INTEGER value somehow? Thanks, Marcus On Jan 16,

Personal compute/storage preferences for campus portals

Hello All, I don't think I've written to this list yet, so let me introduce myself. My name is Marcus Christie and I work in the Science Gateways Group at IU with Suresh and other Airavata developers. I'm looking forward to contributing to Airavata. I'm currently working on creating a UI

Re: Personal compute/storage preferences for campus portals

he tabs for adding resource in their UI? Would the title of resource_owner be descriptive? Mark From: Christie, Marcus Aaron [mailto:machr...@iu.edu] Sent: Monday, October 10, 2016 11:06 AM To: dev@airavata.apache.org Subject: Personal compute/storage preferences for campus portals Hello All,

Re: Personal compute/storage preferences for campus portals

ual accounts. “community_account_individual_allocation” - just the project number field for scenario 4. Again, not creative thoughts, so please feel free to ignore. Suresh On Oct 11, 2016, at 8:24 AM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Mark, Yes. Today when

Re: WSO2 Identity Server + CILogon integration

sernames ? > > Thanks > -Thejaka > > On Thu, Dec 1, 2016 at 5:01 PM, Christie, Marcus Aaron <machr...@iu.edu> > wrote: > Dev, > > I met with Supun and Anuj today to discuss how to best integrate WSO2 > Identity Server (IS) with CILogon’s OpenID Connect se

Is 'server-allowed-file-size' in pga_config.php needed?

Dev, Why is there a 'server-allowed-file-size' variable in pga_config.php? Is this just supposed to be the same as 'upload_max_filesize' in php.ini? If so, then I propose removing it and just getting the ‘upload_max_filesize’ from php.ini. Anyone remember why it was added? Thanks, Marcus

WSO2 Identity Server + CILogon integration

Dev, I met with Supun and Anuj today to discuss how to best integrate WSO2 Identity Server (IS) with CILogon’s OpenID Connect service [1]. The main outline of the solution Supun has been working toward is something like this: * PGA redirects to IS with an authorization code grant type *

Re: Improving the PGA Install

Eric, It’s great to have you working on this. I’m not sure if this really impacts the decision making process much, but I had a thought. One need I have for an improved installation process for PGA is to use that as a much easier to use local development environment. However, the needs for a

Re: Database Version Control for Airavata

Mark, Anuj might know more about this but I thought I would chime in. I believe this is something that database migration tools can do. I haven’t tried that though. Here’s Liquibase’s support for rollback scripts: http://www.liquibase.org/documentation/rollback.html Marcus On Dec 25, 2016,

Re: Web-based user interface for Group Management

Eldho, I think only the group management part is needed. The other aspects are already taken care of by the sharing registry. Thanks, Marcus > On Mar 27, 2017, at 4:23 PM, Eldho Mathulla wrote: > > Hello Dev, > Based on my discussion with Ameya, we have decided on

Re: Welcome Gourav Shenoy as Airavata Committer

Congratulations and welcome aboard, Gourav! > On Apr 9, 2017, at 10:54 PM, Suresh Marru wrote: > > Hi All, > > The Project Management Committee (PMC) for Apache Airavata has asked Gourav > Shenoy to become a committer based on his contributions to the project. We > are

Re: Welcome Anuj Bhandar as Airavata Committer

Welcome aboard Anuj! > On Apr 9, 2017, at 10:56 PM, Suresh Marru wrote: > > Hi All, > > The Project Management Committee (PMC) for Apache Airavata has asked Anuj > Bhandar to become a committer based on his contributions to the project. We > are pleased to announce that he

Re: Welcome Ajinkya Dhamnaskar as Airavata Committer

Congratulations and welcome, Ajinkya! > On Apr 9, 2017, at 10:57 PM, Suresh Marru wrote: > > Hi All, > > The Project Management Committee (PMC) for Apache Airavata has asked Ajinkya > Dhamnaskar to become a committer based on his contributions to the project. > We are

Re: List of Devops Scripts for Apache Airavata

Dev, Eric and I met this morning to discuss how to consolidate these various efforts. Here’s what we came up with: 1. (Marcus) Create an airavata-devops repo for holding all of the Ansible scripts. To start with, we’ll use the dev-tools/ansible scripts. 2. (Eric) Once the airavata-devops

Re: List of Devops Scripts for Apache Airavata

On Mar 10, 2017, at 11:57 AM, Pierce, Marlon > wrote: Re: Marcus’s second bullet. Separating these into separate branches puts the burden on using CI/CD. Marlon, Could you expand on this? I’m not sure I follow what you are saying. Thanks, Marcus

Re: List of Devops Scripts for Apache Airavata

On Mar 10, 2017, at 1:14 PM, Shenoy, Gourav Ganesh > wrote: Although it is not being actively used, but it still is in working shape. Gourav, Thanks, good to know. I think for now I’ll just leave it where it is. If we start to use it more, I

Configuring Airavata logging

Dev, I found out today that the log4j.properties we provide in the bin/ directory of the distribution isn’t used and doesn’t actually configure logging. I think this should be fixed. The problem is a little complicated. I put together what I found in issue AIRAVATA-2363 [1]. Mostly it boils

Re: PGA Enhancements and Bug Fixes

Sneha, That’s a good write up of the state transitions for the new gateway request process. Thank you for your pull request implementing these changes. This will improve the gateway request process both for users requesting gateways and for admins creating gateways. I’ve merged your pull

Re: Group Management - Status Update

Sneha, Good write up. I still have some work to do before it is ready but here is the Django gateway implementation I’ve been working on if you want to take a look at it: https://github.com/machristie/django-airavata-gateway I’m hoping to have something you can use by later today, but I’ll

Re: Reg Installation Prequisite Automation

On May 11, 2017, at 12:26 AM, Bhargava Vadlamani > wrote: Hello Folks, I am planning to develop a faster automated Python 2x script for easier installation of prerequisites such as mcrypt,MySQL,configuring MySQL and Apache systems and

Re: Using Docker images to run Thrift

be welcome. There should be testing to ensure this went through correctly and suggest practical ways to correct any shortcomings. Thanks, Sudhakar. On Jun 7, 2017, at 3:02 PM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Dev, After running into difficulties get

Re: Reg Development of Pip package for Apache Airavata installation

On May 22, 2017, at 11:58 AM, Bhargava Vadlamani > wrote: @Marcus, I will try to get hold of some possible names for the package.Can we go with the name airavata-pga-install for the dev purposes? Sounds good to me.

Re: [VOTE] enables writes to Airavata GitHub mirror

+1 for enabling writes on GitHub On May 22, 2017, at 1:16 PM, Suresh Marru > wrote: When GitHub has outage, we should manually switch to ASF canonical repos and push and hope the synchronization works Would this work? Will there be bidirectional

Re: [VOTE] enables writes to Airavata GitHub mirror

On May 23, 2017, at 10:44 AM, Suresh Marru > wrote: Yes and No. From a git (rather git pubsub) perspective yes both the repos allow writes and they synchronize with post commit hooks. But we should avoid writing to both since there could be code

Re: [VOTE] enables writes to Airavata GitHub mirror

On May 26, 2017, at 9:12 AM, Suresh Marru > wrote: I think that may not be desirable and ASF might not want to fully depend on a third party commercial service as the only write only repo. We can watch the commits and slowly educate all committers

Zookeeper log filling up disk

Dev, This message is just to document what happened today in the SGRC dev environment. But if you have any insight on what caused this to happen, please share. TLDR: Zookeeper log fills disk, Logstash is spamming ZK with requests, not sure what caused it but have reconfigured ZK logging to

Re: [GSoC Plan of Attack] Choosing Apache Spark

Apoorv, Looks like you are making progress, which is great. However, I’m not quite sure what problem you are trying to solve. Is there a writeup or something on the problem you are trying to solve? Thanks, Marcus On May 17, 2017, at 9:13 PM, Apoorv Palkar

Re: Reg Development of Pip package for Apache Airavata installation

Bhargava, +1 for a pip package although I think we’ll need to think carefully when choosing a name for the package. ‘airavata’ is far too general. Maybe ‘airavata-pga-installer’? Thanks, Marcus > On May 20, 2017, at 11:46 PM, Bhargava Vadlamani > wrote: > > Hello,

Using Docker images to run Thrift

Dev, After running into difficulties getting Thrift to build on my laptop I started exploring the possibility of using Docker images to run Thrift. I’ve created a pull request of my changes here: https://github.com/apache/airavata/pull/112 One question: I opted to just switch the scripts to

links

Sneha, Here is a link on Github to the service Anuj created: https://github.com/apache/airavata/tree/b1c390cb42c4f02a7a45231627e0d646fa7c23d5/airavata-services/profile-service/iam-admin-services-core It should be in the ‘develop’ branch of airavata. See also:

Re: links

@gmail.com>> wrote: Thank you, Marcus. Regards, Sneha Tilak On Fri, Jun 16, 2017 at 1:46 PM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Sneha, Here is a link on Github to the service Anuj created: https://github.com/apache/airavata/tree/b1c390cb42c4f

Problem with Keycloak converting usernames to lowercase

Dev, During testing integration with Keycloak, Eroma discovered several issues [1] [2] [3] [4] related to having a legacy username with mixed upper and lower case characters. WSO2 IS allowed users to have usernames with upper case characters. However, Keycloak lowercases the username when a

Re: Problem with Keycloak converting usernames to lowercase

resh Marru wrote: >> Hi Marcus, >> >> Interesting problem. Your conclusion seems to be the right approach. >> >> + 1 for fixing the legacy data and also for employing lowercasing all the >> tables you identified. >> >> Suresh >> >>> On

Re: SciGaP Portal Enhancements and Bug Fixes

Hi Sneha, Nice write up! On Jun 15, 2017, at 5:20 PM, Sneha Tilak > wrote: 1. Auto-generate the OAuth Client key and secret key for an approved gateway - https://issues.apache.org/jira/browse/AIRAVATA-2144 This one is facilitated

Re: SciGaP Portal Enhancements and Bug Fixes

at 12:14 PM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Hi Sneha, Nice write up! On Jun 15, 2017, at 5:20 PM, Sneha Tilak <sneha.tila...@gmail.com<mailto:sneha.tila...@gmail.com>> wrote: 1. Auto-generate the OAuth Client key and secret

Re: Zookeeper log filling up disk

up again. I don’t think we looked at Kafka/Logstash last time the TIME_WAIT problem occurred. [1] https://issues.apache.org/jira/browse/AIRAVATA-2321 On May 26, 2017, at 4:47 PM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Dev, This message is just to d

Upgrade to Thrift 0.10.0

Dev, I’ve merged the thrift 0.10.0 upgrade branch to ‘develop’ [1]. The thrift generation scripts use Docker to run thrift so you don’t need to upgrade your locally installed thrift, but you can if you want. If you want to use your locally install thrift you’ll need version 0.10.0 of course

Re: Airavata Django repo

Suresh, Thanks! I’ve pushed my repo to this repo. On Sep 1, 2017, at 10:49 AM, Suresh Marru > wrote: You can clone from the URL - https://git-wip-us.apache.org/repos/asf/airavata-django-portal.git

Re: Running PGA locally on OS X

Thu, Sep 28, 2017 at 9:15 AM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: On Sep 28, 2017, at 8:24 AM, Neeraj Lad <n...@umail.iu.edu<mailto:n...@umail.iu.edu>> wrote: Hi all, I've followed the instructions to install all the dependencies for th

Re: Working on Load Balancers

Jerrin, What specifically do you want to work on regarding load balancing? Depending on what you want to work on, load balancing a web application is fairly independent of the web application framework. So I would say for now you could just try load balancing any web application, even a

Re: Running PGA locally on OS X

in in Incognito mode, but the error persists. On Thu, Sep 28, 2017 at 3:02 PM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Neeraj, Try again. This required a change in Keycloak to allow http://localhost:8080<http://localhost:8080/> and http://localh

Re: Running PGA locally on OS X

On Sep 28, 2017, at 8:24 AM, Neeraj Lad > wrote: Hi all, I've followed the instructions to install all the dependencies for the PGA. Now I need to run it locally. I got the pga_config file from Eroma, but using it and logging in with CILogon takes

Airavata Django repo

Suresh, Can you create or can you help me create an Apache git repo for the Django code for the new PGA? As for the name, I think “airavata-django” is sufficient. Thanks, Marcus

Re: Issues while running Sharing Service

Shubham, What’s the ‘rabbitmq.broker.url’ property set to in airavata-server.properties? Thanks, Marcus > On Nov 25, 2017, at 2:35 PM, Shubham Kumar wrote: > > Hi Dev, > > I have made changes in thrift file sharing_cpi in local repo. I have created > a simple Java

Re: Welcome Marcus Christie as Airavata PMC member

Thanks everyone for the congratulations, I appreciate it. On Nov 17, 2017, at 3:01 PM, Mangirish Wagle > wrote: Congratulations Marcus! On Fri, Nov 17, 2017 at 2:27 PM, Shenoy, Gourav Ganesh

Re: CLI tool to export Application Catalog information

Shubham, When importing and you call registerApplicationModule, it returns the module id. Does that help? Also you asked about computeHostId on Hipchat. I think computeHostId should be translated to the compute hostname when exporting because different Airavata instances will have different

Re: Airavata test failures in Jenkins?

lling to look into this, Suresh On Nov 1, 2017, at 12:40 PM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Dev, I vaguely recall that there is some issue with running the airavata testsuite in Jenkins and we ended up disabling it. Is there an issue

Airavata test failures in Jenkins?

Dev, I vaguely recall that there is some issue with running the airavata testsuite in Jenkins and we ended up disabling it. Is there an issue for the problems faced, or any pointers? I’m interested in digging into this problem. Thanks, Marcus

Re: Linked Container Services for Apache Airavata Components - Phase 2 - Initial Prototype

On Nov 2, 2017, at 2:11 AM, Shenoy, Gourav Ganesh > wrote: * Another point which comes to my mind is about moving away from this big “API Server” block and segregating into smaller service level first class SDKs. For e.g.: We now have a

Re: Running Airavata in standalone mode

Hi Dimuthu, I’ll get the airavata-server.properties and database dump to you today. On Dec 8, 2017, at 7:40 AM, DImuthu Upeksha > wrote: Hi Suresh/ Marcus, I'm trying to run Airavata in standalone mode by running ServerMain class

Proposed GroupResourceProfile for modeling resource sharing with specific groups of users

Dev, Suresh and I had a good discussion on Friday about how to handle sharing allocation and resources with different groups of gateway users and how to specify restrictions on how that shared allocation can be used by those groups. I’ll try here to summarize what we discussed, and I will

Re: Running Airavata in standalone mode

these into your local MySQL database. Thanks, Marcus On Dec 8, 2017, at 9:03 AM, Christie, Marcus Aaron <machr...@iu.edu<mailto:machr...@iu.edu>> wrote: Hi Dimuthu, I’ll get the airavata-server.properties and database dump to you today. On Dec 8, 2017, at 7:40 AM, DImut

Pushing to Airavata on GitHub

Committers, The Airavata master repos are now on GitHub. To push to them you need to have 2FA enabled on GitHub. Once you have 2FA enabled in GitHub use the following page to make sure that you have access: https://gitbox.apache.org/setup/ Once you have access here you’ll need to generate a

Re: [airavata] branch master updated (2a3302c -> 88acdf1)

Suresh, Just curious. Why is this committed to *airavata* instead of *airavata-sandbox* repo? > On Oct 31, 2017, at 12:03 PM, sma...@apache.org wrote: > > This is an automated email from the ASF dual-hosted git repository. > > smarru pushed a change to branch master > in repository

Re: Expected type 'timedelta', got 'DateTimeField' instead error

Davis, Are you still having trouble with this? My best guess is that it might be the order of the operands. now - datetime.timedelta(days=1) <= self.pub_date might not work since, I think, what happens here is the left hand side is evaluated to a datetime instance and then __le__ is called

Re: update on work progress.

Hi Davis, We’ve been using Vue.js as the frontend framework. You can see some examples of how it is used in the “workspace” Django app [1]. To integrate Leaflet.js there are probably several projects that wrap Leaflet as a Vue component, like this one [2]. Or you could wrap it yourself, like

Re: Database migration scripts for "0.17" release

Just FYI I consolidated these now. [1] [1] https://github.com/apache/airavata/tree/master/modules/registry/release-migration-scripts/0.16-0.17 > On May 2, 2018, at 2:36 PM, Christie, Marcus Aaron <machr...@iu.edu> wrote: > > Yeah no problem. I’ll try to consolidate them on th

Upgrade to OpenJPA 2.4.3?

Any objections to upgrading to OpenJPA 2.4.3? I think now is probably a good time, since we in any case need to do a lot of testing of the registry refactoring code changes. A couple motivating reasons: * In Maven we have a compile time dependency on OpenJPA 2.3.0 [1], but we are actually

Re: Upgrade to OpenJPA 2.4.3?

:35 AM, Christie, Marcus Aaron mailto:machr...@iu.edu>> wrote: Any objections to upgrading to OpenJPA 2.4.3? I think now is probably a good time, since we in any case need to do a lot of testing of the registry refactoring code changes. A couple motivating reasons: * In Maven we have a

Re: Trouble deploying web app to test

Hi Davis, Are you still getting an error? If so, is the error in the browser of does it come from the Django server when it tries to start up? Is this the airavata-django-portal or another Django server? If there is an error message can you please post it. I’ll also be on hipchat in the

Database migration scripts for "0.17" release

Hi Suresh, Just a heads up that we’ve been accumulating database migration scripts for future releases and I need to reorganize them before the coming 0.17 release. Unfortunately I grouped these according to the releases I thought they would end up going into and got those wrong, you can see

Re: Database migration scripts for "0.17" release

Yeah no problem. I’ll try to consolidate them on the master branch maybe tomorrow. > On May 2, 2018, at 1:04 PM, Marru, Suresh <sma...@iu.edu> wrote: > > Thanks Marcus. This is helpful to have all in one place. > > Suresh > >> On Apr 30, 2018, at 4:19 PM,

Migrating from role-based to group-based authorization

Dev, Summary: I want to put in an email my thoughts on how group-based authorization will work and how we can migrate to it from our current role-based approach. Some of this work has already been done, some of this represents some re-thinking on how to do the migration, and some of this is

Re: App to integrate Airavata userbase into NextCloud

Hi Dimuthu, This looks really good. One question, what does NextCloud use groups for? Is it just a way to share things with a group of users? One thought I had is if a user shares a file with another user in NextCloud, we’ll want that to be communicated to Airavata too, I think, otherwise only

registry-refactoring testing

Hi Dev, The registry-refactoring branch changes has been merged to the develop branch. We have a develop deployment that we maintain for testing which can be accessed at dev.seagrid.org. If you want to help with testing please log in there or create an account if you

Re: Securing GroupResourceProfiles

be tracking this work in Jira issue AIRAVATA-2840 [1] Thanks, Marcus [1] https://issues.apache.org/jira/browse/AIRAVATA-2840 On Jul 3, 2018, at 3:12 PM, Christie, Marcus Aaron mailto:machr...@iu.edu>> wrote: Hi Thejaka, Yes, that makes sense. For a bit more context: if you are fa

Re: Securing GroupResourceProfiles

data fields. Hope this makes sense. Thanks Thejaka On Mon, Jun 25, 2018 at 3:57 PM, Christie, Marcus Aaron mailto:machr...@iu.edu>> wrote: Hi All, I’m looking for some advice on how to secure GroupResourceProfiles. The problem is this: any user that has READ access to a GroupResourceP

Re: [ANNOUNCE] Welcome Sneha Tilak as Airavata Committer

Congratulations Sneha! > On Mar 8, 2018, at 10:52 AM, Suresh Marru wrote: > > Hi All, > > The Project Management Committee (PMC) for Apache Airavata has asked Sneha > Tilak to become a committer based on her contributions to the project. We are > pleased to announce that

Re: [ANNOUNCE] Welcome Sachin Kariyattin as Airavata Committer

Congratulations Sachin! > On Mar 9, 2018, at 12:31 PM, Suresh Marru wrote: > > Hi All, > > The Project Management Committee (PMC) for Apache Airavata has asked Sachin > Kariyattin to become a committer based on his contributions to the project. > We are pleased to announce

Re: [ANNOUNCE] Welcome Dimuthu Upeksha as Airavata PMC member and committer

Congratulations Dimuthu! Welcome aboard! > On Mar 6, 2018, at 10:32 AM, Suresh Marru wrote: > > Hi All, > > The Project Management Committee (PMC) for Apache Airavata has asked Dimuthu > Upeksha to become a committer and PMC member based on his contributions to > the

Re: Improving the quality of the commits to Airavata repository

+1, especially for new features. I think we could allow direct commits for small bug fixes (especially time-sensitive ones) and other small changes. On Mar 12, 2018, at 1:34 PM, DImuthu Upeksha > wrote: Hi Folks For last few months

Re: Facility to upload large files to a cluster

Amila, We don’t really have anything like this right now. Sachin is working on a new approach to data management which might help by allowing users to upload files directly to a data store and then selecting those files when configuring an experiment. Would that suffice? That’s a little

Re: Facility to upload large files to a cluster

com<mailto:thejaka.am...@gmail.com>> wrote: Hi Marcus, Thank you for the reply. I need to get the large file into the cluster. Does uploading file to data storage means it will be available in the cluster? If so, it is sufficient for me. Regards -Thejaka On Mon, Apr 16, 2018 at 11:43 AM, Christie,

Re: 0.17 release preparation

+1 On Oct 18, 2018, at 11:01 AM, DImuthu Upeksha mailto:dimuthu.upeks...@gmail.com>> wrote: +1 On Wed, Oct 17, 2018 at 11:10 PM Suresh Marru mailto:sma...@apache.org>> wrote: Hi All, I am going to make some commits to master branch directly (violating our normal process of first getting it

Re: issue facing with ansible-playbook, [UNREACHABLE]

Prashant, For some reason Ansible isn't discovering "ansible_default_ipv4" for that host. You can try to see what it is discovering by running: ansible -i inventories/standalone -m setup 149.165.170.53 Please also file an issue in Jira: https://issues.apache.org/jira/projects/AIRAVATA

Re: facing issue when trying to create docker image of Airavata

Prashant, When the airavata server starts it creates two log files, output.log and airavata.log. output.log has stdout/stderr and airavata.log has the main application logs of airavata. You might check both places. I'm guessing that the api server is encountering an error and then exiting

Re: Achieve the Pre-Data Staging and explore ways to reduce the data transfer between the compute resource and airavata server

Flow Diagram for this approach (Please find the attached if not viewable in email). Please include the comments over this approach. Regards Karan Kotabagi School of Informatics and Computing Indiana University, Bloomington From: Christie, Marcus Aaron mailto:machr...@iu.edu>> Sent: Wednesday, Octobe

Re: error while trying to run airavata server

Hi Prashant, Is the database running and listening on port 3306? > On Oct 29, 2018, at 5:25 PM, Modak, Prashant Kumar wrote: > > Hi, > I have found the root cause of the issue, > ** > Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to >

Re: Achieve the Pre-Data Staging and explore ways to reduce the data transfer between the compute resource and airavata server

Hi Karan, Sorry for taking so long to get back to you. You can call the registerDataProduct method to register the file and its location and this will return the product URI. On Sep 25, 2018, at 9:35 AM, Kotabagi, Karan mailto:kkota...@iu.edu>> wrote: Hi Dev, As we are working on this and

Re: User Defined Workflow Execution Framework

On Sep 8, 2018, at 9:11 AM, Yasas Gunarathne mailto:yasasgunarat...@gmail.com>> wrote: To represent workflow application -> process relationship, it is required to fill the experiment_id field of the process with a null and then add an entry to an intermediate table to keep the above

Re: User Defined Workflow Execution Framework

On Sep 20, 2018, at 12:15 AM, Yasas Gunarathne mailto:yasasgunarat...@gmail.com>> wrote: In the beginning, I tried to use the current ExperimentModel to implement workflows since it has workflow related characteristics as you have mentioned. It seemed to be designed at first keeping the

For the gateway architectures course: demo of integrating Keycloak with Django

Hi Dev, For the Science Gateways Architecture course [0] I put together a simple little Django web application [1] that demonstrates the concepts of OAuth2 and OpenID Connect by integrating with Keycloak. See the README.md which describes how to run Keycloak in a Docker container and how to

Re: Metascheduler work

Hi Dimuthu, > On Dec 17, 2018, at 9:55 AM, DImuthu Upeksha > wrote: > > Metascheduling Usecase 3: Users within a gateway need to fairly use a > community account. Computational resources like XSEDE enforce fair-share > across users, but since gateway job submissions are funneled through a

Re: Unused modules

Hi Dimuthu, Thanks for cleaning things up! However, I'm pretty sure we're still using db-event-manager to manage our event-based synchronization between Airavata services. The rest looks good to be removed though. Thanks, Marcus > On Dec 10, 2018, at 1:08 AM, DImuthu Upeksha > wrote: >

Re: Unused modules

830628> > > Thanks, > Dimuthu > > On Wed, Dec 12, 2018 at 6:22 AM Christie, Marcus Aaron <mailto:machr...@iu.edu>> wrote: > Hi Dimuthu, > > Thanks for cleaning things up! However, I'm pretty sure we're still using > db-event-manager to manage our e

Re: Unused modules

;https://github.com/apache/airavata/commit/78a22163a39a9985d34fa635754ebf9064ee8305> > On Mon, Dec 17, 2018 at 8:51 AM Christie, Marcus Aaron <mailto:machr...@iu.edu>> wrote: > Hi Dimuthu, > > Yes, it's loaded at runtime. See the db_event_manager property in > airavata-server.properties.

TenantProfile proposal

Hi Dev, A week or so ago, Suresh, Dimuthu and I met to discuss what to do with GatewayResourceProfile [0] now that we have the new GroupResourceProfile (on the develop branch). We decided to basically deprecate GatewayResourceProfile and move anything in it that is still needed to a new

Re: TenantProfile proposal

rovide ways for group heads/PIs to be able to look at usage from all users in any group they create/responsible for. But that can be handled by other functions. Sudhakar. On Sep 12, 2018, at 4:39 PM, Christie, Marcus Aaron mailto:machr...@iu.edu>> wrote: Hi Dev, A week or so ago, Suresh, D

Re: TenantProfile proposal

should be not invoked for those. Thanks, Sudhakar. On Sep 18, 2018, at 3:52 PM, Christie, Marcus Aaron mailto:machr...@iu.edu>> wrote: Thanks Sudhakar. One quick question, is the gateway id reported ever different for some compute resources than others? That is, would all of the resource

GSoC ideas for the Airavata Django Portal

Hi All, I've added some GSoC ideas for the Airavata Django Portal to Jira: * User data storage management [1] * Custos Django Admin Portal [2] * Integrate JupyterHub with Airavata Django Portal [3] * General plotting capabilities of experiment outputs [4] Thanks, Marcus [1]

  1   2   3   >