Re: questions regarding dashboards to get quick statistics

[saurav kumar jha]

Hi Community,
I have added an implementation of the handler for getCpuUsages.
The commit is updated in the same PR
.

Thanks & Regards,
Saurav Kumar Jha

On Thu, Aug 24, 2023 at 2:47 PM saurav kumar jha <
imsauravgaurav...@gmail.com> wrote:

> Hi Marcus,
> Thankyou for the response.
>
> I am working on this, I added a method for getting cpu usage.
> implementation of the handler is to be done.
>
> Thanks & Regards,
> Saurav Kumar Jha
>
> On Mon, Aug 14, 2023 at 10:03 PM Christie, Marcus Aaron 
> wrote:
>
>> Hi Saurav,
>>
>> This is a little tricky to answer. I believe what you would need to do is
>> look at JOB_STATUS table for a given experiment/process. There will be a
>> SUBMITTED status, an ACTIVE status and then either a COMPLETED or FAILED or
>> CANCELED status.
>>
>> You would want to get the time different between the ACTIVE and the
>> COMPLETED/FAILED/CANCELED status. This would give the elapsed time of the
>> job.
>>
>> Then you would need to multiple this time, in hours, with the number of
>> cpus used in the job (USER_CONFIGURATION_DATA.TOTAL_CPU_COUNT).
>>
>> Someone on the list might have a better idea, but I think that's the
>> general gist of how you would get cpu hours used.
>>
>> Thanks,
>>
>> Marcus
>>
>> > On Aug 13, 2023, at 1:52 PM, saurav kumar jha <
>> imsauravgaurav...@gmail.com> wrote:
>> >
>> > Hi Community,
>> > I have a question regarding this jira.
>> >
>> > 10. The total cpu-hours used 1. by a user, 2. sorted, 3. quarterly, 4.
>> plotted over a period of time
>> > 11. The total cpu-hours consumed by application, sorted, quarterly,
>> plotted over a period of time
>> >
>> > These are the two requirements with respect to cpu hours.
>> >
>> > Although the COMPUTE_RESOURCE_SCHEDULING table has some of the
>> information, I couldn't find any table which stores cpu hours used
>> information.
>> >
>> > Can anyone please tell me where I can get this info?
>> >
>> > Thanks & Regards,
>> > Saurav Kumar Jha
>>
>>

Re: questions regarding dashboards to get quick statistics

[saurav kumar jha]

Hi Marcus,
Thankyou for the response.

I am working on this, I added a method for getting cpu usage.
implementation of the handler is to be done.

Thanks & Regards,
Saurav Kumar Jha

On Mon, Aug 14, 2023 at 10:03 PM Christie, Marcus Aaron 
wrote:

> Hi Saurav,
>
> This is a little tricky to answer. I believe what you would need to do is
> look at JOB_STATUS table for a given experiment/process. There will be a
> SUBMITTED status, an ACTIVE status and then either a COMPLETED or FAILED or
> CANCELED status.
>
> You would want to get the time different between the ACTIVE and the
> COMPLETED/FAILED/CANCELED status. This would give the elapsed time of the
> job.
>
> Then you would need to multiple this time, in hours, with the number of
> cpus used in the job (USER_CONFIGURATION_DATA.TOTAL_CPU_COUNT).
>
> Someone on the list might have a better idea, but I think that's the
> general gist of how you would get cpu hours used.
>
> Thanks,
>
> Marcus
>
> > On Aug 13, 2023, at 1:52 PM, saurav kumar jha <
> imsauravgaurav...@gmail.com> wrote:
> >
> > Hi Community,
> > I have a question regarding this jira.
> >
> > 10. The total cpu-hours used 1. by a user, 2. sorted, 3. quarterly, 4.
> plotted over a period of time
> > 11. The total cpu-hours consumed by application, sorted, quarterly,
> plotted over a period of time
> >
> > These are the two requirements with respect to cpu hours.
> >
> > Although the COMPUTE_RESOURCE_SCHEDULING table has some of the
> information, I couldn't find any table which stores cpu hours used
> information.
> >
> > Can anyone please tell me where I can get this info?
> >
> > Thanks & Regards,
> > Saurav Kumar Jha
>
>

Re: questions regarding dashboards to get quick statistics

[Christie, Marcus Aaron]

Hi Saurav,

This is a little tricky to answer. I believe what you would need to do is look 
at JOB_STATUS table for a given experiment/process. There will be a SUBMITTED 
status, an ACTIVE status and then either a COMPLETED or FAILED or CANCELED 
status.

You would want to get the time different between the ACTIVE and the 
COMPLETED/FAILED/CANCELED status. This would give the elapsed time of the job.

Then you would need to multiple this time, in hours, with the number of cpus 
used in the job (USER_CONFIGURATION_DATA.TOTAL_CPU_COUNT).

Someone on the list might have a better idea, but I think that's the general 
gist of how you would get cpu hours used.

Thanks,

Marcus

> On Aug 13, 2023, at 1:52 PM, saurav kumar jha  
> wrote:
> 
> Hi Community,
> I have a question regarding this jira.
> 
> 10. The total cpu-hours used 1. by a user, 2. sorted, 3. quarterly, 4. 
> plotted over a period of time
> 11. The total cpu-hours consumed by application, sorted, quarterly, plotted 
> over a period of time
> 
> These are the two requirements with respect to cpu hours. 
> 
> Although the COMPUTE_RESOURCE_SCHEDULING table has some of the information, I 
> couldn't find any table which stores cpu hours used information.
> 
> Can anyone please tell me where I can get this info? 
> 
> Thanks & Regards,
> Saurav Kumar Jha



smime.p7s
Description: S/MIME cryptographic signature

Re: questions regarding dashboards to get quick statistics.

[saurav kumar jha]

Hi Everyone,
I have a few questions related to this jira
<https://issues.apache.org/jira/browse/AIRAVATA-3594>

   1. Currently Airavata Django Portal has a tab (left navigation menu)
   named Experiment Statistics.
   There are requirements for user related statistics and resources related
   statistics.
   Should we introduce two more tabs with name user statistics and resource
   statistics? or should we show all statistics in the existing Experiment
   Statistics tab?

   2. For visualizations (charts, graphs etc) should we use Apache Superset
   or some other library?

   If superset then, I think currently Airavata projects are not using
   superset, so we need to set it up.
   I don't have a complete idea but
   option a.)  As Superset needs to communicate directly with Database,
   should we run Superset on airavata backend in a separate container? and
   show it in the airavata django portal using i-frames?
   option b.) OR, should we run Superset on Airavata django portal, connect
   it with sqlite db and build some pipeline to fetch data and store it in
   sqlite.
   option c.)  Can superset use data fetched using rest api instead of
   directly connecting to db? I couldn't find anything for this.

   If not superset then which library should we use? Can we use vue
   chart.js?


Thanks & Regards,
Saurav Kumar Jha

On Wed, Jun 14, 2023 at 9:25 PM saurav kumar jha <
imsauravgaurav...@gmail.com> wrote:

> Thanks a lot Marcus.
> Your last tip of getting into error producing directory and doing a clean
> install was super helpful in resolving errors !
>
> Now, APIServer and Django-portal are working great locally.
>
> Thanks & Regards,
> Saurav Kumar Jha
>
>
> On Wed, Jun 14, 2023 at 12:26 AM Christie, Marcus Aaron 
> wrote:
>
>> Hi Saurav,
>>
>>
>>
>> Yeah, I’ve seen this issue where it takes a few tries to get it to work.
>> What I would suggest is that you see what Entities aren’t enhanced, then go
>> into that module and do a “mvn install -DskipTests” in just that module and
>> try again.
>>
>>
>>
>> For example, if ExperimentEntity isn’t enhanced, go into
>> modules/registry/registry-core and run “mvn install -DskipTests”.
>>
>>
>>
>> That will be faster than rebuilding the whole thing. But again, you might
>> have to do it a couple of times.
>>
>>
>>
>> *From: *saurav kumar jha 
>> *Date: *Monday, June 12, 2023 at 10:45 PM
>> *To: *Christie, Marcus Aaron 
>> *Cc: *dev@airavata.apache.org 
>> *Subject: *Re: questions regarding dashboards to get quick statistics.
>>
>> Hi Marcus,
>>
>> I turned off the Autobuild : Enabled option.
>>
>> Did a clean install, cloned the repo again but getting the same openJpa
>> error  in all cases.
>>
>>
>>
>> Thanks & Regards,
>>
>> Saurav Kumar Jha
>>
>>
>>
>>
>>
>>
>>
>> On Tue, Jun 13, 2023 at 2:08 AM Christie, Marcus Aaron 
>> wrote:
>>
>> Hi Saurav,
>>
>> > On Jun 11, 2023, at 10:15 AM, saurav kumar jha <
>> imsauravgaurav...@gmail.com> wrote:
>> >
>> > I use VS Code ide but I couldn't find any option "Auto Build" . It will
>> be very helpful if you can elaborate on where I can find this option.
>> >
>>
>> Go into Settings, and search for "Auto Build". Turn off the "Java >
>> Autobuild: Enabled" option.
>>
>>

Re: questions regarding dashboards to get quick statistics.

[saurav kumar jha]

Thanks a lot Marcus.
Your last tip of getting into error producing directory and doing a clean
install was super helpful in resolving errors !

Now, APIServer and Django-portal are working great locally.

Thanks & Regards,
Saurav Kumar Jha


On Wed, Jun 14, 2023 at 12:26 AM Christie, Marcus Aaron 
wrote:

> Hi Saurav,
>
>
>
> Yeah, I’ve seen this issue where it takes a few tries to get it to work.
> What I would suggest is that you see what Entities aren’t enhanced, then go
> into that module and do a “mvn install -DskipTests” in just that module and
> try again.
>
>
>
> For example, if ExperimentEntity isn’t enhanced, go into
> modules/registry/registry-core and run “mvn install -DskipTests”.
>
>
>
> That will be faster than rebuilding the whole thing. But again, you might
> have to do it a couple of times.
>
>
>
> *From: *saurav kumar jha 
> *Date: *Monday, June 12, 2023 at 10:45 PM
> *To: *Christie, Marcus Aaron 
> *Cc: *dev@airavata.apache.org 
> *Subject: *Re: questions regarding dashboards to get quick statistics.
>
> Hi Marcus,
>
> I turned off the Autobuild : Enabled option.
>
> Did a clean install, cloned the repo again but getting the same openJpa
> error  in all cases.
>
>
>
> Thanks & Regards,
>
> Saurav Kumar Jha
>
>
>
>
>
>
>
> On Tue, Jun 13, 2023 at 2:08 AM Christie, Marcus Aaron 
> wrote:
>
> Hi Saurav,
>
> > On Jun 11, 2023, at 10:15 AM, saurav kumar jha <
> imsauravgaurav...@gmail.com> wrote:
> >
> > I use VS Code ide but I couldn't find any option "Auto Build" . It will
> be very helpful if you can elaborate on where I can find this option.
> >
>
> Go into Settings, and search for "Auto Build". Turn off the "Java >
> Autobuild: Enabled" option.
>
>

Re: questions regarding dashboards to get quick statistics.

[Christie, Marcus Aaron]

Hi Saurav, 

Yeah, I’ve seen this issue where it takes a few tries to get it to work. What I 
would suggest is that you see what Entities aren’t enhanced, then go into that 
module and do a “mvn install -DskipTests” in just that module and try again. 

For example, if ExperimentEntity isn’t enhanced, go into 
modules/registry/registry-core and run “mvn install -DskipTests”. 

That will be faster than rebuilding the whole thing. But again, you might have 
to do it a couple of times. 

From: saurav kumar jha 
Date: Monday, June 12, 2023 at 10:45 PM
To: Christie, Marcus Aaron 
Cc: dev@airavata.apache.org 
Subject: Re: questions regarding dashboards to get quick statistics. 

Hi Marcus, 
I turned off the Autobuild : Enabled option. 

Did a clean install, cloned the repo again but getting the same openJpa error 
in all cases. 



Thanks & Regards, 

Saurav Kumar Jha 







On Tue, Jun 13, 2023 at 2:08 AM Christie, Marcus Aaron mailto:machr...@iu.edu>> wrote: 

Hi Saurav,

> On Jun 11, 2023, at 10:15 AM, saurav kumar jha  <_blank>> wrote:
> 
> I use VS Code ide but I couldn't find any option "Auto Build" . It will be 
> very helpful if you can elaborate on where I can find this option.
> 

Go into Settings, and search for "Auto Build". Turn off the "Java > Autobuild: 
Enabled" option. 






smime.p7s
Description: S/MIME cryptographic signature

Re: questions regarding dashboards to get quick statistics.

[saurav kumar jha]

Hi Marcus,
I turned off the Autobuild : Enabled option.
Did a clean install, cloned the repo again but getting the same openJpa
error  in all cases.

Thanks & Regards,
Saurav Kumar Jha



On Tue, Jun 13, 2023 at 2:08 AM Christie, Marcus Aaron 
wrote:

> Hi Saurav,
>
> > On Jun 11, 2023, at 10:15 AM, saurav kumar jha <
> imsauravgaurav...@gmail.com> wrote:
> >
> > I use VS Code ide but I couldn't find any option "Auto Build" . It will
> be very helpful if you can elaborate on where I can find this option.
> >
>
> Go into Settings, and search for "Auto Build". Turn off the "Java >
> Autobuild: Enabled" option.

Re: questions regarding dashboards to get quick statistics.

[Christie, Marcus Aaron]

Hi Saurav,

> On Jun 11, 2023, at 10:15 AM, saurav kumar jha  
> wrote:
> 
> I use VS Code ide but I couldn't find any option "Auto Build" . It will be 
> very helpful if you can elaborate on where I can find this option.
> 

Go into Settings, and search for "Auto Build". Turn off the "Java > Autobuild: 
Enabled" option.

smime.p7s
Description: S/MIME cryptographic signature

Re: questions regarding dashboards to get quick statistics.

[saurav kumar jha]

Error thrown on running
/modules/ide-integration/src/main/java/org/apache/airavata/ide/integration/
*APIServerStarter.java*

[main] ERROR
org.apache.airavata.registry.core.repositories.AbstractRepository {} -
Failed to get EntityManager
*org.apache.openjpa.persistence.ArgumentException: This configuration
disallows runtime optimization, but the following listed types were not
enhanced at build time or at class load time with a javaagent: "*
org.apache.airavata.registry.core.entities.expcatalog.ExperimentEntity
org.apache.airavata.registry.core.entities.expcatalog.ExperimentStatusEntity
org.apache.airavata.registry.core.entities.expcatalog.UserEntity
org.apache.airavata.registry.core.entities.expcatalog.ProcessStatusEntity
org.apache.airavata.registry.core.entities.expcatalog.ProcessErrorEntity
org.apache.airavata.registry.core.entities.expcatalog.ProcessOutputEntity
org.apache.airavata.registry.core.entities.expcatalog.ProcessWorkflowEntity
org.apache.airavata.registry.core.entities.expcatalog.TaskEntity
org.apache.airavata.registry.core.entities.expcatalog.ProcessResourceScheduleEntity
org.apache.airavata.registry.core.entities.expcatalog.TaskStatusEntity
org.apache.airavata.registry.core.entities.expcatalog.UserConfigurationDataEntity
org.apache.airavata.registry.core.entities.expcatalog.ProcessInputEntity
org.apache.airavata.registry.core.entities.expcatalog.ProcessEntity
org.apache.airavata.registry.core.entities.expcatalog.JobStatusEntity
org.apache.airavata.registry.core.entities.expcatalog.TaskErrorEntity
org.apache.airavata.registry.core.entities.expcatalog.ExperimentOutputEntity
org.apache.airavata.registry.core.entities.expcatalog.ComputationalResourceSchedulingEntity
org.apache.airavata.registry.core.entities.expcatalog.NotificationEntity
org.apache.airavata.registry.core.entities.expcatalog.GatewayEntity
org.apache.airavata.registry.core.entities.expcatalog.JobEntity
org.apache.airavata.registry.core.entities.expcatalog.ExperimentInputEntity
org.apache.airavata.registry.core.entities.expcatalog.ProjectUserEntity
org.apache.airavata.registry.core.entities.expcatalog.ExperimentErrorEntity".
at
org.apache.openjpa.enhance.ManagedClassSubclasser.prepareUnenhancedClasses(ManagedClassSubclasser.java:116)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.openjpa.kernel.AbstractBrokerFactory.loadPersistentTypes(AbstractBrokerFactory.java:316)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.openjpa.kernel.AbstractBrokerFactory.initializeBroker(AbstractBrokerFactory.java:240)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.openjpa.kernel.AbstractBrokerFactory.newBroker(AbstractBrokerFactory.java:216)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.openjpa.kernel.DelegatingBrokerFactory.newBroker(DelegatingBrokerFactory.java:166)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.openjpa.persistence.EntityManagerFactoryImpl.createEntityManager(EntityManagerFactoryImpl.java:262)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.openjpa.persistence.EntityManagerFactoryImpl.createEntityManager(EntityManagerFactoryImpl.java:177)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.openjpa.persistence.EntityManagerFactoryImpl.createEntityManager(EntityManagerFactoryImpl.java:167)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.openjpa.persistence.EntityManagerFactoryImpl.createEntityManager(EntityManagerFactoryImpl.java:64)
~[openjpa-3.1.0.jar:3.1.0]
at
org.apache.airavata.registry.core.utils.JPAUtil.ExpCatalogJPAUtils.getEntityManager(ExpCatalogJPAUtils.java:35)
~[classes/:?]
at
org.apache.airavata.registry.core.repositories.expcatalog.ExpCatAbstractRepository.getEntityManager(ExpCatAbstractRepository.java:16)
~[classes/:?]
at
org.apache.airavata.registry.core.repositories.AbstractRepository.execute(AbstractRepository.java:134)
~[classes/:?]
at
org.apache.airavata.registry.core.repositories.AbstractRepository.get(AbstractRepository.java:75)
~[classes/:?]
at
org.apache.airavata.registry.core.repositories.AbstractRepository.isExists(AbstractRepository.java:113)
~[classes/:?]
at
org.apache.airavata.registry.core.repositories.expcatalog.GatewayRepository.isGatewayExist(GatewayRepository.java:99)
~[classes/:?]
at
org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:62)
~[classes/:?]
at
org.apache.airavata.common.utils.DBInitializer.initializeDB(DBInitializer.java:46)
~[classes/:?]
at
org.apache.airavata.registry.api.service.RegistryAPIServer.StartRegistryServer(RegistryAPIServer.java:69)
~[classes/:?]
at
org.apache.airavata.registry.api.service.RegistryAPIServer.start(RegistryAPIServer.java:151)
~[classes/:?]
at
org.apache.airavata.ide.integration.APIServerStarter.main(APIServerStarter.java:23)
~[classes/:?]
Exception in thread "main" java.lang.RuntimeException: Failed to
post-initialize the expcatalog database
at
org.apache.airavata.registry.core.utils.ExpCatalogDBInitC

Re: questions regarding dashboards to get quick statistics.

[saurav kumar jha]

Hi Marcus,
Thanks a lot for the responses.

1. Now I am not getting any issues from Airavata-Django-Portal.
*airavata.host* was somehow removed from /etc/hosts. After adding it
doesn't give ssl version related error. but login still fails saying
 Login failed: Could not connect to any of [('127.0.0.1', 8962)]. Please
try again.

and workspace/dashboard gives the following error:
Could not connect to any of [('127.0.0.1', 9930)]

API Server is down.
 Checking status ...
2. I am still not able to run APIServerStarter.

I ran *mvn clean install -DskipTests *but still had the same error which I
have pasted below.

I use VS Code ide but I couldn't find any option *"Auto Build" *. It will
be very helpful if you can elaborate on where I can find this option.

Thanks & Regards,
Saurav Kumar Jha

On Fri, Jun 9, 2023 at 12:18 AM Christie, Marcus Aaron 
wrote:

> Hi Saurav,
>
> > On Jun 7, 2023, at 10:34 AM, saurav kumar jha <
> imsauravgaurav...@gmail.com> wrote:
> >
> > 2. Fixing 1 fixed the second one as you said. but there is another
> exception related to expcatalog database:
> >
>
> I just went through the instructions to make sure I could bring up the API
> server and django portal locally.
>
> One thing I'll mention, you may want to disable any sort of "auto build"
> option in your IDE (in VS Code it's called "Auto Build"). The reason is
> that the auto build will tend to overwrite the enhanced entity classes.
>
> > Exception in thread "main" java.lang.RuntimeException: Failed to
> post-initialize the expcatalog database
> > at
> org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:81)
> > at
> org.apache.airavata.common.utils.DBInitializer.initializeDB(DBInitializer.java:46)
> > at
> org.apache.airavata.registry.api.service.RegistryAPIServer.StartRegistryServer(RegistryAPIServer.java:69)
> > at
> org.apache.airavata.registry.api.service.RegistryAPIServer.start(RegistryAPIServer.java:151)
> > at
> org.apache.airavata.ide.integration.APIServerStarter.main(APIServerStarter.java:23)
> > Caused by: java.lang.RuntimeException: Failed to get EntityManager
> > at
> org.apache.airavata.registry.core.repositories.AbstractRepository.execute(AbstractRepository.java:137)
> > at
> org.apache.airavata.registry.core.repositories.AbstractRepository.get(AbstractRepository.java:75)
> > at
> org.apache.airavata.registry.core.repositories.AbstractRepository.isExists(AbstractRepository.java:113)
> > at
> org.apache.airavata.registry.core.repositories.expcatalog.GatewayRepository.isGatewayExist(GatewayRepository.java:99)
> > at
> org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:62)
> > ... 4 more
> > Caused by:  nonfatal user error> org.apache.openjpa.persistence.ArgumentException: This
> configuration disallows runtime optimization, but the following listed
> types were not enhanced at build time or at class load time with a
> javaagent: "
> >
> > 3. I copied the django_airavata/settings_local.py.ide to my
> settings_local.py file and still the issue exists. I have attached the
> settings_local.py file with this email.
> >
>
> I was able to use the settings_local.py.ide successfully. If you are still
> getting errors after fixing #2 above, then make sure you are using a Python
> version from 3.6 to 3.10.
>
> Thanks,
>
> Marcus

Re: questions regarding dashboards to get quick statistics.

[Christie, Marcus Aaron]

Hi Saurav,

> On Jun 7, 2023, at 10:34 AM, saurav kumar jha  
> wrote:
> 
> 2. Fixing 1 fixed the second one as you said. but there is another exception 
> related to expcatalog database:
> 

I just went through the instructions to make sure I could bring up the API 
server and django portal locally.

One thing I'll mention, you may want to disable any sort of "auto build" option 
in your IDE (in VS Code it's called "Auto Build"). The reason is that the auto 
build will tend to overwrite the enhanced entity classes.

> Exception in thread "main" java.lang.RuntimeException: Failed to 
> post-initialize the expcatalog database
> at 
> org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:81)
> at 
> org.apache.airavata.common.utils.DBInitializer.initializeDB(DBInitializer.java:46)
> at 
> org.apache.airavata.registry.api.service.RegistryAPIServer.StartRegistryServer(RegistryAPIServer.java:69)
> at 
> org.apache.airavata.registry.api.service.RegistryAPIServer.start(RegistryAPIServer.java:151)
> at 
> org.apache.airavata.ide.integration.APIServerStarter.main(APIServerStarter.java:23)
> Caused by: java.lang.RuntimeException: Failed to get EntityManager
> at 
> org.apache.airavata.registry.core.repositories.AbstractRepository.execute(AbstractRepository.java:137)
> at 
> org.apache.airavata.registry.core.repositories.AbstractRepository.get(AbstractRepository.java:75)
> at 
> org.apache.airavata.registry.core.repositories.AbstractRepository.isExists(AbstractRepository.java:113)
> at 
> org.apache.airavata.registry.core.repositories.expcatalog.GatewayRepository.isGatewayExist(GatewayRepository.java:99)
> at 
> org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:62)
> ... 4 more
> Caused by:  user error> org.apache.openjpa.persistence.ArgumentException: This 
> configuration disallows runtime optimization, but the following listed types 
> were not enhanced at build time or at class load time with a javaagent: "
> 
> 3. I copied the django_airavata/settings_local.py.ide to my settings_local.py 
> file and still the issue exists. I have attached the settings_local.py file 
> with this email.
> 

I was able to use the settings_local.py.ide successfully. If you are still 
getting errors after fixing #2 above, then make sure you are using a Python 
version from 3.6 to 3.10.

Thanks,

Marcus

smime.p7s
Description: S/MIME cryptographic signature

Re: questions regarding dashboards to get quick statistics.

[Christie, Marcus Aaron]

Hi Saurav,

> On Jun 7, 2023, at 10:34 AM, saurav kumar jha  
> wrote:
> 
> Hi Marcus,
> Thanks for the help!
> 1. Applying database migrations worked as you said to look at running 
> containers using docker ps  I observed that the name of the container was  
> containers_db_1 and not containers-db-1 as shown in documentation here. I 
> think we can update it in documentation.

What version of docker-compose are you using? v2 names containers with hyphens 
whereas v1 uses underscores. I suspect you are using version 1 of docker 
compose. I would recommend version 2.

We should then update the documentation to clarify either way.

> 
> 2. Fixing 1 fixed the second one as you said. but there is another exception 
> related to expcatalog database:
> 
> Exception in thread "main" java.lang.RuntimeException: Failed to 
> post-initialize the expcatalog database
> at 
> org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:81)
> at 
> org.apache.airavata.common.utils.DBInitializer.initializeDB(DBInitializer.java:46)
> at 
> org.apache.airavata.registry.api.service.RegistryAPIServer.StartRegistryServer(RegistryAPIServer.java:69)
> at 
> org.apache.airavata.registry.api.service.RegistryAPIServer.start(RegistryAPIServer.java:151)
> at 
> org.apache.airavata.ide.integration.APIServerStarter.main(APIServerStarter.java:23)
> Caused by: java.lang.RuntimeException: Failed to get EntityManager
> at 
> org.apache.airavata.registry.core.repositories.AbstractRepository.execute(AbstractRepository.java:137)
> at 
> org.apache.airavata.registry.core.repositories.AbstractRepository.get(AbstractRepository.java:75)
> at 
> org.apache.airavata.registry.core.repositories.AbstractRepository.isExists(AbstractRepository.java:113)
> at 
> org.apache.airavata.registry.core.repositories.expcatalog.GatewayRepository.isGatewayExist(GatewayRepository.java:99)
> at 
> org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:62)
> ... 4 more
> Caused by:  user error> org.apache.openjpa.persistence.ArgumentException: This 
> configuration disallows runtime optimization, but the following listed types 
> were not enhanced at build time or at class load time with a javaagent: "
> 


You need to run `mvn clean install -DskipTests` first as described in the 
README which will instrument the openjpa entities. You pretty much always have 
to rerun the build before starting the API server.

> 3. I copied the django_airavata/settings_local.py.ide to my settings_local.py 
> file and still the issue exists. I have attached the settings_local.py file 
> with this email.
> 

Yeah, your settings_local.py file looks fine. Do you have airavata.host in your 
/etc/hosts?

Thanks,

Marcus



smime.p7s
Description: S/MIME cryptographic signature

Re: questions regarding dashboards to get quick statistics.

[saurav kumar jha]

Hi Marcus,
Thanks for the help!
1. Applying database migrations worked as you said to look at running
containers using *docker ps  *I observed that the name of the container
was  containers_db_1 and not containers-db-1 as shown in documentation here
.
I think we can update it in documentation.

2. Fixing 1 fixed the second one as you said. but there is another
exception related to *expcatalog database*:

Exception in thread "main" java.lang.RuntimeException: Failed to
post-initialize the expcatalog database
at
org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:81)
at
org.apache.airavata.common.utils.DBInitializer.initializeDB(DBInitializer.java:46)
at
org.apache.airavata.registry.api.service.RegistryAPIServer.StartRegistryServer(RegistryAPIServer.java:69)
at
org.apache.airavata.registry.api.service.RegistryAPIServer.start(RegistryAPIServer.java:151)
at
org.apache.airavata.ide.integration.APIServerStarter.main(APIServerStarter.java:23)
Caused by: java.lang.RuntimeException: Failed to get EntityManager
at
org.apache.airavata.registry.core.repositories.AbstractRepository.execute(AbstractRepository.java:137)
at
org.apache.airavata.registry.core.repositories.AbstractRepository.get(AbstractRepository.java:75)
at
org.apache.airavata.registry.core.repositories.AbstractRepository.isExists(AbstractRepository.java:113)
at
org.apache.airavata.registry.core.repositories.expcatalog.GatewayRepository.isGatewayExist(GatewayRepository.java:99)
at
org.apache.airavata.registry.core.utils.ExpCatalogDBInitConfig.postInit(ExpCatalogDBInitConfig.java:62)
... 4 more
Caused by:  org.apache.openjpa.persistence.ArgumentException: This
configuration disallows runtime optimization, but the following listed
types were not enhanced at build time or at class load time with a
javaagent: "

3. I copied the *django_airavata/settings_local.py.ide* to my
*settings_local.py* file and still the issue exists. I have attached the
settings_local.py file with this email.

Thanks & Regards,
Saurav Kumar Jha

On Wed, Jun 7, 2023 at 3:18 AM Christie, Marcus Aaron 
wrote:

>
> Hi Saurav,
>
> > On Jun 6, 2023, at 12:51 PM, saurav kumar jha <
> imsauravgaurav...@gmail.com> wrote:
> >
> > 1. While Following the steps mentioned at below link:
> > airavata/README.md at develop · apache/airavata · GitHub
> >
> > Apply any database migrations. Go to src/main/containers directory
> and run
> >cat ./database_scripts/init/*-migrations.sql | docker exec -i
> containers-db-1 mysql -p123456
> >
> >Above command produces following error:
> >Error response from daemon: No such container: containers-db-1
> >
>
>
> You need to run docker-compose up first. Make sure that the
> 'containers-db-1' container is running, maybe by doing 'docker ps'.
>
> > 2. Running the APIServerStarter produces following error:
> >
> > Caused by: org.apache.openjpa.persistence.ArgumentException: Table
> "COMPUTE_RESOURCE_SCHEDULING" given for
> "org.apache.airavata.registry.core.entities.expcatalog.ComputationalResourceSchedulingEntity"
> does not exist.
> >
>
> Fixing #1 will fix this one.
>
> > 3. Running Django-Portal works and app frontend is loaded but when I try
> to login, it gives SSL version related error:
> >
> >
>
> I'm not sure about this one. Did you use the
> django_airavata/settings_local.py.ide as your settings_local.py file? If
> you are still having issues, please share your settings_local.py file.
"""
Override default Django settings for a particular instance.

Copy this file to settings_local.py and modify as appropriate. This file will
be imported into settings.py last of all so settings in this file override any
defaults specified in settings.py.
"""

import os

# Build paths inside the project like this: os.path.join(BASE_DIR, ...)
BASE_DIR = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))

# Django - general settings
# Uncomment and specify for production deployments
# DEBUG = False
# STATIC_ROOT = "/var/www/path/to/sitename/static/"
# ALLOWED_HOSTS = ['production.hostname']

# Django - Email settings
# Uncomment and specify the following for sending emails (default email backend
# just prints to the console)
# EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend'
# EMAIL_HOST = '...'
# EMAIL_PORT = '...'
# EMAIL_HOST_USER = '...'
# EMAIL_HOST_PASSWORD = '...'
# EMAIL_USE_TLS = True
ADMINS = [('Admin Name', 'ad...@example.com')]
# PORTAL_ADMINS receive administrative emails, like when a new user is created
# This can be set to a different value than ADMINS so that the PORTAL_ADMINS
# don't receive error emails
PORTAL_ADMINS = ADMINS
# SERVER_EMAIL = 'por...@example.com'

# Keycloak Configuration
KEYCLOAK_CLIENT_ID = 'pga'
KEYCLOAK_CLIENT_SEC

Re: questions regarding dashboards to get quick statistics.

[Christie, Marcus Aaron]

Hi Saurav,

> On Jun 6, 2023, at 12:51 PM, saurav kumar jha  
> wrote:
> 
> 1. While Following the steps mentioned at below link:
> airavata/README.md at develop · apache/airavata · GitHub
> 
> Apply any database migrations. Go to src/main/containers directory and run
>cat ./database_scripts/init/*-migrations.sql | docker exec -i 
> containers-db-1 mysql -p123456
> 
>Above command produces following error:
>Error response from daemon: No such container: containers-db-1
> 


You need to run docker-compose up first. Make sure that the 'containers-db-1' 
container is running, maybe by doing 'docker ps'.

> 2. Running the APIServerStarter produces following error:
> 
> Caused by: org.apache.openjpa.persistence.ArgumentException: Table 
> "COMPUTE_RESOURCE_SCHEDULING" given for 
> "org.apache.airavata.registry.core.entities.expcatalog.ComputationalResourceSchedulingEntity"
>  does not exist.
> 

Fixing #1 will fix this one.

> 3. Running Django-Portal works and app frontend is loaded but when I try to 
> login, it gives SSL version related error:
> 
> 

I'm not sure about this one. Did you use the 
django_airavata/settings_local.py.ide as your settings_local.py file? If you 
are still having issues, please share your settings_local.py file.

smime.p7s
Description: S/MIME cryptographic signature

Re: questions regarding dashboards to get quick statistics.

[saurav kumar jha]

Hi Everyone,
Thanks for your responses.

I am having problems running airavata locally. Please help me solve these
issues.

1. While Following the steps mentioned at below link:
airavata/README.md at develop · apache/airavata · GitHub


Apply any database migrations. Go to src/main/containers directory and
run
   cat ./database_scripts/init/*-migrations.sql | docker exec -i
containers-db-1 mysql -p123456

   Above command produces following error:
   Error response from daemon: No such container: containers-db-1

2. Running the APIServerStarter produces following error:

Caused by: org.apache.openjpa.persistence.ArgumentException: Table
"COMPUTE_RESOURCE_SCHEDULING" given for
"org.apache.airavata.registry.core.entities.expcatalog.ComputationalResourceSchedulingEntity"
does not exist.

3. Running Django-Portal works and app frontend is loaded but when I try to
login, it gives SSL version related error:

[2023-06-06 16:04:15,715 django_airavata.apps.auth.backends:90 WARNING]
login failed
Traceback (most recent call last):
  File
"/home/mysauravnitw2019/code/airavata-django-portal/venv/lib/python3.9/site-packages/urllib3/connectionpool.py",
line 714, in urlopen
httplib_response = self._make_request(
  File
"/home/mysauravnitw2019/code/airavata-django-portal/venv/lib/python3.9/site-packages/urllib3/connectionpool.py",
line 403, in _make_request
self._validate_conn(conn)
  File
"/home/mysauravnitw2019/code/airavata-django-portal/venv/lib/python3.9/site-packages/urllib3/connectionpool.py",
line 1053, in _validate_conn
conn.connect()
  File
"/home/mysauravnitw2019/code/airavata-django-portal/venv/lib/python3.9/site-packages/urllib3/connection.py",
line 419, in connect
self.sock = ssl_wrap_socket(
  File
"/home/mysauravnitw2019/code/airavata-django-portal/venv/lib/python3.9/site-packages/urllib3/util/ssl_.py",
line 449, in ssl_wrap_socket
ssl_sock = _ssl_wrap_socket_impl(
  File
"/home/mysauravnitw2019/code/airavata-django-portal/venv/lib/python3.9/site-packages/urllib3/util/ssl_.py",
line 493, in _ssl_wrap_socket_impl
return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/lib/python3.9/ssl.py", line 501, in wrap_socket
return self.sslsocket_class._create(
  File "/usr/lib/python3.9/ssl.py", line 1041, in _create
self.do_handshake()
  File "/usr/lib/python3.9/ssl.py", line 1310, in do_handshake
self._sslobj.do_handshake()
ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1129)


Thanks & Regards,
Saurav Kumar Jha



On Fri, Jun 2, 2023 at 4:44 PM saurav kumar jha 
wrote:

> Hi Lahiru,
> Thanks a lot for the response.
>
> while trying to run Airavata locally on Ubuntu using this command
>  ```docker-compose -f
> modules/ide-integration/src/main/containers/docker-compose.yml -f
> modules/distribution/src/main/docker/docker-compose.yml up```
>
> Email store Authentication related error comes up. I have pasted the log
> below. I have done nothing for authentication nor have I started any db
> separately. All that I am doing is running above command after creating a
> docker image using the steps mentioned in the readme file of Airavata. What
> should I do to fix this?
>
> emailmonitor_1  | 2023-06-02 07:56:34,488 [Thread-0] ERROR
> org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't
> connect to the store
> emailmonitor_1  | javax.mail.AuthenticationFailedException:
> [AUTHENTICATIONFAILED] Invalid credentials (Failure)
> emailmonitor_1  |   at
> com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at javax.mail.Service.connect(Service.java:366)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at javax.mail.Service.connect(Service.java:246)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at
> org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:185)
> ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
> emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
> emailmonitor_1  | 2023-06-02 07:56:34,489 [Thread-0] ERROR
> org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Caught a
> throwable while closing email store
> emailmonitor_1  | java.lang.NullPointerException: null
> emailmonitor_1  |   at
> org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:231)
> ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
> emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
> emailmonitor_1  | 2023-06-02 07:56:35,595 [Thread-0] ERROR
> org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't
> connect to the store
> emailmonitor_1  | javax.mail.AuthenticationFailedException:
> [AUTHENTICATIONFAILED] Invalid credentials (Failure)
> emailmonitor_1  |   at
> co

Re: questions regarding dashboards to get quick statistics.

[Pamidighantam, Sudhakar V]

Saurav:
While you are at it, Please do a pull request for the documentation as well.

Thanks,
Sudhakar.

From: Lahiru Jayathilake 
Date: Sunday, June 4, 2023 at 11:53 AM
To: saurav kumar jha 
Cc: dev@airavata.apache.org , sma...@apache.org 
, Abeysinghe, Eroma 
Subject: Re: questions regarding dashboards to get quick statistics.
Hi Saurav,

The reason for the issue is missing account credentials for email job 
monitoring. To resolve this, follow the instructions in section [1] to create 
an email account. Then, update the 'email.based.monitor.address' and 
'email.based.monitor.password' properties within the 
modules/distribution/src/main/docker/docker-compose.yml file.
This will resolve the issue you're having.

[1] - 
https://github.com/apache/airavata/tree/develop/modules/ide-integration#starting-job-monitoring-components<https://urldefense.com/v3/__https:/github.com/apache/airavata/tree/develop/modules/ide-integration*starting-job-monitoring-components__;Iw!!DZ3fjg!_Pbihslf0F0F8Q8PKFGS_3qeMiruEDXhBNI_7xWbDEupVotcm_HcCPZh2Kboc4uZ59tucI-eRwnBO5qi2cvsfuUOFv-kyw$>

Cheers!
Lahiru

On Fri, Jun 2, 2023 at 4:44 PM saurav kumar jha 
mailto:imsauravgaurav...@gmail.com>> wrote:
Hi Lahiru,
Thanks a lot for the response.
while trying to run Airavata locally on Ubuntu using this command
 ```docker-compose -f 
modules/ide-integration/src/main/containers/docker-compose.yml -f 
modules/distribution/src/main/docker/docker-compose.yml up```
Email store Authentication related error comes up. I have pasted the log below. 
I have done nothing for authentication nor have I started any db separately. 
All that I am doing is running above command after creating a docker image 
using the steps mentioned in the readme file of Airavata. What should I do to 
fix this?

emailmonitor_1  | 2023-06-02 07:56:34,488 [Thread-0] ERROR 
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't 
connect to the store
emailmonitor_1  | javax.mail.AuthenticationFailedException: 
[AUTHENTICATIONFAILED] Invalid credentials (Failure)
emailmonitor_1  |   at 
com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732) 
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:366) 
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:246) 
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at 
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:185)
 ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
emailmonitor_1  | 2023-06-02 07:56:34,489 [Thread-0] ERROR 
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Caught a 
throwable while closing email store
emailmonitor_1  | java.lang.NullPointerException: null
emailmonitor_1  |   at 
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:231)
 ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
emailmonitor_1  | 2023-06-02 07:56:35,595 [Thread-0] ERROR 
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't 
connect to the store
emailmonitor_1  | javax.mail.AuthenticationFailedException: 
[AUTHENTICATIONFAILED] Invalid credentials (Failure)
emailmonitor_1  |   at 
com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732) 
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:366) 
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:246) 
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at 
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:185)
 ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
emailmonitor_1  | 2023-06-02 07:56:35,596 [Thread-0] ERROR 
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Caught a 
throwable while closing email store
emailmonitor_1  | java.lang.NullPointerException: null
emailmonitor_1  |   at 
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:231)
 ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
apiserver_1 | 2023-06-02 07:56:35,753 [main] INFO  
org.apache.airavata.common.utils.ApplicationSettings {} - Settings loaded from 
file:/opt/apache-airavata-api-server/bin/airavata-server.properties
apiserver_1 | Exception in thread "main" 
org.apache.airavata.common.exception.ApplicationSettingsException: 
api.server.monitoring.enabled
apiserver_1 |   at 
org.apache.airavata.common.utils.ApplicationSettings.getSettingImpl(ApplicationSettings.java:196)
apiserver_1 |   at 
org.apache.airavata.common.utils.ApplicationSettings.getBooleanSetting

Re: questions regarding dashboards to get quick statistics.

[Lahiru Jayathilake]

Hi Saurav,

The reason for the issue is missing account credentials for email job
monitoring. To resolve this, follow the instructions in section [1] to
create an email account. Then, update the 'email.based.monitor.address' and
'email.based.monitor.password' properties within the
modules/distribution/src/main/docker/docker-compose.yml file.
This will resolve the issue you're having.

[1] -
https://github.com/apache/airavata/tree/develop/modules/ide-integration#starting-job-monitoring-components

Cheers!
Lahiru

On Fri, Jun 2, 2023 at 4:44 PM saurav kumar jha 
wrote:

> Hi Lahiru,
> Thanks a lot for the response.
>
> while trying to run Airavata locally on Ubuntu using this command
>  ```docker-compose -f
> modules/ide-integration/src/main/containers/docker-compose.yml -f
> modules/distribution/src/main/docker/docker-compose.yml up```
>
> Email store Authentication related error comes up. I have pasted the log
> below. I have done nothing for authentication nor have I started any db
> separately. All that I am doing is running above command after creating a
> docker image using the steps mentioned in the readme file of Airavata. What
> should I do to fix this?
>
> emailmonitor_1  | 2023-06-02 07:56:34,488 [Thread-0] ERROR
> org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't
> connect to the store
> emailmonitor_1  | javax.mail.AuthenticationFailedException:
> [AUTHENTICATIONFAILED] Invalid credentials (Failure)
> emailmonitor_1  |   at
> com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at javax.mail.Service.connect(Service.java:366)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at javax.mail.Service.connect(Service.java:246)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at
> org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:185)
> ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
> emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
> emailmonitor_1  | 2023-06-02 07:56:34,489 [Thread-0] ERROR
> org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Caught a
> throwable while closing email store
> emailmonitor_1  | java.lang.NullPointerException: null
> emailmonitor_1  |   at
> org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:231)
> ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
> emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
> emailmonitor_1  | 2023-06-02 07:56:35,595 [Thread-0] ERROR
> org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't
> connect to the store
> emailmonitor_1  | javax.mail.AuthenticationFailedException:
> [AUTHENTICATIONFAILED] Invalid credentials (Failure)
> emailmonitor_1  |   at
> com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at javax.mail.Service.connect(Service.java:366)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at javax.mail.Service.connect(Service.java:246)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at
> org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:185)
> ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
> emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
> emailmonitor_1  | 2023-06-02 07:56:35,596 [Thread-0] ERROR
> org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Caught a
> throwable while closing email store
> emailmonitor_1  | java.lang.NullPointerException: null
> emailmonitor_1  |   at
> org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:231)
> ~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
> emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
> apiserver_1 | 2023-06-02 07:56:35,753 [main] INFO
> org.apache.airavata.common.utils.ApplicationSettings {} - Settings loaded
> from file:/opt/apache-airavata-api-server/bin/airavata-server.properties
> apiserver_1 | Exception in thread "main"
> org.apache.airavata.common.exception.ApplicationSettingsException:
> api.server.monitoring.enabled
> apiserver_1 |   at
> org.apache.airavata.common.utils.ApplicationSettings.getSettingImpl(ApplicationSettings.java:196)
> apiserver_1 |   at
> org.apache.airavata.common.utils.ApplicationSettings.getBooleanSetting(ApplicationSettings.java:350)
> apiserver_1 |   at
> org.apache.airavata.server.ServerMain.main(ServerMain.java:175)
> emailmonitor_1  | 2023-06-02 07:56:36,848 [Thread-0] ERROR
> org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't
> connect to the store
> emailmonitor_1  | javax.mail.AuthenticationFailedException:
> [AUTHENTICATIONFAILED] Invalid credentials (Failure)
> emailmonitor_1  |   at
> com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732)
> ~[javax.mail-1.6.2.jar:1.6.2]
> emailmonitor_1  |   at javax.mail.Service.conn

Re: questions regarding dashboards to get quick statistics.

[saurav kumar jha]

Hi Lahiru,
Thanks a lot for the response.

while trying to run Airavata locally on Ubuntu using this command
 ```docker-compose -f
modules/ide-integration/src/main/containers/docker-compose.yml -f
modules/distribution/src/main/docker/docker-compose.yml up```

Email store Authentication related error comes up. I have pasted the log
below. I have done nothing for authentication nor have I started any db
separately. All that I am doing is running above command after creating a
docker image using the steps mentioned in the readme file of Airavata. What
should I do to fix this?

emailmonitor_1  | 2023-06-02 07:56:34,488 [Thread-0] ERROR
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't
connect to the store
emailmonitor_1  | javax.mail.AuthenticationFailedException:
[AUTHENTICATIONFAILED] Invalid credentials (Failure)
emailmonitor_1  |   at
com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:366)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:246)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:185)
~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
emailmonitor_1  | 2023-06-02 07:56:34,489 [Thread-0] ERROR
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Caught a
throwable while closing email store
emailmonitor_1  | java.lang.NullPointerException: null
emailmonitor_1  |   at
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:231)
~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
emailmonitor_1  | 2023-06-02 07:56:35,595 [Thread-0] ERROR
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't
connect to the store
emailmonitor_1  | javax.mail.AuthenticationFailedException:
[AUTHENTICATIONFAILED] Invalid credentials (Failure)
emailmonitor_1  |   at
com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:366)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:246)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:185)
~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
emailmonitor_1  | 2023-06-02 07:56:35,596 [Thread-0] ERROR
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Caught a
throwable while closing email store
emailmonitor_1  | java.lang.NullPointerException: null
emailmonitor_1  |   at
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:231)
~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
apiserver_1 | 2023-06-02 07:56:35,753 [main] INFO
org.apache.airavata.common.utils.ApplicationSettings {} - Settings loaded
from file:/opt/apache-airavata-api-server/bin/airavata-server.properties
apiserver_1 | Exception in thread "main"
org.apache.airavata.common.exception.ApplicationSettingsException:
api.server.monitoring.enabled
apiserver_1 |   at
org.apache.airavata.common.utils.ApplicationSettings.getSettingImpl(ApplicationSettings.java:196)
apiserver_1 |   at
org.apache.airavata.common.utils.ApplicationSettings.getBooleanSetting(ApplicationSettings.java:350)
apiserver_1 |   at
org.apache.airavata.server.ServerMain.main(ServerMain.java:175)
emailmonitor_1  | 2023-06-02 07:56:36,848 [Thread-0] ERROR
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Couldn't
connect to the store
emailmonitor_1  | javax.mail.AuthenticationFailedException:
[AUTHENTICATIONFAILED] Invalid credentials (Failure)
emailmonitor_1  |   at
com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:732)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:366)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at javax.mail.Service.connect(Service.java:246)
~[javax.mail-1.6.2.jar:1.6.2]
emailmonitor_1  |   at
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:185)
~[email-monitor-0.21-SNAPSHOT.jar:0.21-SNAPSHOT]
emailmonitor_1  |   at java.lang.Thread.run(Thread.java:829) ~[?:?]
emailmonitor_1  | 2023-06-02 07:56:36,848 [Thread-0] ERROR
org.apache.airavata.monitor.email.EmailBasedMonitor {} - [EJM]: Caught a
throwable while closing email store
emailmonitor_1  | java.lang.NullPointerException: null
emailmonitor_1  |   at
org.apache.airavata.monitor.email.EmailBasedMonitor.run(EmailBasedMonitor.java:231)
~[email-monitor-0.

Re: questions regarding dashboards to get quick statistics.

[Lahiru Jayathilake]

Hi Saurav,

Regarding the development environments.
You can do the development with the OS that you prefer. (However, based on
my experience, I'd recommend going with Linux)

You can follow this document [1, 2] to set up a local Airavata development
environment and use it in the settings file. Alternatively, if you select
any of the options mentioned in this section [3], you just need to set up
the Airavata Django Portal as your development environment.


[1] - https://github.com/apache/airavata/blob/develop/README.md
[2] - https://github.com/apache/airavata/tree/develop
[3] -
https://github.com/apache/airavata-django-portal#:~:text=Create%20a%20local%20settings%20file
.

Cheers!
Lahiru

On Tue, May 30, 2023 at 12:12 PM saurav kumar jha <
imsauravgaurav...@gmail.com> wrote:

> Hi Suresh & Eroma,
> I have got overview of technical requirements of the following jira::
> [AIRAVATA-3594] Dashboards to get quick statistics - ASF JIRA (apache.org)
> 
>
> I have a few questions related to it.
>
> Should I do development setup of Airavata Django portal
>  on linux or on windows
> for working on above jira?
>
> Can you please assign this jira to me?
>
> What are the repositories other than Airavata Django Portal
>  which I should set up
> locally for development purposes?
>
> Thanks & Regards,
> Saurav Kumar Jha
>
>
>
>

Re: Questions

[Eroma Abeysinghe]

Hi Zhong,

Please check my answers in line.

On Wed, Oct 12, 2016 at 4:20 PM, Zhong Wang  wrote:

> After I use the Airavata platform, I do have 4 questions.
>
>
>
> 1)  Can I lock the setting values for some properties after we
> customize these values for a specified computer source, e.g.Queue*,
> Node Count, Total Core and Wall Time limit. We don’t want the users to
> change these setting for specified computer resource.
>
​You can set these values globally (meanning acroos all compute resources
in pga_config.php file) but users can change them at the time they create
their experiments. ​

​For your requirement could you please create  JIRA in
https://issues.apache.org/jira/login.jsp?os_destination=
%2Fbrowse%2FAIRAVATA-2158%3Fjql%3Dproject%2520%253D%2520AIRAVATA
​ you might need to create a username if you already don't have one.​

>
>
>
>
> 2)  Does the Airavata have a function to delete the experiments? I
> made many test cases, but I don’t want to see them anymore.
>
​In our web based gateway portal we don't have delete experiment feature.
Requirement we initially worked on was that researches don't want to loose
their work/experiments. ​


>
>
> 3)  Can the Airavata  show output log from the SLURM or PBS jobs on
> the web page directly?
> ​ No. Since the PGA is generic and many applications from different
> streams are run such requirement did not come. ​
>
>
>
> 4)  What is the meaning of “Data is Staged” in App Input Fields in
> the UI of Edit Application Interface?
>
​Its a sort of futeristic feature. At the moemnt irrespective of the
setting in Application interface, data is staged.​

>
>
>
>
> Thanks,
>
>
>
> Zhong Wang
>



-- 
Thank You,
Best Regards,
Eroma

Re: Questions about job submissions / RabbitMQ

[Eroma Abeysinghe]

Hi John,

I am not the best person to answer but thought it might direct you on the
right direction.

In Airavata API there is a method called getExperimentStatus. By giving the
authtoken and exp ID you can obtain experiment status.
you need to have a python sample and call this method.

Hope this helps
Also please upload your python samples to git

Thanks, Eroma



On Wed, Aug 12, 2015 at 10:45 AM, John Weachock  wrote:

> Hi devs,
>
> Doug and I are tryinng to understand the flow of events that happens when
> a job is submitted through Airavata. Currently, we have a local Python
> client that creates and submits a  job to `gw56`, and then we're checking
> the RabbitMQ dashboard. From there, we can see that it has received the
> launch messages, but we're unable to obtain any information about them. The
> Python Airavata client is unable to provide us with any information about
> the experiment status or details, and the RabbitMQ dashboard is unable to
> fetch the messages.
>
> Does anyone have any idea why this might be the case and how we can work
> around it?
>
> Thanks,
>
> John
>



-- 
Thank You,
Best Regards,
Eroma

Re: Questions about Custom Application Registration and Complex Input/Output Data

[Suresh Marru]

Hi Alfredo,

Sorry we could not follow up, I am at a conference and only paying fractured 
attention. Can you please login to Airavata Instant Messenger 
(http://s.apache.org/hipchat) and lets interactively get this quickly. For now, 
please see the walk through below:

> > > Assuming this scenario: I have a local application (named "MyApp") 
> > > developed in a certain language (let's assume python or C++) which takes 
> > > some string as launching arguments, (string1 string2 string3), it does 
> > > some processing and creates a more or less complex "output" during it's 
> > > process. I want to generate an interface application on airavata of that 
> > > application. My questions are:

This is a scenario supported by Airavata in a first class way. Too bad you are 
having to work in the middle of refactoring, but navigate it. 

> > > a) When creating the registration script for airavata of MyApp, the 3 
> > > argument string that my application needs are translated as 3 separated 
> > > InputDataObjectType (of string type)?

Yes thats exactly what you will need to do. Three string inputs with three 
InputDataObjectType objects. I would suggest you play around with this on a 
test portal which will let you walk through this - 
http://test-drive.airavata.org/pga/public/  (please ask for a test user name 
password on hip chat).

> > > b) Assuming a simple case where "output" is composed by a string 
> > > indicating the result of the processing, how is this "output" associated 
> > > to the output of the airavata interface which I'm creating? it's always 
> > > what happens comes with the stout of the system or there is a specific 
> > > procedure to follow into MyApp or before create the registration script?

Output are little tricker to automate. Please see this thread for details - 
http://airavata.markmail.org/thread/hd7azhp7w7o7eqyq 

The easier way is, if you application (or a wrapper) can print 
OUTPUT_NAME_USED_IN_REGISTRATION=value, then airavata can pick it up. There 
used to be a way to just tell get me all standard out. Can any of Airavata 
contributors confirm this?

> > > c) (Related to question b) If the Input (or the Ouput) of an application 
> > > is a complex object (not simple object such as string or int but more or 
> > > less complex structures) wow can translate that into the airavata 
> > > Interface? .Is it supported? Do I need to register class/structure on 
> > > apache thrift server and use the thrift-generates interfaces directly 
> > > into my application in order to associate a possible airavata 
> > > OutputDataObjectType?

In the current version only simple types are supported. But this is a good use 
case, you can please create a JIRA issue requesting this new feature, and we 
will look into it.

Again please login to the IM and ask any questions you may have. Thanks for 
your persistence and patience. You are not at all harassing, you are being a 
great contributor to Airavata by means of all these questions. We very much 
like it and would encourage you to continue to do so.

Suresh


On Nov 20, 2014, at 9:10 AM, SmashRod Alfredo  wrote:

> 
> Hi Everyone,
> Since I haven't received replies in last 10 days and the open issues are for 
> me now very blocking I just refresh my currently still open questions trying 
> to simplify the explanation. 
> I have a local application on my machine that is invoked with a couples of 
> argument (for example 2 strings), do it's processing and create some results 
> (more or less complex). Is it possible to wrap the execution of my local 
> application with airavata in such a way that i can register the application 
> on my local airavata-server and subsequently create experiments using the 
> airavata-generated application interface?
> How should the application invocation arguments be translated when I create 
> the application interface? How can I get as output of experiment the results 
> of my applications? Which are the steps that I should follow?
> 
> Thank you again and sorry for my harassment but these questions have become 
> completely blocking in the last days...
> 
> Alfredo
> 
> From: smash...@hotmail.it
> To: dev@airavata.apache.org
> Subject: RE: Questions about Custom Application Registration and Complex 
> Input/Output Data
> Date: Thu, 13 Nov 2014 16:47:35 +0100
> 
> Hi Suresh and Raminder,
> Thank you so much for all the explanations and the references,  there will be 
> really useful!
> 
> Thanks again for your support,
> 
> Alfredo
> Date: Thu, 13 Nov 2014 10:12:25 -0500
> Subject: Re: Questions about Custom Application Registration and Complex 
> I

RE: Questions about Custom Application Registration and Complex Input/Output Data

[SmashRod Alfredo]

Hi Everyone,
Since I haven't received replies in last 10 days and the open issues are for me 
now very blocking I just refresh my currently still open questions trying to 
simplify the explanation. 
I have a local application on my machine that is invoked with a couples of 
argument (for example 2 strings), do it's processing and create some results 
(more or less complex). Is it possible to wrap the execution of my local 
application with airavata in such a way that i can register the application on 
my local airavata-server and subsequently create experiments using the 
airavata-generated application interface?
How should the application invocation arguments be translated when I create the 
application interface? How can I get as output of experiment the results of my 
applications? Which are the steps that I should follow?

Thank you again and sorry for my harassment but these questions have become 
completely blocking in the last days...

Alfredo

From: smash...@hotmail.it
To: dev@airavata.apache.org
Subject: RE: Questions about Custom Application Registration and Complex 
Input/Output Data
Date: Thu, 13 Nov 2014 16:47:35 +0100




Hi Suresh and Raminder,
Thank you so much for all the explanations and the references,  there will be 
really useful!

Thanks again for your support,

Alfredo
Date: Thu, 13 Nov 2014 10:12:25 -0500
Subject: Re: Questions about Custom Application Registration and Complex 
Input/Output Data
From: smarru.apa...@gmail.com
To: dev@airavata.apache.org

Hi Alfredo,
I will answer this easier one first. 
You guessed it right, as it stands now, the token is a handle to a credential 
which is used for compute resources. As for local resources, we can pretty much 
send something and i will get ignored. The current token is described in a 
paper by Amila Jayasekara described at [1] or [2] for a direct link.
One of the many reasons Airavata is holding up on a 1.0 release is to clear 
usage of the API in a secured way. In general, we are modeling similar to how 
Evernote uses Thrift API [3]. We recently had a good long review in this 
context by experts [4], we will soon have a technical paper describing Airavata 
API security and identity management and should have a implementation soon 
there after. 
Thanks for your interest in Airavata,Suresh[1] - 
http://dx.doi.org/10.1109/CCGrid.2014.95[2] - 
https://scholarworks.iu.edu/dspace/bitstream/handle/2022/17379/ccgrid_2014_credential_store.pdf?sequence=1&isAllowed=y[3]
 - https://dev.evernote.com/doc/[4] - http://trustedci.org/
On Nov 13, 2014, at 9:21 AM, SmashRod Alfredo  wrote:
Hi Suresh and Everyone,
I have another question to add to my previous meanwhile,
what do sshTokenId and gsisshTokenId mean (into launchExperiment method)? In 
the samples are hard-coded values.. are they really influent? At least using 
localhost as computeHost it's unnecessary to use/generate them right?

Thanks again,

Alfredo

> Subject: Re: Questions about Custom Application Registration and Complex 
> Input/Output Data
> From: sma...@apache.org
> Date: Tue, 11 Nov 2014 16:54:39 -0500
> To: dev@airavata.apache.org
> 
> Hi Alfredo,
> 
> Thank you for these thoughtful questions. I will get back to you in detail 
> ASAP.
> 
> Suresh
> 
> On Nov 11, 2014, at 1:00 PM, SmashRod Alfredo  wrote:
> 
> > Hi everyone!
> > 
> > I understand how to retrieves specific experiment results directly into a 
> > customized version of CreateLaunchExperiment java class. 
> > 
> > There are more open issues that I would like to ask you:
> > 
> > Assuming this scenario: I have a local application (named "MyApp") 
> > developed in a certain language (let's assume python or C++) which takes 
> > some string as launching arguments, (string1 string2 string3), it does some 
> > processing and creates a more or less complex "output" during it's process. 
> > I want to generate an interface application on airavata of that 
> > application. My questions are:
> > a) When creating the registration script for airavata of MyApp, the 3 
> > argument string that my application needs are translated as 3 separated 
> > InputDataObjectType (of string type)?
> > b) Assuming a simple case where "output" is composed by a string indicating 
> > the result of the processing, how is this "output" associated to the output 
> > of the airavata interface which I'm creating? it's always what happens 
> > comes with the stout of the system or there is a specific procedure to 
> > follow into MyApp or before create the registration script?
> > c) (Related to question b) If the Input (or the Ouput) of an application is 
> > a complex object (not simple object such as string or int but more or less 
> > complex structures) wow can translate that into

RE: Questions about Custom Application Registration and Complex Input/Output Data

[SmashRod Alfredo]

Hi Suresh and Raminder,
Thank you so much for all the explanations and the references,  there will be 
really useful!

Thanks again for your support,

Alfredo
Date: Thu, 13 Nov 2014 10:12:25 -0500
Subject: Re: Questions about Custom Application Registration and Complex 
Input/Output Data
From: smarru.apa...@gmail.com
To: dev@airavata.apache.org

Hi Alfredo,
I will answer this easier one first. 
You guessed it right, as it stands now, the token is a handle to a credential 
which is used for compute resources. As for local resources, we can pretty much 
send something and i will get ignored. The current token is described in a 
paper by Amila Jayasekara described at [1] or [2] for a direct link.
One of the many reasons Airavata is holding up on a 1.0 release is to clear 
usage of the API in a secured way. In general, we are modeling similar to how 
Evernote uses Thrift API [3]. We recently had a good long review in this 
context by experts [4], we will soon have a technical paper describing Airavata 
API security and identity management and should have a implementation soon 
there after. 
Thanks for your interest in Airavata,Suresh[1] - 
http://dx.doi.org/10.1109/CCGrid.2014.95[2] - 
https://scholarworks.iu.edu/dspace/bitstream/handle/2022/17379/ccgrid_2014_credential_store.pdf?sequence=1&isAllowed=y[3]
 - https://dev.evernote.com/doc/[4] - http://trustedci.org/
On Nov 13, 2014, at 9:21 AM, SmashRod Alfredo  wrote:
Hi Suresh and Everyone,
I have another question to add to my previous meanwhile,
what do sshTokenId and gsisshTokenId mean (into launchExperiment method)? In 
the samples are hard-coded values.. are they really influent? At least using 
localhost as computeHost it's unnecessary to use/generate them right?

Thanks again,

Alfredo

> Subject: Re: Questions about Custom Application Registration and Complex 
> Input/Output Data
> From: sma...@apache.org
> Date: Tue, 11 Nov 2014 16:54:39 -0500
> To: dev@airavata.apache.org
> 
> Hi Alfredo,
> 
> Thank you for these thoughtful questions. I will get back to you in detail 
> ASAP.
> 
> Suresh
> 
> On Nov 11, 2014, at 1:00 PM, SmashRod Alfredo  wrote:
> 
> > Hi everyone!
> > 
> > I understand how to retrieves specific experiment results directly into a 
> > customized version of CreateLaunchExperiment java class. 
> > 
> > There are more open issues that I would like to ask you:
> > 
> > Assuming this scenario: I have a local application (named "MyApp") 
> > developed in a certain language (let's assume python or C++) which takes 
> > some string as launching arguments, (string1 string2 string3), it does some 
> > processing and creates a more or less complex "output" during it's process. 
> > I want to generate an interface application on airavata of that 
> > application. My questions are:
> > a) When creating the registration script for airavata of MyApp, the 3 
> > argument string that my application needs are translated as 3 separated 
> > InputDataObjectType (of string type)?
> > b) Assuming a simple case where "output" is composed by a string indicating 
> > the result of the processing, how is this "output" associated to the output 
> > of the airavata interface which I'm creating? it's always what happens 
> > comes with the stout of the system or there is a specific procedure to 
> > follow into MyApp or before create the registration script?
> > c) (Related to question b) If the Input (or the Ouput) of an application is 
> > a complex object (not simple object such as string or int but more or less 
> > complex structures) wow can translate that into the airavata Interface? .Is 
> > it supported? Do I need to register class/structure on apache thrift server 
> > and use the thrift-generates interfaces directly into my application in 
> > order to associate a possible airavata OutputDataObjectType?
> > 
> > I hope to have been sufficiently clear exposing my doubts,
> > 
> > Thanks for your replies
> > 
> > Alfredo
> 
  

Re: Questions about Custom Application Registration and Complex Input/Output Data

[Suresh Marru]

Hi Alfredo,

I will answer this easier one first.

You guessed it right, as it stands now, the token is a handle to a
credential which is used for compute resources. As for local resources, we
can pretty much send something and i will get ignored. The current token is
described in a paper by Amila Jayasekara described at [1] or [2] for a
direct link.

One of the many reasons Airavata is holding up on a 1.0 release is to clear
usage of the API in a secured way. In general, we are modeling similar to
how Evernote uses Thrift API [3]. We recently had a good long review in
this context by experts [4], we will soon have a technical paper describing
Airavata API security and identity management and should have a
implementation soon there after.

Thanks for your interest in Airavata,
Suresh
[1] - http://dx.doi.org/10.1109/CCGrid.2014.95
[2] -
https://scholarworks.iu.edu/dspace/bitstream/handle/2022/17379/ccgrid_2014_credential_store.pdf?sequence=1&isAllowed=y
[3] - https://dev.evernote.com/doc/
[4] - http://trustedci.org/

On Nov 13, 2014, at 9:21 AM, SmashRod Alfredo  wrote:

Hi Suresh and Everyone,
I have another question to add to my previous meanwhile,
what do sshTokenId and gsisshTokenId mean (into launchExperiment method)?
In the samples are hard-coded values.. are they really influent? At least
using localhost as computeHost it's unnecessary to use/generate them right?

Thanks again,

Alfredo

> Subject: Re: Questions about Custom Application Registration and Complex
Input/Output Data
> From: sma...@apache.org
> Date: Tue, 11 Nov 2014 16:54:39 -0500
> To: dev@airavata.apache.org
>
> Hi Alfredo,
>
> Thank you for these thoughtful questions. I will get back to you in
detail ASAP.
>
> Suresh
>
> On Nov 11, 2014, at 1:00 PM, SmashRod Alfredo  wrote:
>
> > Hi everyone!
> >
> > I understand how to retrieves specific experiment results directly into
a customized version of CreateLaunchExperiment java class.
> >
> > There are more open issues that I would like to ask you:
> >
> > Assuming this scenario: I have a local application (named "MyApp")
developed in a certain language (let's assume python or C++) which takes
some string as launching arguments, (string1 string2 string3), it does some
processing and creates a more or less complex "output" during it's process.
I want to generate an interface application on airavata of that
application. My questions are:
> > a) When creating the registration script for airavata of MyApp, the 3
argument string that my application needs are translated as 3 separated
InputDataObjectType (of string type)?
> > b) Assuming a simple case where "output" is composed by a string
indicating the result of the processing, how is this "output" associated to
the output of the airavata interface which I'm creating? it's always what
happens comes with the stout of the system or there is a specific procedure
to follow into MyApp or before create the registration script?
> > c) (Related to question b) If the Input (or the Ouput) of an
application is a complex object (not simple object such as string or int
but more or less complex structures) wow can translate that into the
airavata Interface? .Is it supported? Do I need to register class/structure
on apache thrift server and use the thrift-generates interfaces directly
into my application in order to associate a possible airavata
OutputDataObjectType?
> >
> > I hope to have been sufficiently clear exposing my doubts,
> >
> > Thanks for your replies
> >
> > Alfredo
>

Re: Questions about Custom Application Registration and Complex Input/Output Data

[Raminder Singh]

TokenID are used for credential store and can be used to store and retrieve SSH 
or Grid credentials. You can read [1] for more details. Yes, you are right 
incase of localhost we don’t need any credentials and we ignore the value. For 
developers and evaluation users, we have SSH and Myproxy properties in 
airavata-server.properties. Incase you send a token which does not exist in 
credential store (sample values), we use airavata-server properties values. I 
hope this helps. I will let Suresh reply to your other queries. 

1. 
https://scholarworks.iu.edu/dspace/bitstream/handle/2022/17379/ccgrid_2014_credential_store.pdf?sequence=1

Thanks
Raminder

On Nov 13, 2014, at 9:21 AM, SmashRod Alfredo  wrote:

> Hi Suresh and Everyone,
> I have another question to add to my previous meanwhile,
> what do sshTokenId and gsisshTokenId mean (into launchExperiment method)? In 
> the samples are hard-coded values.. are they really influent? At least using 
> localhost as computeHost it's unnecessary to use/generate them right?
> 
> Thanks again,
> 
> Alfredo
> 
> > Subject: Re: Questions about Custom Application Registration and Complex 
> > Input/Output Data
> > From: sma...@apache.org
> > Date: Tue, 11 Nov 2014 16:54:39 -0500
> > To: dev@airavata.apache.org
> > 
> > Hi Alfredo,
> > 
> > Thank you for these thoughtful questions. I will get back to you in detail 
> > ASAP.
> > 
> > Suresh
> > 
> > On Nov 11, 2014, at 1:00 PM, SmashRod Alfredo  wrote:
> > 
> > > Hi everyone!
> > > 
> > > I understand how to retrieves specific experiment results directly into a 
> > > customized version of CreateLaunchExperiment java class. 
> > > 
> > > There are more open issues that I would like to ask you:
> > > 
> > > Assuming this scenario: I have a local application (named "MyApp") 
> > > developed in a certain language (let's assume python or C++) which takes 
> > > some string as launching arguments, (string1 string2 string3), it does 
> > > some processing and creates a more or less complex "output" during it's 
> > > process. I want to generate an interface application on airavata of that 
> > > application. My questions are:
> > > a) When creating the registration script for airavata of MyApp, the 3 
> > > argument string that my application needs are translated as 3 separated 
> > > InputDataObjectType (of string type)?
> > > b) Assuming a simple case where "output" is composed by a string 
> > > indicating the result of the processing, how is this "output" associated 
> > > to the output of the airavata interface which I'm creating? it's always 
> > > what happens comes with the stout of the system or there is a specific 
> > > procedure to follow into MyApp or before create the registration script?
> > > c) (Related to question b) If the Input (or the Ouput) of an application 
> > > is a complex object (not simple object such as string or int but more or 
> > > less complex structures) wow can translate that into the airavata 
> > > Interface? .Is it supported? Do I need to register class/structure on 
> > > apache thrift server and use the thrift-generates interfaces directly 
> > > into my application in order to associate a possible airavata 
> > > OutputDataObjectType?
> > > 
> > > I hope to have been sufficiently clear exposing my doubts,
> > > 
> > > Thanks for your replies
> > > 
> > > Alfredo
> >

RE: Questions about Custom Application Registration and Complex Input/Output Data

[SmashRod Alfredo]

Hi Suresh and Everyone,
I have another question to add to my previous meanwhile,
what do sshTokenId and gsisshTokenId mean (into launchExperiment method)? In 
the samples are hard-coded values.. are they really influent? At least using 
localhost as computeHost it's unnecessary to use/generate them right?

Thanks again,

Alfredo

> Subject: Re: Questions about Custom Application Registration and Complex 
> Input/Output Data
> From: sma...@apache.org
> Date: Tue, 11 Nov 2014 16:54:39 -0500
> To: dev@airavata.apache.org
> 
> Hi Alfredo,
> 
> Thank you for these thoughtful questions. I will get back to you in detail 
> ASAP.
> 
> Suresh
> 
> On Nov 11, 2014, at 1:00 PM, SmashRod Alfredo  wrote:
> 
> > Hi everyone!
> > 
> > I understand how to retrieves specific experiment results directly into a 
> > customized version of CreateLaunchExperiment java class. 
> > 
> > There are more open issues that I would like to ask you:
> > 
> > Assuming this scenario: I have a local application (named "MyApp") 
> > developed in a certain language (let's assume python or C++) which takes 
> > some string as launching arguments, (string1 string2 string3), it does some 
> > processing and creates a more or less complex "output" during it's process. 
> > I want to generate an interface application on airavata of that 
> > application. My questions are:
> >   a) When creating the registration script for airavata of MyApp, the 3 
> > argument string that my application needs are translated as 3 separated 
> > InputDataObjectType (of string type)?
> >   b) Assuming a simple case where "output" is composed by a string 
> > indicating the result of the processing,  how is this "output" associated 
> > to the output of the airavata interface which I'm creating? it's always 
> > what happens comes with the stout of the system or there is a specific 
> > procedure to follow into MyApp or before create the registration script?
> >   c) (Related to question b) If the Input (or the Ouput) of an application 
> > is a complex object (not simple object such as string or int but more or 
> > less complex structures) wow can translate that into the airavata 
> > Interface? .Is it supported? Do I need to register class/structure on 
> > apache thrift server and use the thrift-generates interfaces directly into 
> > my application in order to associate a possible airavata 
> > OutputDataObjectType?
> > 
> > I hope to have been sufficiently clear exposing my doubts,
> > 
> > Thanks for your replies
> > 
> > Alfredo
> 
  

Re: Questions about Custom Application Registration and Complex Input/Output Data

[Suresh Marru]

Hi Alfredo,

Thank you for these thoughtful questions. I will get back to you in detail ASAP.

Suresh

On Nov 11, 2014, at 1:00 PM, SmashRod Alfredo  wrote:

> Hi everyone!
> 
> I understand how to retrieves specific experiment results directly into a 
> customized version of CreateLaunchExperiment java class. 
> 
> There are more open issues that I would like to ask you:
> 
> Assuming this scenario: I have a local application (named "MyApp") developed 
> in a certain language (let's assume python or C++) which takes some string as 
> launching arguments, (string1 string2 string3), it does some processing and 
> creates a more or less complex "output" during it's process. I want to 
> generate an interface application on airavata of that application. My 
> questions are:
>   a) When creating the registration script for airavata of MyApp, the 3 
> argument string that my application needs are translated as 3 separated 
> InputDataObjectType (of string type)?
>   b) Assuming a simple case where "output" is composed by a string indicating 
> the result of the processing,  how is this "output" associated to the output 
> of the airavata interface which I'm creating? it's always what happens comes 
> with the stout of the system or there is a specific procedure to follow into 
> MyApp or before create the registration script?
>   c) (Related to question b) If the Input (or the Ouput) of an application is 
> a complex object (not simple object such as string or int but more or less 
> complex structures) wow can translate that into the airavata Interface? .Is 
> it supported? Do I need to register class/structure on apache thrift server 
> and use the thrift-generates interfaces directly into my application in order 
> to associate a possible airavata OutputDataObjectType?
> 
> I hope to have been sufficiently clear exposing my doubts,
> 
> Thanks for your replies
> 
> Alfredo

Re: Questions about properties in airavata-server.properties

[Saminda Wijeratne]

On Fri, Jan 25, 2013 at 3:10 PM, Amila Jayasekara
wrote:

> Hi All,
>
> In airavata-server.properties file i see following properties defined,
>
> system.gateway=default
> system.user=admin
> system.password=admin
>
These are the credentials & gateway used by the the axis2 web services
(WorkflowInterpreter/GFacService/MessageBox.. etc)  when they want to
register their service url in the registry when services initialize.

>
> Further down the file I see following properties also,
>
> default.registry.user=admin
> default.registry.password=admin
> default.registry.gateway=default
>
This is used as the default data to add when the database is created

>
> Are these 2 things different or same ?
>
> In addition in the airavata-server.properties file in web app i see a
> "gateway.id=default" also.
>
No one should use this... Should be removed...

Saminda


> So which one should we use ?
>
> Thanks
> Amila
>