Is there a difference in the experiments that get created
through xbaya workflow creation and through commandline
createExperiment? I can clone and run the xbaya experiment
through the Python API client, but when I try creating my own
experiment, the run fails. Perhaps someone can send out
the attributes required by createExperiment for creating a runnable
experiment on localhost?
Kenneth
On Fri, Jan 09, 2015 at 03:26:39PM -0800, K Yoshimoto wrote:
>
> Marlon,
>
> I'm finding all the structures I'm trying to use. Do the other
> thrift files get pulled in with the include lines?
>
> I got to the point of trying to launch an experiment but ran into
> an error. Maybe I'm missing a field in my experiment? Does anyone
> have a blow-by-blow set of steps for creating a project, creating
> an experiment, launching the experiment?
>
> ./Airavata-remote -h localhost:8930 getAllUserExperiments kenneth1
> [ Experiment(userName='kenneth1', experimentOutputs=[], errors=None,
> applicationVersion=None, name='dateexperiment', workflowTemplateId=None,
> projectID='test1_cfe50d5c-6d70-4119-a485-f879943ecfea',
> stateChangeList=[WorkflowNodeStatus(timeOfStateChange=1420844997906,
> workflowNodeState=7)], creationTime=1420844856258,
> workflowNodeDetailsList=[WorkflowNodeDetails(nodeInstanceId='IDontNeedaNode_ff3cbbb8-e752-4be6-916d-b3a0fc252826',
> errors=[], nodeName='IDontNeedaNode', nodeOutputs=[],
> executionUnitData=None,
> workflowNodeStatus=WorkflowNodeStatus(timeOfStateChange=1420844997906,
> workflowNodeState=7), creationTime=1420844997871, executionUnit=1,
> taskDetailsList=[TaskDetails(applicationInputs=[], errors=[],
> applicationVersion=None, applicationOutputs=[], applicationDeploymentId=None,
> advancedOutputDataHandling=None, creationTime=None,
> dataTransferDetailsList=[],
> taskStatus=TaskStatus(timeOfStateChange=1420844997950, executionState=12),
> advancedInputDataHandling=None,
> taskID='IDontNeedaNode_7b028bba-52b7-402a-b9d2-41b43796d675',
> jobDetailsList=[], taskScheduling=None,
> applicationId='datetest_7292e719-beea-4872-b6a2-b6b76c28f3ee')],
> nodeInputs=[])],
> experimentID='dateexperiment_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0',
> workflowTemplateVersion=None, workflowExecutionInstanceId=None,
> userConfigurationData=None, experimentInputs=[],
> experimentStatus=ExperimentStatus(timeOfStateChange=1420844856279,
> experimentState=0),
> applicationId='datetest_7292e719-beea-4872-b6a2-b6b76c28f3ee',
> description=None)]
>
> ./Airavata-remote -h localhost:8930 launchExperiment
> dateexperiment_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0 runme
> Traceback (most recent call last):
> File "./Airavata-remote", line 301, in <module>
> pp.pprint(client.launchExperiment(args[0],args[1],))
> File
> "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api/Airavata.py",
> line 2572, in launchExperiment
> self.recv_launchExperiment()
> File
> "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api/Airavata.py",
> line 2589, in recv_launchExperiment
> raise x
> thrift.Thrift.TApplicationException: Internal error processing
> launchExperiment
>
>
> From the server console:
>
> [ERROR] Error occurred during processing of message.
> java.lang.NullPointerException
> at
> org.apache.airavata.orchestrator.core.validator.impl.SimpleAppDataValidator.validate(SimpleAppDataValidator.java:50)
> at
> org.apache.airavata.orchestrator.cpi.impl.SimpleOrchestratorImpl.validateExperiment(SimpleOrchestratorImpl.java:120)
> at
> org.apache.airavata.orchestrator.server.OrchestratorServerHandler.validateExperiment(OrchestratorServerHandler.java:252)
> at
> org.apache.airavata.orchestrator.cpi.OrchestratorService$Processor$validateExperiment.getResult(OrchestratorService.java:552)
> at
> org.apache.airavata.orchestrator.cpi.OrchestratorService$Processor$validateExperiment.getResult(OrchestratorService.java:536)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:701)
> [ERROR] Internal error processing launchExperiment
> org.apache.thrift.transport.TTransportException
> at
> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:362)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:284)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:191)
> at
> org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
> at
> org.apache.airavata.orchestrator.cpi.OrchestratorService$Client.recv_validateExperiment(OrchestratorService.java:239)
> at
> org.apache.airavata.orchestrator.cpi.OrchestratorService$Client.validateExperiment(OrchestratorService.java:226)
> at
> org.apache.airavata.api.server.handler.AiravataServerHandler.launchExperiment(AiravataServerHandler.java:1118)
> at
> org.apache.airavata.api.Airavata$Processor$launchExperiment.getResult(Airavata.java:8929)
> at
> org.apache.airavata.api.Airavata$Processor$launchExperiment.getResult(Airavata.java:8913)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:701)
>
>
> On Fri, Jan 09, 2015 at 04:48:09PM -0500, Marlon Pierce wrote:
> > Hi Kenneth--
> >
> > You'll probably run into problems with the python bindings, but it is an
> > easy fix (I think). The thrift files need to specify the language
> > bindings you want. Only three of the thrift files have python bindings
> > set up.
> >
> > Marlon
> >
> >
> > thrift-interface-descriptions mpierce$ find . -type f -exec grep -il
> > "namespace py" {} \;
> > ./airavataAPI.thrift
> > ./airavataErrors.thrift
> > ./workflowAPI.thrift
> >
> >
> > On 1/9/15 4:15 PM, K Yoshimoto wrote:
> > >Okay, looks like the C in Compute needs to be capitalized.
> > >I must have typoed that.
> > >
> > >On Fri, Jan 09, 2015 at 11:46:32AM -0800, K Yoshimoto wrote:
> > >>Marlon,
> > >>
> > >> I can do the startup with ./airavata-server.sh for now.
> > >>
> > >> I'm trying to go through the steps of creating my own app and
> > >>launching it using the Python client. I ran into a problem with
> > >>a method not found in the client:
> > >>
> > >>In
> > >>airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api
> > >>
> > >>./Airavata-remote -h localhost:8930 getAllcomputeResourceNames
> > >>Unrecognized method getAllcomputeResourceNames
> > >>
> > >> Should the python client be up-to-date?
> > >>
> > >>Kenneth
> > >>
> > >>On Thu, Jan 08, 2015 at 08:08:58PM -0500, Marlon Pierce wrote:
> > >>>Hi Ken--
> > >>>
> > >>>Thanks--feel free to fix the startup script and submit a patch.
> > >>>
> > >>>Marlon
> > >>>
> > >>>On 1/8/15 6:28 PM, K Yoshimoto wrote:
> > >>>>I grabbed the source release from
> > >>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
> > >>>>
> > >>>>and built that. The server startup script is still broken for
> > >>>>Ubuntu when run as the quick start describes (sh airavata-server.sh),
> > >>>>but works when invoked as ./airavata-server.sh.
> > >>>>
> > >>>>Registering sample apps and xbaya workflow construction work.
> > >>>>Not sure when the xbaya workflow construction would be useful?
> > >>>>Running the workflow generates output in /tmp.
> > >>>>
> > >>>>I would like to try creating new experiments and running them.
> > >>>>I will be playing with the python client. Are all the samples in
> > >>>>airavata-0.14/airavata-api/airavata-client-sdks/java-client-samples/src/main/java/org/apache/airavata/client/samples
> > >>>>
> > >>>>up-to-date? I'll probably go by them to try registering new experiments
> > >>>>and running them with the python client, unless anyone has documentation
> > >>>>handy.
> > >>>>
> > >>>>Kenneth
> > >>>>
> > >>>>On Wed, Jan 07, 2015 at 12:56:00PM -0500, Marlon Pierce wrote:
> > >>>>>We also run the server components (not XBaya) full time and run daily
> > >>>>>tests against it as part of test-drive.airavata.org.
> > >>>>>
> > >>>>>Marlon
> > >>>>>
> > >>>>>On 1/7/15 12:31 PM, K Yoshimoto wrote:
> > >>>>>>Was it stable enough to use outside the demo? Any problems to note?
> > >>>>>>
> > >>>>>>On Wed, Jan 07, 2015 at 10:48:58PM +0530, Suresh Marru wrote:
> > >>>>>>>+ 1 for the release.
> > >>>>>>>
> > >>>>>>>P.S. I was able to demo this RC2 in a talk and couple of participants
> > >>>>>>>followed along successfully.
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>On Dec 30, 2014, at 1:34 AM, Chathuri Wimalasena
> > >>>>>>><[email protected]>
> > >>>>>>>wrote:
> > >>>>>>>
> > >>>>>>>>Apache Airavata PMC is pleased to call for a vote on the following
> > >>>>>>>>Apache Airavata 0.14 release candidate artifacts:
> > >>>>>>>>
> > >>>>>>>>Detailed change log/release notes:
> > >>>>>>>>
> > >>>>>>>>https://git-wip-us.apache.org/repos/asf?p=airavata.git;a=blob_plain;f=RELEASE_NOTES;hb=refs/tags/airavata-0.14
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>All Release Artifacts:
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>PGP release keys (signed using 65541DBC):
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/release/airavata/KEYS
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>Specific URL's:
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>GIT source tag:
> > >>>>>>>>https://git-wip-us.apache.org/repos/asf?p=airavata.git;a=shortlog;h=refs/tags/airavata-0.14
> > >>>>>>>>
> > >>>>>>>>Source release:
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/airavata-0.14-source-release.zip
> > >>>>>>>>
> > >>>>>>>>Binary Artifacts:
> > >>>>>>>>
> > >>>>>>>>Airavata Server:
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-server-0.14-bin.zip
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-server-0.14-bin.tar.gz
> > >>>>>>>>
> > >>>>>>>>API Server
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-api-server-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-api-server-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>GFac Server
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-gfac-server-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-gfac-server-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>Orchestrator Server
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-orchestrator-server-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-orchestrator-server-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>Xbaya Distribution
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-xbaya-gui-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-xbaya-gui-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>Client SDKs
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-java-sdk-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-java-sdk-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-php-sdk-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-php-sdk-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>Maven staging repo:
> > >>>>>>>>https://repository.apache.org/content/repositories/orgapacheairavata-1005
> > >>>>>>>>
> > >>>>>>>>Please verify the artifacts and vote. The vote will be open for
> > >>>>>>>>atleast
> > >>>>>>>>72 hours.
> > >>>>>>>>
> > >>>>>>>>[ ] +1 approve
> > >>>>>>>>[ ] +0 no opinion
> > >>>>>>>>[ ] -1 disapprove (and reason why)
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>[ ] +1 approve
> > >>>>>>>>[ ] +0 no opinion
> > >>>>>>>>[ ] -1 disapprove (and reason why)
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
