On Apr 8, 2013, at 12:27 PM, Heshan Suriyaarachchi <[email protected]> wrote:
> Hi Heejoon, > > Please see my inline comments. > > On Sun, Apr 7, 2013 at 11:27 PM, Heejoon Chae <[email protected]> wrote: > Hi, Heshan, > > This is great feature additions to handle Amazon components! Thank you for > your improvements and kind explanation using Bioinformatics example. > > I have some questions based on that. Please correct me if I get confused. > > Q1. For the execution result from your example, it can be only shown by > monitoring panel with text like "result=xxx". As we briefly discussed > previously, is it also possible to show the result from the web browser when > the result contains text like "http://..."; or "s3:..." in case when user > click the output component? I think that feature will dramatically increase > the Xbaya's output delivery ability and make more user friendly. > Let me briefly explain on how I did the development of the EC2 integration > feature of Airavata. The current EC2Provider of Airavata is like a rewrite. > It does not resemble (in the implementation level) to the earlier EC2Provider > of OGCE. We had to fix and implement a lot of backend code of Airavata to > support this due to the new Airavata architecture refactoring. These will not > be relevant to you but I just wanted to give you a context. > > The current release is in code freeze state and I can not add new features to > it. The next release will be out in few weeks time and I would be more than > happy to provide the feature that you requested. We need community > interaction in public lists of Airavata. Therefore, I'd appreciate it if you > could report the feature request through jira > https://issues.apache.org/jira/browse/AIRAVATA, so that we could better track > your user request. Please describe the issue thoroughly so we'd understand it > better. I did not understand what you meant by s3 result and what you > expected out of it. > > In the next release I"m planning to have features like EC2 instance > scheduling as well. This feature was not there in the OGCE version. I did not > have time to properly test and add UI support for them. Therefore, we made a > decision to not release it with the current release. Heejoon, this is a good feature request, please create a JIRA and add the details. Any one can create account on apache JIRA. Heshan, I think you can make the change within the EC2 provider. In GRAM provider the output is prefixed with gsiftp://$hostname, similarly you should be able to add http, s3 prefix. > > Q2. Since you accept credential(including private key) information through > the Xbaya directly, is it stored only local machine even when you use remote > Airavata server? > We are not persisting that information anywhere. It's kept at the XBaya UI > level. We are not storing it anywhere now due to security concerns. Airavata > security implementation will be available with the future releases of > Airavata. UI is capable of handling requests to the remote Airavata server. > That is, in case you are the registering person on the remote server, you > don't need to consider the log-in credential within application, and > user(local Xbaya) creates connection to Amazon with that credential > information and use registered remote apps to run the job. Am I correct? > We are not keeping the login credential (Secret key /access key) within the > application. It's just kept at the XBaya level. Once you launch a job through > XBaya, the credentials will be handled properly. These are good use cases for the Airavata Credential store. So please create a jira with these concerns as well. > Q3. From the screen shots, I can see 'refresh', 'launch' and 'terminate'. It > is also possible to 'stop' the instance without terminating? > I have to look up in amazon-java-sdk api whether they have provided any > method to support that. If that is available, I could support that. I would > once again appreciate if we could do this communications in a public list > ([email protected]) as it will be beneficial for other > users as well. > > Could you ask this feature request through jira as well? + 1. Suresh > > I hope I answered all your questions. If you need any clarifications, please > don't hesitate to ask. > > Thanks, > Heshan > > > Thank you for your help! > Heejoon. > > > > On Sat, Apr 6, 2013 at 2:21 AM, Heshan Suriyaarachchi > <[email protected]> wrote: > Hi Guys, > > Airavata 0.7 supports EC2 job submissions. You can refer the following posts > [1] [2] and run your EC2 jobs. If you need any clarifications, please ask. > > [1] - > http://heshans.blogspot.com/2013/04/run-ec2-jobs-with-airavata-part-i.html > [2] - > http://heshans.blogspot.com/2013/04/run-ec2-jobs-with-airavata-part-ii.html > > Thanks, > Heshan. > > On Tue, Mar 12, 2013 at 7:55 PM, Sun Kim <[email protected]> wrote: > Thanks munch, Suresh, Heshan, and Hyungro. > Sun > > 2013. 3. 13., 오전 12:32, Suresh Marru <[email protected]> 작성: > >> Hi Hyungro, >> >> Can you please share these details with Heshan? I will appreciate if you can >> work with Heshan and deploy this completely on Airavata, that way whenever >> Sun is continuing work on it, we can better support it. >> >> Thanks, >> Suresh >> >> On Mar 12, 2013, at 6:42 AM, Heshan Suriyaarachchi >> <[email protected]> wrote: >> >>> Hi Heejoon, >>> >>> Just having the AMI id, won't be sufficient for me to run the application. >>> I need the following information as well. >>> >>> 1. Access key >>> 2. Secret key >>> 3. Script name and input parameters. (Give me some sample inputs and >>> expected result) >>> 4. How the result will be printed to the standard out. (I need this to >>> filter out the application specific result) >>> >>> On Tue, Mar 12, 2013 at 12:16 AM, Heejoon Chae <[email protected]> >>> wrote: >>> The ami number is ami-957291fc. >>> >>> Sorry for the confusion. >>> >>> Thank you, >>> Heejoon. >>> >>> >>> On Tue, Mar 12, 2013 at 1:12 PM, Heejoon Chae <[email protected]> >>> wrote: >>> Hi, Heshan, >>> >>> The MMIA ami that I used was ami-95729. >>> >>> After the all the processes are done, the result 's3:xxxx' link produced >>> from the final node and passed to output node not allow to open the result >>> page on S3 when click the output component. >>> >>> Thank you, >>> Heejoon. >>> >>> >>> On Tue, Mar 12, 2013 at 12:49 PM, Sun Kim <[email protected]> wrote: >>> Heejoon, >>> >>> Please communicate with Heshan and follow this up. >>> >>> Hyungro -- I wonder if you were able to use the last application box to >>> retrieve the MMIA analysis result? >>> >>> Thank you >>> Sun >>> >>> >>> 2013. 3. 12., 오전 12:23, Heshan Suriyaarachchi >>> <[email protected]> 작성: >>> >>>> Hi Sun, >>>> >>>> Could you ask Heejoon to send me the issue he came across? I would prefer >>>> having access to an AMI he's referring to? >>>> >>>> In Hyungro's case, what he did was to make the script call the application >>>> on an AMI (where that script would have the EC2 connection info). There >>>> he's not using the EC2Provider but the generic provider at Airavata. With >>>> the use of EC2Provider you can submit jobs to your AMI instances. >>>> >>>> Thanks, >>>> Heshan >>>> >>>> On Mon, Mar 11, 2013 at 11:08 AM, Sun Kim <[email protected]> wrote: >>>> Thanks, Heshan. >>>> >>>> Heejoon also tested Airavata in Korea and it works well. >>>> >>>> One important request to you and Suresh -- At the end of a workflow, we >>>> add an application to connect to S3 to display the analysis result. >>>> Heejoon told me that it did not work. I appreciate your checking on this. >>>> >>>> Thanks again. >>>> Sun >>>> >>>> >>>> >>>> >>>> 2013. 3. 11., 오후 11:44, Heshan Suriyaarachchi >>>> <[email protected]> 작성: >>>> >>>>> Hi All, >>>>> >>>>> Airavata is now supporting job submissions to EC2. I have rewritten the >>>>> EC2Provider in a such a way that it is no longer bound to SSHProvider. It >>>>> gives us more flexibility in running cloud jobs. I am currently running >>>>> some tests and evaluating the new EC2Provider and still the UI components >>>>> are not added. I will start working on them shortly. >>>>> >>>>> Hi Hyungro, >>>>> >>>>> In the meantime, could you give me access to the AMI that you are using >>>>> for BioVLab? Then I could start testing it with the new implementation. I >>>>> will be there in the CIB during this week and you can come and meet me >>>>> when you are free. >>>>> >>>>> Thanks, >>>>> Heshan. >>>>> >>>>> On Mon, Feb 25, 2013 at 6:41 AM, Heshan Suriyaarachchi >>>>> <[email protected]> wrote: >>>>> Hi Hyungro, >>>>> >>>>> Great news. I'll be around the CIB too. My skype id is >>>>> heshan.suriyaarachchi. Ping me once you are there. >>>>> >>>>> Thanks, >>>>> Heshan. >>>>> >>>>> >>>>> On Sun, Feb 24, 2013 at 10:12 PM, Hyungro Lee <[email protected]> wrote: >>>>> Hi all, >>>>> >>>>> During the weekend, I installed Airavata to >>>>> biovlab.gateway.iu.teragrid.org which is our current gateway machine for >>>>> BioVLAB-MMIA and I tested the workflow. Luckily, it was successfully >>>>> finished :) >>>>> >>>>> Now, I would like to hear feedback from you for testing BioVLAB-MMIA with >>>>> Airavata. >>>>> >>>>> I created an instruction web page which is here: >>>>> https://sites.google.com/site/biovlab/biovlab-mmia-on-airavata-new >>>>> >>>>> It may take up to 30 minutes to proceed test. >>>>> >>>>> When you get errors, or want to give some opinion, please leave a comment >>>>> on the page or email me. It would be really appreciated. >>>>> >>>>> Also, I just want to let you know, BioVLAB project has a mailing list on >>>>> google. You can join here: https://groups.google.com/d/forum/biovlab >>>>> Email address for the list is: [email protected] >>>>> >>>>> No one seems to use it but this might be good time to start using it. >>>>> >>>>> Heshan - I would like to have a chance to talk with you about the >>>>> Airavata. I have couple of questions about the XBaya's functionality. For >>>>> example, importing / exporting workflow to Registry, and opening web >>>>> browser by clicking output component. I will be around PTI on Monday >>>>> afternoon and Tuesday. >>>>> >>>>> In the meantime, I will improve some minor things since we moved to the >>>>> new framework. Thank you. >>>>> >>>>> Best, >>>>> Hyungro >>>>> >>>>> -- >>>>> Hyungro Lee >>>>> Pervasive Technology Institute >>>>> School of Informatics and Computing >>>>> Indiana University >>>>> >>>>> >>>>> >>>>> -- >>>>> Regards, >>>>> Heshan Suriyaarachchi >>>>> >>>>> http://heshans.blogspot.com/ >>>>> http://www.linkedin.com/in/heshan >>>>> >>>>> >>>>> >>>>> -- >>>>> Regards, >>>>> Heshan Suriyaarachchi >>>>> >>>>> http://heshans.blogspot.com/ >>>>> http://www.linkedin.com/in/heshan >>>> >>>> >>>> >>>> >>>> -- >>>> Regards, >>>> Heshan Suriyaarachchi >>>> >>>> http://heshans.blogspot.com/ >>>> http://www.linkedin.com/in/heshan >>> >>> >>> >>> >>> >>> >>> -- >>> Regards, >>> Heshan Suriyaarachchi >>> >>> http://heshans.blogspot.com/ >>> http://www.linkedin.com/in/heshan >> > > > > > -- > Regards, > Heshan Suriyaarachchi > > http://heshans.blogspot.com/ > http://www.linkedin.com/in/heshan > > > > > -- > Regards, > Heshan Suriyaarachchi > > http://heshans.blogspot.com/ > http://www.linkedin.com/in/heshan
