Hi Lahiru, I’m impressed what Shameera has with all the Ansible playbooks. A very similar goal could be accomplished with Docker Container Images and Terraform could also be accomplished with adding AWS modules to the Ansible playbooks. Ansible can create EC2 images (1), but I didn’t see that in the ansible-airiavata playbooks yet. Let me know if I missed that, Shameera. A similar thing could be done with Terraform and Docker – either using Terraform to start up EC2 instances running internal docker containers, or using the EC2 Container service (which is lightweight, less expensive, but in my experience trickier).
Maybe this chart can explain it? Please let me know if I got something wrong, or if you can add to it. Ansible Docker Ansible w AWS module Docker w Terraform Automate deployment configurations Y Y Y Y Relatively easy to change configs Y N ? ? Start or stop EC2 servers with single command N N Y Y Containerized N Y N Y Could scale (multiple worker nodes) N N ? ? What I meant by spin up multiple containers in one command: I should have said ‘provision’. Once terraform configuration files are set up, Terraform can provision AWS instances and mount and configure Docker instances for each server in the architecture. It can provision these EC2 instances in one command, and take them back down with another. There’s a small example of using Terraform to spin up EC2 instances here (2). Because so much work has already been done with the Ansible playbooks, it may be easier to add AWS support to them rather than try to use Terraform with Docker. Unless there is a need for auto-scaling and provisioning. Is there ever a need for multiple load balanced Airiavata API servers, or Application Factories? Thanks, Colin (1) http://docs.ansible.com/ansible/guide_aws.html (2) https://github.com/hashicorp/terraform/tree/master/examples/aws-two-tier From: Lahiru Ginnaliya Gamathige [mailto:[email protected]] Sent: Friday, September 2, 2016 12:16 PM To: dev <[email protected]> Subject: Re: FW: Docker with Airavata Hi Colin, We are not really trying to run airavata locally we are trying to use docker for for our production which mean multiple VM multiple components. I have some docker work done here [1] for my testing. But I think Shameera is also working some task productionizing airavata. Can you please explain a bit what did you mean by spin up multiple containers in one command ? On Thu, Sep 1, 2016 at 7:58 AM, Roy-Ehri, Colin Josef <[email protected]<mailto:[email protected]>> wrote: Hi Lahiru, Are you investigating running Airavata with docker for local testing purposes, or in order to spin up multiple instances to handle changing loads? I did some work with Terraform (www.terraform.io<http://www.terraform.io>) and spinning up multiple containers in AWS with one command. I'd be happy try that with Airavata, if you think it could be useful. Thanks, Colin Roy-Ehri, MS.Ed. Senior Software Engineer Enterprise Decision Support Services (EDSS) Indiana University > Hi Lahiru, > That was my 2015 GSoC project. It was ended well and I did not work on >this after the demo to Suresh and Marlon last year. You can find the >instructions how to create and run dockerized Airavata here ><https://docs.google.com/document/d/1v2J1wFZx0TZXQs7PO7i6biNpzbM6KzdXrV >fwJiNtkvM/edit?usp=sharing> >. > > I am sharing the docker files and required scripts attached. Please > let me know if you find trouble accessing these files and the link. > > Thanks > Pankaj > > On Fri, Aug 19, 2016 at 10:23 PM, Lahiru Ginnaliya Gamathige < > [email protected]<mailto:[email protected]>> wrote: > > > Hi Devs, > > > > I remember a Gsoc student did some docker work, I am curious where > > did it ended, I see that no Dockerfile is in the repo. > > > > Do we have those separate ? Please give me some insight on that > > project, I would like to look in to it. > > > > Regards > > Lahiru > >
