[
https://issues.apache.org/jira/browse/BIGTOP-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176365#comment-14176365
]
Evans Ye edited comment on BIGTOP-1417 at 10/19/14 5:49 PM:
------------------------------------------------------------
Hi [~jayunit100]
Good news!
Finally, I just have the new patch available now.
But I need to make it clear first that the patch does not written in pure shell
script + Docker commands.
Instead, I still use Vagrant to manage containers and add a wrapper script on
top of it.
There're some reasons for me to keep Vagrant in the patch:
* Vagrant supports sync folder from host to container even though using
boot2docker on non-Linux host, while Docker can only sync volume between
container and boot2docker VM which require you to clone bigtop in boot2docker.
(see
[BIGTOP-1417.pdf|https://issues.apache.org/jira/secure/attachment/12675729/BIGTOP-1417.pdf])
* container life-cycle management are way easier (create, destroy, gathering
host information...)
* Without Vagrant provisioners(which cause the issue), we can now support any
hosts including OS X and Windows
* Without Vagrant provisioners(which cause the issue), we need to do the
provisioning by executing a set of ssh commands. This is the same regardless
using Docker commands or Vagrant. Thus we still have the flexibility to
replace Vagrant by Docker commands.
Now with the wrapper script, the creation of Dockerize Bigtop cluser is simpler.
You can just do {{./docker-hadoop.sh --build-image --create 3}} to create
cluster from scratch.
I've tested it on Centos 6.5 bare metal and Windows.
Please give me any kind of feedback so that we can revise it to be better.
Thanks!
was (Author: evans_ye):
Hi [~jay vyas,
Good news!
Finally, I just have the new patch available now.
But I need to make it clear first that the patch does not written in pure shell
script + Docker commands.
Instead, I still use Vagrant to manage containers and add a wrapper script on
top of it.
There're some reasons for me to keep Vagrant in the patch:
* Vagrant supports sync folder from host to container even though using
boot2docker on non-Linux host, while Docker can only sync volume between
container and boot2docker VM which require you to clone bigtop in boot2docker.
(see
[BIGTOP-1417.pdf|https://issues.apache.org/jira/secure/attachment/12675729/BIGTOP-1417.pdf])
* container life-cycle management are way easier (create, destroy, gathering
host information...)
* Without Vagrant provisioners(which cause the issue), we can now support any
hosts including OS X and Windows
* Without Vagrant provisioners(which cause the issue), we need to do the
provisioning by executing a set of ssh commands. This is the same regardless
using Docker commands or Vagrant. Thus we still have the flexibility to
replace Vagrant by Docker commands.
Now with the wrapper script, the creation of Dockerize Bigtop cluser is simpler.
You can just do {{./docker-hadoop.sh --build-image --create 3}} to create
cluster from scratch.
I've tested it on Centos 6.5 bare metal and Windows.
Please give me any kind of feedback so that we can revise it to be better.
Thanks!
> Dockerize the puppetized vagrant deployer
> -----------------------------------------
>
> Key: BIGTOP-1417
> URL: https://issues.apache.org/jira/browse/BIGTOP-1417
> Project: Bigtop
> Issue Type: New Feature
> Components: deployment
> Affects Versions: 0.7.0
> Reporter: Evans Ye
> Priority: Minor
> Fix For: 0.9.0
>
> Attachments: BIGTOP-1417.1.patch, BIGTOP-1417.2.patch,
> BIGTOP-1417.3.patch, BIGTOP-1417.4.patch, BIGTOP-1417.5.patch, BIGTOP-1417.pdf
>
>
> This is one of the bigtop's dockerize task which mainly focus on deploying
> bigtop hadoop cluster using
> [bigtop-puppet|https://github.com/apache/bigtop/tree/master/bigtop-deploy/puppet]
> on top of docker containers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
