If Docker is using Virtualbox itself, is it any different than current state with Vagrant? Are there advantages to this approach over Vagrant? How does the performance compare to current state with Vagrant? Can I run multiple topologies without the whole thing burning a hole in my table?
Even if your Docker approach has similar performance to Vagrant, this seems to mimic a multi-node cluster, which is good in the sense that it more accurately reflects Metron running in production. On Mon, Sep 26, 2016 at 10:52 AM, Justin Leet <[email protected]> wrote: > Hey Nick, > > There wasn't anything automated or special at all. Keep in mind there's > still a lot of spinup time to actually build the base cluster (and doesn't > even install Metron). > > The setup was basically: > > 1. Creating the docker machine (more memory might be helpful, btw). > > `docker-machine create --driver virtualbox --virtualbox-disk-size > "51200" --virtualbox-memory "8192" --virtualbox-cpu-count "2" default` > 2. > > Use the project at: https://github.com/sequenceiq/docker-ambari to > start > up a cluster. I was using `amb-start-cluster 5` to spin up 5 nodes + > consul server. Basically will spin up an Ambari managed cluster > (without > installing everything). > 3. > > Use the amb-shell functions laid out in https://github.com/apache/ > incubator-metron/pull/266 > > > I can write something a little more involved out, if you (or anyone else) > is interested, but it's basically just what I have in the PR. It's really > just useful for getting a clean cluster (relatively) painlessly. There'd > be a lot of refinement before this is generally useful probably (it's still > not fast since it has to install the cluster, etc.). > > Justin > > On Fri, Sep 23, 2016 at 3:34 PM, Nick Allen <[email protected]> wrote: > > > And actually, I shouldn't say Vagrant. It is painful because I run > Vagrant > > over Virtualbox. Its Virtualbox that is my nemesis. > > > > In very early iterations of the project, sometime in January, I was > > developing some of the sensor stuff with our Vagrant images running on > KVM > > in Linux. It was so quick to launch and consumed barely any resources. > It > > was lovely. > > > > On Fri, Sep 23, 2016 at 3:29 PM, Nick Allen <[email protected]> wrote: > > > > > So Justin - When can I use Docker for development? Even if we don't > have > > > an automated mechanism, do you have anything written that would provide > > > guidance on setting that up? > > > > > > > > > > > > > > > > > > -- > > > Nick Allen <[email protected]> > > > > > > > > > > > -- > > Nick Allen <[email protected]> > > > -- Nick Allen <[email protected]>
