You could.  This was a consideration when creating the IntegrationTest
infrastructure.    There are some challenges here, though, with hbase and
storm coexisting in the same jvm.  I do not know if this is still an issue
with storm 1.0+.

On Thu, Oct 13, 2016 at 2:26 PM, Otto Fowler <ottobackwa...@gmail.com>
wrote:

> Could we use the IntegrationTest components to do this?
>
>
>
> On October 13, 2016 at 14:04:54, zeo...@gmail.com (zeo...@gmail.com)
> wrote:
>
> +1 Ryan and Otto's comments.
>
> I also strongly think we need to make a demo environment easier, but that
> should be different than quick-dev.
>
> Jon
>
> On Thu, Oct 13, 2016 at 1:15 PM Otto Fowler <ottobackwa...@gmail.com>
> wrote:
>
> > - create scripts/utilities to easily run a topology locally in an IDE
> > instead of in the VM
> >
> >
> > ^^^^^^^^ THIS.
> >
> >
> > On October 13, 2016 at 12:36:45, Ryan Merriman (merrim...@gmail.com)
> > wrote:
> >
> > Working with the quick-dev vagrant VM recently left a lot to be desired.
> > All forthcoming comments are made under the assumption that this VM is
> > intended for development purposes. If that is not true, I think we should
> > consider adding a VM for this purpose (or Docker containers?). Here are
> > the issues I ran into that I think can be improved:
> >
> > - had to upgrade VirtualBox from 5.0.16 to 5.0.20
> > - had to update to the latest metron/hdp-base Vagrant box
> > - takes forever to spin up
> > - VM is constrained for resources making it unstable
> > - spent a large amount of time troubleshooting sensors (no raw messages
> > in Kafka)
> > - no easy way to debug topologies
> >
> > Fortunately I think we can make this a much better experience without a
> > major effort. Here are my ideas to do this:
> >
> > - update the prereqs for VirtualBox
> > - add a check for the appropriate base box version (Jira has already
> > been created https://issues.apache.org/jira/browse/METRON-497)
> > - don't install any sensors and replace them with a data generator that
> > just loops through sample data and emits to Kafka (could also be used to
> > replay and troubleshoot edge cases)
> > - everything in monit is off by default except for ES or other critical
> > services
> > - create scripts/utilities to easily run a topology locally in an IDE
> > instead of in the VM
> > - improved documentation with examples of how to run and troubleshoot
> > topologies
> >
> > Is this a worthwhile effort? I think this would also give users an easier
> > path to demonstrate or tour Metron's capabilities. Are there any other
> > improvements people would like to see? Should we wait for Docker?
> > Thoughts?
> >
> > Ryan Merriman
> >
> --
>
> Jon
>

Reply via email to