Hi All,
As community we are growing and adding new and exciting
features to Storm and also we've ever growing connector which
only helps in storm adoption. One thing we've severely lacking
is system tests. There are unit tests which acts as
integration tests to storm-core but there are no system wide
integration tests that can spin up kafka nodes and storm ,
hbase and run a topology that can make sure the data is
getting into hbase.
We at Hortonworks use our test topologies run some of these
tests but this integration code to spin up vms or nodes is hard
to share. In apache kafka we are using ducktape to write system
tests so far its working out good. If there are any other
frameworks you've in mind we can definitely take a look. But as
a community we need start looking at
https://github.com/confluentinc/ducktape or similar frameworks
to start writing systems tests. Ducktape makes it easy to run
in a vm or any other infrastructure. Appreciate any feedback
on this.
Thanks,
Harsha
