Hi All,
Currently the way we publish storm connector jars into maven
repositories is to just publish storm-kafka, hive, hbase without any of its
dependencies included.
The expectation here is user will include their version of hdfs and kafka
dependencies along with storm-hdfs or kafka and package it with topology as a
uber jar.
IMO this is most painful step in deploying/building a topology as observed here
https://issues.apache.org/jira/browse/STORM-967 . I think we need to
standardize either assembly or shade plugin.
Also why don’t we publish connectors with all the dependencies included and
user only need to include a dependency storm-hdfs in their pom.xml and it will
bring all the other dependencies its needed.
Any ideas on improving this?
Thanks,
Harsha