I am struggling with storm running on mesos. The main objective is my topology would write data into hbase. When I submitted the topology to the storm. it would create mesos task. In my topology, I load spring hbase template to make connection with hbase by reading configuration from zookeeper. However I encouter the error message like this.
Another difference would be zookeeper classpath doesn't contains all the libraries. Anyone has ideas on this? 2014-10-30 23:40:50 o.a.h.h.u.DynamicClassLoader [WARN] Failed to identify the fs of dir /tmp/hbase-ubuntu/hbase/lib, ignored java.io.IOException: No FileSystem for scheme: file at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2385) ~[stormjar.jar:na] at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392) ~[stormjar.jar:na] at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89) ~[stormjar.jar:na] at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431) ~[stormjar.jar:na] at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413) ~[stormjar.jar:na] at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368) ~[stormjar.jar:na] at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:167) ~[stormjar.jar:na] at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:352) ~[stormjar.jar:na] at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296) ~[stormjar.jar:na] at org.apache.hadoop.hbase.util.DynamicClassLoader.<init>(DynamicClassLoader.java:104) ~[stormjar.jar:na] at org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:201) [stormjar.jar:na] at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64) [stormjar.jar:na] at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:69) [stormjar.jar:na] at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83) [stormjar.jar:na] at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:857) [stormjar.jar:na] at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:662) [stormjar.jar:na] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) [na:1.7.0_67] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) [na:1.7.0_67] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) [na:1.7.0_67] at java.lang.reflect.Constructor.newInstance(Constructor.java:526) [na:1.7.0_67] at org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:414) [stormjar.jar:na] at org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:393) [stormjar.jar:na] at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:274) [stormjar.jar:na] at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:194) [stormjar.jar:na] at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:171) [stormjar.jar:na] at org.springframework.data.hadoop.hbase.HbaseUtils.getHTable(HbaseUtils.java:76) [stormjar.jar:na] at org.springframework.data.hadoop.hbase.HbaseTemplate.getTable(HbaseTemplate.java:75) [stormjar.jar:na] at org.springframework.data.hadoop.hbase.HbaseTemplate.execute(HbaseTemplate.java:54) [stormjar.jar:na] at com.samsung.smcl.dashboard.storm.PersonUsageSpout.nextTuple(PersonUsageSpout.java:103) [stormjar.jar:na] at backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563) [storm-core-0.9.2-incubating.jar:0.9.2-incubating] at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431) [storm-core-0.9.2-incubating.jar:0.9.2-incubating] at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_67] 2014 -Luyi.
