Can you try to submit the jar from a directory which is writable by storm user. Try from /tmp maybe.
On Mon, Apr 3, 2017 at 3:56 PM, I PVP <[email protected]> wrote: > that is the error: > > > 2017-04-03 10:31:44.535 pool-15-thread-56 o.a.s.d.nimbus [INFO] Uploading > file from client to /opt/storm/storm-local/nimbus/ > inbox/stormjar-fceb1c76-b88e-415d-803d-ab73c0d2fafe.jar > 2017-04-03 10:31:44.820 pool-15-thread-17 o.a.s.d.nimbus [INFO] Finished > uploading file from client: /opt/storm/storm-local/nimbus/ > inbox/stormjar-fceb1c76-b88e-415d-803d-ab73c0d2fafe.jar > 2017-04-03 10:31:44.842 pool-15-thread-20 o.a.s.d.nimbus [INFO] Received > topology submission for <COMPANYNAME>Topology with conf > {"topology.max.task.parallelism" > nil, "topology.submitter.principal" "", "topology.acker.executors" nil, > "topology.eventlogger.executors" 0, "topology.workers" 1, > "topology.debug" false, "storm.zookeeper.superACL" nil, "topology.users" > (), "topology.submitter.user" "storm", "topology.kryo.register" nil, > "topology.kryo.decorators" (), "storm.id" > "<COMPANYNAME>Topology-2-1491226304", > "topology.name" "<COMPANYNAME>Topology"} > 2017-04-03 10:31:44.846 pool-15-thread-20 o.a.s.d.nimbus [INFO] > uploadedJar /opt/storm/storm-local/nimbus/inbox/stormjar-fceb1c76-b88e- > 415d-803d-ab73c0d2fafe.jar > 2017-04-03 10:31:44.847 pool-15-thread-20 > o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl > [INFO] Starting > 2017-04-03 10:31:44.848 pool-15-thread-20 o.a.s.s.o.a.z.ZooKeeper [INFO] > Initiating client connection, connectString=172.31.5.153:2181, > 172.31.3.29:2181,172.31.0.218:2181/storm sessionTimeout=20000 > watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@13bf52ea > 2017-04-03 10:31:44.851 pool-15-thread-20-SendThread(172.31.0.218:2181) > o.a.s.s.o.a.z.ClientCnxn [INFO] Opening socket connection to server > 172.31.0.218/172.31.0.218:2181. Will not attempt to authenticate using > SASL (unknown error) > 2017-04-03 10:31:44.852 pool-15-thread-20-SendThread(172.31.0.218:2181) > o.a.s.s.o.a.z.ClientCnxn [INFO] Socket connection established to > 172.31.0.218/172.31.0.218:2181, initiating session > 2017-04-03 10:31:44.855 pool-15-thread-20-SendThread(172.31.0.218:2181) > o.a.s.s.o.a.z.ClientCnxn [INFO] Session establishment complete on server > 172.31.0.218/172.31.0.218:2181, sessionid = 0x35b33b21dad0005, negotiated > timeout = 20000 > 2017-04-03 10:31:44.855 pool-15-thread-20-EventThread > o.a.s.s.o.a.c.f.s.ConnectionStateManager > [INFO] State change: CONNECTED > 2017-04-03 10:31:44.860 Curator-Framework-0 > o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl > [INFO] backgroundOperationsLoop exiting > 2017-04-03 10:31:44.862 pool-15-thread-20 o.a.s.s.o.a.z.ZooKeeper [INFO] > Session: 0x35b33b21dad0005 closed > 2017-04-03 10:31:44.862 pool-15-thread-20 o.a.s.cluster [INFO] > setup-path/blobstore/<COMPANYNAME>Topology-2-1491226304-stormjar.jar/ip- > 172-31-5-153.sa-east-1.compute.internal:6627-1 > 2017-04-03 10:31:44.862 pool-15-thread-20-EventThread > o.a.s.s.o.a.z.ClientCnxn [INFO] EventThread shut down > 2017-04-03 10:31:44.877 pool-15-thread-20 o.a.s.d.nimbus [WARN] Topology > submission exception. (topology name='<COMPANYNAME>Topology') #error { > :cause No such file or directory > :via > [{:type java.lang.RuntimeException > :message java.io.IOException: No such file or directory > :at [org.apache.storm.blobstore.LocalFsBlobStore createBlob > LocalFsBlobStore.java 117]} > {:type java.io.IOException > :message No such file or directory > :at [java.io.UnixFileSystem createFileExclusively UnixFileSystem.java > -2]}] > :trace > [[java.io.UnixFileSystem createFileExclusively UnixFileSystem.java -2] > [java.io.File createNewFile File.java 1012] > [org.apache.storm.blobstore.LocalFsBlobStoreFile getOutputStream > LocalFsBlobStoreFile.java 109] > [org.apache.storm.blobstore.BlobStore$BlobStoreFileOutputStream <init> > BlobStore.java 316] > [org.apache.storm.blobstore.LocalFsBlobStore createBlob > LocalFsBlobStore.java 111] > [org.apache.storm.blobstore.BlobStore createBlob BlobStore.java 217] > [sun.reflect.NativeMethodAccessorImpl invoke0 > NativeMethodAccessorImpl.java -2] > [sun.reflect.NativeMethodAccessorImpl invoke > NativeMethodAccessorImpl.java 62] > [sun.reflect.DelegatingMethodAccessorImpl invoke > DelegatingMethodAccessorImpl.java 43] > [java.lang.reflect.Method invoke Method.java 498] > [clojure.lang.Reflector invokeMatchingMethod Reflector.java 93] > [clojure.lang.Reflector invokeInstanceMethod Reflector.java 28] > [org.apache.storm.daemon.nimbus$setup_storm_code invoke nimbus.clj 474] > [org.apache.storm.daemon.nimbus$fn__9109$exec_fn__1371__auto__$reify__9138 > submitTopologyWithOpts nimbus.clj 1525] > [org.apache.storm.daemon.nimbus$fn__9109$exec_fn__1371__auto__$reify__9138 > submitTopology nimbus.clj 1541] > [org.apache.storm.generated.Nimbus$Processor$submitTopology getResult > Nimbus.java 2912] > [org.apache.storm.generated.Nimbus$Processor$submitTopology getResult > Nimbus.java 2896] > [org.apache.storm.thrift.ProcessFunction process ProcessFunction.java > 39] > [org.apache.storm.thrift.TBaseProcessor process TBaseProcessor.java 39] > [org.apache.storm.security.auth.SimpleTransportPlugin$SimpleWrapProcessor > process SimpleTransportPlugin.java 162] > [org.apache.storm.thrift.server.AbstractNonblockingServer$FrameBuffer > invoke AbstractNonblockingServer.java 518] > [org.apache.storm.thrift.server.Invocation run Invocation.java 18] > [java.util.concurrent.ThreadPoolExecutor runWorker > ThreadPoolExecutor.java 1142] > [java.util.concurrent.ThreadPoolExecutor$Worker run > ThreadPoolExecutor.java 617] > [java.lang.Thread run Thread.java 745]]} > 2017-04-03 10:31:44.877 pool-15-thread-20 o.a.s.t.s. > AbstractNonblockingServer$FrameBuffer [ERROR] Unexpected throwable while > invoking! > java.lang.RuntimeException: java.io.IOException: No such file or directory > at org.apache.storm.blobstore.LocalFsBlobStore.createBlob( > LocalFsBlobStore.java:117) > at org.apache.storm.blobstore.BlobStore.createBlob(BlobStore.java:217) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) > at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) > at org.apache.storm.daemon.nimbus$setup_storm_code.invoke(nimbus.clj:474) > at org.apache.storm.daemon.nimbus$fn__9109$exec_fn__1371_ > _auto__$reify__9138.submitTopologyWithOpts(nimbus.clj:1525) > at org.apache.storm.daemon.nimbus$fn__9109$exec_fn__1371_ > _auto__$reify__9138.submitTopology(nimbus.clj:1541) > at org.apache.storm.generated.Nimbus$Processor$submitTopology.getResult( > Nimbus.java:2912) > at org.apache.storm.generated.Nimbus$Processor$submitTopology.getResult( > Nimbus.java:2896) > at org.apache.storm.thrift.ProcessFunction.process( > ProcessFunction.java:39) > at org.apache.storm.thrift.TBaseProcessor.process(TBaseProcessor.java:39) > at org.apache.storm.security.auth.SimpleTransportPlugin$ > SimpleWrapProcessor.process(SimpleTransportPlugin.java:162) > at org.apache.storm.thrift.server.AbstractNonblockingServer$ > FrameBuffer.invoke(AbstractNonblockingServer.java:518) > at org.apache.storm.thrift.server.Invocation.run(Invocation.java:18) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.io.IOException: No such file or directory > at java.io.UnixFileSystem.createFileExclusively(Native Method) > at java.io.File.createNewFile(File.java:1012) > at org.apache.storm.blobstore.LocalFsBlobStoreFile.getOutputStream( > LocalFsBlobStoreFile.java:109) > at org.apache.storm.blobstore.BlobStore$BlobStoreFileOutputStream.< > init>(BlobStore.java:316) > at org.apache.storm.blobstore.LocalFsBlobStore.createBlob( > LocalFsBlobStore.java:111) > ... 20 more > > — > Storm 1.0.3 on AWS Red Hat Enterprise Linux 7.3. > Storm path is /opt/storm > user: storm:storm > > Thanks > > IPVP > > On March 31, 2017 at 3:10:05 AM, Harsh Choudhary ([email protected]) > wrote: > > Can you show the exact error you getting? > > *Cheers!* > > Harsh Choudhary > > On Thu, Mar 30, 2017 at 11:39 PM, I PVP <[email protected]> wrote: > >> that is how it is being done as of now: >> >> sudo chown -R storm:storm /opt/storm >> sudo chmod -R 700 /opt/storm >> >> but still facing some issues while submitting topologies. looks like >> Nimbus is not being able to create blob store directories or files. >> >> i just tried sudo chmod -R 777 /opt/storm. but the issue still happening. >> >> >> On March 30, 2017 at 3:02:07 PM, Harsh Choudhary ([email protected]) >> wrote: >> >> It depends on from which user, you are running storm. That user must own >> the folders of storm. So, you need not use chmod but chown. >> >> *Cheers!* >> >> Harsh Choudhary >> >> On Thu, Mar 30, 2017 at 11:24 PM, I PVP <[email protected]> wrote: >> >>> What are the recommended files/folders permissions for running Storm on >>> Linux ? >>> >>> Can I just set the entire folder tree to 700 or are there specific >>> files/folders that required a particular permission ? >>> >>> >>> I am installing Storm 1.0.3 on Red Hat Enterprise Linux 7.3. >>> Storm path is /opt/storm >>> user: storm:storm. >>> >>> >>> Thanks >>> >>> IPVP >>> >>> >> >
