That is occurring from shutting down Supervisor, which wouldn't hurt anything I think. I agree the message looks strange and may feel like actual error message, so better to reword log message and adjust log level in this case.
2018년 2월 7일 (수) 오후 12:50, Suman Mallela <[email protected]>님이 작성: > Hi, > > > > I have built a stormcrawler project that integrates with solr 6.4.1. > > > > I had run a mvn clean package to build a uberjar. > > > > Then I ran the following commands to run a SolrCrawlTopolgy in local mode. > > root@stormvm:/opt/stormcrawler# storm jar target/stormcrawler-1.0.jar > org.apache.storm.flux.Flux --sleep 30000 --local solr-injector.flux > > injector.log > > > > *Here is the error/exception I get, (Attached is the injector.log for more > details)* > > > > 42285 [SLOT_1024] INFO o.a.s.d.s.Slot - SLOT 1024: Changing current > assignment from LocalAssignment(topology_id:injector-1-1517974606, > executors:[ExecutorInfo(task_start:4, task_end:4), > ExecutorInfo(task_start:3, task_end:3), ExecutorInfo(task_start:2, > task_end:2), ExecutorInfo(task_start:1, task_end:1)], > resources:WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, cpu:0.0)) to > null > > 42481 [main] INFO o.a.s.d.s.ReadClusterState - Waiting for > Thread[SLOT_1025,5,main] to be EMPTY, currently EMPTY > > 42481 [main] INFO o.a.s.d.s.ReadClusterState - Waiting for > Thread[SLOT_1026,5,main] to be EMPTY, currently EMPTY > > 42481 [main] INFO o.a.s.d.s.Supervisor - Shutting down supervisor > 78552f24-1329-4de3-95cd-3222cd03588b > > *42483 [Thread-10] ERROR o.a.s.d.s.ReadClusterState - Failed to Sync > Supervisor* > > *java.lang.InterruptedException: null* > > * at java.lang.Object.wait(Native Method) ~[?:1.8.0_151]* > > * at java.lang.Object.wait(Object.java:502) ~[?:1.8.0_151]* > > * at org.apache.storm.shade.org > <http://org.apache.storm.shade.org>.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) > ~[storm-core-1.1.0.jar:1.1.0]* > > at > org.apache.storm.shade.org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1073) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.ExistsBuilderImpl$3.call(ExistsBuilderImpl.java:233) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.ExistsBuilderImpl$3.call(ExistsBuilderImpl.java:226) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.ExistsBuilderImpl.pathInForegroundStandard(ExistsBuilderImpl.java:223) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.ExistsBuilderImpl.pathInForeground(ExistsBuilderImpl.java:216) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:175) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:32) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.zookeeper.Zookeeper.getVersion(Zookeeper.java:248) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.cluster.ZKStateStorage.get_version(ZKStateStorage.java:163) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.cluster.StormClusterStateImpl.assignmentVersion(StormClusterStateImpl.java:185) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.daemon.supervisor.ReadClusterState.getAssignmentsSnapshot(ReadClusterState.java:191) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.daemon.supervisor.ReadClusterState.run(ReadClusterState.java:128) > [storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.event.EventManagerImp$1.run(EventManagerImp.java:54) > [storm-core-1.1.0.jar:1.1.0] > > 42485 [Thread-10] INFO o.a.s.e.EventManagerImp - Event manager interrupted > > 42487 [Curator-Framework-0] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - > backgroundOperationsLoop exiting > > 42489 [ProcessThread(sid:0 cport:-1):] INFO > o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for > sessionid: 0x1616e564fff000a > > 42491 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO > o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client > /0:0:0:0:0:0:0:1:36990 which had sessionid 0x1616e564fff000a > > 42491 [main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x1616e564fff000a > closed > > 42491 [main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut > down > > 42491 [main] INFO o.a.s.d.s.ReadClusterState - Setting > Thread[SLOT_1027,5,main] assignment to null > > 42492 [main] INFO o.a.s.d.s.ReadClusterState - Setting > Thread[SLOT_1028,5,main] assignment to null > > 42492 [main] INFO o.a.s.d.s.ReadClusterState - Setting > Thread[SLOT_1029,5,main] assignment to null > > 42492 [main] INFO o.a.s.d.s.ReadClusterState - Waiting for > Thread[SLOT_1027,5,main] to be EMPTY, currently EMPTY > > 42492 [main] INFO o.a.s.d.s.ReadClusterState - Waiting for > Thread[SLOT_1028,5,main] to be EMPTY, currently EMPTY > > 42492 [main] INFO o.a.s.d.s.ReadClusterState - Waiting for > Thread[SLOT_1029,5,main] to be EMPTY, currently EMPTY > > 42492 [main] INFO o.a.s.d.s.Supervisor - Shutting down supervisor > 878ab062-6dcc-4687-be04-e1494476bd57 > > 42494 [Thread-14] INFO o.a.s.e.EventManagerImp - Event manager interrupted > > 42497 [Curator-Framework-0] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - > backgroundOperationsLoop exiting > > 42499 [ProcessThread(sid:0 cport:-1):] INFO > o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for > sessionid: 0x1616e564fff000c > > 42501 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO > o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client > /0:0:0:0:0:0:0:1:36994 which had sessionid 0x1616e564fff000c > > 42501 [main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut > down > > 42501 [main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x1616e564fff000c > closed > > 42511 [main] INFO o.a.s.testing - Shutting down in process zookeeper > > 42511 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO > o.a.s.s.o.a.z.s.NIOServerCnxnFactory - NIOServerCnxn factory exited run > method > > 42512 [main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - shutting down > > 42512 [main] INFO o.a.s.s.o.a.z.s.SessionTrackerImpl - Shutting down > > 42512 [main] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Shutting down > > 42512 [ProcessThread(sid:0 cport:-1):] INFO > o.a.s.s.o.a.z.s.PrepRequestProcessor - PrepRequestProcessor exited loop! > > 42512 [main] INFO o.a.s.s.o.a.z.s.SyncRequestProcessor - Shutting down > > 42513 [SyncThread:0] INFO o.a.s.s.o.a.z.s.SyncRequestProcessor - > SyncRequestProcessor exited! > > 42513 [main] INFO o.a.s.s.o.a.z.s.FinalRequestProcessor - shutdown of > request processor complete > > 42514 [main] INFO o.a.s.testing - Done shutting down in process zookeeper > > 42514 [main] INFO o.a.s.testing - Deleting temporary path > /tmp/b0f5eea2-32c9-446f-912b-7091801b6a4c > > 42521 [main] INFO o.a.s.testing - Deleting temporary path > /tmp/35d0290c-625d-49de-9964-b71b103f98c5 > > 42522 [main] INFO o.a.s.testing - Deleting temporary path > /tmp/80be0fec-fbd9-40ac-91f0-6a1ed6ad5292 > > 42532 [main] INFO o.a.s.testing - Deleting temporary path > /tmp/376e2f26-4663-4225-b3ec-98937e5877af > > 44272 [SessionTracker] INFO o.a.s.s.o.a.z.s.SessionTrackerImpl - > SessionTrackerImpl exited loop! > > > > *The above occurs even when I try to run the below command to start the > crawl (Attached crawler.log for more details)* > > > > root@stormvm:/opt/stormcrawler# storm jar target/stormcrawler-1.0.jar > org.apache.storm.flux.Flux --sleep 30000 --local solr-crawler.flux > > crawler.log > > > > [SLOT_1024] INFO o.a.s.l.AsyncLocalizer - Released blob reference > crawler-1-1517975006 1024 Cleaning up basic files... > > 43778 [SLOT_1024] INFO o.a.s.d.s.AdvancedFSOps - Deleting path > /tmp/757a8c9e-6b07-48ef-85a7-75f4eb929583/supervisor/stormdist/crawler-1-1517975006 > > 43779 [SLOT_1024] INFO o.a.s.d.s.Slot - STATE KILL msInState: 12 > topo:crawler-1-1517975006 worker:null -> EMPTY msInState: 0 > > 43779 [SLOT_1024] INFO o.a.s.d.s.Slot - SLOT 1024: Changing current > assignment from LocalAssignment(topology_id:crawler-1-1517975006, > executors:[ExecutorInfo(task_start:8, task_end:8), > ExecutorInfo(task_start:2, task_end:2), ExecutorInfo(task_start:6, > task_end:6), ExecutorInfo(task_start:4, task_end:4), > ExecutorInfo(task_start:7, task_end:7), ExecutorInfo(task_start:3, > task_end:3), ExecutorInfo(task_start:1, task_end:1), > ExecutorInfo(task_start:9, task_end:9), ExecutorInfo(task_start:5, > task_end:5)], resources:WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, > cpu:0.0)) to null > > 43788 [main] INFO o.a.s.d.s.ReadClusterState - Waiting for > Thread[SLOT_1025,5,main] to be EMPTY, currently EMPTY > > 43789 [main] INFO o.a.s.d.s.ReadClusterState - Waiting for > Thread[SLOT_1026,5,main] to be EMPTY, currently EMPTY > > 43789 [main] INFO o.a.s.d.s.Supervisor - Shutting down supervisor > 510629cb-d0ef-4bec-b44d-2d25c751742f > > *43791 [Thread-10] ERROR o.a.s.d.s.ReadClusterState - Failed to Sync > Supervisor* > > *java.lang.RuntimeException: java.lang.InterruptedException* > > * at org.apache.storm.utils.Utils.wrapInRuntime(Utils.java:1531) > ~[storm-core-1.1.0.jar:1.1.0]* > > * at > org.apache.storm.zookeeper.Zookeeper.getChildren(Zookeeper.java:265) > ~[storm-core-1.1.0.jar:1.1.0]* > > * at* > org.apache.storm.cluster.ZKStateStorage.get_children(ZKStateStorage.java:174) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.cluster.StormClusterStateImpl.assignments(StormClusterStateImpl.java:153) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.daemon.supervisor.ReadClusterState.run(ReadClusterState.java:126) > [storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.event.EventManagerImp$1.run(EventManagerImp.java:54) > [storm-core-1.1.0.jar:1.1.0] > > Caused by: java.lang.InterruptedException > > at java.lang.Object.wait(Native Method) ~[?:1.8.0_151] > > at java.lang.Object.wait(Object.java:502) ~[?:1.8.0_151] > > at > org.apache.storm.shade.org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1588) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1625) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:226) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:219) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:216) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:207) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.shade.org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:40) > ~[storm-core-1.1.0.jar:1.1.0] > > at > org.apache.storm.zookeeper.Zookeeper.getChildren(Zookeeper.java:260) > ~[storm-core-1.1.0.jar:1.1.0] > > ... 4 more > > 43800 [Thread-10] INFO o.a.s.e.EventManagerImp - Event manager interrupted > > 43802 [Curator-Framework-0] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - > backgroundOperationsLoop exiting > > > > Storm 1.1.0 keeps failing always. > > > > Thank you. > >
