[
https://issues.apache.org/jira/browse/STORM-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuzhao Chen reassigned STORM-2905:
----------------------------------
Assignee: Yuzhao Chen
> Supervisor still downloads storm blob files when the topology was killed.
> -------------------------------------------------------------------------
>
> Key: STORM-2905
> URL: https://issues.apache.org/jira/browse/STORM-2905
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-server
> Affects Versions: 2.0.0
> Reporter: Yuzhao Chen
> Assignee: Yuzhao Chen
> Priority: Major
>
> When we kill a topology, at the moment of topology blob-files be removed,
> Supervisor executor still request blob-files and get an KeyNotFoundException,
> this is the partial of Supervisor log:
> 2017-11-21 17:32:00.435 o.a.s.d.s.Slot SLOT_9703 [INFO] SLOT 9703: Changing
> current assignment from
> LocalAssignment(topology_id:word_count_fk_iii-3-1511256346,
> executors:[ExecutorInfo(task_start:7, task_end:7), ExecutorInfo(task_start:5,
> task_end:5), ExecutorInfo(task_start:3, task_end:3),
> ExecutorInfo(task_start:1, task_end:1)],
> resources:WorkerResources(mem_on_heap:512.0, mem_off_heap:0.0, cpu:40.0,
> shared_mem_on_heap:0.0, shared_mem_off_heap:0.0,
> resources:\{offheap.memory.mb=0.0, onheap.memory.mb=512.0,
> cpu.pcore.percent=40.0}, shared_resources:{}), owner:sankuai) to null
> 2017-11-21 17:32:10.520 o.a.s.l.AsyncLocalizer AsyncLocalizer Executor - 3
> [WARN] Failed to download blob LOCAL TOPO BLOB TOPO_CODE
> word_count_fk_iii-3-1511256346 will try again in 100 ms
> org.apache.storm.generated.KeyNotFoundException: null
> at
> org.apache.storm.generated.Nimbus$getBlobMeta_result$getBlobMeta_resultStandardScheme.read(Nimbus.java:24935)
> ~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
> at
> org.apache.storm.generated.Nimbus$getBlobMeta_result$getBlobMeta_resultStandardScheme.read(Nimbus.java:24903)
> ~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
> at
> org.apache.storm.generated.Nimbus$getBlobMeta_result.read(Nimbus.java:24834)
> ~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86)
> ~[libthrift-0.9.3.jar:0.9.3]
> at
> org.apache.storm.generated.Nimbus$Client.recv_getBlobMeta(Nimbus.java:812)
> ~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
> at org.apache.storm.generated.Nimbus$Client.getBlobMeta(Nimbus.java:799)
> ~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
> at
> org.apache.storm.blobstore.NimbusBlobStore.getBlobMeta(NimbusBlobStore.java:306)
> ~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
> at
> org.apache.storm.localizer.LocallyCachedTopologyBlob.getRemoteVersion(LocallyCachedTopologyBlob.java:176)
> ~[storm-server-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
> at
> org.apache.storm.localizer.AsyncLocalizer.lambda$downloadOrUpdate$5(AsyncLocalizer.java:249)
> ~[storm-server-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
> at
> java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1626)
> [?:1.8.0_151]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [?:1.8.0_151]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_151]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> [?:1.8.0_151]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> [?:1.8.0_151]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_151]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_151]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_151]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)