[
https://issues.apache.org/jira/browse/STORM-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249683#comment-16249683
]
Robert Joseph Evans commented on STORM-2809:
--------------------------------------------
I also found the following killing off the supervisor that needs to be fixed,
but I have to go so I may not be able to work on this more until tonight.
{code}
2017-11-13 08:54:22.597 o.a.s.d.s.Slot SLOT_6703 [ERROR] Error when processing
event
java.io.FileNotFoundException: File
'/.../storm-local/supervisor/stormdist/SlidingWindowTestw2s5-4-1510584685/stormconf.ser'
does no
t exist
at org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:292)
~[commons-io-2.5.jar:2.5]
at
org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1815)
~[commons-io-2.5.jar:2.5]
at
org.apache.storm.utils.ConfigUtils.readSupervisorStormConfGivenPath(ConfigUtils.java:269)
~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
at
org.apache.storm.utils.ConfigUtils.readSupervisorStormConfImpl(ConfigUtils.java:425)
~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
at
org.apache.storm.utils.ConfigUtils.readSupervisorStormConf(ConfigUtils.java:264)
~[storm-client-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
at
org.apache.storm.localizer.AsyncLocalizer.getLocalResources(AsyncLocalizer.java:332)
~[storm-server-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
at
org.apache.storm.localizer.AsyncLocalizer.releaseSlotFor(AsyncLocalizer.java:496)
~[storm-server-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
at
org.apache.storm.daemon.supervisor.Slot.handleWaitingForBlobLocalization(Slot.java:632)
~[storm-server-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
at
org.apache.storm.daemon.supervisor.Slot.stateMachineStep(Slot.java:391)
~[storm-server-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
at org.apache.storm.daemon.supervisor.Slot.run(Slot.java:1120)
[storm-server-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT]
{code}
> Integration test is failing consistently and topologies sometimes fail to
> start workers
> ---------------------------------------------------------------------------------------
>
> Key: STORM-2809
> URL: https://issues.apache.org/jira/browse/STORM-2809
> Project: Apache Storm
> Issue Type: Bug
> Affects Versions: 2.0.0
> Reporter: Stig Rohde Døssing
> Assignee: Robert Joseph Evans
> Fix For: 2.0.0
>
>
> The integration test has been failing fairly consistently since
> https://github.com/apache/storm/pull/2363. I tried running the test outside a
> VM with a locally installed Storm setup, and it has failed every time for me.
> Most runs seem to fail in ways that make it look like the integration test is
> just flaky (e.g. tuple windows not matching the calculated window), but in at
> least a few tests I saw the topology get submitted to Nimbus followed by
> about 3 minutes of nothing happening. The workers never started and the
> supervisor didn't seem aware of the scheduling. The only evidence that the
> topology was submitted was in the Nimbus log. This still happens even if the
> test topologies are killed with a timeout of 0, so there should be slots free
> for the next test immediately.
> I tried reverting https://github.com/apache/storm/pull/2363 and it seems to
> make the integration test pass much more often. Over 5 runs there was still
> an instance of a supervisor failing to start the workers, but the other 4
> passed.
> We should try to fix whatever is causing the supervisor to fail to start
> workers, and get the integration test more stable.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
