[
https://issues.apache.org/jira/browse/STORM-982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957609#comment-14957609
]
Robert Joseph Evans commented on STORM-982:
-------------------------------------------
This is a race condition between nimbus and the worker. The worker is writing
heartbeats, but nimbus has decided the topology is gone and cleaned up
zookeeper. I'm not sure the best thing to do, because this is arguably a
desired behavior, the topology is gone and the worker didn't get the message
yet through the normal path.
> Random test failures on backtype.storm.grouping-test
> ----------------------------------------------------
>
> Key: STORM-982
> URL: https://issues.apache.org/jira/browse/STORM-982
> Project: Apache Storm
> Issue Type: Sub-task
> Components: storm-core
> Reporter: Jungtaek Lim
>
> {code}
> Error parsing
> /home/travis/build/HeartSaVioR/storm/storm-core/target/test-reports/backtype.storm.grouping-test.xml
> <?xml version="1.0" encoding="UTF-8"?>
> <testsuites>
> <testsuite package="backtype.storm" name="grouping-test">
> <testcase name="test-custom-groupings"
> classname="backtype.storm.grouping-test">
> <system-out>
> <![CDATA[119127 [main] INFO b.s.zookeeper - Starting inprocess zookeeper at
> port 2002 and dir /tmp/da732832-bada-4305-9132-e4b0e2de0e5b
> 119130 [main] INFO b.s.u.Utils - Using defaults.yaml from resources
> 119139 [main] INFO b.s.d.nimbus - Starting Nimbus with conf
> {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts"
> "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local",
> "storm.messaging.netty.client_worker_threads" 1,
> "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil,
> "zmq.threads" 1, "storm.group.mapping.service"
> "backtype.storm.security.auth.ShellBasedGroupsMapping",
> "transactional.zookeeper.root" "/transactional",
> "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773,
> "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer",
> "storm.messaging.netty.server_worker_threads" 1,
> "topology.max.error.report.per.interval" 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0,
> "storm.principal.tolocal"
> "backtype.storm.security.auth.DefaultPrincipalToLocal",
> "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5,
> "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true,
> "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100,
> "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5,
> "topology.enable.message.timeouts" false, "drpc.worker.threads" 64,
> "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port"
> 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024,
> "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy",
> "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000,
> "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path"
> "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil,
> "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers"
> ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins"
> 10080, "topology.worker.childopts" nil, "topology.classpath" nil,
> "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs"
> 600, "topology.skip.missing.kryo.registrations" true,
> "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml",
> "storm.group.mapping.service.cache.duration.secs" 120,
> "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10,
> "supervisor.supervisors" [], "topology.tasks" nil,
> "topology.bolts.outgoing.overflow.buffer.enable" false,
> "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1,
> "storm.local.dir" "/tmp/855275ea-e2eb-456c-a8f0-50fcc178969f",
> "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [],
> "topology.message.timeout.secs" 30,
> "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m",
> "topology.environment" nil, "topology.debug" false,
> "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m",
> "drpc.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil,
> "storm.meta.serialization.delegate"
> "backtype.storm.serialization.GzipThriftSerializationDelegate",
> "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60,
> "nimbus.task.timeout.secs" 30, "drpc.port" 3772,
> "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port"
> 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5,
> "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval"
> 1000, "logs.users" nil, "transactional.zookeeper.port" nil,
> "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30,
> "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1,
> "supervisor.slots.ports" [6700 6701 6702 6703],
> "topology.transfer.buffer.size" 1024,
> "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict"
> false, "nimbus.file.copy.expiration.secs" 600,
> "topology.executor.receive.buffer.size" 1024, "nimbus.task.launch.secs" 120,
> "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880,
> "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil,
> "drpc.https.port" -1, "task.refresh.poll.secs" 10,
> "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000,
> "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10,
> "storm.messaging.transport" "backtype.storm.messaging.netty.Context",
> "storm.messaging.netty.authentication" false, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "",
> "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator",
> "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil,
> "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30,
> "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m",
> "ui.filter" nil, "ui.header.buffer.bytes" 4096,
> "topology.disruptor.wait.timeout.millis" 1000,
> "storm.nimbus.retry.intervalceiling.millis" 60000,
> "topology.trident.batch.emit.interval.millis" 50,
> "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy",
> "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64,
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080,
> "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name"
> "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost",
> "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119139 [main] INFO b.s.d.nimbus - Using default scheduler
> 119140 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119146 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119146 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 119150 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119152 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119158 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119160 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119161 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 119162 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2002] WARN
> o.a.z.s.NIOServerCnxn - caught end of stream exception
> org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read
> additional data from client sessionid 0x14f1cc844830002, likely client has
> closed socket
> at
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> [zookeeper-3.4.6.jar:3.4.6-1569965]
> at
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> [zookeeper-3.4.6.jar:3.4.6-1569965]
> at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]
> 119162 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119164 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119164 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119166 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119166 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 119168 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119170 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119174 [main] INFO b.s.d.supervisor - Starting Supervisor with conf
> {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts"
> "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local",
> "storm.messaging.netty.client_worker_threads" 1,
> "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil,
> "zmq.threads" 1, "storm.group.mapping.service"
> "backtype.storm.security.auth.ShellBasedGroupsMapping",
> "transactional.zookeeper.root" "/transactional",
> "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773,
> "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer",
> "storm.messaging.netty.server_worker_threads" 1,
> "topology.max.error.report.per.interval" 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0,
> "storm.principal.tolocal"
> "backtype.storm.security.auth.DefaultPrincipalToLocal",
> "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5,
> "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true,
> "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100,
> "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5,
> "topology.enable.message.timeouts" false, "drpc.worker.threads" 64,
> "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port"
> 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024,
> "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy",
> "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000,
> "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path"
> "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil,
> "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers"
> ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins"
> 10080, "topology.worker.childopts" nil, "topology.classpath" nil,
> "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs"
> 600, "topology.skip.missing.kryo.registrations" true,
> "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml",
> "storm.group.mapping.service.cache.duration.secs" 120,
> "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10,
> "supervisor.supervisors" [], "topology.tasks" nil,
> "topology.bolts.outgoing.overflow.buffer.enable" false,
> "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1,
> "storm.local.dir" "/tmp/b74f8021-d3c3-48ff-a172-bb649daedd96",
> "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [],
> "topology.message.timeout.secs" 30,
> "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m",
> "topology.environment" nil, "topology.debug" false,
> "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m",
> "drpc.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil,
> "storm.meta.serialization.delegate"
> "backtype.storm.serialization.GzipThriftSerializationDelegate",
> "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60,
> "nimbus.task.timeout.secs" 30, "drpc.port" 3772,
> "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port"
> 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5,
> "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval"
> 1000, "logs.users" nil, "transactional.zookeeper.port" nil,
> "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30,
> "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1,
> "supervisor.slots.ports" (1024 1025 1026), "topology.transfer.buffer.size"
> 1024, "topology.worker.shared.thread.pool.size" 4,
> "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600,
> "topology.executor.receive.buffer.size" 1024, "nimbus.task.launch.secs" 120,
> "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880,
> "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil,
> "drpc.https.port" -1, "task.refresh.poll.secs" 10,
> "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000,
> "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10,
> "storm.messaging.transport" "backtype.storm.messaging.netty.Context",
> "storm.messaging.netty.authentication" false, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "",
> "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator",
> "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil,
> "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30,
> "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m",
> "ui.filter" nil, "ui.header.buffer.bytes" 4096,
> "topology.disruptor.wait.timeout.millis" 1000,
> "storm.nimbus.retry.intervalceiling.millis" 60000,
> "topology.trident.batch.emit.interval.millis" 50,
> "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy",
> "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64,
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080,
> "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name"
> "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost",
> "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119176 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119177 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119178 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 119179 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119181 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119186 [main] INFO b.s.d.supervisor - Starting supervisor with id
> a675baeb-c40f-4589-a33b-d828ea24e42b at host localhost
> 119188 [main] INFO b.s.d.supervisor - Starting Supervisor with conf
> {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts"
> "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local",
> "storm.messaging.netty.client_worker_threads" 1,
> "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil,
> "zmq.threads" 1, "storm.group.mapping.service"
> "backtype.storm.security.auth.ShellBasedGroupsMapping",
> "transactional.zookeeper.root" "/transactional",
> "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773,
> "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer",
> "storm.messaging.netty.server_worker_threads" 1,
> "topology.max.error.report.per.interval" 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0,
> "storm.principal.tolocal"
> "backtype.storm.security.auth.DefaultPrincipalToLocal",
> "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5,
> "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true,
> "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100,
> "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5,
> "topology.enable.message.timeouts" false, "drpc.worker.threads" 64,
> "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port"
> 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024,
> "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy",
> "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000,
> "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path"
> "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil,
> "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers"
> ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins"
> 10080, "topology.worker.childopts" nil, "topology.classpath" nil,
> "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs"
> 600, "topology.skip.missing.kryo.registrations" true,
> "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml",
> "storm.group.mapping.service.cache.duration.secs" 120,
> "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10,
> "supervisor.supervisors" [], "topology.tasks" nil,
> "topology.bolts.outgoing.overflow.buffer.enable" false,
> "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1,
> "storm.local.dir" "/tmp/94b40e92-cc7a-4bcb-aab3-cb6be4f31a87",
> "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [],
> "topology.message.timeout.secs" 30,
> "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m",
> "topology.environment" nil, "topology.debug" false,
> "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m",
> "drpc.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil,
> "storm.meta.serialization.delegate"
> "backtype.storm.serialization.GzipThriftSerializationDelegate",
> "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60,
> "nimbus.task.timeout.secs" 30, "drpc.port" 3772,
> "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port"
> 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5,
> "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval"
> 1000, "logs.users" nil, "transactional.zookeeper.port" nil,
> "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30,
> "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1,
> "supervisor.slots.ports" (1027 1028 1029), "topology.transfer.buffer.size"
> 1024, "topology.worker.shared.thread.pool.size" 4,
> "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600,
> "topology.executor.receive.buffer.size" 1024, "nimbus.task.launch.secs" 120,
> "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880,
> "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil,
> "drpc.https.port" -1, "task.refresh.poll.secs" 10,
> "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000,
> "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10,
> "storm.messaging.transport" "backtype.storm.messaging.netty.Context",
> "storm.messaging.netty.authentication" false, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "",
> "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator",
> "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil,
> "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30,
> "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m",
> "ui.filter" nil, "ui.header.buffer.bytes" 4096,
> "topology.disruptor.wait.timeout.millis" 1000,
> "storm.nimbus.retry.intervalceiling.millis" 60000,
> "topology.trident.batch.emit.interval.millis" 50,
> "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy",
> "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64,
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080,
> "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name"
> "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost",
> "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119189 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119191 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119191 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 119193 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119195 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 119199 [main] INFO b.s.d.supervisor - Starting supervisor with id
> 392aa8b2-1060-4cc0-b938-8dfe090ce254 at host localhost
> 119213 [main] INFO b.s.d.nimbus - [req 1] Access from: principal:
> op:submitTopology
> 119217 [main] INFO b.s.d.nimbus - Received topology submission for
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef with conf
> {"topology.max.task.parallelism" nil, "topology.submitter.principal" "",
> "topology.acker.executors" nil, "storm.zookeeper.superACL" nil,
> "topology.users" (), "topology.submitter.user" "", "topology.kryo.register"
> nil, "topology.kryo.decorators" (), "storm.id"
> "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0", "topology.name"
> "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef"}
> 119220 [main] INFO b.s.d.nimbus - nimbus file
> location:/tmp/855275ea-e2eb-456c-a8f0-50fcc178969f/nimbus/stormdist/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119228 [main] INFO b.s.d.nimbus - Activating
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef:
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119250 [main] INFO b.s.s.EvenScheduler - Available slots:
> (["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1025]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1026]
> ["392aa8b2-1060-4cc0-b938-8dfe090ce254" 1027]
> ["392aa8b2-1060-4cc0-b938-8dfe090ce254" 1028]
> ["392aa8b2-1060-4cc0-b938-8dfe090ce254" 1029])
> 119253 [main] INFO b.s.d.nimbus - Setting new assignment for topology id
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0:
> #backtype.storm.daemon.common.Assignment{:master-code-dir
> "/tmp/855275ea-e2eb-456c-a8f0-50fcc178969f/nimbus/stormdist/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0",
> :node->host {"a675baeb-c40f-4589-a33b-d828ea24e42b" "localhost"},
> :executor->node+port {[8 8] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024],
> [12 12] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [2 2]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [7 7]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [3 3]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [1 1]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [6 6]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [9 9]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [11 11]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [13 13]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [5 5]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [10 10]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [4 4]
> ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024]}, :executor->start-time-secs
> {[8 8] 0, [12 12] 0, [2 2] 0, [7 7] 0, [3 3] 0, [1 1] 0, [6 6] 0, [9 9] 0,
> [11 11] 0, [13 13] 0, [5 5] 0, [10 10] 0, [4 4] 0}}
> 119271 [Thread-745] INFO b.s.d.supervisor - Copying resources at
> file:/home/travis/build/HeartSaVioR/storm/storm-core/target/test-classes/resources
> to
> /tmp/b74f8021-d3c3-48ff-a172-bb649daedd96/supervisor/stormdist/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0/resources
> 119276 [Thread-746] INFO b.s.d.supervisor - Launching worker with assignment
> {:storm-id "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0",
> :executors [[8 8] [12 12] [2 2] [7 7] [3 3] [1 1] [6 6] [9 9] [11 11] [13 13]
> [5 5] [10 10] [4 4]]} for this supervisor
> a675baeb-c40f-4589-a33b-d828ea24e42b on port 1024 with id
> a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119277 [Thread-746] INFO b.s.d.worker - Launching worker for
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0 on
> a675baeb-c40f-4589-a33b-d828ea24e42b:1024 with id
> a1dfcef2-be80-43b9-841f-93a170d3f96a and conf
> {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts"
> "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local",
> "storm.messaging.netty.client_worker_threads" 1,
> "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil,
> "zmq.threads" 1, "storm.group.mapping.service"
> "backtype.storm.security.auth.ShellBasedGroupsMapping",
> "transactional.zookeeper.root" "/transactional",
> "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773,
> "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer",
> "storm.messaging.netty.server_worker_threads" 1,
> "topology.max.error.report.per.interval" 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0,
> "storm.principal.tolocal"
> "backtype.storm.security.auth.DefaultPrincipalToLocal",
> "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5,
> "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true,
> "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100,
> "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5,
> "topology.enable.message.timeouts" false, "drpc.worker.threads" 64,
> "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port"
> 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024,
> "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy",
> "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000,
> "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path"
> "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil,
> "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers"
> ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins"
> 10080, "topology.worker.childopts" nil, "topology.classpath" nil,
> "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs"
> 600, "topology.skip.missing.kryo.registrations" true,
> "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml",
> "storm.group.mapping.service.cache.duration.secs" 120,
> "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10,
> "supervisor.supervisors" [], "topology.tasks" nil,
> "topology.bolts.outgoing.overflow.buffer.enable" false,
> "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1,
> "storm.local.dir" "/tmp/b74f8021-d3c3-48ff-a172-bb649daedd96",
> "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [],
> "topology.message.timeout.secs" 30,
> "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m",
> "topology.environment" nil, "topology.debug" false,
> "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m",
> "drpc.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil,
> "storm.meta.serialization.delegate"
> "backtype.storm.serialization.GzipThriftSerializationDelegate",
> "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60,
> "nimbus.task.timeout.secs" 30, "drpc.port" 3772,
> "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port"
> 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5,
> "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval"
> 1000, "logs.users" nil, "transactional.zookeeper.port" nil,
> "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30,
> "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1,
> "supervisor.slots.ports" (1024 1025 1026), "topology.transfer.buffer.size"
> 1024, "topology.worker.shared.thread.pool.size" 4,
> "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600,
> "topology.executor.receive.buffer.size" 1024, "nimbus.task.launch.secs" 120,
> "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880,
> "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil,
> "drpc.https.port" -1, "task.refresh.poll.secs" 10,
> "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000,
> "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10,
> "storm.messaging.transport" "backtype.storm.messaging.netty.Context",
> "storm.messaging.netty.authentication" false, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "",
> "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator",
> "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil,
> "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30,
> "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m",
> "ui.filter" nil, "ui.header.buffer.bytes" 4096,
> "topology.disruptor.wait.timeout.millis" 1000,
> "storm.nimbus.retry.intervalceiling.millis" 60000,
> "topology.trident.batch.emit.interval.millis" 50,
> "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy",
> "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64,
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080,
> "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name"
> "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost",
> "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119279 [Thread-746] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119281 [Thread-746-EventThread] INFO o.a.c.f.s.ConnectionStateManager -
> State change: CONNECTED
> 119281 [Thread-746-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 119283 [Thread-746] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119285 [Thread-746-EventThread] INFO o.a.c.f.s.ConnectionStateManager -
> State change: CONNECTED
> 119289 [Thread-746] INFO b.s.s.a.AuthUtils - Got AutoCreds []
> 119289 [Thread-746] INFO b.s.d.worker - Reading Assignments.
> 119304 [Thread-746] INFO b.s.d.worker - Launching receive-thread for
> a675baeb-c40f-4589-a33b-d828ea24e42b:1024
> 119304 [Thread-749-worker-receiver-thread-0] INFO b.s.m.loader - Starting
> receive-thread: [stormId:
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0, port: 1024, thread-id:
> 0 ]
> 119316 [Thread-746] INFO b.s.d.executor - Loading executor 3:[8 8]
> 119318 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 3:[8 8]
> 119319 [Thread-746] INFO b.s.d.executor - Finished loading executor 3:[8 8]
> 119324 [Thread-746] INFO b.s.d.executor - Loading executor
> 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119324 [Thread-746] INFO b.s.d.executor - Loaded executor tasks
> 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119326 [Thread-746] INFO b.s.d.executor - Finished loading executor
> 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119330 [Thread-746] INFO b.s.d.executor - Loading executor 2:[2 2]
> 119332 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 2:[2 2]
> 119333 [Thread-746] INFO b.s.d.executor - Finished loading executor 2:[2 2]
> 119337 [Thread-746] INFO b.s.d.executor - Loading executor 3:[7 7]
> 119339 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 3:[7 7]
> 119341 [Thread-746] INFO b.s.d.executor - Finished loading executor 3:[7 7]
> 119345 [Thread-746] INFO b.s.d.executor - Loading executor 2:[3 3]
> 119346 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 2:[3 3]
> 119348 [Thread-746] INFO b.s.d.executor - Finished loading executor 2:[3 3]
> 119355 [Thread-746] INFO b.s.d.executor - Loading executor 1:[1 1]
> 119356 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 1:[1 1]
> 119359 [Thread-746] INFO b.s.d.executor - Timeouts disabled for executor
> 1:[1 1]
> 119359 [Thread-746] INFO b.s.d.executor - Finished loading executor 1:[1 1]
> 119363 [Thread-746] INFO b.s.d.executor - Loading executor 3:[6 6]
> 119365 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 3:[6 6]
> 119367 [Thread-746] INFO b.s.d.executor - Finished loading executor 3:[6 6]
> 119371 [Thread-746] INFO b.s.d.executor - Loading executor 3:[9 9]
> 119373 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 3:[9 9]
> 119374 [Thread-746] INFO b.s.d.executor - Finished loading executor 3:[9 9]
> 119379 [Thread-746] INFO b.s.d.executor - Loading executor 3:[11 11]
> 119380 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 3:[11 11]
> 119382 [Thread-746] INFO b.s.d.executor - Finished loading executor 3:[11 11]
> 119386 [Thread-746] INFO b.s.d.executor - Loading executor __system:[-1 -1]
> 119386 [Thread-746] INFO b.s.d.executor - Loaded executor tasks __system:[-1
> -1]
> 119388 [Thread-746] INFO b.s.d.executor - Finished loading executor
> __system:[-1 -1]
> 119391 [Thread-746] INFO b.s.d.executor - Loading executor __acker:[13 13]
> 119392 [Thread-746] INFO b.s.d.executor - Loaded executor tasks __acker:[13
> 13]
> 119393 [Thread-746] INFO b.s.d.executor - Timeouts disabled for executor
> __acker:[13 13]
> 119394 [Thread-746] INFO b.s.d.executor - Finished loading executor
> __acker:[13 13]
> 119397 [Thread-746] INFO b.s.d.executor - Loading executor 2:[5 5]
> 119399 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 2:[5 5]
> 119401 [Thread-746] INFO b.s.d.executor - Finished loading executor 2:[5 5]
> 119405 [Thread-746] INFO b.s.d.executor - Loading executor 3:[10 10]
> 119406 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 3:[10 10]
> 119408 [Thread-746] INFO b.s.d.executor - Finished loading executor 3:[10 10]
> 119412 [Thread-746] INFO b.s.d.executor - Loading executor 2:[4 4]
> 119414 [Thread-746] INFO b.s.d.executor - Loaded executor tasks 2:[4 4]
> 119416 [Thread-746] INFO b.s.d.executor - Finished loading executor 2:[4 4]
> 119419 [Thread-746] INFO b.s.d.worker - Worker has topology config
> {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts"
> "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local",
> "storm.messaging.netty.client_worker_threads" 1,
> "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil,
> "zmq.threads" 1, "storm.group.mapping.service"
> "backtype.storm.security.auth.ShellBasedGroupsMapping",
> "transactional.zookeeper.root" "/transactional",
> "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773,
> "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer",
> "storm.messaging.netty.server_worker_threads" 1,
> "topology.max.error.report.per.interval" 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0,
> "storm.principal.tolocal"
> "backtype.storm.security.auth.DefaultPrincipalToLocal",
> "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5,
> "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true,
> "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100,
> "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5,
> "topology.enable.message.timeouts" false, "drpc.worker.threads" 64,
> "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port"
> 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024,
> "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy",
> "ui.host" "0.0.0.0", "topology.submitter.principal" "",
> "storm.nimbus.retry.interval.millis" 2000, "nimbus.inbox.jar.expiration.secs"
> 3600, "dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
> "topology.acker.executors" nil, "topology.fall.back.on.java.serialization"
> true, "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" 64,
> "logviewer.cleanup.age.mins" 10080, "topology.worker.childopts" nil,
> "topology.classpath" nil, "supervisor.monitor.frequency.secs" 3,
> "nimbus.credential.renewers.freq.secs" 600,
> "topology.skip.missing.kryo.registrations" true,
> "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml",
> "storm.group.mapping.service.cache.duration.secs" 120,
> "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10,
> "supervisor.supervisors" [], "topology.tasks" nil,
> "topology.bolts.outgoing.overflow.buffer.enable" false,
> "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1,
> "storm.local.dir" "/tmp/b74f8021-d3c3-48ff-a172-bb649daedd96",
> "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [],
> "topology.message.timeout.secs" 30,
> "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m",
> "topology.environment" nil, "topology.debug" false,
> "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m",
> "drpc.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil,
> "storm.meta.serialization.delegate"
> "backtype.storm.serialization.GzipThriftSerializationDelegate",
> "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60,
> "nimbus.task.timeout.secs" 30, "storm.zookeeper.superACL" nil, "drpc.port"
> 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000,
> "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [],
> "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs" 120,
> "storm.zookeeper.retry.interval" 1000, "logs.users" nil,
> "transactional.zookeeper.port" nil, "drpc.max_buffer_size" 1048576,
> "task.credentials.poll.secs" 30, "drpc.https.keystore.type" "JKS",
> "topology.worker.receiver.thread.count" 1, "supervisor.slots.ports" (1024
> 1025 1026), "topology.transfer.buffer.size" 1024,
> "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict"
> false, "nimbus.file.copy.expiration.secs" 600,
> "topology.executor.receive.buffer.size" 1024, "topology.users" [],
> "nimbus.task.launch.secs" 120, "storm.local.mode.zmq" false,
> "storm.messaging.netty.buffer_size" 5242880,
> "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.root" "/storm", "topology.submitter.user" "",
> "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -1,
> "task.refresh.poll.secs" 10, "task.heartbeat.frequency.secs" 3,
> "storm.messaging.netty.max_wait_ms" 1000, "drpc.http.port" 3774,
> "topology.error.throttle.interval.secs" 10, "storm.messaging.transport"
> "backtype.storm.messaging.netty.Context",
> "storm.messaging.netty.authentication" false, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "topology.kryo.register"
> nil, "worker.gc.childopts" "", "nimbus.topology.validator"
> "backtype.storm.nimbus.DefaultTopologyValidator",
> "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil,
> "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30,
> "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m",
> "ui.filter" nil, "ui.header.buffer.bytes" 4096,
> "topology.disruptor.wait.timeout.millis" 1000,
> "storm.nimbus.retry.intervalceiling.millis" 60000,
> "topology.trident.batch.emit.interval.millis" 50,
> "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy",
> "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64,
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080,
> "topology.kryo.decorators" [], "storm.id"
> "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0", "topology.name"
> "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef",
> "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name"
> "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost",
> "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119419 [Thread-746] INFO b.s.d.worker - Worker
> a1dfcef2-be80-43b9-841f-93a170d3f96a for storm
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0 on
> a675baeb-c40f-4589-a33b-d828ea24e42b:1024 has finished loading
> 119419 [Thread-746] INFO b.s.config - SET worker-user
> a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119438 [refresh-active-timer] INFO b.s.d.worker - All connections are ready
> for worker a675baeb-c40f-4589-a33b-d828ea24e42b:1024 with id
> a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119441 [Thread-757-3] INFO b.s.d.executor - Preparing bolt 3:(7)
> 119443 [Thread-757-3] INFO b.s.d.executor - Prepared bolt 3:(7)
> 119448 [Thread-759-2] INFO b.s.d.executor - Preparing bolt 2:(3)
> 119450 [Thread-759-2] INFO b.s.d.executor - Prepared bolt 2:(3)
> 119459 [Thread-761-1] INFO b.s.d.executor - Opening spout 1:(1)
> 119459 [Thread-761-1] INFO b.s.d.executor - Opened spout 1:(1)
> 119460 [Thread-761-1] INFO b.s.d.executor - Activating spout 1:(1)
> 119467 [Thread-763-3] INFO b.s.d.executor - Preparing bolt 3:(6)
> 119469 [Thread-763-3] INFO b.s.d.executor - Prepared bolt 3:(6)
> 119475 [Thread-765-3] INFO b.s.d.executor - Preparing bolt 3:(9)
> 119476 [Thread-765-3] INFO b.s.d.executor - Prepared bolt 3:(9)
> 119482 [Thread-767-3] INFO b.s.d.executor - Preparing bolt 3:(11)
> 119483 [Thread-767-3] INFO b.s.d.executor - Prepared bolt 3:(11)
> 119488 [Thread-769-__system] INFO b.s.d.executor - Preparing bolt
> __system:(-1)
> 119488 [Thread-769-__system] INFO b.s.d.executor - Prepared bolt
> __system:(-1)
> 119494 [Thread-771-__acker] INFO b.s.d.executor - Preparing bolt __acker:(13)
> 119494 [Thread-771-__acker] INFO b.s.d.executor - Prepared bolt __acker:(13)
> 119501 [Thread-773-2] INFO b.s.d.executor - Preparing bolt 2:(5)
> 119502 [Thread-773-2] INFO b.s.d.executor - Prepared bolt 2:(5)
> 119508 [Thread-775-3] INFO b.s.d.executor - Preparing bolt 3:(10)
> 119510 [Thread-775-3] INFO b.s.d.executor - Prepared bolt 3:(10)
> 119516 [Thread-777-2] INFO b.s.d.executor - Preparing bolt 2:(4)
> 119518 [Thread-777-2] INFO b.s.d.executor - Prepared bolt 2:(4)
> 119520 [Thread-751-3] INFO b.s.d.executor - Preparing bolt 3:(8)
> 119521 [Thread-751-3] INFO b.s.d.executor - Prepared bolt 3:(8)
> 119526 [Thread-753-7db2538f-2c23-487a-9a75-1afda66c6134] INFO b.s.d.executor
> - Preparing bolt 7db2538f-2c23-487a-9a75-1afda66c6134:(12)
> 119527 [Thread-753-7db2538f-2c23-487a-9a75-1afda66c6134] INFO b.s.d.executor
> - Prepared bolt 7db2538f-2c23-487a-9a75-1afda66c6134:(12)
> 119534 [Thread-755-2] INFO b.s.d.executor - Preparing bolt 2:(2)
> 119535 [Thread-755-2] INFO b.s.d.executor - Prepared bolt 2:(2)
> 119583 [main] INFO b.s.d.nimbus - [req 1] Access from: principal:
> op:killTopology
> 119586 [main] INFO b.s.d.nimbus - Delaying event :remove for 0 secs for
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119593 [timer] INFO b.s.d.nimbus - Killing topology:
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119596 [Thread-745] INFO b.s.d.supervisor - Removing code for storm id
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119600 [Thread-746] INFO b.s.d.supervisor - Shutting down and clearing state
> for id a1dfcef2-be80-43b9-841f-93a170d3f96a. Current supervisor time: 11.
> State: :disallowed, Heartbeat: {:time-secs 11, :storm-id
> "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0", :executors [[8 8]
> [12 12] [2 2] [7 7] [3 3] [1 1] [6 6] [9 9] [11 11] [-1 -1] [13 13] [5 5] [10
> 10] [4 4]], :port 1024}
> 119600 [Thread-746] INFO b.s.d.supervisor - Shutting down
> a675baeb-c40f-4589-a33b-d828ea24e42b:a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119600 [Thread-746] INFO b.s.config - GET worker-user
> a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119600 [Thread-746] INFO b.s.process-simulator - Killing process
> 49e76a1a-4cc0-4037-af28-2dc46cdf36c5
> 119600 [Thread-746] INFO b.s.d.worker - Shutting down worker
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> a675baeb-c40f-4589-a33b-d828ea24e42b 1024
> 119600 [Thread-746] INFO b.s.d.worker - Shutting down receive thread
> 119601 [Thread-746] INFO b.s.m.loader - Shutting down receiving-thread:
> [topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0, 1024]
> 119601 [Thread-746] INFO b.s.m.loader - Waiting for
> receiving-thread:[topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0,
> 1024] to die
> 119601 [Thread-746] INFO b.s.m.loader - Shutdown receiving-thread:
> [topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0, 1024]
> 119601 [Thread-749-worker-receiver-thread-0] INFO b.s.m.loader -
> Receiving-thread:[topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0,
> 1024] received shutdown notice
> 119601 [Thread-746] INFO b.s.d.worker - Shut down receive thread
> 119601 [Thread-746] INFO b.s.d.worker - Terminating messaging context
> 119601 [Thread-746] INFO b.s.d.worker - Shutting down executors
> 119601 [Thread-746] INFO b.s.d.executor - Shutting down executor 3:[8 8]
> 119601 [Thread-751-3] INFO b.s.util - Async loop interrupted!
> 119601 [Thread-750-disruptor-executor[8 8]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119601 [Thread-746] INFO b.s.d.executor - Shut down executor 3:[8 8]
> 119603 [Thread-746] INFO b.s.d.executor - Shutting down executor
> 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119603 [Thread-753-7db2538f-2c23-487a-9a75-1afda66c6134] INFO b.s.util -
> Async loop interrupted!
> 119603 [Thread-752-disruptor-executor[12 12]-send-queue] INFO b.s.util -
> Async loop interrupted!
> 119603 [Thread-746] INFO b.s.d.executor - Shut down executor
> 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119603 [Thread-746] INFO b.s.d.executor - Shutting down executor 2:[2 2]
> 119603 [Thread-754-disruptor-executor[2 2]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119603 [Thread-755-2] INFO b.s.util - Async loop interrupted!
> 119604 [Thread-746] INFO b.s.d.executor - Shut down executor 2:[2 2]
> 119604 [Thread-746] INFO b.s.d.executor - Shutting down executor 3:[7 7]
> 119604 [Thread-756-disruptor-executor[7 7]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119604 [Thread-757-3] INFO b.s.util - Async loop interrupted!
> 119604 [Thread-746] INFO b.s.d.executor - Shut down executor 3:[7 7]
> 119604 [Thread-746] INFO b.s.d.executor - Shutting down executor 2:[3 3]
> 119605 [Thread-759-2] INFO b.s.util - Async loop interrupted!
> 119605 [Thread-758-disruptor-executor[3 3]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119605 [Thread-746] INFO b.s.d.executor - Shut down executor 2:[3 3]
> 119605 [Thread-746] INFO b.s.d.executor - Shutting down executor 1:[1 1]
> 119605 [Thread-760-disruptor-executor[1 1]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119605 [Thread-761-1] INFO b.s.util - Async loop interrupted!
> 119605 [Thread-746] INFO b.s.d.executor - Shut down executor 1:[1 1]
> 119605 [Thread-746] INFO b.s.d.executor - Shutting down executor 3:[6 6]
> 119606 [timer] INFO b.s.d.nimbus - Cleaning up
> topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119606 [Thread-762-disruptor-executor[6 6]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119606 [Thread-763-3] INFO b.s.util - Async loop interrupted!
> 119606 [Thread-746] INFO b.s.d.executor - Shut down executor 3:[6 6]
> 119606 [Thread-746] INFO b.s.d.executor - Shutting down executor 3:[9 9]
> 119606 [Thread-765-3] INFO b.s.util - Async loop interrupted!
> 119606 [Thread-764-disruptor-executor[9 9]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119607 [Thread-746] INFO b.s.d.executor - Shut down executor 3:[9 9]
> 119607 [Thread-746] INFO b.s.d.executor - Shutting down executor 3:[11 11]
> 119607 [Thread-767-3] INFO b.s.util - Async loop interrupted!
> 119607 [Thread-766-disruptor-executor[11 11]-send-queue] INFO b.s.util -
> Async loop interrupted!
> 119607 [Thread-746] INFO b.s.d.executor - Shut down executor 3:[11 11]
> 119607 [Thread-746] INFO b.s.d.executor - Shutting down executor
> __system:[-1 -1]
> 119607 [Thread-769-__system] INFO b.s.util - Async loop interrupted!
> 119607 [Thread-768-disruptor-executor[-1 -1]-send-queue] INFO b.s.util -
> Async loop interrupted!
> 119608 [Thread-746] INFO b.s.d.executor - Shut down executor __system:[-1 -1]
> 119608 [Thread-746] INFO b.s.d.executor - Shutting down executor __acker:[13
> 13]
> 119608 [Thread-771-__acker] INFO b.s.util - Async loop interrupted!
> 119608 [Thread-770-disruptor-executor[13 13]-send-queue] INFO b.s.util -
> Async loop interrupted!
> 119608 [Thread-746] INFO b.s.d.executor - Shut down executor __acker:[13 13]
> 119608 [Thread-746] INFO b.s.d.executor - Shutting down executor 2:[5 5]
> 119608 [Thread-772-disruptor-executor[5 5]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119608 [Thread-773-2] INFO b.s.util - Async loop interrupted!
> 119608 [Thread-746] INFO b.s.d.executor - Shut down executor 2:[5 5]
> 119609 [Thread-746] INFO b.s.d.executor - Shutting down executor 3:[10 10]
> 119609 [Thread-775-3] INFO b.s.util - Async loop interrupted!
> 119609 [Thread-774-disruptor-executor[10 10]-send-queue] INFO b.s.util -
> Async loop interrupted!
> 119610 [Thread-746] INFO b.s.d.executor - Shut down executor 3:[10 10]
> 119610 [Thread-746] INFO b.s.d.executor - Shutting down executor 2:[4 4]
> 119610 [Thread-777-2] INFO b.s.util - Async loop interrupted!
> 119610 [Thread-776-disruptor-executor[4 4]-send-queue] INFO b.s.util - Async
> loop interrupted!
> 119610 [Thread-746] INFO b.s.d.executor - Shut down executor 2:[4 4]
> 119610 [Thread-746] INFO b.s.d.worker - Shut down executors
> 119610 [Thread-746] INFO b.s.d.worker - Shutting down transfer thread
> 119611 [Thread-778-disruptor-worker-transfer-queue] INFO b.s.util - Async
> loop interrupted!
> 119611 [Thread-746] INFO b.s.d.worker - Shut down transfer thread
> 119608 [executor-heartbeat-timer] ERROR b.s.d.worker - Error when processing
> event
> java.lang.RuntimeException:
> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =
> NoNode for
> /workerbeats/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0/a675baeb-c40f-4589-a33b-d828ea24e42b-1024
> at backtype.storm.util$wrap_in_runtime.invoke(util.clj:48) ~[classes/:?]
> at backtype.storm.zookeeper$set_data.invoke(zookeeper.clj:177)
> ~[classes/:?]
> at
> backtype.storm.cluster$mk_distributed_cluster_state$reify__5018.set_data(cluster.clj:103)
> ~[classes/:?]
> at
> backtype.storm.cluster$mk_storm_cluster_state$reify__5558.worker_heartbeat_BANG_(cluster.clj:376)
> ~[classes/:?]
> at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) ~[?:?]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.7.0_76]
> at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_76]
> at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
> ~[clojure-1.6.0.jar:?]
> at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
> ~[clojure-1.6.0.jar:?]
> at
> backtype.storm.daemon.worker$do_executor_heartbeats.doInvoke(worker.clj:66)
> ~[classes/:?]
> at clojure.lang.RestFn.invoke(RestFn.java:439) ~[clojure-1.6.0.jar:?]
> at
> backtype.storm.daemon.worker$fn__7341$exec_fn__1689__auto__$reify__7343$fn__7346.invoke(worker.clj:439)
> ~[classes/:?]
> at
> backtype.storm.timer$schedule_recurring$this__4173.invoke(timer.clj:99)
> ~[classes/:?]
> at backtype.storm.timer$mk_timer$fn__4156$fn__4157.invoke(timer.clj:50)
> [classes/:?]
> at backtype.storm.timer$mk_timer$fn__4156.invoke(timer.clj:42)
> [classes/:?]
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]
> Caused by: org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for
> /workerbeats/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0/a675baeb-c40f-4589-a33b-d828ea24e42b-1024
> at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
> ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
> ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> at
> org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:260)
> ~[curator-framework-2.5.0.jar:?]
> at
> org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:256)
> ~[curator-framework-2.5.0.jar:?]
> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
> ~[curator-client-2.5.0.jar:?]
> at
> org.apache.curator.framework.imps.SetDataBuilderImpl.pathInForeground(SetDataBuilderImpl.java:252)
> ~[curator-framework-2.5.0.jar:?]
> at
> org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:239)
> ~[curator-framework-2.5.0.jar:?]
> at
> org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:39)
> ~[curator-framework-2.5.0.jar:?]
> at backtype.storm.zookeeper$set_data.invoke(zookeeper.clj:176)
> ~[classes/:?]
> ... 15 more
> 119617 [executor-heartbeat-timer] ERROR b.s.util - Halting process: ("Error
> when processing an event")
> java.lang.RuntimeException: ("Error when processing an event")
> at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:332)
> [classes/:?]
> at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:?]
> at
> backtype.storm.daemon.worker$mk_halting_timer$fn__7151.invoke(worker.clj:190)
> [classes/:?]
> at backtype.storm.timer$mk_timer$fn__4156$fn__4157.invoke(timer.clj:68)
> [classes/:?]
> at backtype.storm.timer$mk_timer$fn__4156.invoke(timer.clj:42)
> [classes/:?]
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
