[
https://issues.apache.org/jira/browse/STORM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chuck Burgess resolved STORM-1223.
----------------------------------
Resolution: Fixed
> test-nimbus-check-authorization-params consistently crashes (not fails) on
> Windows
> ----------------------------------------------------------------------------------
>
> Key: STORM-1223
> URL: https://issues.apache.org/jira/browse/STORM-1223
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-core
> Environment: Windows7 64bit
> Java 1.7.0_45 64bit
> Reporter: Chuck Burgess
> Assignee: Chuck Burgess
> Priority: Minor
>
> test-nimbus-check-authorization-params consistently crashes on Windows. This
> appears to be a crash, not a testcase-recognized "failure" or "error". I'm
> testing now against master (a8d253a9b725b8fb3181efbfcac78d06e186bea9), but
> I've been seeing it for several days, so it's been an issue longer than the
> latest commit.
> Here's the system-out portion of the test report:
> {quote}
> <testcase name="test-nimbus-check-authorization-params"
> classname="backtype.storm.nimbus-test">
> <system-out>
> <![CDATA[66921 [main] INFO b.s.zookeeper - Starting inprocess zookeeper at
> port 2000 and dir
> C:\Users\cburgess\AppData\Local\Temp\6baba454-c591-4699-8a55-d3161b02b7e3
> 66939 [main] INFO b.s.d.nimbus - Starting Nimbus with conf
> {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts"
> "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local",
> "storm.messaging.netty.client_worker_threads" 1,
> "logviewer.max.per.worker.logs.size.mb" 2048, "supervisor.run.worker.as.user"
> false, "topology.max.task.parallelism" nil, "zmq.threads" 1,
> "storm.group.mapping.service"
> "backtype.storm.security.auth.ShellBasedGroupsMapping",
> "transactional.zookeeper.root" "/transactional",
> "topology.sleep.spout.wait.strategy.time.ms" 1, "scheduler.display.resource"
> false, "topology.max.replication.wait.time.sec" 60, "drpc.invocations.port"
> 3773, "topology.multilang.serializer"
> "backtype.storm.multilang.JsonSerializer",
> "storm.messaging.netty.server_worker_threads" 1,
> "topology.max.error.report.per.interval" 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0,
> "storm.group.mapping.service.params" nil, "worker.profiler.enabled" true,
> "storm.principal.tolocal"
> "backtype.storm.security.auth.DefaultPrincipalToLocal",
> "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5,
> "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true,
> "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100,
> "worker.log.level.reset.poll.secs" 30, "storm.zookeeper.port" 2000,
> "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts"
> false, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" 64,
> "drpc.queue.size" 128, "topology.backpressure.enable" true,
> "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" 300,
> "logviewer.port" 8000, "topology.executor.send.buffer.size" 1024,
> "topology.worker.logwriter.childopts" "-Xmx64m",
> "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy",
> "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000,
> "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path"
> "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil,
> "topology.fall.back.on.java.serialization" true,
> "topology.eventlogger.executors" nil, "storm.zookeeper.servers"
> ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins"
> 10080, "topology.worker.childopts" nil, "topology.classpath" nil,
> "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs"
> 600, "topology.skip.missing.kryo.registrations" true,
> "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml",
> "storm.group.mapping.service.cache.duration.secs" 120,
> "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10,
> "storm.health.check.timeout.ms" 5000, "supervisor.supervisors" [],
> "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false,
> "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1,
> "storm.local.dir"
> "C:\\Users\\cburgess\\AppData\\Local\\Temp\\e2a608d7-edc6-4348-b18b-5224d1cd3b17",
> "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m
> -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps
> -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10
> -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError
> -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users"
> [], "topology.disruptor.batch.timeout.millis" 1,
> "topology.message.timeout.secs" 30,
> "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m",
> "topology.environment" nil, "topology.debug" false,
> "topology.disruptor.batch.size" 100, "storm.messaging.netty.max_retries" 300,
> "ui.childopts" "-Xmx768m", "storm.network.topography.plugin"
> "backtype.storm.networktopography.DefaultRackDNSToSwitchMapping",
> "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m",
> "drpc.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil,
> "storm.meta.serialization.delegate"
> "backtype.storm.serialization.GzipThriftSerializationDelegate",
> "topology.max.spout.pending" nil, "storm.codedistributor.class"
> "backtype.storm.codedistributor.LocalFileSystemCodeDistributor",
> "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30,
> "drpc.port" 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000,
> "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [],
> "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb"
> 3072.0, "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs"
> 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil,
> "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil,
> "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30,
> "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1,
> "supervisor.slots.ports" [6700 6701 6702 6703],
> "topology.transfer.buffer.size" 1024, "storm.health.check.dir"
> "healthchecks", "topology.worker.shared.thread.pool.size" 4,
> "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600,
> "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures
> -XX:+FlightRecorder", "topology.executor.receive.buffer.size" 1024,
> "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" 120,
> "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880,
> "worker.heartbeat.frequency.secs" 1, "storm.log4j2.conf.dir" "log4j2",
> "ui.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil,
> "drpc.https.port" -1, "task.refresh.poll.secs" 10,
> "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000,
> "nimbus.impersonation.authorizer"
> "backtype.storm.security.auth.authorizer.ImpersonationAuthorizer",
> "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" 3774,
> "topology.error.throttle.interval.secs" 10, "storm.messaging.transport"
> "backtype.storm.messaging.netty.Context",
> "storm.messaging.netty.authentication" false,
> "topology.component.resources.onheap.memory.mb" 128.0,
> "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory",
> "worker.gc.childopts" "", "nimbus.topology.validator"
> "backtype.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds"
> ["localhost"], "nimbus.cleanup.inbox.freq.secs" 600, "worker.heap.memory.mb"
> 768, "logviewer.max.sum.worker.logs.size.mb" 4096, "ui.users" nil,
> "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30,
> "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m",
> "topology.worker.max.heap.size.mb" 768.0,
> "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil,
> "nimbus.authorizer" "backtype.storm.security.auth.authorizer.NoopAuthorizer",
> "ui.header.buffer.bytes" 4096, "topology.min.replication.count" 1,
> "topology.disruptor.wait.timeout.millis" 1000,
> "storm.nimbus.retry.intervalceiling.millis" 60000,
> "topology.trident.batch.emit.interval.millis" 50,
> "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64,
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080,
> "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name"
> "A1", "nimbus.thrift.max_buffer_size" 1048576,
> "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 66939 [main] INFO b.s.d.nimbus - Using default scheduler
> 66939 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 66944 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 66977 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 66977 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 66998 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 66998 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 67048 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67050 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67069 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67089 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67334 [main] INFO b.s.zookeeper - Queued up for leader lock.
> 67334 [main] INFO b.s.d.nimbus - not a leader, skipping
> cleanup-corrupt-topologies
> 67381 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67414 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67414 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 67435 [main-EventThread] INFO b.s.zookeeper - ITOC049.progressrail.com
> gained leadership, checking if it has all the topology code locally.
> 67456 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67456 [main-EventThread] INFO b.s.zookeeper - active-topology-ids []
> local-topology-ids [] diff-topology []
> 67456 [main-EventThread] INFO b.s.zookeeper - Accepting leadership, all
> active topology found localy.
> 67458 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67476 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67497 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67497 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 67526 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67547 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67551 [main] INFO b.s.d.supervisor - Starting Supervisor with conf
> {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts"
> "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local",
> "storm.messaging.netty.client_worker_threads" 1,
> "logviewer.max.per.worker.logs.size.mb" 2048, "supervisor.run.worker.as.user"
> false, "topology.max.task.parallelism" nil, "zmq.threads" 1,
> "storm.group.mapping.service"
> "backtype.storm.security.auth.ShellBasedGroupsMapping",
> "transactional.zookeeper.root" "/transactional",
> "topology.sleep.spout.wait.strategy.time.ms" 1, "scheduler.display.resource"
> false, "topology.max.replication.wait.time.sec" 60, "drpc.invocations.port"
> 3773, "topology.multilang.serializer"
> "backtype.storm.multilang.JsonSerializer",
> "storm.messaging.netty.server_worker_threads" 1,
> "topology.max.error.report.per.interval" 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0,
> "storm.group.mapping.service.params" nil, "worker.profiler.enabled" true,
> "storm.principal.tolocal"
> "backtype.storm.security.auth.DefaultPrincipalToLocal",
> "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5,
> "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true,
> "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100,
> "worker.log.level.reset.poll.secs" 30, "storm.zookeeper.port" 2000,
> "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts"
> false, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" 64,
> "drpc.queue.size" 128, "topology.backpressure.enable" true,
> "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" 300,
> "logviewer.port" 8000, "topology.executor.send.buffer.size" 1024,
> "topology.worker.logwriter.childopts" "-Xmx64m",
> "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy",
> "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000,
> "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path"
> "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil,
> "topology.fall.back.on.java.serialization" true,
> "topology.eventlogger.executors" nil, "storm.zookeeper.servers"
> ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins"
> 10080, "topology.worker.childopts" nil, "topology.classpath" nil,
> "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs"
> 600, "topology.skip.missing.kryo.registrations" true,
> "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml",
> "storm.group.mapping.service.cache.duration.secs" 120,
> "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10,
> "storm.health.check.timeout.ms" 5000, "supervisor.supervisors" [],
> "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false,
> "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1,
> "storm.local.dir"
> "C:\\Users\\cburgess\\AppData\\Local\\Temp\\e04a8e92-63cd-4360-8b71-d36eccf77dd4",
> "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m
> -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps
> -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10
> -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError
> -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users"
> [], "topology.disruptor.batch.timeout.millis" 1,
> "topology.message.timeout.secs" 30,
> "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m",
> "topology.environment" nil, "topology.debug" false,
> "topology.disruptor.batch.size" 100, "storm.messaging.netty.max_retries" 300,
> "ui.childopts" "-Xmx768m", "storm.network.topography.plugin"
> "backtype.storm.networktopography.DefaultRackDNSToSwitchMapping",
> "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m",
> "drpc.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil,
> "storm.meta.serialization.delegate"
> "backtype.storm.serialization.GzipThriftSerializationDelegate",
> "topology.max.spout.pending" nil, "storm.codedistributor.class"
> "backtype.storm.codedistributor.LocalFileSystemCodeDistributor",
> "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30,
> "drpc.port" 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000,
> "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [],
> "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb"
> 3072.0, "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs"
> 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil,
> "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil,
> "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30,
> "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1,
> "supervisor.slots.ports" (1024 1025 1026), "topology.transfer.buffer.size"
> 1024, "storm.health.check.dir" "healthchecks",
> "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict"
> false, "nimbus.file.copy.expiration.secs" 600, "worker.profiler.childopts"
> "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder",
> "topology.executor.receive.buffer.size" 1024,
> "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" 120,
> "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880,
> "worker.heartbeat.frequency.secs" 1, "storm.log4j2.conf.dir" "log4j2",
> "ui.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil,
> "drpc.https.port" -1, "task.refresh.poll.secs" 10,
> "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000,
> "nimbus.impersonation.authorizer"
> "backtype.storm.security.auth.authorizer.ImpersonationAuthorizer",
> "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" 3774,
> "topology.error.throttle.interval.secs" 10, "storm.messaging.transport"
> "backtype.storm.messaging.netty.Context",
> "storm.messaging.netty.authentication" false,
> "topology.component.resources.onheap.memory.mb" 128.0,
> "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory",
> "worker.gc.childopts" "", "nimbus.topology.validator"
> "backtype.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds"
> ["localhost"], "nimbus.cleanup.inbox.freq.secs" 600, "worker.heap.memory.mb"
> 768, "logviewer.max.sum.worker.logs.size.mb" 4096, "ui.users" nil,
> "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30,
> "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m",
> "topology.worker.max.heap.size.mb" 768.0,
> "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil,
> "nimbus.authorizer" "backtype.storm.security.auth.authorizer.NoopAuthorizer",
> "ui.header.buffer.bytes" 4096, "topology.min.replication.count" 1,
> "topology.disruptor.wait.timeout.millis" 1000,
> "storm.nimbus.retry.intervalceiling.millis" 60000,
> "topology.trident.batch.emit.interval.millis" 50,
> "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64,
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080,
> "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name"
> "A1", "nimbus.thrift.max_buffer_size" 1048576,
> "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 67558 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67593 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67593 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 67631 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67651 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67681 [main] INFO b.s.d.supervisor - Starting supervisor with id
> c15c718b-a6a2-4fd1-910e-c28343b9526f at host ITOC049.progressrail.com
> 67682 [main] INFO b.s.d.supervisor - Starting Supervisor with conf
> {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts"
> "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local",
> "storm.messaging.netty.client_worker_threads" 1,
> "logviewer.max.per.worker.logs.size.mb" 2048, "supervisor.run.worker.as.user"
> false, "topology.max.task.parallelism" nil, "zmq.threads" 1,
> "storm.group.mapping.service"
> "backtype.storm.security.auth.ShellBasedGroupsMapping",
> "transactional.zookeeper.root" "/transactional",
> "topology.sleep.spout.wait.strategy.time.ms" 1, "scheduler.display.resource"
> false, "topology.max.replication.wait.time.sec" 60, "drpc.invocations.port"
> 3773, "topology.multilang.serializer"
> "backtype.storm.multilang.JsonSerializer",
> "storm.messaging.netty.server_worker_threads" 1,
> "topology.max.error.report.per.interval" 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0,
> "storm.group.mapping.service.params" nil, "worker.profiler.enabled" true,
> "storm.principal.tolocal"
> "backtype.storm.security.auth.DefaultPrincipalToLocal",
> "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5,
> "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true,
> "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100,
> "worker.log.level.reset.poll.secs" 30, "storm.zookeeper.port" 2000,
> "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts"
> false, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" 64,
> "drpc.queue.size" 128, "topology.backpressure.enable" true,
> "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" 300,
> "logviewer.port" 8000, "topology.executor.send.buffer.size" 1024,
> "topology.worker.logwriter.childopts" "-Xmx64m",
> "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy",
> "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000,
> "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path"
> "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil,
> "topology.fall.back.on.java.serialization" true,
> "topology.eventlogger.executors" nil, "storm.zookeeper.servers"
> ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins"
> 10080, "topology.worker.childopts" nil, "topology.classpath" nil,
> "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs"
> 600, "topology.skip.missing.kryo.registrations" true,
> "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml",
> "storm.group.mapping.service.cache.duration.secs" 120,
> "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10,
> "storm.health.check.timeout.ms" 5000, "supervisor.supervisors" [],
> "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false,
> "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1,
> "storm.local.dir"
> "C:\\Users\\cburgess\\AppData\\Local\\Temp\\9082e081-1786-4eb9-b1d0-05b0132cda00",
> "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m
> -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps
> -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10
> -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError
> -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users"
> [], "topology.disruptor.batch.timeout.millis" 1,
> "topology.message.timeout.secs" 30,
> "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m",
> "topology.environment" nil, "topology.debug" false,
> "topology.disruptor.batch.size" 100, "storm.messaging.netty.max_retries" 300,
> "ui.childopts" "-Xmx768m", "storm.network.topography.plugin"
> "backtype.storm.networktopography.DefaultRackDNSToSwitchMapping",
> "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m",
> "drpc.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil,
> "storm.meta.serialization.delegate"
> "backtype.storm.serialization.GzipThriftSerializationDelegate",
> "topology.max.spout.pending" nil, "storm.codedistributor.class"
> "backtype.storm.codedistributor.LocalFileSystemCodeDistributor",
> "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30,
> "drpc.port" 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000,
> "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [],
> "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb"
> 3072.0, "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs"
> 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil,
> "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil,
> "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30,
> "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1,
> "supervisor.slots.ports" (1027 1028 1029), "topology.transfer.buffer.size"
> 1024, "storm.health.check.dir" "healthchecks",
> "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict"
> false, "nimbus.file.copy.expiration.secs" 600, "worker.profiler.childopts"
> "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder",
> "topology.executor.receive.buffer.size" 1024,
> "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" 120,
> "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880,
> "worker.heartbeat.frequency.secs" 1, "storm.log4j2.conf.dir" "log4j2",
> "ui.http.creds.plugin"
> "backtype.storm.security.auth.DefaultHttpCredentialsPlugin",
> "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil,
> "drpc.https.port" -1, "task.refresh.poll.secs" 10,
> "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000,
> "nimbus.impersonation.authorizer"
> "backtype.storm.security.auth.authorizer.ImpersonationAuthorizer",
> "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" 3774,
> "topology.error.throttle.interval.secs" 10, "storm.messaging.transport"
> "backtype.storm.messaging.netty.Context",
> "storm.messaging.netty.authentication" false,
> "topology.component.resources.onheap.memory.mb" 128.0,
> "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory",
> "worker.gc.childopts" "", "nimbus.topology.validator"
> "backtype.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds"
> ["localhost"], "nimbus.cleanup.inbox.freq.secs" 600, "worker.heap.memory.mb"
> 768, "logviewer.max.sum.worker.logs.size.mb" 4096, "ui.users" nil,
> "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30,
> "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m",
> "topology.worker.max.heap.size.mb" 768.0,
> "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil,
> "nimbus.authorizer" "backtype.storm.security.auth.authorizer.NoopAuthorizer",
> "ui.header.buffer.bytes" 4096, "topology.min.replication.count" 1,
> "topology.disruptor.wait.timeout.millis" 1000,
> "storm.nimbus.retry.intervalceiling.millis" 60000,
> "topology.trident.batch.emit.interval.millis" 50,
> "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64,
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080,
> "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name"
> "A1", "nimbus.thrift.max_buffer_size" 1048576,
> "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 67689 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67717 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67718 [main-EventThread] INFO b.s.zookeeper - Zookeeper state update:
> :connected:none
> 67739 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 67767 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State
> change: CONNECTED
> 67797 [main] INFO b.s.d.supervisor - Starting supervisor with id
> 1d0d7361-0e29-4ff5-9cfd-e0b3a4eceaf9 at host ITOC049.progressrail.com
> 67798 [main] INFO b.s.l.ThriftAccessLogger - Request ID: 1 access from:
> principal: operation: submitTopology
> 67799 [main] INFO b.s.d.nimbus - Received topology submission for
> test-nimbus-check-autho-params with conf {"topology.max.task.parallelism"
> nil, "topology.submitter.principal" "", "topology.acker.executors" nil,
> "topology.eventlogger.executors" nil, "storm.zookeeper.superACL" nil,
> "topology.users" (), "topology.submitter.user" "", "topology.kryo.register"
> nil, "topology.kryo.decorators" (), "storm.id"
> "test-nimbus-check-autho-params-1-1448071948", "topology.name"
> "test-nimbus-check-autho-params"}
> 67839 [main] INFO b.s.d.nimbus - nimbus file
> location:C:\Users\cburgess\AppData\Local\Temp\e2a608d7-edc6-4348-b18b-5224d1cd3b17\nimbus\stormdist\test-nimbus-check-autho-params-1-1448071948
> 67897 [main] INFO b.s.d.nimbus - desired replication count of 1 not achieved
> but we have hit the max wait time 60 so moving on with replication count = 0
> 67961 [main] INFO b.s.d.nimbus - Activating test-nimbus-check-autho-params:
> test-nimbus-check-autho-params-1-1448071948
> 68019 [timer] ERROR b.s.d.nimbus - Error when processing event
> java.lang.NullPointerException
> at
> backtype.storm.daemon.common$all_components$iter__1523__1527$fn__1528.invoke(common.clj:130)
> ~[classes/:?]
> at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
> at clojure.lang.RT.boundedLength(RT.java:1735) ~[clojure-1.7.0.jar:?]
> at clojure.lang.RestFn.applyTo(RestFn.java:130) ~[clojure-1.7.0.jar:?]
> at clojure.core$apply.invoke(core.clj:632) ~[clojure-1.7.0.jar:?]
> at backtype.storm.daemon.common$all_components.invoke(common.clj:128)
> ~[classes/:?]
> at backtype.storm.daemon.common$storm_task_info.invoke(common.clj:358)
> ~[classes/:?]
> at
> backtype.storm.daemon.nimbus$compute_executors.invoke(nimbus.clj:537)
> ~[classes/:?]
> at
> backtype.storm.daemon.nimbus$compute_executor__GT_component.invoke(nimbus.clj:549)
> ~[classes/:?]
> at
> backtype.storm.daemon.nimbus$read_topology_details.invoke(nimbus.clj:441)
> ~[classes/:?]
> at
> backtype.storm.daemon.nimbus$mk_assignments$iter__10041__10045$fn__10046.invoke(nimbus.clj:797)
> ~[classes/:?]
> at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
> at clojure.core$seq__4128.invoke(core.clj:137) ~[clojure-1.7.0.jar:?]
> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
> ~[clojure-1.7.0.jar:?]
> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
> ~[clojure-1.7.0.jar:?]
> at
> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
> ~[clojure-1.7.0.jar:?]
> at clojure.core$reduce.invoke(core.clj:6519) ~[clojure-1.7.0.jar:?]
> at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
> at backtype.storm.daemon.nimbus$mk_assignments.doInvoke(nimbus.clj:796)
> ~[classes/:?]
> at clojure.lang.RestFn.invoke(RestFn.java:410) ~[clojure-1.7.0.jar:?]
> at
> backtype.storm.daemon.nimbus$fn__10320$exec_fn__1460__auto____10321$fn__10334$fn__10335.invoke(nimbus.clj:1280)
> ~[classes/:?]
> at
> backtype.storm.daemon.nimbus$fn__10320$exec_fn__1460__auto____10321$fn__10334.invoke(nimbus.clj:1279)
> ~[classes/:?]
> at
> backtype.storm.timer$schedule_recurring$this__1826.invoke(timer.clj:105)
> ~[classes/:?]
> at backtype.storm.timer$mk_timer$fn__1809$fn__1810.invoke(timer.clj:50)
> [classes/:?]
> at backtype.storm.timer$mk_timer$fn__1809.invoke(timer.clj:42)
> [classes/:?]
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
> at java.lang.Thread.run(Thread.java:744) [?:1.7.0_45]
> 68022 [timer] ERROR b.s.util - Halting process: ("Error when processing an
> event")
> java.lang.RuntimeException: ("Error when processing an event")
> at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:339)
> [classes/:?]
> at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.7.0.jar:?]
> at
> backtype.storm.daemon.nimbus$nimbus_data$fn__9579.invoke(nimbus.clj:160)
> [classes/:?]
> at backtype.storm.timer$mk_timer$fn__1809$fn__1810.invoke(timer.clj:71)
> [classes/:?]
> at backtype.storm.timer$mk_timer$fn__1809.invoke(timer.clj:42)
> [classes/:?]
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
> at java.lang.Thread.run(Thread.java:744) [?:1.7.0_45]
> 68023 [main] INFO b.s.d.nimbus - Shutting down master
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
