[
https://issues.apache.org/jira/browse/STORM-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Derek Dagit updated STORM-1377:
-------------------------------
Affects Version/s: 0.11.0
0.10.0
> nimbus_auth_test: some tests may access the wrong nimbus test node
> -------------------------------------------------------------------
>
> Key: STORM-1377
> URL: https://issues.apache.org/jira/browse/STORM-1377
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-core
> Affects Versions: 0.10.0, 0.11.0
> Reporter: Derek Dagit
> Priority: Minor
>
> A race condition may lead certain tests to fail in the nimbus-auth-test
> namespace.
> {noformat}
> Running backtype.storm.security.auth.nimbus-auth-test
> 75777 [pool-475-thread-1] INFO b.s.l.ThriftAccessLogger - Request ID: 6
> access from: principal: operation: submitTopology
> 75780 [pool-475-thread-1] WARN b.s.d.nimbus - Topology submission exception.
> (topology name='topo-name') #error {
> :cause nil
> :via
> [{:type backtype.storm.generated.AuthorizationException
> :message nil
> :at [backtype.storm.daemon.nimbus$check_authorization_BANG_ invoke
> nimbus.clj 935]}]
> :trace
> [[backtype.storm.daemon.nimbus$check_authorization_BANG_ invoke nimbus.clj
> 935]
> [backtype.storm.daemon.nimbus$check_authorization_BANG_ invoke nimbus.clj
> 938]
> [backtype.storm.daemon.nimbus$fn__7019$exec_fn__3205__auto__$reify__7048
> submitTopologyWithOpts nimbus.clj 1328]
> [backtype.storm.daemon.nimbus$fn__7019$exec_fn__3205__auto__$reify__7048
> submitTopology nimbus.clj 1401]
> [backtype.storm.generated.Nimbus$Processor$submitTopology getResult
> Nimbus.java 2014]
> [backtype.storm.generated.Nimbus$Processor$submitTopology getResult
> Nimbus.java 1998]
> [org.apache.thrift.ProcessFunction process ProcessFunction.java 39]
> [org.apache.thrift.TBaseProcessor process TBaseProcessor.java 39]
> [backtype.storm.security.auth.SimpleTransportPlugin$SimpleWrapProcessor
> process SimpleTransportPlugin.java 158]
> [org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer invoke
> AbstractNonblockingServer.java 518]
> [org.apache.thrift.server.Invocation run Invocation.java 18]
> [java.util.concurrent.ThreadPoolExecutor runWorker ThreadPoolExecutor.java
> 1142]
> [java.util.concurrent.ThreadPoolExecutor$Worker run ThreadPoolExecutor.java
> 617]
> [java.lang.Thread run Thread.java 745]]}
> 75956 [Thread-191-spout-executor[8 8]-EventThread] WARN
> o.a.c.ConnectionState - Session expired event received
> 75959 [Thread-191-spout-executor[8 8]-EventThread] INFO
> o.a.c.f.s.ConnectionStateManager - State change: LOST
> 75984 [pool-475-thread-2] INFO b.s.l.ThriftAccessLogger - Request ID: 7
> access from: principal: operation: submitTopology
> 75984 [pool-475-thread-2] WARN b.s.d.nimbus - Topology submission exception.
> (topology name='topo-name') #error {
> :cause nil
> :via
> [{:type backtype.storm.generated.AuthorizationException
> :message nil
> :at [backtype.storm.daemon.nimbus$check_authorization_BANG_ invoke
> nimbus.clj 935]}]
> :trace
> [[backtype.storm.daemon.nimbus$check_authorization_BANG_ invoke nimbus.clj
> 935]
> [backtype.storm.daemon.nimbus$check_authorization_BANG_ invoke nimbus.clj
> 938]
> [backtype.storm.daemon.nimbus$fn__7019$exec_fn__3205__auto__$reify__7048
> submitTopologyWithOpts nimbus.clj 1328]
> [backtype.storm.generated.Nimbus$Processor$submitTopologyWithOpts getResult
> Nimbus.java 2042]
> [backtype.storm.generated.Nimbus$Processor$submitTopologyWithOpts getResult
> Nimbus.java 2026]
> [org.apache.thrift.ProcessFunction process ProcessFunction.java 39]
> [org.apache.thrift.TBaseProcessor process TBaseProcessor.java 39]
> [backtype.storm.security.auth.SimpleTransportPlugin$SimpleWrapProcessor
> process SimpleTransportPlugin.java 158]
> [org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer invoke
> AbstractNonblockingServer.java 518]
> [org.apache.thrift.server.Invocation run Invocation.java 18]
> [java.util.concurrent.ThreadPoolExecutor runWorker ThreadPoolExecutor.java
> 1142]
> [java.util.concurrent.ThreadPoolExecutor$Worker run ThreadPoolExecutor.java
> 617]
> [java.lang.Thread run Thread.java 745]]}
> 75989 [Thread-191-spout-executor[8 8]-EventThread] INFO
> o.a.c.f.s.ConnectionStateManager - State change: RECONNECTED
> 76006 [pool-475-thread-3] INFO b.s.l.ThriftAccessLogger - Request ID: 8
> access from: principal: operation: fileUpload
> 76044 [pool-475-thread-4] INFO b.s.l.ThriftAccessLogger - Request ID: 9
> access from: principal: operation: fileUpload
> 76049 [pool-475-thread-5] INFO b.s.l.ThriftAccessLogger - Request ID: 10
> access from: principal: operation: fileUpload
> 76054 [pool-475-thread-1] INFO b.s.l.ThriftAccessLogger - Request ID: 6
> access from: principal: operation: fileDownload
> 76059 [pool-475-thread-2] INFO b.s.l.ThriftAccessLogger - Request ID: 7
> access from: principal: operation: fileDownload
> 76063 [pool-475-thread-3] INFO b.s.l.ThriftAccessLogger - Request ID: 8
> access from: principal: operation: getNimbusConf
> 76068 [pool-475-thread-4] INFO b.s.l.ThriftAccessLogger - Request ID: 9
> access from: principal: operation: getClusterInfo
> 76074 [pool-475-thread-5] INFO b.s.l.ThriftAccessLogger - Request ID: 10
> access from: principal: operation: killTopology
> 76087 [pool-475-thread-1] INFO b.s.l.ThriftAccessLogger - Request ID: 6
> access from: principal: operation: killTopology
> 76088 [pool-475-thread-2] INFO b.s.l.ThriftAccessLogger - Request ID: 7
> access from: principal: operation: activate
> 76093 [pool-475-thread-3] INFO b.s.l.ThriftAccessLogger - Request ID: 8
> access from: principal: operation: deactivate
> 76098 [pool-475-thread-4] INFO b.s.l.ThriftAccessLogger - Request ID: 9
> access from: principal: operation: rebalance
> 76103 [pool-475-thread-5] INFO b.s.l.ThriftAccessLogger - Request ID: 10
> access from: principal: operation: getTopologyConf
> 76109 [pool-475-thread-1] INFO b.s.l.ThriftAccessLogger - Request ID: 6
> access from: principal: operation: getTopology
> 76114 [pool-475-thread-2] INFO b.s.l.ThriftAccessLogger - Request ID: 7
> access from: principal: operation: getUserTopology
> 76123 [pool-475-thread-3] INFO b.s.l.ThriftAccessLogger - Request ID: 8
> access from: principal: operation: getTopologyInfo
> 76124 [main] INFO b.s.d.nimbus - Shutting down master
> 76126 [main] INFO b.s.zookeeper - closing zookeeper connection of leader
> elector.
> 76127 [main] INFO b.s.d.nimbus - Shut down master
> 76130 [main] INFO b.s.testing - Shutting down in process zookeeper
> 76132 [main] INFO b.s.testing - Done shutting down in process zookeeper
> 76132 [main] INFO b.s.testing - Deleting temporary path
> /tmp/1fe384ec-a2f5-4985-a31b-3a419b85504b
> 76132 [main] INFO b.s.testing - Deleting temporary path
> /tmp/632fb133-326b-4c26-91a5-03f1bbe933d2
> Tests run: 5, Passed: 36, Failures: 3, Errors: 0
> {noformat}
> Sometimes, 3 tests that should trivially pass do not.
> From the logs, it seems the three tests that fail are:
> * Simple-authentication-test
> * test-noop-authorization-w-simple-transport
> * test-noop-authorization-w-sasl-digest
> Since each of these should trivially pass, it seems the nimbus client in
> these three tests was not talking to the correct nimbus instance.
> We could add locking in the with-test-cluster macro to ensure the cluster
> fully shuts down before another test runs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
