dubee opened a new issue #4332: Sequence tests failing intermittently in multiple test environments URL: https://github.com/apache/incubator-openwhisk/issues/4332 Two sequence tests are failing intermittently in multiple test environments. These environments include Travis for incubator-openwhisk and incubator-openwhisk-cli. From the invoker logs, it seems the connection to the Docker container is being interrupted for some reason. This connection issue only appears to be happening for these two tests. Test: `system.basic.WskCliSequenceTests.Wsk Sequence should invoke a sequence with an enclosing sequence action` Activation: ``` Starting test Wsk Sequence should invoke a sequence with an enclosing sequence action at 2019-03-09 19:46:22.141 check failed for activation 4ea9846da7a74593a9846da7a7b593e2: {"activationId":"4ea9846da7a74593a9846da7a7b593e2","annotations":[{"key":"topmost","value":true},{"key":"path","value":"guest/outer_sequence"},{"key":"kind","value":"sequence"},{"key":"limits","value":{"concurrency":1,"logs":10,"memory":256,"timeout":60000}}],"duration":77,"end":1552178797774,"logs":["725e6517035946769e651703595676fc","8c256b236d86401ea56b236d86e01ebc","74f728438193486eb728438193286e38"],"name":"outer_sequence","namespace":"guest","publish":false,"response":{"result":{"error":"The action did not produce a valid response and exited unexpectedly."},"status":"action developer error","statusCode":0,"success":false},"start":1552178785014,"subject":"guest","version":"0.0.1"} Exception occurred during test execution: org.scalatest.exceptions.TestFailedException: None was not defined ``` Invoker logs: ``` [2019-03-10T00:46:25.775Z] [INFO] [#tid_544c1e29dcfc92e24f6efddfbd5d276d] [DockerContainer] sending arguments to /guest/cat at ContainerId(acaa743e3037b969a6edc2c5daaadc33820a19b5befd22066a0a2d4592235406) ContainerAddress(172.17.0.8,8080) [marker:invoker_activationRun_start:863] [2019-03-10T00:46:37.771Z] [INFO] [#tid_544c1e29dcfc92e24f6efddfbd5d276d] [DockerContainer] running result: ConnectionError(akka.http.impl.engine.client.OutgoingConnectionBlueprint$UnexpectedConnectionClosureException: The http server closed the connection unexpectedly before delivering responses for 1 outstanding requests) [marker:invoker_activationRun_finish:12859:1] [2019-03-10T00:46:37.771Z] [INFO] [#tid_544c1e29dcfc92e24f6efddfbd5d276d] [ContainerProxy] [marker:invoker_collectLogs_start:12859] [2019-03-10T00:46:37.772Z] [INFO] [#tid_544c1e29dcfc92e24f6efddfbd5d276d] [InvokerReactive] posted completion of activation 74f728438193486eb728438193286e38 [2019-03-10T00:46:39.791Z] [WARN] [#tid_544c1e29dcfc92e24f6efddfbd5d276d] [ContainerProxy] reading logs failed: org.apache.openwhisk.core.containerpool.logging.LogCollectingException: Failed to read logs [marker:invoker_collectLogs_error:14879:2020] [2019-03-10T00:46:39.791Z] [INFO] [#tid_544c1e29dcfc92e24f6efddfbd5d276d] [CouchDbRestStore] [PUT] 'whisk_local_activations' saving document: 'id: guest/74f728438193486eb728438193286e38, rev: null' [marker:database_saveDocument_start:14879] [2019-03-10T00:46:39.794Z] [INFO] [#tid_544c1e29dcfc92e24f6efddfbd5d276d] [InvokerReactive] posted completion of activation 74f728438193486eb728438193286e38 [2019-03-10T00:46:39.900Z] [INFO] [#tid_544c1e29dcfc92e24f6efddfbd5d276d] [CouchDbRestStore] [marker:database_saveDocument_finish:14987:108] ``` Test: `system.basic.WskCliSequenceTests.Wsk Sequence should invoke a sequence with normal payload and payload with error field` Activation: ``` Starting test Wsk Sequence should invoke a sequence with normal payload and payload with error field at 2019-03-09 18:15:54.619 check failed for activation 4ce6142f01b941faa6142f01b9f1fa15: {"activationId":"4ce6142f01b941faa6142f01b9f1fa15","annotations":[{"key":"topmost","value":true},{"key":"path","value":"guest/sequence"},{"key":"kind","value":"sequence"},{"key":"limits","value":{"concurrency":1,"logs":10,"memory":256,"timeout":120000}}],"duration":7,"end":1552173376521,"logs":["dfe3abaeb8e04297a3abaeb8e0b297d0","22a841008a8d4c28a841008a8d0c2886"],"name":"sequence","namespace":"guest","publish":false,"response":{"result":{"error":"The action did not produce a valid response and exited unexpectedly."},"status":"action developer error","statusCode":0,"success":false},"start":1552173364482,"subject":"guest","version":"0.0.2"} Exception occurred during test execution: org.scalatest.exceptions.TestFailedException: None was not equal to Some(2) ``` Invoker logs: ``` [2019-03-09T23:16:04.519Z] [INFO] [#tid_1029719d3373c5cb827dfbd4119b79c2] [DockerContainer] sending arguments to /guest/sort at ContainerId(b8ba4e6c7621076343b072f694e07564ae1b67bea078376c1adca16323b223d9) ContainerAddress(172.17.0.14,8080) [marker:invoker_activationRun_start:137] [2019-03-09T23:16:04.611Z] [INFO] [#tid_1029719d3373c5cb827dfbd4119b79c2] [CouchDbRestStore] [marker:database_saveDocument_finish:229:111] [2019-03-09T23:16:16.517Z] [INFO] [#tid_1029719d3373c5cb827dfbd4119b79c2] [DockerContainer] running result: ConnectionError(akka.stream.StreamTcpException: The connection closed with error: Connection reset by peer) [marker:invoker_activationRun_finish:12135:2] [2019-03-09T23:16:16.518Z] [INFO] [#tid_1029719d3373c5cb827dfbd4119b79c2] [ContainerProxy] [marker:invoker_collectLogs_start:12136] [2019-03-09T23:16:16.519Z] [INFO] [#tid_1029719d3373c5cb827dfbd4119b79c2] [InvokerReactive] posted completion of activation 22a841008a8d4c28a841008a8d0c2886 [2019-03-09T23:16:18.537Z] [WARN] [#tid_1029719d3373c5cb827dfbd4119b79c2] [ContainerProxy] reading logs failed: org.apache.openwhisk.core.containerpool.logging.LogCollectingException: Failed to read logs [marker:invoker_collectLogs_error:14155:2019] [2019-03-09T23:16:18.538Z] [INFO] [#tid_1029719d3373c5cb827dfbd4119b79c2] [CouchDbRestStore] [PUT] 'whisk_local_activations' saving document: 'id: guest/22a841008a8d4c28a841008a8d0c2886, rev: null' [marker:database_saveDocument_start:14155] [2019-03-09T23:16:18.538Z] [INFO] [#tid_sid_dbBatcher] [CouchDbRestStore] 'whisk_local_activations' saving 1 documents [marker:database_saveDocumentBulk_start:3935277] ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
