rabbah opened a new issue #2987: invokers losing connection to kafka URL: https://github.com/apache/incubator-openwhisk/issues/2987 I'm observing connection failures which don't recover since picking up master. ``` [2017-11-20T17:51:09.343Z] [ERROR] [??] [CouchDbRestStore] [PUT] 'whisk_dockermachine_activations' internal error, failure: 'Object is missing required member 'rev'' [marker:database_saveDocumentBulk_error:96713:15] [2017-11-20T17:51:09.354Z] [ERROR] [#tid_20] [CouchDbRestStore] [PUT] 'whisk_dockermachine_activations' internal error, failure: 'Object is missing required member 'rev'' [marker:database_saveDocument_error:15825:17] [2017-11-20T17:51:09.356Z] [ERROR] [#tid_20] [InvokerReactive] failed to record activation [2017-11-20T17:51:09.435Z] [INFO] [#sid_102] [DockerClientWithFileAccess] [marker:invoker_docker.rm_finish:96807:94] [2017-11-20T17:51:35.728Z] [ERROR] [??] [KafkaProducerConnector] sending message on topic 'health' failed: Expiring 1 record(s) for health-0: 30011 ms has passed since batch creation plus linger time [2017-11-20T17:51:35.730Z] [ERROR] [??] [Invoker] failed to ping the controller: org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for health-0: 30011 ms has passed since batch creation plus linger time [2017-11-20T17:51:36.926Z] [ERROR] [#tid_20] [KafkaProducerConnector] sending message on topic 'completed0' failed: Expiring 1 record(s) for completed0-0: 30011 ms has passed since batch creation plus linger time ... many more of these error ``` I think the couch error is unrelated but captured for completes. @dgrove-oss FYI
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
