2019-07-30 06:44:51 UTC - Pepi Paraskevoulakou: still the problem remains [2019-07-30T06:27:57.804Z] [ERROR] [#tid_sid_invokerHealth] [InvokerReactive] activation event was not sent: java.lang.IllegalStateException: key ‘kind’ does not exist [2019-07-30T06:27:57.808Z] [INFO] [#tid_sid_invokerHealth] [CouchDbRestStore] [PUT] ‘local_activations’ saving document: ‘id: whisk.system/3c644249e1654c84a44249e1653c8403, rev: null’ [marker:database_saveDocument_start:9358] https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564469091262500?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 06:45:38 UTC - Pepi Paraskevoulakou: [2019-07-30T06:27:52.720Z] [INFO] [#tid_sid_invokerWarmup] [ContainerPool] pre-warming 2 nodejs:6 256 MB [2019-07-30T06:27:53.018Z] [ERROR] [#tid_sid_invoker] [CouchDbRestStore] Unexpected http response code: 404 Not Found (details: {“error”:“not_found”,“reason”:“Database does not exist.“} ) [marker:database_queryView_error:5790:745] [2019-07-30T06:27:53.019Z] [ERROR] [#tid_sid_unknown] [InvokerReactive] error on updating the blacklist: Unexpected http response code: 404 Not Found (details: {“error”:“not_found”,“reason”:“Database does not exist.“} ) https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564469138262700 ---- 2019-07-30 06:58:37 UTC - Jiang PengCheng: it seems that the `make init-couchdb` are failed, would you please check the couchdb from browser to see whether databases are created? the url should be `<http://x.x.x.x:5984/_utils>` https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564469917264700?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:04:13 UTC - Pepi Paraskevoulakou: https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564470253264900?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:04:57 UTC - Jiang PengCheng: try with `whisk_admin` and `some_passw0rd` https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564470297265300?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:07:27 UTC - Pepi Paraskevoulakou: https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564470447265500?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:10:30 UTC - Jiang PengCheng: hm, databases are already created https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564470630265900?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:11:58 UTC - Pepi Paraskevoulakou: i followed exactly the instructions for installation docker and docker compose https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564470718266100?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:13:01 UTC - Pepi Paraskevoulakou: <https://docs.docker.com/compose/install/> https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564470781266300?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:13:16 UTC - Pepi Paraskevoulakou: <https://docs.docker.com/install/linux/docker-ce/ubuntu/> https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564470796266600?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:19:06 UTC - Jiang PengCheng: I think the steps are correct, but there maybe something wrong with couchdb, could you run the `wsk activation list`? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564471146266900?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:24:09 UTC - Pepi Paraskevoulakou: https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564471449267100?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:32:50 UTC - Jiang PengCheng: need to run `make init-whisk-cli` first https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564471970267500?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 07:39:22 UTC - Pepi Paraskevoulakou: still the same https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564472362267700?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 09:03:55 UTC - Ahmet Uyar: many thanks https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564477435267900?thread_ts=1564400058.229500&cid=C3TPCAQG1 ---- 2019-07-30 09:32:58 UTC - Jiang PengCheng: I have no idea now, how about redeploy the whole project? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564479178268100?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 09:33:47 UTC - Pepi Paraskevoulakou: i have tried a thousand times i cannot understand what i i ve done wrong :disappointed: https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564479227268300?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 09:34:10 UTC - Pepi Paraskevoulakou: have you deploy it? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564479250268500?thread_ts=1564469091.262500&cid=C3TPCAQG1 ---- 2019-07-30 11:23:19 UTC - Rodric Rabbah: @Pepi Paraskevoulakou the error indicates couch is not configured correctly. I’ll reach out by dm. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564485799270300 ---- 2019-07-30 11:23:34 UTC - Pepi Paraskevoulakou: thank you!!!! https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564485814270500 ---- 2019-07-30 14:46:14 UTC - Roberto Santiago: Hi All! Still working with my invokers (k8s install). When I shell into the invoker pod (i.e. `kubectl exec -it (pod name) -n openwhisk -- /bin/bash`) and take a look at the containers running (i.e. `docker ps`). I see that I have a bunch of node v6 and node v8 images running. But, all of my actions are specified as node v10. This seems very weird to me. Anybody have any insights or places I should go look to see why so many node v6 and v8 containers exist? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564497974273900 ---- 2019-07-30 14:46:47 UTC - Roberto Santiago: ```e5007e2a1b06 openwhisk/nodejs6action:b99d71e dbd386afe7fb openwhisk/action-nodejs-v10:b99d71e b9756554ca78 openwhisk/nodejs6action:b99d71e f255542928c7 openwhisk/action-nodejs-v8:b99d71e c22f485c9bad openwhisk/action-nodejs-v10:b99d71e c4663d974a76 openwhisk/nodejs6action:b99d71e fdaa1d0301f1 openwhisk/nodejs6action:b99d71e 3c7aceab4c41 openwhisk/nodejs6action:b99d71e 6f207f6fdcea openwhisk/nodejs6action:b99d71e cba6c87a8588 openwhisk/nodejs6action:b99d71e 81d28242e03a openwhisk/nodejs6action:b99d71e ac1f35560c35 openwhisk/nodejs6action:b99d71e 1a127ecda9bd openwhisk/nodejs6action:b99d71e 4022750b2cfa openwhisk/nodejs6action:b99d71e f01b8faaa628 openwhisk/nodejs6action:b99d71e 99914a176043 openwhisk/nodejs6action:b99d71e aa1e84fe4539 openwhisk/nodejs6action:b99d71e 071d635f0f0c openwhisk/nodejs6action:b99d71e f4ae84b092ac openwhisk/action-nodejs-v10:b99d71e 9b5d259ef60e openwhisk/action-nodejs-v8:b99d71e 81ae51f09d1c openwhisk/action-nodejs-v8:b99d71e ec8408218371 openwhisk/action-nodejs-v10:b99d71e f7315568976b openwhisk/action-nodejs-v10:b99d71e 9593cfb4f3c1 openwhisk/nodejs6action:b99d71e 19641afbb57c openwhisk/action-nodejs-v10:b99d71e e6b505c9095b openwhisk/action-nodejs-v10:b99d71e 2e8db1318583 openwhisk/action-nodejs-v8:b99d71e b507cd9accd9 openwhisk/action-nodejs-v8:b99d71e 140cce53dea6 openwhisk/action-nodejs-v8:b99d71e e4b20778d52d openwhisk/action-nodejs-v10:b99d71e 470a5a31ab01 openwhisk/action-nodejs-v8:b99d71e 664e6469c16b openwhisk/action-nodejs-v8:b99d71e a741455ef1e6 openwhisk/action-nodejs-v10:b99d71e ab625cd5e99c openwhisk/action-nodejs-v8:b99d71e 3809641227a7 openwhisk/action-nodejs-v8:b99d71e 57ac39173b5d openwhisk/action-nodejs-v8:b99d71e f12a7f9eca84 openwhisk/action-nodejs-v10:b99d71e 610813fffec5 openwhisk/action-nodejs-v8:b99d71e 51745087a83d openwhisk/action-nodejs-v10:b99d71e 781d845822ca openwhisk/action-nodejs-v10:b99d71e 55d4eea4bce6 openwhisk/action-nodejs-v10:b99d71e 10e7a314f825 openwhisk/action-nodejs-v10:b99d71e 00f8180464c6 openwhisk/nodejs6action:b99d71e d76f9402cb5e openwhisk/action-nodejs-v10:b99d71e 946ff9d2aa03 openwhisk/nodejs6action:b99d71e e144608dea3a openwhisk/nodejs6action:b99d71e cbe311786adc openwhisk/action-nodejs-v8:b99d71e fdea6de9a25a openwhisk/nodejs6action:b99d71e 9173b0fa2802 openwhisk/action-nodejs-v8:b99d71e 5ce5140531f8 openwhisk/action-nodejs-v10:b99d71e 52896834296f openwhisk/action-nodejs-v10:b99d71e f12b51da59b3 openwhisk/action-nodejs-v8:b99d71e a28d11497c44 openwhisk/action-nodejs-v8:b99d71e 3a9dbd5c673c openwhisk/action-nodejs-v8:b99d71e 75dc2b6ad1bb openwhisk/action-nodejs-v8:b99d71e 7241b4c25935 openwhisk/action-nodejs-v10:b99d71e fcaac1ddf63d openwhisk/action-nodejs-v8:b99d71e c0aea84566eb openwhisk/action-nodejs-v8:b99d71e 2b259e4fd408 openwhisk/action-nodejs-v10:b99d71e 3bb1714f265c openwhisk/action-nodejs-v10:b99d71e ``` https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564498007274100?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 14:52:09 UTC - chetanm: it may be due to prewarm config. Whats your runtime.json https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564498329274200?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 14:55:48 UTC - Roberto Santiago: @chetanm Where should I find that. I don't think we did anything with this file. But, should I be able to find it on the running invokers? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564498548274400?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 14:57:03 UTC - chetanm: If you are using the out of the box setup from kube repo then it only defines stemCells for nodejs v10 <https://github.com/apache/incubator-openwhisk-deploy-kube/blob/master/helm/openwhisk/runtimes.json> https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564498623274600?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 14:58:15 UTC - Roberto Santiago: If I were to manually remove these, should I expect anything bad to happen? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564498695274800?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:00:33 UTC - chetanm: Are these running containers or just images. It looks like image listing to me https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564498833275000?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:01:29 UTC - Roberto Santiago: these are containers https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564498889275200?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:03:48 UTC - chetanm: ah yes. van you also dump the name column. If those are pre warm then they would have name like `wsk0_2_prewarm_nodejs10` https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499028275400?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:05:53 UTC - Roberto Santiago: Here you go" https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499153275600?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:06:25 UTC - Roberto Santiago: shoot.... can't paste big clip of text here https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499185275800?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:06:35 UTC - Roberto Santiago: https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499195276000?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:06:41 UTC - Roberto Santiago: there you go https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499201276400?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:06:48 UTC - Roberto Santiago: All are prewarm https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499208276600?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:07:25 UTC - chetanm: yeah https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499245276800?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:08:44 UTC - chetanm: Can you check the content for `RUNTIMES_MANIFEST` env in Invoker pod https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499324277000?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:14:26 UTC - Roberto Santiago: sorry for stupid question but where should I be able to find that? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499666277200?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:15:45 UTC - Roberto Santiago: wait... got it https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499745277400?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:15:51 UTC - Roberto Santiago: missed that its an env variable https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499751277600?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:16:15 UTC - Roberto Santiago: https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499775277800?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:16:18 UTC - Roberto Santiago: there you go https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499778278200?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 15:17:54 UTC - Roberto Santiago: I see the stem cells there..... ok.... I think I know how that happened. Thanks @chetanm!!! https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564499874278400?thread_ts=1564498007.274100&cid=C3TPCAQG1 ---- 2019-07-30 20:06:00 UTC - Roberto Santiago: @Rodric Rabbah We are rebuilding our OW environment. Having an issue with api gateway. It looks like the 0.10.0 release found at <https://github.com/apache/incubator-openwhisk-apigateway/releases> does not include this important bug fix: <https://github.com/apache/incubator-openwhisk-apigateway/pull/343> https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564517160279800 ---- 2019-07-30 20:06:39 UTC - Roberto Santiago: But, strangely, if I look at the 0.10.0 release here: <http://www.apache.org/dist/incubator/openwhisk/> it does include it https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564517199280600 ---- 2019-07-30 20:07:00 UTC - Roberto Santiago: If anyone else has info that would be helpful https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564517220280900 ---- 2019-07-30 20:21:56 UTC - Roberto Santiago: Just checked with docker and it seems its not included in that one either https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564518116281400 ---- 2019-07-30 23:03:24 UTC - Rodric Rabbah: @Dave Grove FYI, we have to fix the convenience links it looks like https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1564527804282600 ----