2019-09-26 06:27:23 UTC - zyqCSL: The controller indeed says the invoker is
unhealthy: {"invoker0/ath-9":"unhealthy"}% @chetanm
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479243034100?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:28:52 UTC - chetanm: For reference for others this is
continuation of discussion at
<https://github.com/apache/openwhisk-deploy-kube/issues/531>
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479332034200?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:29:33 UTC - chetanm: From logs Invoker seems to able to execute
health action fine but looks like message is not getting picked up by the
controller LB
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479373034400?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:34:07 UTC - chetanm: @zyqCSL Just to confirm you are deploying
from current master
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479647034600?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:35:01 UTC - Bill Zong: @chetanm I’ve met that too, and the
invoker seems to be `unhealthy` forever.
Hard to reproduce it, but it show occasionally.
@zyqCSL Try to get more information?
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479701034800?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:36:45 UTC - chetanm: I had seen it once when I used a release
name having dash `ow-test` then it caused issue due to incorrect parsing of
hostname. But that has been fixed a while back and here release name is normal.
So that cannot be the cause
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479805035100?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:37:55 UTC - zyqCSL: Yes, this is where I start from
<https://github.com/apache/openwhisk-deploy-kube> @chetanm.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479875035300?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:38:04 UTC - chetanm: Here controller is able to pickup invoker
info but just considers it unhealthy
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479884035500?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:39:56 UTC - zyqCSL: I'm deploying on a 2-node k8s cluster, one
labeled as openwhisk-role=core (master node), and the other as
openwhisk-role=invoker
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569479996035700?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:43:17 UTC - zyqCSL: I added kafka log at
<https://github.com/apache/openwhisk-deploy-kube/issues/531>
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569480197035900?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:43:45 UTC - zyqCSL: Is there any other information you think
could be helpful? @Bill Zong
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569480225036100?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:45:07 UTC - chetanm: may be share the whole controller log
somewhere … that may give some clue. For now with data present cannot say much
why Controller is considering them as unhealthy
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569480307036300?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:46:14 UTC - Bill Zong: Yeap. `[InvokerPool]` tag in controller’s
log would do more help.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569480374036500?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 06:54:31 UTC - zyqCSL: Full controller log posted (as a file, due to
word limit) on the git issue page. InvokerPool did label invoker as unhealthy
at the very beginning
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569480871036700?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 07:29:11 UTC - Bill Zong: Normally, the invoker was marked as
`unhealthy`, then controller would post an `invokerHealthTest` to invoker, and
use it `ack` to judge its health state.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569482951036900?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 07:34:47 UTC - Bill Zong: @zyqCSL I didn’t found any
`whisk.system/invokerHealthTestAction0`( 0 means send to invoker0 ) ack in your
logs, so invoker health state was unchanged.
Deploy it once again from scratch, and monitor the controller’s & invoker’s
logs.
It should look like that.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569483287037300?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 08:39:46 UTC - Mike: Hi, I fixed the issue. thanks for your time
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569487186037500?thread_ts=1569336025.030000&cid=C3TPCAQG1
----
2019-09-26 09:44:49 UTC - Bill Zong: You’re welcome.
Any tips to share?
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569491089037700?thread_ts=1569336025.030000&cid=C3TPCAQG1
----
2019-09-26 10:58:02 UTC - Rob Shepherd: Hi, I'm just evaluating serverless
implementations for an upcoming project. I'd like to know the relationship
between functions, containers (and k8s pods if that is a suitable runtime env)
- I'm specfiically wondering about container re-use etc in a multi-tenant
deployment. Cheers!
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569495482040600?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 11:17:48 UTC - Rodric Rabbah: welcome @Rob Shepherd :wave:
blush : Rob Shepherd
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569496668040900
----
2019-09-26 11:18:04 UTC - Rodric Rabbah: every function in openwhisk runs
inside a container. functions may belong to different users. the openwhisk
scheduler will reuse a container for a particular function from the same user
but will also allocate new containers for concurrent requests and to provide
elasticity.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569496684041000?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 11:19:05 UTC - Rodric Rabbah: containers are reclaimed after a quiet
period or when capacity is needed.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569496745041300?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 11:19:30 UTC - Rodric Rabbah: openwhisk does not expose containers
to the end user - they don’t interact with the underlying container
implementation at all.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569496770041500?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 11:19:51 UTC - Rodric Rabbah: it’s also possible to bring your own
container and run them as functions.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569496791041700?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 11:20:24 UTC - Rodric Rabbah: there are several large scale
production deployment of openwhisk on k8s if that’s your target environment
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569496824041900?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 11:20:51 UTC - Rodric Rabbah: feel free to ask questions - there are
plenty of experts here on k8s and openwhisk with production experience
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569496851042100?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 13:40:30 UTC - Dave Grove: looks to me from the @zyqCSL invoker log
that log collection didn’t complete. I’ll post a segment of what I expect an
invoker log to look like in the github issue.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569505230042300?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 13:40:49 UTC - Rob Shepherd: This is excellent, and interesting
@Rodric Rabbah thank you.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569505249042500?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 13:41:37 UTC - Rob Shepherd: "functions may belong to different
users" is intriguing, I will try and find some docs on this
:slightly_smiling_face:
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569505297042700?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 13:43:50 UTC - Rodric Rabbah: openwhisk is multi-tenant - different
users have different authentication keys
+1 : Rob Shepherd
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569505430042900?thread_ts=1569495482.040600&cid=C3TPCAQG1
----
2019-09-26 14:30:36 UTC - Rob Shepherd: From `helm install` ... `Error: failed
to download "openwhisk"`
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569508236043700?thread_ts=1569508236.043700&cid=C3TPCAQG1
----
2019-09-26 14:31:01 UTC - Rob Shepherd: Do i need to download and build some
components?
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569508261043800?thread_ts=1569508236.043700&cid=C3TPCAQG1
----
2019-09-26 15:35:47 UTC - Sven Lange-Last: @Bill Zong sorry to correct you -
`whisk.system/invokerHealthTestAction0` means that the action is owned by
controller 0.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569512147044000?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 15:39:47 UTC - Dave Grove: the instructions assume you have cloned
the openwhisk-deploy-kube repository. If that isn’t the problem, please post
complete log so we can try to help
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569512387044200?thread_ts=1569508236.043700&cid=C3TPCAQG1
----
2019-09-26 17:49:04 UTC - zyqCSL: Thank you all guys! Seems an issue with
DockerContainerFactory. After switching to KubernetesFactory, install package
completes successfully.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569520144044400?thread_ts=1569479243.034100&cid=C3TPCAQG1
----
2019-09-26 18:50:21 UTC - Rob Shepherd: gotcha. `git clone $repo; cd
openwhisk-deploy-kube/helm`
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569523821044700?thread_ts=1569508236.043700&cid=C3TPCAQG1
----
2019-09-26 22:21:50 UTC - Rob Shepherd: Please could I ask for some help
troubleshooting errors trying to get a working OpenWhisk. owdev-controller is
0/1 CrashLoopBackoff (restarts: 9)
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569536510046400?thread_ts=1569536510.046400&cid=C3TPCAQG1
----
2019-09-26 22:23:34 UTC - Rodric Rabbah: did you check the controller logs
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569536614046500?thread_ts=1569536510.046400&cid=C3TPCAQG1
----
2019-09-26 22:41:23 UTC - Rob Shepherd: please could you give me a little clue
the best way to do this.
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569537683046700?thread_ts=1569536510.046400&cid=C3TPCAQG1
----
2019-09-26 22:47:53 UTC - Rob Shepherd: OK, from: `kubectl describe pods
owdev-controller-0 -n openwhisk`
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569538073046900?thread_ts=1569536510.046400&cid=C3TPCAQG1
----
2019-09-26 22:58:22 UTC - Rob Shepherd: Openwhisk Controller Logs
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1569538702048300?thread_ts=1569536510.046400&cid=C3TPCAQG1
----
