2021-04-01 13:33:41 UTC - shivam gargshya: Hello everyone. We have openwhisk deployed on kubernetes using helm charts from this repo <https://github.com/apache/openwhisk-deploy-kube>. As a part of deployment the couchdb is installed on a container with Persistent volume. The PV size is 35 GB. On trigger of compaction the couch db container restarts and also couch db PV size keeps on increasing like 2-3Gb per week. though not much activations were created for any actions. especially the size of database that stores artifact definitions (actions, triggers attachements) keeps increasing without new actions being added. Though kube deployments are triggered multiple times in a week. Couch db logs when compaction restars :- ```[error] 2021-03-31T23:30:30.778979Z couchdb@couchdb0 <0.24751.0> -------- CRASH REPORT Process (<0.24751.0>) with 0 neighbors exited with reason: no match of right hand value {error,enospc} at couch_bt_engine:write_doc_body/2(line:385) <= couch_db_updater:'-flush_trees/3-fun-0-'/6(line:366) <= couch_key_tree:mapfold_simple/4(line:447) <= couch_key_tree:mapfold_simple/4(line:449) <= couch_key_tree:mapfold/3(line:440) <= couch_db_updater:flush_trees/3(line:355) <= couch_db_updater:update_docs_int/5(line:604) <= couch_db_updater:handle_info/2(line:175) at gen_server:terminate/7(line:812) <= couch_db_updater:init/1(line:45) <= proc_lib:init_p_do_apply/3(line:247); initial_call: {couch_db_updater,init,['Argument__1']}, ancestors: [<0.24750.0>], messages: [], links: [<0.218.0>], dictionary: [{idle_limit,61000},{last_id_merged,<<"aster-pubsub/test-once-trigger">>},...], trap_exit: false, status: running, heap_size: 17731, stack_size: 27, reductions: 20176 [info] 2021-03-31T23:30:30.833655Z couchdb@couchdb0 <0.24391.0> -------- Starting compaction for db "shards/00000000-1fffffff/test_whisks.1589036207" at 5960 [notice] 2021-03-31T23:30:30.833757Z couchdb@couchdb0 <0.21940.0> 14051ceba4 <http://couchdbaster.mum1-stage.zeta.in|couchdbaster.mum1-stage.zeta.in> 127.0.0.1 whisk_admin POST /test_whisks/_compact 202 ok 1 [info] 2021-03-31T23:30:30.833768Z couchdb@couchdb0 <0.12924.0> -------- Starting compaction for db "shards/40000000-5fffffff/test_whisks.1589036207" at 2244 [info] 2021-03-31T23:30:30.895951Z couchdb@couchdb0 <0.24784.0> -------- Starting compaction for db "shards/80000000-9fffffff/test_whisks.1589036207" at 10301 [info] 2021-03-31T23:30:30.895992Z couchdb@couchdb0 <0.24778.0> -------- Starting compaction for db "shards/20000000-3fffffff/test_whisks.1589036207" at 5030 [info] 2021-03-31T23:30:30.895999Z couchdb@couchdb0 <0.24786.0> -------- Starting compaction for db "shards/a0000000-bfffffff/test_whisks.1589036207" at 4846 [info] 2021-03-31T23:30:30.896034Z couchdb@couchdb0 <0.24781.0> -------- Starting compaction for db "shards/60000000-7fffffff/test_whisks.1589036207" at 9023 [info] 2021-03-31T23:30:30.896062Z couchdb@couchdb0 <0.24790.0> -------- Starting compaction for db "shards/c0000000-dfffffff/test_whisks.1589036207" at 12524 [info] 2021-03-31T23:30:30.896180Z couchdb@couchdb0 <0.24793.0> -------- Starting compaction for db "shards/e0000000-ffffffff/test_whisks.1589036207" at 3953 [notice] 2021-03-31T23:30:30.995598Z couchdb@couchdb0 <0.19899.0> 792791bc74 aster-couchdb.aster.svc.cluster.local:5984 10.80.236.29 whisk_admin GET /test_whisks/heracles-apollo%2Fapollo-heracles-integrator-trigger 200 ok 100 [os_mon] cpu supervisor port (cpu_sup): Erlang has closed [os_mon] memory supervisor port (memsup): Erlang has closed```
https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1617284021073700?thread_ts=1617284021.073700&cid=C3TPCAQG1 ---- 2021-04-01 18:57:01 UTC - alex: Hi, I'm trying to increase the timeout for my action beyond 5 minutes. I'm running in kubernetes so I edited the "CONFIG_whisk_timeLimit_max" env variable in the invoker's statefulset to be 20m, but when I try running `wsk action update --timeout 600000`I still get an error saying the maximum allowed timeout is 300000 ms. Is there something other than the invoker pod that I need to change? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1617303421078100 ---- 2021-04-01 19:18:01 UTC - alex: Nevermind, it looks like controller statefulset has the same env variable setting, changing the value there worked tada : Rodric Rabbah https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1617304681078900 ----
