Kumar - The PR has not been merged yet. Could you pull the PR itself to try? https://github.com/apache/incubator-openwhisk-deploy-mesos/pull/2
cheers, Duy On Tue, Mar 6, 2018 at 7:45 PM, Kumar Subramanian <[email protected]> wrote: > Hi Duy, > I would love to try it. > > Is your changes in master? If so what’s master link? > > In the link https://github.com/apache/incubator-openwhisk-deploy-mesos I > only see a license.txt file in it. > > Thanks, > Kumar. > > On 3/6/18, 9:41 AM, "Duy Nguyen" <[email protected]> wrote: > > Hi Kumar, > > I have updated the universe to latest Openwhisk changes, verified it > on a > vanilla DC/OS 1.11 cluster, and opened a PR at [1], do you mind trying > it > out? > Hope it would solve bunch of issues you got earlier. > > cheers, > Duy > > [1] https://urldefense.proofpoint.com/v2/url?u=https-3A__github. > com_apache_incubator-2Dopenwhisk-2Ddeploy-2Dmesos_pull_2&d=DwIFaQ&c= > uilaK90D4TOVoH58JNXRgQ&r=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo&m= > Wd0tt9Y6emKuk7HzgaeTCmlXjND8hGbhr2r-NAd74ug&s= > 6lelXSxZQpZSLezJ62bqfqxgcZkF3SNgkzaFNM_qZGU&e= > > > On Tue, Mar 6, 2018 at 12:00 AM, Kumar Subramanian < > [email protected]> > wrote: > > > After I increased the timeout on the health checks I get the > following > > [2018-03-05T22:58:34.042Z] [ERROR] [??] [KafkaMessagingProvider] > > ensureTopic for completed0 failed due to java.util.concurrent. > ExecutionException: > > org.apache.kafka.common.errors.TimeoutException: Timed out waiting > for a > > node assignment. > > [2018-03-05T22:58:34.044Z] [ERROR] [??] [Controller] failure during > > msgProvider.ensureTopic for topic completed0 > > [INFO] [03/05/2018 22:58:34.070] [kamon-shutdown-hook-1] > > [CoordinatedShutdown(akka://kamon)] Starting coordinated shutdown > from > > JVM shutdown hook > > > > On 3/5/18, 2:58 PM, "Kumar Subramanian" <[email protected]> > wrote: > > > > Hi Carlos/Tyson/Chetan, > > Any Suggestions? > > > > Note: I just tried to increase the timeout on the health checks > …no > > luck. > > > > Thanks, > > Kumar. > > > > On 3/5/18, 12:28 PM, "Kumar Subramanian" < > [email protected]> > > wrote: > > > > This is the output log > > [2018-03-05T20:24:10.016Z] [INFO] Initializing Kamon... > > [INFO] [03/05/2018 20:24:10.301] [main] > > [StatsDExtension(akka://kamon)] Starting the Kamon(StatsD) extension > > [2018-03-05T20:24:10.352Z] [INFO] Slf4jLogger started > > [2018-03-05T20:24:10.706Z] [INFO] [??] [Config] environment > set > > value for db.whisk.actions > > [2018-03-05T20:24:10.707Z] [INFO] [??] [Config] environment > set > > value for db.protocol > > [2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment > set > > value for limits.actions.sequence.maxLength > > [2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment > set > > value for limits.triggers.fires.perMinute > > [2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment > set > > value for akka.cluster.seed.nodes > > [2018-03-05T20:24:10.709Z] [INFO] [??] [Config] environment > set > > value for limits.actions.invokes.concurrent > > [2018-03-05T20:24:10.709Z] [INFO] [??] [Config] environment > set > > value for controller.instances > > [2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment > set > > value for controller.localBookkeeping > > [2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment > set > > value for whisk.version.date > > [2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment > set > > value for db.port > > [2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment > set > > value for whisk.version.buildno > > [2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment > set > > value for db.whisk.activations > > [2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment > set > > value for db.username > > [2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment > set > > value for limits.actions.invokes.perMinute > > [2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment > set > > value for db.whisk.auths > > [2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment > set > > value for limits.actions.invokes.concurrentInSystem > > [2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment > set > > value for runtimes.manifest > > [2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment > set > > value for kafka.hosts > > [2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment > set > > value for db.host > > [2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment > set > > value for port > > [2018-03-05T20:24:10.714Z] [INFO] [??] [Config] environment > set > > value for db.password > > [2018-03-05T20:24:10.714Z] [INFO] [??] [Config] environment > set > > value for db.provider > > Received killTask for task whisk-controller.28d25d91- > > 20b3-11e8-8754-3afdc003616b > > [INFO] [03/05/2018 20:25:38.974] [kamon-shutdown-hook-1] > > [CoordinatedShutdown(akka://kamon)] Starting coordinated shutdown > from > > JVM shutdown hook > > [2018-03-05T20:25:38.975Z] [INFO] Starting coordinated > shutdown > > from JVM shutdown hook > > [2018-03-05T20:25:38.982Z] [INFO] [??] [Controller] Shutting > down > > Kamon with coordinated shutdown > > > > ERROR_LOG > > I0305 20:24:09.220711 1337 exec.cpp:162] Version: 1.2.3 > > I0305 20:24:09.227144 1338 exec.cpp:237] Executor > registered on > > agent 995020e0-5129-44a3-8cf4-65900838b3af-S7 > > W0305 20:24:09.227144 1341 logging.cpp:91] RAW: Received > signal > > SIGTERM from process 10243 of user 0; exiting > > > > On 3/5/18, 12:24 PM, "Kumar Subramanian" < > [email protected]> > > wrote: > > > > I get the following error while in the deploying state > (then > > kills it automatically and re-installs and goes on…) > > Task was killed since health check failed. Reason: > > ConnectionAttemptFailedException: Connection attempt to > > <whisk_controller_ip>>:8888 failed > > > > > > > > On 3/5/18, 12:21 PM, "Kumar Subramanian" < > > [email protected]> wrote: > > > > Gave the value as mykafka.marathon.mesos:9092…it > seems to > > be going forward now with the deployment…hope it succeeds > > > > On 3/5/18, 12:13 PM, "Kumar Subramanian" < > > [email protected]> wrote: > > > > Hi Chetan, > > I resolved all the settings (not sure about some > those > > values set)….now I’m getting the following error > > I0305 20:07:00.341622 21216 exec.cpp:162] > Version: > > 1.2.3 > > I0305 20:07:00.347102 21224 exec.cpp:237] > Executor > > registered on agent 995020e0-5129-44a3-8cf4-65900838b3af-S4 > > Exception in thread "main" > org.apache.kafka.common.KafkaException: > > Failed create new KafkaAdminClient > > at org.apache.kafka.clients. > > admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:322) > > at org.apache.kafka.clients. > > admin.AdminClient.create(AdminClient.java:50) > > at whisk.connector.kafka. > KafkaMessagingProvider$. > > ensureTopic(KafkaMessagingProvider.scala:70) > > at whisk.core.controller. > > Controller$.main(Controller.scala:217) > > at whisk.core.controller. > > Controller.main(Controller.scala) > > Caused by: org.apache.kafka.common. > config.ConfigException: > > No resolvable bootstrap urls given in bootstrap.servers > > at org.apache.kafka.clients.ClientUtils. > > parseAndValidateAddresses(ClientUtils.java:64) > > at org.apache.kafka.clients. > > admin.KafkaAdminClient.<init>(KafkaAdminClient.java:345) > > at org.apache.kafka.clients. > > admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:315) > > ... 4 more > > <<WHISK_CONTROLLER ENVIRONMENT SETTINGS>> > > The config environment values are: > > "KAFKA_HOST": "broker-0.kafka.mesos" > > "KAFKA_HOSTS": "mykafka.docker:9092" > > > > > > Here is the Kakfka service in my dcos services > > <<KAFKA_SERVICE>> > > ID: mykafka.654fa8cd-1e56-11e8-8754-3afdc003616b > > Name: mykafka > > Address: <<internal_ip>> > > Status: Running > > > > On 3/5/18, 12:01 PM, "Kumar Subramanian" < > > [email protected]> wrote: > > > > Also what is DB_WHISK_ACTIVATIONS=local_ > activations, > > what does it mean by “local” activations? This setting is also > needed, what > > should the value be in my dcos env? Should it still be > local_activations? > > > > On 3/5/18, 11:48 AM, "Kumar Subramanian" < > > [email protected]> wrote: > > > > Thanks Chetan, I added that now I’m > getting the > > > > [2018-03-05T19:43:45.025Z] [ERROR] [??] > > [Config] required property kafka.hosts still not set > > > > what is kafka.hosts is that the kafka > host > > name? (as in mykafka…that;s the kafka name I gave when I installed > kakfa). > > Should it be just the name or is FQDN ? > > > > > > On 3/5/18, 11:32 AM, "Chetan Mehrotra" < > > [email protected]> wrote: > > > > > required property > controller.instances > > still not set > > > > Looks like some configs are missing. > You > > would need to this or few > > more props. The configs are generally > > managed via Ansible for default > > setup. For dcos you may need to > configure > > them explicitly. You can see > > various configs and there values as > an > > example at [1] > > (controller.instances becomes > > CONTROLLER_INSTANCES). They would need > > to be tweaked as per your setup > though > > > > Chetan Mehrotra > > [1] https://urldefense.proofpoint. > com/v2/url?u=https-3A__urldefense.proofpoint&d=DwIFaQ&c= > uilaK90D4TOVoH58JNXRgQ&r=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo&m= > Wd0tt9Y6emKuk7HzgaeTCmlXjND8hGbhr2r-NAd74ug&s=hoaE2rcIjVS-9GdlR2d- > rNVCuHc4I3L3hG3J5MxHMss&e=. > > com/v2/url?u=https-3A__github.com_apache_incubator- > > 2Dopenwhisk-2Ddevtools_blob_master_docker-2Dcompose_ > > docker-2Dwhisk-2Dcontroller.env&d=DwIFaQ&c=uilaK90D4TOVoH58JNXRgQ&r= > > F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo&m= > K8Rzl5BrVqOWFx5b1fYG8EjdY- > > 6JVyi-x_eMD0thaKY&s=VfbixlUG4tFbgBNxiMr-KCNJOakmlGuNcnXLlbQMrVY&e= > > > > > > On Tue, Mar 6, 2018 at 12:09 AM, > Kumar > > Subramanian > > <[email protected]> wrote: > > > Hi, > > > I was able to successfully do the > > following > > > 1) Build the Controller image > > > 2) Push the image > > > > > > However when I installed the > controller > > package it gives me the following error in the output; then it shuts > down > > and retries the installation (goes on…) > > > > > > Registered docker executor on > 10.0.6.13 > > > Starting task > whisk-controller.a46ae612- > > 20a2-11e8-8754-3afdc003616b > > > [2018-03-05T18:25:55.853Z] [INFO] > > Initializing Kamon... > > > [INFO] [03/05/2018 18:25:56.151] > [main] > > [StatsDExtension(akka://kamon)] Starting the Kamon(StatsD) extension > > > [2018-03-05T18:25:56.193Z] [INFO] > > Slf4jLogger started > > > [2018-03-05T18:25:56.552Z] [INFO] > [??] > > [Config] environment set value for db.whisk.actions > > > [2018-03-05T18:25:56.554Z] [INFO] > [??] > > [Config] environment set value for db.protocol > > > [2018-03-05T18:25:56.554Z] [INFO] > [??] > > [Config] environment set value for limits.triggers.fires.perMinute > > > [2018-03-05T18:25:56.554Z] [INFO] > [??] > > [Config] environment set value for limits.actions.invokes.concurrent > > > [2018-03-05T18:25:56.555Z] [INFO] > [??] > > [Config] environment set value for whisk.version.date > > > [2018-03-05T18:25:56.555Z] [INFO] > [??] > > [Config] environment set value for db.port > > > [2018-03-05T18:25:56.555Z] [INFO] > [??] > > [Config] environment set value for whisk.version.buildno > > > [2018-03-05T18:25:56.556Z] [INFO] > [??] > > [Config] environment set value for db.username > > > [2018-03-05T18:25:56.556Z] [INFO] > [??] > > [Config] environment set value for limits.actions.invokes.perMinute > > > [2018-03-05T18:25:56.556Z] [INFO] > [??] > > [Config] environment set value for db.whisk.auths > > > [2018-03-05T18:25:56.556Z] [INFO] > [??] > > [Config] environment set value for limits.actions.invokes. > > concurrentInSystem > > > [2018-03-05T18:25:56.557Z] [INFO] > [??] > > [Config] environment set value for runtimes.manifest > > > [2018-03-05T18:25:56.557Z] [INFO] > [??] > > [Config] environment set value for db.host > > > [2018-03-05T18:25:56.558Z] [INFO] > [??] > > [Config] environment set value for port > > > [2018-03-05T18:25:56.558Z] [INFO] > [??] > > [Config] environment set value for db.password > > > [2018-03-05T18:25:56.558Z] [INFO] > [??] > > [Config] environment set value for db.provider > > > [2018-03-05T18:25:56.561Z] [ERROR] > [??] > > [Config] required property controller.instances still not set > > > [2018-03-05T18:25:56.561Z] [ERROR] > [??] > > [Controller] Bad configuration, cannot start. > > > > > > Any suggestions? > > > > > > > > > On 3/2/18, 4:05 PM, "Kumar > Subramanian" < > > [email protected]> wrote: > > > > > > This is the error I get when I > did > > docker build (for Controller) > > > > > > Step 1/7 : FROM scala > > > repository scala not found: > does not > > exist or no pull access > > > > > > > > > Any Suggestions? > > > > > > On 3/2/18, 3:34 PM, "Carlos > Santana" > > <[email protected]> wrote: > > > > > > No that it’s still in PR > > > > > > Just pull the changes > locally > > and build > > > > > > - Carlos Santana > > > @csantanapr > > > > > > > On Mar 2, 2018, at 6:20 > PM, > > Kumar Subramanian <[email protected]> wrote: > > > > > > > > Is that change at > > https://urldefense.proofpoint.com/v2/url?u=https-3A__github. > > com_chetanmeh_incubator-2Dopenwhisk_blob_ > fa302249f4f9b4e6b3084956f18bda > > 987674f46f_core_controller_Dockerfile&d=DwIFaQ&c= > uilaK90D4TOVoH58JNXRgQ&r= > > F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo&m=nLubLAFijdQ4pOPqIydDI_ > > wguMgbdmdmoMXcP7g-m8k&s=0_zv4jTDip5Uk9oBB5-6Ka_ > Iug3KYWIhy7qzSDryqM0&e= > > not merged? I don’t see change in master > https://urldefense.proofpoint.com/v2/url?u=https-3A__ > urldefense.proofpoint&d=DwIFaQ&c=uilaK90D4TOVoH58JNXRgQ&r= > F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo&m= > Wd0tt9Y6emKuk7HzgaeTCmlXjND8hGbhr2r-NAd74ug&s=hoaE2rcIjVS-9GdlR2d- > rNVCuHc4I3L3hG3J5MxHMss&e=. > > com/v2/url?u=https-3A__github.com_apache_incubator- > > 2Dopenwhisk_blob_master_core_controller_Dockerfile&d=DwIFaQ&c= > > uilaK90D4TOVoH58JNXRgQ&r=F5C8fYlpBJ270qrdwLq2iRQrPd1CLa > p8zItxk8laWpo&m= > > nLubLAFijdQ4pOPqIydDI_wguMgbdmdmoMXcP7g-m8k&s=TdB-IjihM3- > > 0dqBF029dSMkoWbZHBAUXXqeDjfQMlhg&e= > > > > > > > > Thanks, > > > > Kumar. > > > > > > > > On 3/2/18, 2:59 PM, > "Kumar > > Subramanian" <[email protected]> wrote: > > > > > > > > Ok, I will try to > build the > > controller image and see. Will keep you posted. > > > > > > > > On 3/2/18, 2:39 PM, > "Tyson > > Norris" <[email protected]> wrote: > > > > > > > > Thanks Carlos - I > think > > you’re right. > > > > > > > > > > > > > > > > Kumar you can > either > > build the controller image with that PR, or else you should be able > to > > manually set the docker cmd, e.g. /bin/sh -c \"exec /init.sh 0 >> > > /dev/stdout\” on the dcos service for controller; > > > > > > > > > > > > > > > > I think you will > have > > similar issue with invoker, mostly because this universe is far out > of date > > from current openwhisk images. > > > > > > > > > > > > > > > > For invoker can > you use > > the docker cmd as /bin/sh -c \"exec /init.sh --name $LIBPROCESS_IP >> > > /dev/stdout\” > > > > > > > > > > > > > > > > Additionally, the > env > > vars (both invoker and controller) have changed substantially, so I > would > > expect a few hiccups there as well. > > > > > > > > > > > > > > > > We are working on > > getting updates to the universe so that our internal deployment > details are > > not included, and it will actually work with recent openwhisk images > (and > > stay working) but haven’t gotten everything set just yet. > > > > > > > > > > > > > > > > Hope that helps > > > > > > > > Tyson > > > > > > > > > > > > > > > >>> On Mar 2, 2018, at > 2:21 PM, > > Carlos Santana <[email protected]> wrote: > > > >> > > > >> > > > > > > > >> Maybe for the init.sh > this PR > > is related > > > > > > > >> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__na01. > > safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F- > > 252Fgithub.com-252Fapache-252Fincubator-2Dopenwhisk- > > 252Fpull-252F3374-252Ffiles-2523diff-2D8f445fbdf6253dd176975ff6c629 > > def4R18-26data-3D02-257C01-257Ctnorris-2540adobe.com- > > 257C605cc50c7a484ccb833708d5808bfe64-257Cfa7b1b5a7b34438794aed2c178 > > decee1-257C0-257C0-257C636556261107863657-26sdata- > > 3Dtk8Des10hubLs7FNSgzDlsk1ibxDTIqSlXti-252FcAUyz0-253D- > > 26reserved-3D0&d=DwIGaQ&c=uilaK90D4TOVoH58JNXRgQ&r= > > F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo&m= > > LUthdew4Dt10vSAZSYRBbREqgwWk2PUWc4KDBJtt0uU&s= > > 3UqWljTQjItMnzWhPrsfD1AF2IX6abtc9dYRfrxb2_M&e= > > > > > > > >> > > > > > > > >> > > > > > > > >> On Fri, Mar 2, 2018 at > 5:09 > > PM Tyson Norris <[email protected]> > > > > > > > >> wrote: > > > > > > > >> > > > > > > > >>> Check your > marathon/dcos > > service config to verify what image is used, and > > > > > > > >>> that you have the > latest > > image pulled? > > > > > > > >>> > > > > > > > >>> The default should be > > openwhisk/controller - but I see that universe > > > > > > > >>> package marathon > config is > > not set to force pull, so if you are using that > > > > > > > >>> image, make sure you > have > > pulled the latest manually (or change the config > > > > > > > >>> to force pull in > > dcos/marathon ui). > > > > > > > >>> > > > > > > > >>> Tyson > > > > > > > >>> > > > > > > > >>>> On Mar 2, 2018, at > 12:45 > > PM, Kumar Subramanian <[email protected]> > > > > > > > >>> wrote: > > > > > > > >>>> > > > > > > > >>>> Hi, > > > > > > > >>>> I have installed the > > following in DCOS successfully: > > > > > > > >>>> 1. Apigateway > > > > > > > >>>> 2. Exhibitor-dcos > > > > > > > >>>> 3. Kafka (name given > is > > mykafka at the time of installation) > > > > > > > >>>> 4. Whisk-couchdb > > > > > > > >>>> 5. Consul > > > > > > > >>>> 6. Registrator > > > > > > > >>>> > > > > > > > >>>> Eror when deploying > > Whisk-Controller in DCOS: > > > > > > > >>>> When I tried to deploy > > whisk-controller with default settings, then the > > > > > > > >>> service fails to > deploy (it > > just kills and redploys the service > > > > > > > >>> continuously on its > own when > > deploying) > > > > > > > >>>> > > > > > > > >>>> Here is the content > in the > > Error and Output > > > > > > > >>>> > > > > > > > >>>> STDERR: > > > > > > > >>>> (AT BEGINNING OF FILE) > > > > > > > >>>> I0302 20:38:35.176177 > 19822 > > exec.cpp:162] Version: 1.2.3 > > > > > > > >>>> I0302 20:38:35.180703 > 19824 > > exec.cpp:237] Executor registered on agent > > > > > > > >>> > 995020e0-5129-44a3-8cf4- > > 65900838b3af-S6 > > > > > > > >>>> docker: Error > response from > > daemon: Container command 'init.sh' not > > > > > > > >>> found or does not > exist.. > > > > > > > >>>> > > > > > > > >>>> OUTPUT: > > > > > > > >>>> (AT BEGINNING OF FILE) > > > > > > > >>>> Registered docker > executor > > on 10.0.6.55 > > > > > > > >>>> Starting task > > whisk-controller.adb62c44-1e59-11e8-8754-3afdc003616b > > > > > > > >>>> > > > > > > > >>>> Can you please > provide your > > valuable inputs on how to get > > > > > > > >>> whisk-controller > deployed in > > dcos? > > > > > > > >>>> > > > > > > > >>>> Thanks, > > > > > > > >>>> Kumar. > > > > > > > >>>> > > > > > > > >>> > > > > > > > >>> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
