Re: Using bash-based actions

2018-03-05 Thread Michael Marth
Hi Erez,

Fwiw some issues on bash support with more info:
https://github.com/apache/incubator-openwhisk/issues/2927
https://github.com/apache/incubator-openwhisk/pull/3138

Michael



On 04/03/18 13:00, "Carlos Santana"  wrote:

Hi Herez

Perl and Bash Actions are supported is just that we need to improve the
documentation to make it more explicit I’m working on improving docker
Actions documentation this week :-)

Try this:

wsk action update fooBash foo.sh —native

Or

wsk action update fooPerl foo.pl —native

It can be any script file the action will chmod +x and then executed.

For the second question I don’t know what you mean for logs.
Any text to stdout and stderr before the last line with the json string
result are capture in te logs in the activation record

Fell free to open an issue with more info on how to reproduce your problem.

— Carlos
PS: my employer is also IBM. :-)

On Sun, Mar 4, 2018 at 5:56 AM Erez Hadad  wrote:

> Hi folks,
>
> I'm working with technical people from different organizations outside my
> employer (IBM), and we're testing OpenWhisk as a mechanism for integrating
> our different tools and services into a single heterogeneous event-driven
> programming model.
> On the face of it, OW seems like a great fit.
> However, when it comes down to implementation, we often hit a case where
> the easiest way to delegate action execution to a custom tool is by
> writing a simple bash script. This is where things get complicated.
> To the best of my understanding (please correct me otherwise), there is no
> first-class support for bash runtime in OW.
> So, it's down to creating either a "native" action using a zip, or a
> custom docker action. Both options are quite more cumbersome than using
> native runtimes.
>
> So this is my first question - would it make sense to have a native bash
> runtime in OW? especially given that some of the function that OW
> seemingly provides is glue-code between existing tools and services (where
> bash also shines).
>
> As a second issue, we explored the native action. It seems that output is
> not captured in the action logs when including ssh calls that invoke bash
>
> My second question - does anyone have a different experience with this
> that they can share? (maybe this problem is not related to OW?)
>
> Regards,
> -- Erez Hadad
>
> Erez Hadad, PhD
> Cloud System Technologies
> IBM Research - Haifa
> email: er...@il.ibm.com
> phone: +972-4-829-6509
>
>
>
>




Re: Using bash-based actions

2018-03-05 Thread Michele Sciabarra
I am wondering... would be helpful if you could write bash based actions as a 
"pipe-loop"? Something reading and writing in stdout like this:


#!/bin/bash
echo '{"openwhisk":1}'
while true
do read line
   hello="Hello, $(echo $line | jq -r .name)"
   echo '{"greetings":"'$hello'"}'
done


Because I am buiding support for golang and generic binaries, and implementing 
also support for bash scripts would be as easy as to detect scripts in addition 
to elf binaries when they are uploaded. 

The "Start()" command I use should be able to launch also bash scripts

-- 
  Michele Sciabarra
  mich...@sciabarra.com

On Sun, Mar 4, 2018, at 12:53 PM, Carlos Santana wrote:
> Hi Herez
> 
> Perl and Bash Actions are supported is just that we need to improve the
> documentation to make it more explicit I’m working on improving docker
> Actions documentation this week :-)
> 
> Try this:
> 
> wsk action update fooBash foo.sh —native
> 
> Or
> 
> wsk action update fooPerl foo.pl —native
> 
> It can be any script file the action will chmod +x and then executed.
> 
> For the second question I don’t know what you mean for logs.
> Any text to stdout and stderr before the last line with the json string
> result are capture in te logs in the activation record
> 
> Fell free to open an issue with more info on how to reproduce your problem.
> 
> — Carlos
> PS: my employer is also IBM. :-)
> 
> On Sun, Mar 4, 2018 at 5:56 AM Erez Hadad  wrote:
> 
> > Hi folks,
> >
> > I'm working with technical people from different organizations outside my
> > employer (IBM), and we're testing OpenWhisk as a mechanism for integrating
> > our different tools and services into a single heterogeneous event-driven
> > programming model.
> > On the face of it, OW seems like a great fit.
> > However, when it comes down to implementation, we often hit a case where
> > the easiest way to delegate action execution to a custom tool is by
> > writing a simple bash script. This is where things get complicated.
> > To the best of my understanding (please correct me otherwise), there is no
> > first-class support for bash runtime in OW.
> > So, it's down to creating either a "native" action using a zip, or a
> > custom docker action. Both options are quite more cumbersome than using
> > native runtimes.
> >
> > So this is my first question - would it make sense to have a native bash
> > runtime in OW? especially given that some of the function that OW
> > seemingly provides is glue-code between existing tools and services (where
> > bash also shines).
> >
> > As a second issue, we explored the native action. It seems that output is
> > not captured in the action logs when including ssh calls that invoke bash
> >
> > My second question - does anyone have a different experience with this
> > that they can share? (maybe this problem is not related to OW?)
> >
> > Regards,
> > -- Erez Hadad
> >
> > Erez Hadad, PhD
> > Cloud System Technologies
> > IBM Research - Haifa
> > email: er...@il.ibm.com
> > phone: +972-4-829-6509
> >
> >
> >
> >


Re: Using bash-based actions

2018-03-05 Thread Michele Sciabarra
Hello, I am happy to announce I just implemented also support for "non 
binaries", i.e. bash scripts, in my new go-based runtime. Well, it was 
something in the to-do list actually. If binary parameter was false in the init 
request, the runtime returned "scripts not supported". Now, if binary is false, 
it will save the "code" and treat it as a script, and it will launch it in the 
same way as the others. Nothing fancy, just ordinary linux way of treating 
scripts and exe in the same way.
Scripts, even bash ones, however will have to follow a protocol, that currently 
is:

1. start with a handshake message: { "openwhisk":1}
2. repeat
2a. read a line in json format
2b. process the line and emil  a line in json format
2c. log in stderr

Example:


 #!/bin/bash
 echo '{"openwhisk":1}'
 while true
 do read line
hello="Hello, $(echo $line | jq -r .name)"
echo '{"greetings":"'$hello'"}'
 done

-- 
  Michele Sciabarra
  mich...@sciabarra.com

On Sun, Mar 4, 2018, at 3:01 PM, Michele Sciabarra wrote:
> I am wondering... would be helpful if you could write bash based actions 
> as a "pipe-loop"? Something reading and writing in stdout like this:
> 
> 
> #!/bin/bash
> echo '{"openwhisk":1}'
> while true
> do read line
>hello="Hello, $(echo $line | jq -r .name)"
>echo '{"greetings":"'$hello'"}'
> done
> 
> 
> Because I am buiding support for golang and generic binaries, and 
> implementing also support for bash scripts would be as easy as to detect 
> scripts in addition to elf binaries when they are uploaded. 
> 
> The "Start()" command I use should be able to launch also bash scripts
> 
> -- 
>   Michele Sciabarra
>   mich...@sciabarra.com
> 
> On Sun, Mar 4, 2018, at 12:53 PM, Carlos Santana wrote:
> > Hi Herez
> > 
> > Perl and Bash Actions are supported is just that we need to improve the
> > documentation to make it more explicit I’m working on improving docker
> > Actions documentation this week :-)
> > 
> > Try this:
> > 
> > wsk action update fooBash foo.sh —native
> > 
> > Or
> > 
> > wsk action update fooPerl foo.pl —native
> > 
> > It can be any script file the action will chmod +x and then executed.
> > 
> > For the second question I don’t know what you mean for logs.
> > Any text to stdout and stderr before the last line with the json string
> > result are capture in te logs in the activation record
> > 
> > Fell free to open an issue with more info on how to reproduce your problem.
> > 
> > — Carlos
> > PS: my employer is also IBM. :-)
> > 
> > On Sun, Mar 4, 2018 at 5:56 AM Erez Hadad  wrote:
> > 
> > > Hi folks,
> > >
> > > I'm working with technical people from different organizations outside my
> > > employer (IBM), and we're testing OpenWhisk as a mechanism for integrating
> > > our different tools and services into a single heterogeneous event-driven
> > > programming model.
> > > On the face of it, OW seems like a great fit.
> > > However, when it comes down to implementation, we often hit a case where
> > > the easiest way to delegate action execution to a custom tool is by
> > > writing a simple bash script. This is where things get complicated.
> > > To the best of my understanding (please correct me otherwise), there is no
> > > first-class support for bash runtime in OW.
> > > So, it's down to creating either a "native" action using a zip, or a
> > > custom docker action. Both options are quite more cumbersome than using
> > > native runtimes.
> > >
> > > So this is my first question - would it make sense to have a native bash
> > > runtime in OW? especially given that some of the function that OW
> > > seemingly provides is glue-code between existing tools and services (where
> > > bash also shines).
> > >
> > > As a second issue, we explored the native action. It seems that output is
> > > not captured in the action logs when including ssh calls that invoke bash
> > >
> > > My second question - does anyone have a different experience with this
> > > that they can share? (maybe this problem is not related to OW?)
> > >
> > > Regards,
> > > -- Erez Hadad
> > >
> > > Erez Hadad, PhD
> > > Cloud System Technologies
> > > IBM Research - Haifa
> > > email: er...@il.ibm.com
> > > phone: +972-4-829-6509
> > >
> > >
> > >
> > >


any updates to include in OW quarterly board report draft?

2018-03-05 Thread Matt Rutkowski
working in earnest to draft our project's quarterly board report on our 
CWIKI:
https://cwiki.apache.org/confluence/display/OPENWHISK/2018-03+March

Please feel free to send me of notable items/features/contribs. you do not 
want me to miss (as I will use primarily the "dev" list discussions, as 
well as scan the merged PRs over last 3 months across most repos.

Any help appreciated.

Kind regards,
Matt 




Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Kumar Subramanian
Hi,
I was able to successfully do the following
1) Build the Controller image
2) Push the image

However when I installed the controller package it gives me the following error 
in the output; then it shuts down and retries the installation (goes on…)

Registered docker executor on 10.0.6.13
Starting task whisk-controller.a46ae612-20a2-11e8-8754-3afdc003616b
[2018-03-05T18:25:55.853Z] [INFO] Initializing Kamon...
[INFO] [03/05/2018 18:25:56.151] [main] [StatsDExtension(akka://kamon)] 
Starting the Kamon(StatsD) extension
[2018-03-05T18:25:56.193Z] [INFO] Slf4jLogger started
[2018-03-05T18:25:56.552Z] [INFO] [??] [Config] environment set value for 
db.whisk.actions
[2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value for 
db.protocol
[2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value for 
limits.triggers.fires.perMinute
[2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value for 
limits.actions.invokes.concurrent
[2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value for 
whisk.version.date
[2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value for 
db.port
[2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value for 
whisk.version.buildno
[2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value for 
db.username
[2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value for 
limits.actions.invokes.perMinute
[2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value for 
db.whisk.auths
[2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value for 
limits.actions.invokes.concurrentInSystem
[2018-03-05T18:25:56.557Z] [INFO] [??] [Config] environment set value for 
runtimes.manifest
[2018-03-05T18:25:56.557Z] [INFO] [??] [Config] environment set value for 
db.host
[2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value for port
[2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value for 
db.password
[2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value for 
db.provider
[2018-03-05T18:25:56.561Z] [ERROR] [??] [Config] required property 
controller.instances still not set
[2018-03-05T18:25:56.561Z] [ERROR] [??] [Controller] Bad configuration, cannot 
start.

Any suggestions?


On 3/2/18, 4:05 PM, "Kumar Subramanian"  wrote:

This is the error I get when I did docker build (for Controller)

Step 1/7 : FROM scala
repository scala not found: does not exist or no pull access


Any Suggestions?

On 3/2/18, 3:34 PM, "Carlos Santana"  wrote:

No that it’s still in PR 

Just pull the changes locally and build 

- Carlos Santana
@csantanapr

> On Mar 2, 2018, at 6:20 PM, Kumar Subramanian 
 wrote:
> 
> Is that change at 
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_chetanmeh_incubator-2Dopenwhisk_blob_fa302249f4f9b4e6b3084956f18bda987674f46f_core_controller_Dockerfile=DwIFaQ=uilaK90D4TOVoH58JNXRgQ=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo=nLubLAFijdQ4pOPqIydDI_wguMgbdmdmoMXcP7g-m8k=0_zv4jTDip5Uk9oBB5-6Ka_Iug3KYWIhy7qzSDryqM0=
 not merged? I don’t see change in master 
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_incubator-2Dopenwhisk_blob_master_core_controller_Dockerfile=DwIFaQ=uilaK90D4TOVoH58JNXRgQ=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo=nLubLAFijdQ4pOPqIydDI_wguMgbdmdmoMXcP7g-m8k=TdB-IjihM3-0dqBF029dSMkoWbZHBAUXXqeDjfQMlhg=
> 
> Thanks,
> Kumar. 
> 
> On 3/2/18, 2:59 PM, "Kumar Subramanian"  
wrote:
> 
>Ok, I will try to build the controller image and see. Will keep 
you posted.
> 
>On 3/2/18, 2:39 PM, "Tyson Norris"  
wrote:
> 
>Thanks Carlos - I think you’re right. 
> 
> 
> 
>Kumar you can either build the controller image with that PR, 
or else you should be able to manually set the docker cmd, e.g. /bin/sh -c 
\"exec /init.sh 0 >> /dev/stdout\” on the dcos service for controller; 
> 
> 
> 
>I think you will have similar issue with invoker, mostly 
because this universe is far out of date from current openwhisk images. 
> 
> 
> 
>For invoker can you use the docker cmd as /bin/sh -c \"exec 
/init.sh --name $LIBPROCESS_IP >> /dev/stdout\”
> 
> 
> 
>Additionally, the env vars (both invoker and controller) have 
changed substantially, so I would expect a few hiccups there as well. 
> 
> 
> 
>We are working on getting updates to the universe so that our 
internal deployment details are not included, and it will actually work with 
recent openwhisk 

Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Chetan Mehrotra
> required property controller.instances still not set

Looks like some configs are missing. You would need to this or few
more props. The configs are generally managed via Ansible for default
setup. For dcos you may need to configure them explicitly. You can see
various configs and there values as an example at [1]
(controller.instances becomes CONTROLLER_INSTANCES). They would need
to be tweaked as per your setup though

Chetan Mehrotra
[1] 
https://github.com/apache/incubator-openwhisk-devtools/blob/master/docker-compose/docker-whisk-controller.env


On Tue, Mar 6, 2018 at 12:09 AM, Kumar Subramanian
 wrote:
> Hi,
> I was able to successfully do the following
> 1) Build the Controller image
> 2) Push the image
>
> However when I installed the controller package it gives me the following 
> error in the output; then it shuts down and retries the installation (goes 
> on…)
>
> Registered docker executor on 10.0.6.13
> Starting task whisk-controller.a46ae612-20a2-11e8-8754-3afdc003616b
> [2018-03-05T18:25:55.853Z] [INFO] Initializing Kamon...
> [INFO] [03/05/2018 18:25:56.151] [main] [StatsDExtension(akka://kamon)] 
> Starting the Kamon(StatsD) extension
> [2018-03-05T18:25:56.193Z] [INFO] Slf4jLogger started
> [2018-03-05T18:25:56.552Z] [INFO] [??] [Config] environment set value for 
> db.whisk.actions
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value for 
> db.protocol
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value for 
> limits.triggers.fires.perMinute
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value for 
> limits.actions.invokes.concurrent
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value for 
> whisk.version.date
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value for 
> db.port
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value for 
> whisk.version.buildno
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value for 
> db.username
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value for 
> limits.actions.invokes.perMinute
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value for 
> db.whisk.auths
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value for 
> limits.actions.invokes.concurrentInSystem
> [2018-03-05T18:25:56.557Z] [INFO] [??] [Config] environment set value for 
> runtimes.manifest
> [2018-03-05T18:25:56.557Z] [INFO] [??] [Config] environment set value for 
> db.host
> [2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value for port
> [2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value for 
> db.password
> [2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value for 
> db.provider
> [2018-03-05T18:25:56.561Z] [ERROR] [??] [Config] required property 
> controller.instances still not set
> [2018-03-05T18:25:56.561Z] [ERROR] [??] [Controller] Bad configuration, 
> cannot start.
>
> Any suggestions?
>
>
> On 3/2/18, 4:05 PM, "Kumar Subramanian"  wrote:
>
> This is the error I get when I did docker build (for Controller)
>
> Step 1/7 : FROM scala
> repository scala not found: does not exist or no pull access
>
>
> Any Suggestions?
>
> On 3/2/18, 3:34 PM, "Carlos Santana"  wrote:
>
> No that it’s still in PR
>
> Just pull the changes locally and build
>
> - Carlos Santana
> @csantanapr
>
> > On Mar 2, 2018, at 6:20 PM, Kumar Subramanian 
>  wrote:
> >
> > Is that change at 
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_chetanmeh_incubator-2Dopenwhisk_blob_fa302249f4f9b4e6b3084956f18bda987674f46f_core_controller_Dockerfile=DwIFaQ=uilaK90D4TOVoH58JNXRgQ=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo=nLubLAFijdQ4pOPqIydDI_wguMgbdmdmoMXcP7g-m8k=0_zv4jTDip5Uk9oBB5-6Ka_Iug3KYWIhy7qzSDryqM0=
>  not merged? I don’t see change in master 
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_incubator-2Dopenwhisk_blob_master_core_controller_Dockerfile=DwIFaQ=uilaK90D4TOVoH58JNXRgQ=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo=nLubLAFijdQ4pOPqIydDI_wguMgbdmdmoMXcP7g-m8k=TdB-IjihM3-0dqBF029dSMkoWbZHBAUXXqeDjfQMlhg=
> >
> > Thanks,
> > Kumar.
> >
> > On 3/2/18, 2:59 PM, "Kumar Subramanian"  
> wrote:
> >
> >Ok, I will try to build the controller image and see. Will keep 
> you posted.
> >
> >On 3/2/18, 2:39 PM, "Tyson Norris"  
> wrote:
> >
> >Thanks Carlos - I think you’re right.
> >
> >
> >
> >Kumar you can either build the controller image with that 
> PR, or else you should be able to manually set the docker cmd, e.g. /bin/sh 
> -c \"exec /init.sh 0 >> 

Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Kumar Subramanian
Also what is DB_WHISK_ACTIVATIONS=local_activations, what does it mean by 
“local” activations? This setting is also needed, what should the value be in 
my dcos env? Should it still be local_activations?

On 3/5/18, 11:48 AM, "Kumar Subramanian"  wrote:

Thanks Chetan, I added that now I’m getting the 

[2018-03-05T19:43:45.025Z] [ERROR] [??] [Config] required property 
kafka.hosts still not set

what is kafka.hosts is that the kafka host name? (as in mykafka…that;s the 
kafka name I gave when I installed kakfa). Should it be just the name or is 
FQDN ?
 

On 3/5/18, 11:32 AM, "Chetan Mehrotra"  wrote:

> required property controller.instances still not set

Looks like some configs are missing. You would need to this or few
more props. The configs are generally managed via Ansible for default
setup. For dcos you may need to configure them explicitly. You can see
various configs and there values as an example at [1]
(controller.instances becomes CONTROLLER_INSTANCES). They would need
to be tweaked as per your setup though

Chetan Mehrotra
[1] 
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_incubator-2Dopenwhisk-2Ddevtools_blob_master_docker-2Dcompose_docker-2Dwhisk-2Dcontroller.env=DwIFaQ=uilaK90D4TOVoH58JNXRgQ=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo=K8Rzl5BrVqOWFx5b1fYG8EjdY-6JVyi-x_eMD0thaKY=VfbixlUG4tFbgBNxiMr-KCNJOakmlGuNcnXLlbQMrVY=


On Tue, Mar 6, 2018 at 12:09 AM, Kumar Subramanian
 wrote:
> Hi,
> I was able to successfully do the following
> 1) Build the Controller image
> 2) Push the image
>
> However when I installed the controller package it gives me the 
following error in the output; then it shuts down and retries the installation 
(goes on…)
>
> Registered docker executor on 10.0.6.13
> Starting task whisk-controller.a46ae612-20a2-11e8-8754-3afdc003616b
> [2018-03-05T18:25:55.853Z] [INFO] Initializing Kamon...
> [INFO] [03/05/2018 18:25:56.151] [main] 
[StatsDExtension(akka://kamon)] Starting the Kamon(StatsD) extension
> [2018-03-05T18:25:56.193Z] [INFO] Slf4jLogger started
> [2018-03-05T18:25:56.552Z] [INFO] [??] [Config] environment set value 
for db.whisk.actions
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value 
for db.protocol
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value 
for limits.triggers.fires.perMinute
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set value 
for limits.actions.invokes.concurrent
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value 
for whisk.version.date
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value 
for db.port
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set value 
for whisk.version.buildno
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value 
for db.username
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value 
for limits.actions.invokes.perMinute
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value 
for db.whisk.auths
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set value 
for limits.actions.invokes.concurrentInSystem
> [2018-03-05T18:25:56.557Z] [INFO] [??] [Config] environment set value 
for runtimes.manifest
> [2018-03-05T18:25:56.557Z] [INFO] [??] [Config] environment set value 
for db.host
> [2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value 
for port
> [2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value 
for db.password
> [2018-03-05T18:25:56.558Z] [INFO] [??] [Config] environment set value 
for db.provider
> [2018-03-05T18:25:56.561Z] [ERROR] [??] [Config] required property 
controller.instances still not set
> [2018-03-05T18:25:56.561Z] [ERROR] [??] [Controller] Bad 
configuration, cannot start.
>
> Any suggestions?
>
>
> On 3/2/18, 4:05 PM, "Kumar Subramanian"  
wrote:
>
> This is the error I get when I did docker build (for Controller)
>
> Step 1/7 : FROM scala
> repository scala not found: does not exist or no pull access
>
>
> Any Suggestions?
>
> On 3/2/18, 3:34 PM, "Carlos Santana"  wrote:
>
> No that it’s still in PR
>
> Just pull the changes locally and build
>
> - Carlos Santana
> @csantanapr
>
> > On Mar 2, 2018, at 6:20 

Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Kumar Subramanian
Here is my config
{
 "description":"OpenWhisk Controller service running on DC/OS",
 "framework":true,
 "maintainer":"dungu...@adobe.com",
 "minDcosReleaseVersion":"1.8",
 "name":"whisk-controller",
 "packagingVersion":"3.0",
 "postInstallNotes":"DC/OS OpenWhisk controller has been successfully 
installed!",
 "postUninstallNotes":"DC/OS OpenWhisk controller service has been 
uninstalled.",
 "preInstallNotes":"OpenWhisk Controller requires Kafka, CouchDB, 
Consul, Registrator and APIGateway already installed in the same DC/OS 
cluster.",
 "selected":true,
 "tags":[
"openwhisk",
"controller",
"serverless",
"lambda"
 ],
 "version":"0.1",
 "releaseVersion":0,
 "resource":{
"images":{
   
"icon-small":"https://github.com/dcos/dcos-ui/blob/master/plugins/services/src/img/icon-service-default-small.png?raw=true;,
   
"icon-medium":"https://github.com/dcos/dcos-ui/blob/master/plugins/services/src/img/icon-service-default-medium.png?raw=true;,
   
"icon-large":"https://github.com/dcos/dcos-ui/blob/master/plugins/services/src/img/icon-service-default-large.png?raw=true;
},
"assets":{
   "container":{
  "docker":{
 "whisk-controller":"kumarsubrama/controller",
 "forcePullImage":"true"
  }
   }
}
 },
 "marathon":{


Re: any updates to include in OW quarterly board report draft?

2018-03-05 Thread Carlos Santana
Thanks Matt for handling this +1

- Carlos Santana
@csantanapr

> On Mar 5, 2018, at 12:20 PM, Matt Rutkowski  wrote:
> 
> working in earnest to draft our project's quarterly board report on our 
> CWIKI:
> https://cwiki.apache.org/confluence/display/OPENWHISK/2018-03+March
> 
> Please feel free to send me of notable items/features/contribs. you do not 
> want me to miss (as I will use primarily the "dev" list discussions, as 
> well as scan the merged PRs over last 3 months across most repos.
> 
> Any help appreciated.
> 
> Kind regards,
> Matt 
> 
> 


Re: Using bash-based actions

2018-03-05 Thread Carlos Santana
Yep bash is supported in the current form as I described. 

And will have a dockerskeketon V2 with the new golang Michele is working on 

I envision the new bash to be behind a kind map to the new runtime using the 
new golang proxy in the CLI

wsk action create fooBash foo.sh —kind bash

Or can be more generic —kind script 

Or we we have a new native

wsk action create foo foo.sh —native2

Something to discuss when we get there 

- Carlos Santana
@csantanapr

> On Mar 4, 2018, at 6:54 PM, Michele Sciabarra  wrote:
> 
> Hello, I am happy to announce I just implemented also support for "non 
> binaries", i.e. bash scripts, in my new go-based runtime. Well, it was 
> something in the to-do list actually. If binary parameter was false in the 
> init request, the runtime returned "scripts not supported". Now, if binary is 
> false, it will save the "code" and treat it as a script, and it will launch 
> it in the same way as the others. Nothing fancy, just ordinary linux way of 
> treating scripts and exe in the same way.
> Scripts, even bash ones, however will have to follow a protocol, that 
> currently is:
> 
> 1. start with a handshake message: { "openwhisk":1}
> 2. repeat
>2a. read a line in json format
>2b. process the line and emil  a line in json format
>2c. log in stderr
> 
> Example:
> 
> 
> #!/bin/bash
> echo '{"openwhisk":1}'
> while true
> do read line
>hello="Hello, $(echo $line | jq -r .name)"
>echo '{"greetings":"'$hello'"}'
> done
> 
> -- 
>  Michele Sciabarra
>  mich...@sciabarra.com
> 
>> On Sun, Mar 4, 2018, at 3:01 PM, Michele Sciabarra wrote:
>> I am wondering... would be helpful if you could write bash based actions 
>> as a "pipe-loop"? Something reading and writing in stdout like this:
>> 
>> 
>> #!/bin/bash
>> echo '{"openwhisk":1}'
>> while true
>> do read line
>>   hello="Hello, $(echo $line | jq -r .name)"
>>   echo '{"greetings":"'$hello'"}'
>> done
>> 
>> 
>> Because I am buiding support for golang and generic binaries, and 
>> implementing also support for bash scripts would be as easy as to detect 
>> scripts in addition to elf binaries when they are uploaded. 
>> 
>> The "Start()" command I use should be able to launch also bash scripts
>> 
>> -- 
>>  Michele Sciabarra
>>  mich...@sciabarra.com
>> 
>>> On Sun, Mar 4, 2018, at 12:53 PM, Carlos Santana wrote:
>>> Hi Herez
>>> 
>>> Perl and Bash Actions are supported is just that we need to improve the
>>> documentation to make it more explicit I’m working on improving docker
>>> Actions documentation this week :-)
>>> 
>>> Try this:
>>> 
>>> wsk action update fooBash foo.sh —native
>>> 
>>> Or
>>> 
>>> wsk action update fooPerl foo.pl —native
>>> 
>>> It can be any script file the action will chmod +x and then executed.
>>> 
>>> For the second question I don’t know what you mean for logs.
>>> Any text to stdout and stderr before the last line with the json string
>>> result are capture in te logs in the activation record
>>> 
>>> Fell free to open an issue with more info on how to reproduce your problem.
>>> 
>>> — Carlos
>>> PS: my employer is also IBM. :-)
>>> 
 On Sun, Mar 4, 2018 at 5:56 AM Erez Hadad  wrote:
 
 Hi folks,
 
 I'm working with technical people from different organizations outside my
 employer (IBM), and we're testing OpenWhisk as a mechanism for integrating
 our different tools and services into a single heterogeneous event-driven
 programming model.
 On the face of it, OW seems like a great fit.
 However, when it comes down to implementation, we often hit a case where
 the easiest way to delegate action execution to a custom tool is by
 writing a simple bash script. This is where things get complicated.
 To the best of my understanding (please correct me otherwise), there is no
 first-class support for bash runtime in OW.
 So, it's down to creating either a "native" action using a zip, or a
 custom docker action. Both options are quite more cumbersome than using
 native runtimes.
 
 So this is my first question - would it make sense to have a native bash
 runtime in OW? especially given that some of the function that OW
 seemingly provides is glue-code between existing tools and services (where
 bash also shines).
 
 As a second issue, we explored the native action. It seems that output is
 not captured in the action logs when including ssh calls that invoke bash
 
 My second question - does anyone have a different experience with this
 that they can share? (maybe this problem is not related to OW?)
 
 Regards,
 -- Erez Hadad
 
 Erez Hadad, PhD
 Cloud System Technologies
 IBM Research - Haifa
 email: er...@il.ibm.com
 phone: +972-4-829-6509
 
 
 
 


Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Kumar Subramanian
Gave the value as mykafka.marathon.mesos:9092…it seems to be going forward now 
with the deployment…hope it succeeds

On 3/5/18, 12:13 PM, "Kumar Subramanian"  wrote:

Hi Chetan,
I resolved all the settings (not sure about some those values set)….now I’m 
getting the following error
I0305 20:07:00.341622 21216 exec.cpp:162] Version: 1.2.3
I0305 20:07:00.347102 21224 exec.cpp:237] Executor registered on agent 
995020e0-5129-44a3-8cf4-65900838b3af-S4
Exception in thread "main" org.apache.kafka.common.KafkaException: Failed 
create new KafkaAdminClient
at 
org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:322)
at 
org.apache.kafka.clients.admin.AdminClient.create(AdminClient.java:50)
at 
whisk.connector.kafka.KafkaMessagingProvider$.ensureTopic(KafkaMessagingProvider.scala:70)
at whisk.core.controller.Controller$.main(Controller.scala:217)
at whisk.core.controller.Controller.main(Controller.scala)
Caused by: org.apache.kafka.common.config.ConfigException: No resolvable 
bootstrap urls given in bootstrap.servers
at 
org.apache.kafka.clients.ClientUtils.parseAndValidateAddresses(ClientUtils.java:64)
at 
org.apache.kafka.clients.admin.KafkaAdminClient.(KafkaAdminClient.java:345)
at 
org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:315)
... 4 more
<>
The config environment values are:
"KAFKA_HOST": "broker-0.kafka.mesos"
"KAFKA_HOSTS": "mykafka.docker:9092"


Here is the Kakfka service in my dcos services
<>   
ID: mykafka.654fa8cd-1e56-11e8-8754-3afdc003616b
Name: mykafka
Address: <>
Status: Running

On 3/5/18, 12:01 PM, "Kumar Subramanian"  wrote:

Also what is DB_WHISK_ACTIVATIONS=local_activations, what does it mean 
by “local” activations? This setting is also needed, what should the value be 
in my dcos env? Should it still be local_activations?

On 3/5/18, 11:48 AM, "Kumar Subramanian"  
wrote:

Thanks Chetan, I added that now I’m getting the 

[2018-03-05T19:43:45.025Z] [ERROR] [??] [Config] required property 
kafka.hosts still not set

what is kafka.hosts is that the kafka host name? (as in 
mykafka…that;s the kafka name I gave when I installed kakfa). Should it be just 
the name or is FQDN ?
 

On 3/5/18, 11:32 AM, "Chetan Mehrotra"  
wrote:

> required property controller.instances still not set

Looks like some configs are missing. You would need to this or 
few
more props. The configs are generally managed via Ansible for 
default
setup. For dcos you may need to configure them explicitly. You 
can see
various configs and there values as an example at [1]
(controller.instances becomes CONTROLLER_INSTANCES). They would 
need
to be tweaked as per your setup though

Chetan Mehrotra
[1] 
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_incubator-2Dopenwhisk-2Ddevtools_blob_master_docker-2Dcompose_docker-2Dwhisk-2Dcontroller.env=DwIFaQ=uilaK90D4TOVoH58JNXRgQ=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo=K8Rzl5BrVqOWFx5b1fYG8EjdY-6JVyi-x_eMD0thaKY=VfbixlUG4tFbgBNxiMr-KCNJOakmlGuNcnXLlbQMrVY=


On Tue, Mar 6, 2018 at 12:09 AM, Kumar Subramanian
 wrote:
> Hi,
> I was able to successfully do the following
> 1) Build the Controller image
> 2) Push the image
>
> However when I installed the controller package it gives me 
the following error in the output; then it shuts down and retries the 
installation (goes on…)
>
> Registered docker executor on 10.0.6.13
> Starting task 
whisk-controller.a46ae612-20a2-11e8-8754-3afdc003616b
> [2018-03-05T18:25:55.853Z] [INFO] Initializing Kamon...
> [INFO] [03/05/2018 18:25:56.151] [main] 
[StatsDExtension(akka://kamon)] Starting the Kamon(StatsD) extension
> [2018-03-05T18:25:56.193Z] [INFO] Slf4jLogger started
> [2018-03-05T18:25:56.552Z] [INFO] [??] [Config] environment 
set value for db.whisk.actions
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment 
set value for db.protocol
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment 
set value for limits.triggers.fires.perMinute
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment 
set value for 

Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Kumar Subramanian
I get the following error while in the deploying state (then kills it 
automatically and re-installs and goes on…)
Task was killed since health check failed. Reason: 
ConnectionAttemptFailedException: Connection attempt to 
>: failed



On 3/5/18, 12:21 PM, "Kumar Subramanian"  wrote:

Gave the value as mykafka.marathon.mesos:9092…it seems to be going forward 
now with the deployment…hope it succeeds

On 3/5/18, 12:13 PM, "Kumar Subramanian"  wrote:

Hi Chetan,
I resolved all the settings (not sure about some those values set)….now 
I’m getting the following error
I0305 20:07:00.341622 21216 exec.cpp:162] Version: 1.2.3
I0305 20:07:00.347102 21224 exec.cpp:237] Executor registered on agent 
995020e0-5129-44a3-8cf4-65900838b3af-S4
Exception in thread "main" org.apache.kafka.common.KafkaException: 
Failed create new KafkaAdminClient
at 
org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:322)
at 
org.apache.kafka.clients.admin.AdminClient.create(AdminClient.java:50)
at 
whisk.connector.kafka.KafkaMessagingProvider$.ensureTopic(KafkaMessagingProvider.scala:70)
at whisk.core.controller.Controller$.main(Controller.scala:217)
at whisk.core.controller.Controller.main(Controller.scala)
Caused by: org.apache.kafka.common.config.ConfigException: No 
resolvable bootstrap urls given in bootstrap.servers
at 
org.apache.kafka.clients.ClientUtils.parseAndValidateAddresses(ClientUtils.java:64)
at 
org.apache.kafka.clients.admin.KafkaAdminClient.(KafkaAdminClient.java:345)
at 
org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:315)
... 4 more
<>
The config environment values are:
"KAFKA_HOST": "broker-0.kafka.mesos"
"KAFKA_HOSTS": "mykafka.docker:9092"


Here is the Kakfka service in my dcos services
<>   
ID: mykafka.654fa8cd-1e56-11e8-8754-3afdc003616b
Name: mykafka
Address: <>
Status: Running

On 3/5/18, 12:01 PM, "Kumar Subramanian"  
wrote:

Also what is DB_WHISK_ACTIVATIONS=local_activations, what does it 
mean by “local” activations? This setting is also needed, what should the value 
be in my dcos env? Should it still be local_activations?

On 3/5/18, 11:48 AM, "Kumar Subramanian"  
wrote:

Thanks Chetan, I added that now I’m getting the 

[2018-03-05T19:43:45.025Z] [ERROR] [??] [Config] required 
property kafka.hosts still not set

what is kafka.hosts is that the kafka host name? (as in 
mykafka…that;s the kafka name I gave when I installed kakfa). Should it be just 
the name or is FQDN ?
 

On 3/5/18, 11:32 AM, "Chetan Mehrotra" 
 wrote:

> required property controller.instances still not set

Looks like some configs are missing. You would need to this 
or few
more props. The configs are generally managed via Ansible 
for default
setup. For dcos you may need to configure them explicitly. 
You can see
various configs and there values as an example at [1]
(controller.instances becomes CONTROLLER_INSTANCES). They 
would need
to be tweaked as per your setup though

Chetan Mehrotra
[1] 
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_incubator-2Dopenwhisk-2Ddevtools_blob_master_docker-2Dcompose_docker-2Dwhisk-2Dcontroller.env=DwIFaQ=uilaK90D4TOVoH58JNXRgQ=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo=K8Rzl5BrVqOWFx5b1fYG8EjdY-6JVyi-x_eMD0thaKY=VfbixlUG4tFbgBNxiMr-KCNJOakmlGuNcnXLlbQMrVY=


On Tue, Mar 6, 2018 at 12:09 AM, Kumar Subramanian
 wrote:
> Hi,
> I was able to successfully do the following
> 1) Build the Controller image
> 2) Push the image
>
> However when I installed the controller package it gives 
me the following error in the output; then it shuts down and retries the 
installation (goes on…)
>
> Registered docker executor on 10.0.6.13
> Starting task 
whisk-controller.a46ae612-20a2-11e8-8754-3afdc003616b
> [2018-03-05T18:25:55.853Z] [INFO] 

Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Kumar Subramanian
Hi Chetan,
I resolved all the settings (not sure about some those values set)….now I’m 
getting the following error
I0305 20:07:00.341622 21216 exec.cpp:162] Version: 1.2.3
I0305 20:07:00.347102 21224 exec.cpp:237] Executor registered on agent 
995020e0-5129-44a3-8cf4-65900838b3af-S4
Exception in thread "main" org.apache.kafka.common.KafkaException: Failed 
create new KafkaAdminClient
at 
org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:322)
at 
org.apache.kafka.clients.admin.AdminClient.create(AdminClient.java:50)
at 
whisk.connector.kafka.KafkaMessagingProvider$.ensureTopic(KafkaMessagingProvider.scala:70)
at whisk.core.controller.Controller$.main(Controller.scala:217)
at whisk.core.controller.Controller.main(Controller.scala)
Caused by: org.apache.kafka.common.config.ConfigException: No resolvable 
bootstrap urls given in bootstrap.servers
at 
org.apache.kafka.clients.ClientUtils.parseAndValidateAddresses(ClientUtils.java:64)
at 
org.apache.kafka.clients.admin.KafkaAdminClient.(KafkaAdminClient.java:345)
at 
org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:315)
... 4 more
<>
The config environment values are:
"KAFKA_HOST": "broker-0.kafka.mesos"
"KAFKA_HOSTS": "mykafka.docker:9092"


Here is the Kakfka service in my dcos services
<>   
ID: mykafka.654fa8cd-1e56-11e8-8754-3afdc003616b
Name: mykafka
Address: <>
Status: Running

On 3/5/18, 12:01 PM, "Kumar Subramanian"  wrote:

Also what is DB_WHISK_ACTIVATIONS=local_activations, what does it mean by 
“local” activations? This setting is also needed, what should the value be in 
my dcos env? Should it still be local_activations?

On 3/5/18, 11:48 AM, "Kumar Subramanian"  wrote:

Thanks Chetan, I added that now I’m getting the 

[2018-03-05T19:43:45.025Z] [ERROR] [??] [Config] required property 
kafka.hosts still not set

what is kafka.hosts is that the kafka host name? (as in mykafka…that;s 
the kafka name I gave when I installed kakfa). Should it be just the name or is 
FQDN ?
 

On 3/5/18, 11:32 AM, "Chetan Mehrotra"  
wrote:

> required property controller.instances still not set

Looks like some configs are missing. You would need to this or few
more props. The configs are generally managed via Ansible for 
default
setup. For dcos you may need to configure them explicitly. You can 
see
various configs and there values as an example at [1]
(controller.instances becomes CONTROLLER_INSTANCES). They would need
to be tweaked as per your setup though

Chetan Mehrotra
[1] 
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_incubator-2Dopenwhisk-2Ddevtools_blob_master_docker-2Dcompose_docker-2Dwhisk-2Dcontroller.env=DwIFaQ=uilaK90D4TOVoH58JNXRgQ=F5C8fYlpBJ270qrdwLq2iRQrPd1CLap8zItxk8laWpo=K8Rzl5BrVqOWFx5b1fYG8EjdY-6JVyi-x_eMD0thaKY=VfbixlUG4tFbgBNxiMr-KCNJOakmlGuNcnXLlbQMrVY=


On Tue, Mar 6, 2018 at 12:09 AM, Kumar Subramanian
 wrote:
> Hi,
> I was able to successfully do the following
> 1) Build the Controller image
> 2) Push the image
>
> However when I installed the controller package it gives me the 
following error in the output; then it shuts down and retries the installation 
(goes on…)
>
> Registered docker executor on 10.0.6.13
> Starting task 
whisk-controller.a46ae612-20a2-11e8-8754-3afdc003616b
> [2018-03-05T18:25:55.853Z] [INFO] Initializing Kamon...
> [INFO] [03/05/2018 18:25:56.151] [main] 
[StatsDExtension(akka://kamon)] Starting the Kamon(StatsD) extension
> [2018-03-05T18:25:56.193Z] [INFO] Slf4jLogger started
> [2018-03-05T18:25:56.552Z] [INFO] [??] [Config] environment set 
value for db.whisk.actions
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set 
value for db.protocol
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set 
value for limits.triggers.fires.perMinute
> [2018-03-05T18:25:56.554Z] [INFO] [??] [Config] environment set 
value for limits.actions.invokes.concurrent
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set 
value for whisk.version.date
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set 
value for db.port
> [2018-03-05T18:25:56.555Z] [INFO] [??] [Config] environment set 
value for whisk.version.buildno
> [2018-03-05T18:25:56.556Z] [INFO] [??] [Config] environment set 
value for db.username
   

Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Kumar Subramanian
After I increased the timeout on the health checks I get the following
[2018-03-05T22:58:34.042Z] [ERROR] [??] [KafkaMessagingProvider] ensureTopic 
for completed0 failed due to java.util.concurrent.ExecutionException: 
org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node 
assignment.
[2018-03-05T22:58:34.044Z] [ERROR] [??] [Controller] failure during 
msgProvider.ensureTopic for topic completed0
[INFO] [03/05/2018 22:58:34.070] [kamon-shutdown-hook-1] 
[CoordinatedShutdown(akka://kamon)] Starting coordinated shutdown from JVM 
shutdown hook

On 3/5/18, 2:58 PM, "Kumar Subramanian"  wrote:

Hi Carlos/Tyson/Chetan,
Any Suggestions?

Note: I just tried to increase the timeout on the health checks …no luck.

Thanks,
Kumar. 

On 3/5/18, 12:28 PM, "Kumar Subramanian"  wrote:

This is the output log
[2018-03-05T20:24:10.016Z] [INFO] Initializing Kamon...
[INFO] [03/05/2018 20:24:10.301] [main] [StatsDExtension(akka://kamon)] 
Starting the Kamon(StatsD) extension
[2018-03-05T20:24:10.352Z] [INFO] Slf4jLogger started
[2018-03-05T20:24:10.706Z] [INFO] [??] [Config] environment set value 
for db.whisk.actions
[2018-03-05T20:24:10.707Z] [INFO] [??] [Config] environment set value 
for db.protocol
[2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment set value 
for limits.actions.sequence.maxLength
[2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment set value 
for limits.triggers.fires.perMinute
[2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment set value 
for akka.cluster.seed.nodes
[2018-03-05T20:24:10.709Z] [INFO] [??] [Config] environment set value 
for limits.actions.invokes.concurrent
[2018-03-05T20:24:10.709Z] [INFO] [??] [Config] environment set value 
for controller.instances
[2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment set value 
for controller.localBookkeeping
[2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment set value 
for whisk.version.date
[2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment set value 
for db.port
[2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment set value 
for whisk.version.buildno
[2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment set value 
for db.whisk.activations
[2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment set value 
for db.username
[2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment set value 
for limits.actions.invokes.perMinute
[2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment set value 
for db.whisk.auths
[2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment set value 
for limits.actions.invokes.concurrentInSystem
[2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment set value 
for runtimes.manifest
[2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment set value 
for kafka.hosts
[2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment set value 
for db.host
[2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment set value 
for port
[2018-03-05T20:24:10.714Z] [INFO] [??] [Config] environment set value 
for db.password
[2018-03-05T20:24:10.714Z] [INFO] [??] [Config] environment set value 
for db.provider
Received killTask for task 
whisk-controller.28d25d91-20b3-11e8-8754-3afdc003616b
[INFO] [03/05/2018 20:25:38.974] [kamon-shutdown-hook-1] 
[CoordinatedShutdown(akka://kamon)] Starting coordinated shutdown from JVM 
shutdown hook
[2018-03-05T20:25:38.975Z] [INFO] Starting coordinated shutdown from 
JVM shutdown hook
[2018-03-05T20:25:38.982Z] [INFO] [??] [Controller] Shutting down Kamon 
with coordinated shutdown

ERROR_LOG
I0305 20:24:09.220711  1337 exec.cpp:162] Version: 1.2.3
I0305 20:24:09.227144  1338 exec.cpp:237] Executor registered on agent 
995020e0-5129-44a3-8cf4-65900838b3af-S7
W0305 20:24:09.227144  1341 logging.cpp:91] RAW: Received signal 
SIGTERM from process 10243 of user 0; exiting

On 3/5/18, 12:24 PM, "Kumar Subramanian"  
wrote:

I get the following error while in the deploying state (then kills 
it automatically and re-installs and goes on…)
Task was killed since health check failed. Reason: 
ConnectionAttemptFailedException: Connection attempt to 
>: failed



On 3/5/18, 12:21 PM, "Kumar Subramanian"  
wrote:

Gave the value as mykafka.marathon.mesos:9092…it seems to be 
going forward now with the deployment…hope it succeeds

On 3/5/18, 12:13 PM, "Kumar Subramanian" 
 wrote:

   

Re: Error when deploying Whisk-Controller in dcos

2018-03-05 Thread Tyson Norris
I’m guessing the kafka service did not start properly? Can you verify the kafka 
service is usable?

> On Mar 5, 2018, at 3:00 PM, Kumar Subramanian  wrote:
> 
> After I increased the timeout on the health checks I get the following
> [2018-03-05T22:58:34.042Z] [ERROR] [??] [KafkaMessagingProvider] ensureTopic 
> for completed0 failed due to java.util.concurrent.ExecutionException: 
> org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node 
> assignment.
> [2018-03-05T22:58:34.044Z] [ERROR] [??] [Controller] failure during 
> msgProvider.ensureTopic for topic completed0
> [INFO] [03/05/2018 22:58:34.070] [kamon-shutdown-hook-1] 
> [CoordinatedShutdown(akka://kamon)] Starting coordinated shutdown from JVM 
> shutdown hook
> 
> On 3/5/18, 2:58 PM, "Kumar Subramanian"  wrote:
> 
>Hi Carlos/Tyson/Chetan,
>Any Suggestions?
> 
>Note: I just tried to increase the timeout on the health checks …no luck.
> 
>Thanks,
>Kumar. 
> 
>On 3/5/18, 12:28 PM, "Kumar Subramanian"  wrote:
> 
>This is the output log
>[2018-03-05T20:24:10.016Z] [INFO] Initializing Kamon...
>[INFO] [03/05/2018 20:24:10.301] [main] 
> [StatsDExtension(akka://kamon)] Starting the Kamon(StatsD) extension
>[2018-03-05T20:24:10.352Z] [INFO] Slf4jLogger started
>[2018-03-05T20:24:10.706Z] [INFO] [??] [Config] environment set value 
> for db.whisk.actions
>[2018-03-05T20:24:10.707Z] [INFO] [??] [Config] environment set value 
> for db.protocol
>[2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment set value 
> for limits.actions.sequence.maxLength
>[2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment set value 
> for limits.triggers.fires.perMinute
>[2018-03-05T20:24:10.708Z] [INFO] [??] [Config] environment set value 
> for akka.cluster.seed.nodes
>[2018-03-05T20:24:10.709Z] [INFO] [??] [Config] environment set value 
> for limits.actions.invokes.concurrent
>[2018-03-05T20:24:10.709Z] [INFO] [??] [Config] environment set value 
> for controller.instances
>[2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment set value 
> for controller.localBookkeeping
>[2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment set value 
> for whisk.version.date
>[2018-03-05T20:24:10.710Z] [INFO] [??] [Config] environment set value 
> for db.port
>[2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment set value 
> for whisk.version.buildno
>[2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment set value 
> for db.whisk.activations
>[2018-03-05T20:24:10.711Z] [INFO] [??] [Config] environment set value 
> for db.username
>[2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment set value 
> for limits.actions.invokes.perMinute
>[2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment set value 
> for db.whisk.auths
>[2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment set value 
> for limits.actions.invokes.concurrentInSystem
>[2018-03-05T20:24:10.712Z] [INFO] [??] [Config] environment set value 
> for runtimes.manifest
>[2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment set value 
> for kafka.hosts
>[2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment set value 
> for db.host
>[2018-03-05T20:24:10.713Z] [INFO] [??] [Config] environment set value 
> for port
>[2018-03-05T20:24:10.714Z] [INFO] [??] [Config] environment set value 
> for db.password
>[2018-03-05T20:24:10.714Z] [INFO] [??] [Config] environment set value 
> for db.provider
>Received killTask for task 
> whisk-controller.28d25d91-20b3-11e8-8754-3afdc003616b
>[INFO] [03/05/2018 20:25:38.974] [kamon-shutdown-hook-1] 
> [CoordinatedShutdown(akka://kamon)] Starting coordinated shutdown from JVM 
> shutdown hook
>[2018-03-05T20:25:38.975Z] [INFO] Starting coordinated shutdown from 
> JVM shutdown hook
>[2018-03-05T20:25:38.982Z] [INFO] [??] [Controller] Shutting down 
> Kamon with coordinated shutdown
> 
>ERROR_LOG
>I0305 20:24:09.220711  1337 exec.cpp:162] Version: 1.2.3
>I0305 20:24:09.227144  1338 exec.cpp:237] Executor registered on agent 
> 995020e0-5129-44a3-8cf4-65900838b3af-S7
>W0305 20:24:09.227144  1341 logging.cpp:91] RAW: Received signal 
> SIGTERM from process 10243 of user 0; exiting
> 
>On 3/5/18, 12:24 PM, "Kumar Subramanian"  
> wrote:
> 
>I get the following error while in the deploying state (then kills 
> it automatically and re-installs and goes on…)
>Task was killed since health check failed. Reason: 
> ConnectionAttemptFailedException: Connection attempt to 
> >: failed
> 
> 
> 
>On 3/5/18, 12:21 PM, "Kumar Subramanian"  
> wrote:
> 
>