Re: [openstack-dev] [horizon] npm lint and test problems in gate

2016-06-29 Thread Timur Sufiev
JFYI, CR [1] which fixes the corresponding bug [2] was merged on Jun 28, so
it may make sense to recheck you perfectly looking commit if it has been
staying in Gerrit for a while.

[1] https://review.openstack.org/#/c/334582/
[2] https://bugs.launchpad.net/horizon/+bug/1595938

On Mon, Jun 27, 2016 at 10:42 PM Jeremy Stanley  wrote:

> On 2016-06-24 22:08:40 + (+), Jeremy Stanley wrote:
> [...]
> > the gate-horizon-npm-run-test job uses that same configuration
> > (just passing a different {command}) and we're still seeing
> > failures registered for it even now.
> [...]
>
> Just following up since I got a few more minutes to poke at this
> after discussing in IRC: I have confirmed the stats we have in
> graphite seem to match what's recorded by logstash, and dug up
> three example failure logs from today.
>
>
> http://logs.openstack.org/00/334300/1/check/gate-horizon-npm-run-test/469ff89/console.html
>
>
> http://logs.openstack.org/03/320203/9/check/gate-horizon-npm-run-test/e71f803/console.html
>
>
> http://logs.openstack.org/28/333628/5/check/gate-horizon-npm-run-test/5ae2085/console.html
>
> However, there's (thankfully) a consistent explanation. Take a look
> at the timestamp gaps between the penultimate and ultimate lines of
> each log... timeouts! So I agree the issue seems to be lack of
> errexit in the npm-run builder. The old failures observed for
> gate-horizon-npm-run-lint are probably similarly explained as
> timeout issues we've just been lucky enough not to hit in the past
> week or so. Unfortunately those failures fall just outside our
> elasticsearch retention window so confirming that would be a very
> time-intensive exercise at this point.
> --
> Jeremy Stanley
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [horizon] npm lint and test problems in gate

2016-06-27 Thread Jeremy Stanley
On 2016-06-24 22:08:40 + (+), Jeremy Stanley wrote:
[...]
> the gate-horizon-npm-run-test job uses that same configuration
> (just passing a different {command}) and we're still seeing
> failures registered for it even now.
[...]

Just following up since I got a few more minutes to poke at this
after discussing in IRC: I have confirmed the stats we have in
graphite seem to match what's recorded by logstash, and dug up
three example failure logs from today.

http://logs.openstack.org/00/334300/1/check/gate-horizon-npm-run-test/469ff89/console.html

http://logs.openstack.org/03/320203/9/check/gate-horizon-npm-run-test/e71f803/console.html

http://logs.openstack.org/28/333628/5/check/gate-horizon-npm-run-test/5ae2085/console.html

However, there's (thankfully) a consistent explanation. Take a look
at the timestamp gaps between the penultimate and ultimate lines of
each log... timeouts! So I agree the issue seems to be lack of
errexit in the npm-run builder. The old failures observed for
gate-horizon-npm-run-lint are probably similarly explained as
timeout issues we've just been lucky enough not to hit in the past
week or so. Unfortunately those failures fall just outside our
elasticsearch retention window so confirming that would be a very
time-intensive exercise at this point.
-- 
Jeremy Stanley

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [horizon] npm lint and test problems in gate

2016-06-24 Thread Jeremy Stanley
On 2016-06-24 19:12:01 + (+), Borland, Matt wrote:
> It seems that the npm-run jobs are both passing Jenkins even when the tests
> themselves fail.  I'm not sure why that is, but Cores in particular:
> 
> Please run "npm run lint && npm run test" before you +2 (or +1) anything.
> This ensures that we don't pollute master with broken linting/tests.

I started digging into this briefly, mostly so that we could rule
out a behavior change from the switch from Jenkins to
zuul-launcher/ansible. Jobs were fully on zuul-launcher and off
Jenkins by the UTC end of the 16th[1] but according to graphite[2]
failures were seen in the check pipeline for
gate-horizon-npm-run-lint up to almost noon UTC on the 18th. Worth
noting, however, the gate-horizon-npm-run-test job uses that same
configuration (just passing a different {command}) and we're still
seeing failures[3] registered for it even now.

I also don't see any obvious changes to the configuration
gate-{name}-npm-run-{command} template or npm-run builder definition
this week to account for the behavior change.

[1] http://lists.openstack.org/pipermail/openstack-infra/2016-June/004435.html
[2] http://graphite.openstack.org/render/?width=800&height=400&target=None&target=stats_counts.zuul.pipeline.check.job.gate-horizon-npm-run-lint.FAILURE&from=-24days
 >
[3] http://graphite.openstack.org/render/?width=800&height=400&target=None&target=stats_counts.zuul.pipeline.check.job.gate-horizon-npm-run-test.FAILURE&from=-24days
 >

-- 
Jeremy Stanley

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [horizon] npm lint and test problems in gate

2016-06-24 Thread Borland, Matt
Horizoneers,

It seems that the npm-run jobs are both passing Jenkins even when the tests
themselves fail.  I'm not sure why that is, but Cores in particular:

Please run "npm run lint && npm run test" before you +2 (or +1) anything.
This ensures that we don't pollute master with broken linting/tests.

Thanks!

Matt Borland


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev