Re: [vpp-dev] Test failing

2017-10-11 Thread Dave Wallace 
Please see my previous email about rebasing to fix the 
vpp-verify-master-centos7 failure.


Thanks,
-daw-

On 10/11/2017 7:38 AM, Klement Sekera -X (ksekera - PANTHEON 
TECHNOLOGIES at Cisco) wrote:

I'm can't tell ... I just noticed that this seems to be the real
cause for failure but missed you mentioning it earlier..

Sorry for confusion :)

Klement

Quoting Marco Varlese (2017-10-11 13:22:57)

Klement,

I did notice it and I pointed that out in my previous email too.
Do you think that's caused by my patch?


Cheers,
Marco

On Wed, 2017-10-11 at 10:38 +, Klement Sekera -X (ksekera - PANTHEON
TECHNOLOGIES at Cisco) wrote:

Did you notice this issue?

08:54:52 Removing rpm/SRPMS/
08:54:52 Removing rpm/tmp/
08:54:52 make[2]: Leaving directory
`/w/workspace/vpp-verify-master-centos7/dpdk'
08:54:52 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
08:54:53 
08:54:53  package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer
than vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed
08:54:53 make[1]: *** [install-rpm] Error 2
08:54:53 make[1]: Leaving directory
`/w/workspace/vpp-verify-master-centos7/dpdk'
08:54:53 make: *** [dpdk-install-dev] Error 2
08:54:53 Build step 'Execute shell' marked build as failure

Thanks,
Klement

Quoting Marco Varlese (2017-10-11 12:28:48)

Hi Jan,

Thanks for pointing to the correct TEST failure.
However, what I'd like to mention is that it's literally impossible to get a
build/run through for the past couple of days.
I am not sure if it's just me being unlucky but none of the "-1 Verified" I
get
are due to the patch I submit... :(
Please, if you have 2 spare mins, take a look at this patch https://gerrit.f
d.io
/r/#/c/8733/ and see how many "recheck" I have and all failed.


Cheers,
Marco

On Wed, 2017-10-11 at 10:15 +, Jan Gelety -X (jgelety - PANTHEON
TECHNOLOGIES at Cisco) wrote:

Hello Marco,

Regarding failure of vpp-csit-verify-virl-master job - the issue is not
the TC
mentioned by you below. "TC02: DUT reports packet flow for traffic with
local
destination address" is also marked as non-critical as it is expected to
fail
now. You can see it in the console log too:

08:00:53 TC02: DUT reports packet flow for traffic with local destination
address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | FAIL |
08:00:53 Traffic script execution failed
08:00:53 ---

-
08:01:22 TC03: DUT reports packet flow for traffic with remote destination
address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure ... | PASS |
08:01:22 ---

-
08:01:22 Tests.Vpp.Func.Telemetry.Eth2P-Ethip6-Ip6Base-Ip6Ipfixbase-Func
::
*IPFIX ipv6 test cases*  | PASS |
08:01:22 0 critical tests, 0 passed, 0 failed
08:01:22 3 tests total, 2 passed, 1 failed

=> there is no critical test failure (only critical tests can block the
verification)


The failed test is " Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func .TC01: VPP
policer 2R3C Color-aware marks packet":

08:07:42 TC01: VPP policer 2R3C Color-aware marks packet :: [Top]
TG=DUT1.
[ WARN ] Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func -
TC01:
VPP policer 2R3C Color-aware marks packet
08:07:42 The VPP PIDs are not equal!
08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215':
6792}
08:07:42 Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func -
TC01:
VPP policer 2R3C Color-aware marks packet
08:07:42 The VPP PIDs are not equal!
08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215':
6792}
08:07:42 | FAIL |
08:07:42 Teardown failed:
08:07:42 SSHTimeout: Timeout exception.
08:07:42 Current contents of stdout buffer:
08:07:42 Current contents of stderr buffer:

It seems that there was VPP restart during execution of this test.

Regards,
Jan

-Original Message-
From: Marco Varlese [mailto:marco.varl...@suse.com]
Sent: Wednesday, October 11, 2017 10:49
To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) <jgelety@cisc
o.co
m>; Ed Kern (ejk) <e...@cisco.com>
Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
Subject: Re: [vpp-dev] Test failing

Today I can't get a build +1 Verified.

Different sort of errors and completely random...

https://jenkins.fd.io/job/vpp-verify-master-centos7/7520/console
07:11:39 make[2]: Leaving directory `/w/workspace/vpp-verify-master-
centos7/dpdk'
07:11:39 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
07:11:39 
07:11:39  package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is

Re: [vpp-dev] Test failing

2017-10-11 Thread Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco) 
IDs: {'10.30.52.214': 9863, '10.30.52.215':
> > > > 6792}
> > > > 08:07:42 Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func -
> > > > TC01:
> > > > VPP policer 2R3C Color-aware marks packet 
> > > > 08:07:42 The VPP PIDs are not equal!
> > > > 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 
> > > > 6792}
> > > > 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215':
> > > > 6792}
> > > > 08:07:42 | FAIL |
> > > > 08:07:42 Teardown failed:
> > > > 08:07:42 SSHTimeout: Timeout exception.
> > > > 08:07:42 Current contents of stdout buffer: 
> > > > 08:07:42 Current contents of stderr buffer:
> > > > 
> > > > It seems that there was VPP restart during execution of this test.
> > > > 
> > > > Regards,
> > > > Jan
> > > > 
> > > > -Original Message-
> > > > From: Marco Varlese [mailto:marco.varl...@suse.com] 
> > > > Sent: Wednesday, October 11, 2017 10:49
> > > > To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
> > > > <jgelety@cisc
> > > > o.co
> > > > m>; Ed Kern (ejk) <e...@cisco.com>
> > > > Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
> > > > Subject: Re: [vpp-dev] Test failing
> > > > 
> > > > Today I can't get a build +1 Verified.
> > > > 
> > > > Different sort of errors and completely random...
> > > > 
> > > > https://jenkins.fd.io/job/vpp-verify-master-centos7/7520/console
> > > > 07:11:39 make[2]: Leaving directory `/w/workspace/vpp-verify-master-
> > > > centos7/dpdk'
> > > > 07:11:39 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
> > > > 07:11:39 
> > > > 07:11:39  package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer
> > > > than
> > > > vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed
> > > > 07:11:39 make[1]: *** [install-rpm] Error 2
> > > > 07:11:39 make[1]: Leaving directory `/w/workspace/vpp-verify-master-
> > > > centos7/dpdk'
> > > > 07:11:39 make: *** [dpdk-install-dev] Error 2
> > > > 07:11:39 Build step 'Execute shell' marked build as failure
> > > > 
> > > > https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7533/console
> > > > 08:29:44 08:00:53 TC02: DUT reports packet flow for traffic with local
> > > > destination address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure 
> > > > I...
> > > > |
> > > > FAIL |
> > > > 08:29:44 08:00:53 Traffic script execution failed
> > > > 08:29:44
> > > > ======================
> > > > 
> > > > ==
> > > > 08:29:44 Final result of all test
> > > > loops:  
> > > >   
> > > > 
> > > >   
> > > >| FAIL |
> > > > 08:29:44 1 critical test has failed.
> > > > 08:29:44
> > > > ==
> > > > 
> > > > ==
> > > > 
> > > > 
> > > > - Marco
> > > > 
> > > > On Mon, 2017-10-09 at 07:26 +, Jan Gelety -X (jgelety - PANTHEON
> > > > TECHNOLOGIES at Cisco) wrote:
> > > > > Hello Marco,
> > > > > 
> > > > > I had a look on the test case log 
> > > > > (https://jenkins.fd.io/job/vpp-csit-verify-v
> > > > > irl-master/7480/robot/report/log.html) - it's always the best action 
> > > > > you can do to check what test case really caused the failure as there 
> > > > > are some tests expected to fail because of non-fixed issues in VPP - 
> > > > > and failed test is
> > > > > 
> > > > > TEST TC01: Route IPv4 packet through LISP with Bridge Domain setup.
> > > > > 
> > > > > Where no running VPP was detected (no VPP pid returned) during the 
> > > > > test case setup phase.
> > > > > 
> > > > > Regards,
> > > > > Jan
> > > > > 
> > > > > -Original Message-
> > > > > From: Marco Varlese [mailto:marco.varl...@suse.com]
> >

Re: [vpp-dev] Test failing

2017-10-11 Thread Marco Varlese 
Klement,

I did notice it and I pointed that out in my previous email too.
Do you think that's caused by my patch?


Cheers,
Marco

On Wed, 2017-10-11 at 10:38 +, Klement Sekera -X (ksekera - PANTHEON
TECHNOLOGIES at Cisco) wrote:
> Did you notice this issue?
> 
> 08:54:52 Removing rpm/SRPMS/
> 08:54:52 Removing rpm/tmp/
> 08:54:52 make[2]: Leaving directory
> `/w/workspace/vpp-verify-master-centos7/dpdk'
> 08:54:52 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
> 08:54:53 
> 08:54:53  package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer
> than vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed
> 08:54:53 make[1]: *** [install-rpm] Error 2
> 08:54:53 make[1]: Leaving directory
> `/w/workspace/vpp-verify-master-centos7/dpdk'
> 08:54:53 make: *** [dpdk-install-dev] Error 2
> 08:54:53 Build step 'Execute shell' marked build as failure
> 
> Thanks,
> Klement
> 
> Quoting Marco Varlese (2017-10-11 12:28:48)
> > Hi Jan,
> > 
> > Thanks for pointing to the correct TEST failure.
> > However, what I'd like to mention is that it's literally impossible to get a
> > build/run through for the past couple of days. 
> > I am not sure if it's just me being unlucky but none of the "-1 Verified" I
> > get
> > are due to the patch I submit... :(
> > Please, if you have 2 spare mins, take a look at this patch https://gerrit.f
> > d.io
> > /r/#/c/8733/ and see how many "recheck" I have and all failed.
> > 
> > 
> > Cheers,
> > Marco
> > 
> > On Wed, 2017-10-11 at 10:15 +, Jan Gelety -X (jgelety - PANTHEON
> > TECHNOLOGIES at Cisco) wrote:
> > > Hello Marco,
> > > 
> > > Regarding failure of vpp-csit-verify-virl-master job - the issue is not
> > > the TC
> > > mentioned by you below. "TC02: DUT reports packet flow for traffic with
> > > local
> > > destination address" is also marked as non-critical as it is expected to
> > > fail
> > > now. You can see it in the console log too:
> > > 
> > > 08:00:53 TC02: DUT reports packet flow for traffic with local destination
> > > address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | FAIL |
> > > 08:00:53 Traffic script execution failed
> > > 08:00:53 ---
> > > 
> > > -
> > > 08:01:22 TC03: DUT reports packet flow for traffic with remote destination
> > > address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure ... | PASS |
> > > 08:01:22 ---
> > > 
> > > -
> > > 08:01:22 Tests.Vpp.Func.Telemetry.Eth2P-Ethip6-Ip6Base-Ip6Ipfixbase-Func
> > > ::
> > > *IPFIX ipv6 test cases*  | PASS |
> > > 08:01:22 0 critical tests, 0 passed, 0 failed
> > > 08:01:22 3 tests total, 2 passed, 1 failed
> > > 
> > > => there is no critical test failure (only critical tests can block the
> > > verification)
> > > 
> > > 
> > > The failed test is " Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func .TC01: VPP
> > > policer 2R3C Color-aware marks packet":
> > > 
> > > 08:07:42 TC01: VPP policer 2R3C Color-aware marks packet :: [Top]
> > > TG=DUT1. 
> > > [ WARN ] Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func -
> > > TC01:
> > > VPP policer 2R3C Color-aware marks packet 
> > > 08:07:42 The VPP PIDs are not equal!
> > > 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
> > > 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215':
> > > 6792}
> > > 08:07:42 Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func -
> > > TC01:
> > > VPP policer 2R3C Color-aware marks packet 
> > > 08:07:42 The VPP PIDs are not equal!
> > > 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
> > > 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215':
> > > 6792}
> > > 08:07:42 | FAIL |
> > > 08:07:42 Teardown failed:
> > > 08:07:42 SSHTimeout: Timeout exception.
> > > 08:07:42 Current contents of stdout buffer: 
> > > 08:07:42 Current contents of stderr buffer:
> > > 
> > > It seems that there was VPP

Re: [vpp-dev] Test failing

2017-10-11 Thread Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco) 
Did you notice this issue?

08:54:52 Removing rpm/SRPMS/
08:54:52 Removing rpm/tmp/
08:54:52 make[2]: Leaving directory
`/w/workspace/vpp-verify-master-centos7/dpdk'
08:54:52 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
08:54:53 
08:54:53package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer
than vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed
08:54:53 make[1]: *** [install-rpm] Error 2
08:54:53 make[1]: Leaving directory
`/w/workspace/vpp-verify-master-centos7/dpdk'
08:54:53 make: *** [dpdk-install-dev] Error 2
08:54:53 Build step 'Execute shell' marked build as failure

Thanks,
Klement

Quoting Marco Varlese (2017-10-11 12:28:48)
> Hi Jan,
> 
> Thanks for pointing to the correct TEST failure.
> However, what I'd like to mention is that it's literally impossible to get a
> build/run through for the past couple of days. 
> I am not sure if it's just me being unlucky but none of the "-1 Verified" I 
> get
> are due to the patch I submit... :(
> Please, if you have 2 spare mins, take a look at this patch 
> https://gerrit.fd.io
> /r/#/c/8733/ and see how many "recheck" I have and all failed.
> 
> 
> Cheers,
> Marco
> 
> On Wed, 2017-10-11 at 10:15 +, Jan Gelety -X (jgelety - PANTHEON
> TECHNOLOGIES at Cisco) wrote:
> > Hello Marco,
> > 
> > Regarding failure of vpp-csit-verify-virl-master job - the issue is not the 
> > TC
> > mentioned by you below. "TC02: DUT reports packet flow for traffic with 
> > local
> > destination address" is also marked as non-critical as it is expected to 
> > fail
> > now. You can see it in the console log too:
> > 
> > 08:00:53 TC02: DUT reports packet flow for traffic with local destination
> > address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | FAIL |
> > 08:00:53 Traffic script execution failed
> > 08:00:53 ---
> > -
> > 08:01:22 TC03: DUT reports packet flow for traffic with remote destination
> > address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure ... | PASS |
> > 08:01:22 ---
> > -
> > 08:01:22 Tests.Vpp.Func.Telemetry.Eth2P-Ethip6-Ip6Base-Ip6Ipfixbase-Func ::
> > *IPFIX ipv6 test cases*  | PASS |
> > 08:01:22 0 critical tests, 0 passed, 0 failed
> > 08:01:22 3 tests total, 2 passed, 1 failed
> > 
> > => there is no critical test failure (only critical tests can block the
> > verification)
> > 
> > 
> > The failed test is " Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func .TC01: VPP
> > policer 2R3C Color-aware marks packet":
> > 
> > 08:07:42 TC01: VPP policer 2R3C Color-aware marks packet :: [Top]
> > TG=DUT1. 
> > [ WARN ] Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - 
> > TC01:
> > VPP policer 2R3C Color-aware marks packet 
> > 08:07:42 The VPP PIDs are not equal!
> > 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
> > 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 
> > 6792}
> > 08:07:42 Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - 
> > TC01:
> > VPP policer 2R3C Color-aware marks packet 
> > 08:07:42 The VPP PIDs are not equal!
> > 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
> > 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 
> > 6792}
> > 08:07:42 | FAIL |
> > 08:07:42 Teardown failed:
> > 08:07:42 SSHTimeout: Timeout exception.
> > 08:07:42 Current contents of stdout buffer: 
> > 08:07:42 Current contents of stderr buffer:
> > 
> > It seems that there was VPP restart during execution of this test.
> > 
> > Regards,
> > Jan
> > 
> > -Original Message-
> > From: Marco Varlese [mailto:marco.varl...@suse.com] 
> > Sent: Wednesday, October 11, 2017 10:49
> > To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
> > <jgel...@cisco.co
> > m>; Ed Kern (ejk) <e...@cisco.com>
> > Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
> > Subject: Re: [vpp-dev] Test failing
> > 
> > Today I can't get a build +1 Verified.
> > 
> > Different sort of errors and completely random...
> > 
> > https://jenkins.fd.io/job/vpp-verify-master-centos7/7520/console
> > 07:1

Re: [vpp-dev] Test failing

2017-10-11 Thread Marco Varlese 
Hi Jan,

Thanks for pointing to the correct TEST failure.
However, what I'd like to mention is that it's literally impossible to get a
build/run through for the past couple of days. 
I am not sure if it's just me being unlucky but none of the "-1 Verified" I get
are due to the patch I submit... :(
Please, if you have 2 spare mins, take a look at this patch https://gerrit.fd.io
/r/#/c/8733/ and see how many "recheck" I have and all failed.


Cheers,
Marco

On Wed, 2017-10-11 at 10:15 +, Jan Gelety -X (jgelety - PANTHEON
TECHNOLOGIES at Cisco) wrote:
> Hello Marco,
> 
> Regarding failure of vpp-csit-verify-virl-master job - the issue is not the TC
> mentioned by you below. "TC02: DUT reports packet flow for traffic with local
> destination address" is also marked as non-critical as it is expected to fail
> now. You can see it in the console log too:
> 
> 08:00:53 TC02: DUT reports packet flow for traffic with local destination
> address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | FAIL |
> 08:00:53 Traffic script execution failed
> 08:00:53 ---
> -
> 08:01:22 TC03: DUT reports packet flow for traffic with remote destination
> address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure ... | PASS |
> 08:01:22 ---
> -
> 08:01:22 Tests.Vpp.Func.Telemetry.Eth2P-Ethip6-Ip6Base-Ip6Ipfixbase-Func ::
> *IPFIX ipv6 test cases*  | PASS |
> 08:01:22 0 critical tests, 0 passed, 0 failed
> 08:01:22 3 tests total, 2 passed, 1 failed
> 
> => there is no critical test failure (only critical tests can block the
> verification)
> 
> 
> The failed test is " Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func .TC01: VPP
> policer 2R3C Color-aware marks packet":
> 
> 08:07:42 TC01: VPP policer 2R3C Color-aware marks packet :: [Top]
> TG=DUT1. 
> [ WARN ] Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - TC01:
> VPP policer 2R3C Color-aware marks packet 
> 08:07:42 The VPP PIDs are not equal!
> 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
> 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 6792}
> 08:07:42 Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - TC01:
> VPP policer 2R3C Color-aware marks packet 
> 08:07:42 The VPP PIDs are not equal!
> 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
> 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 6792}
> 08:07:42 | FAIL |
> 08:07:42 Teardown failed:
> 08:07:42 SSHTimeout: Timeout exception.
> 08:07:42 Current contents of stdout buffer: 
> 08:07:42 Current contents of stderr buffer:
> 
> It seems that there was VPP restart during execution of this test.
> 
> Regards,
> Jan
> 
> -Original Message-
> From: Marco Varlese [mailto:marco.varl...@suse.com] 
> Sent: Wednesday, October 11, 2017 10:49
> To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) <jgel...@cisco.co
> m>; Ed Kern (ejk) <e...@cisco.com>
> Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
> Subject: Re: [vpp-dev] Test failing
> 
> Today I can't get a build +1 Verified.
> 
> Different sort of errors and completely random...
> 
> https://jenkins.fd.io/job/vpp-verify-master-centos7/7520/console
> 07:11:39 make[2]: Leaving directory `/w/workspace/vpp-verify-master-
> centos7/dpdk'
> 07:11:39 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
> 07:11:39 
> 07:11:39  package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer than
> vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed
> 07:11:39 make[1]: *** [install-rpm] Error 2
> 07:11:39 make[1]: Leaving directory `/w/workspace/vpp-verify-master-
> centos7/dpdk'
> 07:11:39 make: *** [dpdk-install-dev] Error 2
> 07:11:39 Build step 'Execute shell' marked build as failure
> 
> https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7533/console
> 08:29:44 08:00:53 TC02: DUT reports packet flow for traffic with local
> destination address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... |
> FAIL |
> 08:29:44 08:00:53 Traffic script execution failed
> 08:29:44
> ==
> ==
> 08:29:44 Final result of all test
> loops:
>   
>| FAIL |
> 08:29:44 1 critical t

Re: [vpp-dev] Test failing

2017-10-11 Thread Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
Hello Marco,

Regarding failure of vpp-csit-verify-virl-master job - the issue is not the TC 
mentioned by you below. "TC02: DUT reports packet flow for traffic with local 
destination address" is also marked as non-critical as it is expected to fail 
now. You can see it in the console log too:

08:00:53 TC02: DUT reports packet flow for traffic with local destination 
address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | FAIL |
08:00:53 Traffic script execution failed
08:00:53 

08:01:22 TC03: DUT reports packet flow for traffic with remote destination 
address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure ... | PASS |
08:01:22 

08:01:22 Tests.Vpp.Func.Telemetry.Eth2P-Ethip6-Ip6Base-Ip6Ipfixbase-Func :: 
*IPFIX ipv6 test cases*  | PASS |
08:01:22 0 critical tests, 0 passed, 0 failed
08:01:22 3 tests total, 2 passed, 1 failed

=> there is no critical test failure (only critical tests can block the 
verification)


The failed test is " Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func .TC01: VPP 
policer 2R3C Color-aware marks packet":

08:07:42 TC01: VPP policer 2R3C Color-aware marks packet :: [Top] TG=DUT1.  
   
[ WARN ] Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - TC01: 
VPP policer 2R3C Color-aware marks packet 
08:07:42 The VPP PIDs are not equal!
08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 6792}
08:07:42 Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - TC01: 
VPP policer 2R3C Color-aware marks packet 
08:07:42 The VPP PIDs are not equal!
08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 6792}
08:07:42 | FAIL |
08:07:42 Teardown failed:
08:07:42 SSHTimeout: Timeout exception.
08:07:42 Current contents of stdout buffer: 
08:07:42 Current contents of stderr buffer:

It seems that there was VPP restart during execution of this test.

Regards,
Jan

-Original Message-
From: Marco Varlese [mailto:marco.varl...@suse.com] 
Sent: Wednesday, October 11, 2017 10:49
To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
<jgel...@cisco.com>; Ed Kern (ejk) <e...@cisco.com>
Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
Subject: Re: [vpp-dev] Test failing

Today I can't get a build +1 Verified.

Different sort of errors and completely random...

https://jenkins.fd.io/job/vpp-verify-master-centos7/7520/console
07:11:39 make[2]: Leaving directory `/w/workspace/vpp-verify-master- 
centos7/dpdk'
07:11:39 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
07:11:39 
07:11:39package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer than
vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed
07:11:39 make[1]: *** [install-rpm] Error 2
07:11:39 make[1]: Leaving directory `/w/workspace/vpp-verify-master- 
centos7/dpdk'
07:11:39 make: *** [dpdk-install-dev] Error 2
07:11:39 Build step 'Execute shell' marked build as failure

https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7533/console
08:29:44 08:00:53 TC02: DUT reports packet flow for traffic with local 
destination address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | 
FAIL |
08:29:44 08:00:53 Traffic script execution failed
08:29:44

08:29:44 Final result of all test
loops:  
   | FAIL |
08:29:44 1 critical test has failed.
08:29:44



- Marco

On Mon, 2017-10-09 at 07:26 +, Jan Gelety -X (jgelety - PANTHEON 
TECHNOLOGIES at Cisco) wrote:
> Hello Marco,
> 
> I had a look on the test case log 
> (https://jenkins.fd.io/job/vpp-csit-verify-v
> irl-master/7480/robot/report/log.html) - it's always the best action 
> you can do to check what test case really caused the failure as there 
> are some tests expected to fail because of non-fixed issues in VPP - 
> and failed test is
> 
> TEST TC01: Route IPv4 packet through LISP with Bridge Domain setup.
> 
> Where no running VPP was detected (no VPP pid returned) during the 
> test case setup phase.
> 
> Regards,
> Jan
> 
> -Original Message-
> From: Marco Varlese [mailto:marco.varl...@suse.com]
> Sent: Monday, October 09, 2017 09:04
> To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
> &

Re: [vpp-dev] Test failing

2017-10-11 Thread Marco Varlese 
Today I can't get a build +1 Verified.

Different sort of errors and completely random...

https://jenkins.fd.io/job/vpp-verify-master-centos7/7520/console
07:11:39 make[2]: Leaving directory `/w/workspace/vpp-verify-master-
centos7/dpdk'
07:11:39 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
07:11:39 
07:11:39package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer than
vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed
07:11:39 make[1]: *** [install-rpm] Error 2
07:11:39 make[1]: Leaving directory `/w/workspace/vpp-verify-master-
centos7/dpdk'
07:11:39 make: *** [dpdk-install-dev] Error 2
07:11:39 Build step 'Execute shell' marked build as failure

https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7533/console
08:29:44 08:00:53 TC02: DUT reports packet flow for traffic with local
destination address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... |
FAIL |
08:29:44 08:00:53 Traffic script execution failed
08:29:44

08:29:44 Final result of all test
loops:  
   | FAIL |
08:29:44 1 critical test has failed.
08:29:44



- Marco

On Mon, 2017-10-09 at 07:26 +, Jan Gelety -X (jgelety - PANTHEON
TECHNOLOGIES at Cisco) wrote:
> Hello Marco,
> 
> I had a look on the test case log (https://jenkins.fd.io/job/vpp-csit-verify-v
> irl-master/7480/robot/report/log.html) - it's always the best action you can
> do to check what test case really caused the failure as there are some tests
> expected to fail because of non-fixed issues in VPP - and failed test is
> 
> TEST TC01: Route IPv4 packet through LISP with Bridge Domain setup.
> 
> Where no running VPP was detected (no VPP pid returned) during the test case
> setup phase.
> 
> Regards,
> Jan
> 
> -Original Message-
> From: Marco Varlese [mailto:marco.varl...@suse.com] 
> Sent: Monday, October 09, 2017 09:04
> To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) <jgel...@cisco.co
> m>; Ed Kern (ejk) <e...@cisco.com>
> Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
> Subject: Re: [vpp-dev] Test failing
> 
> Please, take a look at this logs:
> 
> https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7480/console
> 
> After Ed and yourself mentioned it... maybe the cause of the failure is linked
> to this failure instead?
> 14:32:52 14:11:12 Tests.Vpp.Func.Ip4 Tunnels.Lisp.Eth2P-Ethip4Lisp-
> L2Bdbasemaclrn-Func :: *ip4-lispgpe-ip4 encapsulation test
> cases*  |
> FAIL |
> 14:32:52 14:11:12 1 critical test, 0 passed, 1 failed
> 14:32:52 14:11:12 1 test total, 0 passed, 1 failed
> 
> 
> Cheers,
> Marco
> 
> On Fri, 2017-10-06 at 15:49 +, Jan Gelety -X (jgelety - PANTHEON
> TECHNOLOGIES at Cisco) wrote:
> > + csit-dev
> > 
> > Hello Marco,
> > 
> > The mentioned test case is not responsible for -1 in verification as 
> > this test case is marked as non-critical. Please, provide links to 
> > affected jobs to find which TC is really failing.
> > 
> > Thanks,
> > Jan
> > 
> > -Original Message-
> > From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] 
> > On Behalf Of Ed Kern (ejk)
> > Sent: Friday, October 06, 2017 17:07
> > To: Marco Varlese <marco.varl...@suse.com>
> > Cc: vpp-dev@lists.fd.io
> > Subject: Re: [vpp-dev] Test failing
> > 
> > could you throw me some example jobs?
> > 
> > thanks,
> > 
> > Ed
> > 
> > 
> > > On Oct 6, 2017, at 8:54 AM, Marco Varlese <marco.varl...@suse.com> wrote:
> > > 
> > > Hi all,
> > > 
> > > I have seen this many times these days...
> > > I wonder if it's a infra hiccup or something is really broken?
> > > 
> > > The "recheck" is becoming the norm to get a clean +1 Verified... :(
> > > 
> > > 14:32:52 14:00:32 TC04: VPP doesn't send DHCPv4 REQUEST after OFFER 
> > > with wrong
> > > XID :: Configure DHCPv4 client on interface to TG. If server   | FAIL
> > > |
> > > 14:32:52 14:00:32 Expected error 'DHCP REQUEST Rx timeout' but got 
> > > 'Traffic script execution failed'.
> > > 
> > > 
> > > Cheers,
> > > Marco
> > > ___
> > > vpp-dev mailing list
> > > vpp-dev@lists.fd.io
> > > https://lists.fd.io/mailman/listinfo/vpp-dev
> > 
> > ___
> > vpp-dev mailing list
> > vpp-dev@lists.fd.io
> > https://lists.fd.io/mailman/listinfo/vpp-dev
> > 
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] Test failing

2017-10-09 Thread Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
Hello Marco,

I had a look on the test case log 
(https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7480/robot/report/log.html)
 - it's always the best action you can do to check what test case really caused 
the failure as there are some tests expected to fail because of non-fixed 
issues in VPP - and failed test is

TEST TC01: Route IPv4 packet through LISP with Bridge Domain setup.

Where no running VPP was detected (no VPP pid returned) during the test case 
setup phase.

Regards,
Jan

-Original Message-
From: Marco Varlese [mailto:marco.varl...@suse.com] 
Sent: Monday, October 09, 2017 09:04
To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
<jgel...@cisco.com>; Ed Kern (ejk) <e...@cisco.com>
Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
Subject: Re: [vpp-dev] Test failing

Please, take a look at this logs:

https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7480/console

After Ed and yourself mentioned it... maybe the cause of the failure is linked 
to this failure instead?
14:32:52 14:11:12 Tests.Vpp.Func.Ip4 Tunnels.Lisp.Eth2P-Ethip4Lisp-
L2Bdbasemaclrn-Func :: *ip4-lispgpe-ip4 encapsulation test cases*  |
FAIL |
14:32:52 14:11:12 1 critical test, 0 passed, 1 failed
14:32:52 14:11:12 1 test total, 0 passed, 1 failed


Cheers,
Marco

On Fri, 2017-10-06 at 15:49 +, Jan Gelety -X (jgelety - PANTHEON 
TECHNOLOGIES at Cisco) wrote:
> + csit-dev
> 
> Hello Marco,
> 
> The mentioned test case is not responsible for -1 in verification as 
> this test case is marked as non-critical. Please, provide links to 
> affected jobs to find which TC is really failing.
> 
> Thanks,
> Jan
> 
> -Original Message-
> From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] 
> On Behalf Of Ed Kern (ejk)
> Sent: Friday, October 06, 2017 17:07
> To: Marco Varlese <marco.varl...@suse.com>
> Cc: vpp-dev@lists.fd.io
> Subject: Re: [vpp-dev] Test failing
> 
> could you throw me some example jobs?
> 
> thanks,
> 
> Ed
> 
> 
> > On Oct 6, 2017, at 8:54 AM, Marco Varlese <marco.varl...@suse.com> wrote:
> > 
> > Hi all,
> > 
> > I have seen this many times these days...
> > I wonder if it's a infra hiccup or something is really broken?
> > 
> > The "recheck" is becoming the norm to get a clean +1 Verified... :(
> > 
> > 14:32:52 14:00:32 TC04: VPP doesn't send DHCPv4 REQUEST after OFFER 
> > with wrong
> > XID :: Configure DHCPv4 client on interface to TG. If server   | FAIL |
> > 14:32:52 14:00:32 Expected error 'DHCP REQUEST Rx timeout' but got 
> > 'Traffic script execution failed'.
> > 
> > 
> > Cheers,
> > Marco
> > ___
> > vpp-dev mailing list
> > vpp-dev@lists.fd.io
> > https://lists.fd.io/mailman/listinfo/vpp-dev
> 
> ___
> vpp-dev mailing list
> vpp-dev@lists.fd.io
> https://lists.fd.io/mailman/listinfo/vpp-dev
> 
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] Test failing

2017-10-09 Thread Marco Varlese 
Please, take a look at this logs:

https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7480/console

After Ed and yourself mentioned it... maybe the cause of the failure is linked
to this failure instead?
14:32:52 14:11:12 Tests.Vpp.Func.Ip4 Tunnels.Lisp.Eth2P-Ethip4Lisp-
L2Bdbasemaclrn-Func :: *ip4-lispgpe-ip4 encapsulation test cases*  |
FAIL |
14:32:52 14:11:12 1 critical test, 0 passed, 1 failed
14:32:52 14:11:12 1 test total, 0 passed, 1 failed


Cheers,
Marco

On Fri, 2017-10-06 at 15:49 +, Jan Gelety -X (jgelety - PANTHEON
TECHNOLOGIES at Cisco) wrote:
> + csit-dev
> 
> Hello Marco,
> 
> The mentioned test case is not responsible for -1 in verification as this test
> case is marked as non-critical. Please, provide links to affected jobs to find
> which TC is really failing.
> 
> Thanks,
> Jan
> 
> -Original Message-
> From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] On
> Behalf Of Ed Kern (ejk)
> Sent: Friday, October 06, 2017 17:07
> To: Marco Varlese <marco.varl...@suse.com>
> Cc: vpp-dev@lists.fd.io
> Subject: Re: [vpp-dev] Test failing
> 
> could you throw me some example jobs?
> 
> thanks,
> 
> Ed
> 
> 
> > On Oct 6, 2017, at 8:54 AM, Marco Varlese <marco.varl...@suse.com> wrote:
> > 
> > Hi all,
> > 
> > I have seen this many times these days...
> > I wonder if it's a infra hiccup or something is really broken?
> > 
> > The "recheck" is becoming the norm to get a clean +1 Verified... :(
> > 
> > 14:32:52 14:00:32 TC04: VPP doesn't send DHCPv4 REQUEST after OFFER with
> > wrong
> > XID :: Configure DHCPv4 client on interface to TG. If server   | FAIL |
> > 14:32:52 14:00:32 Expected error 'DHCP REQUEST Rx timeout' but got 
> > 'Traffic script execution failed'.
> > 
> > 
> > Cheers,
> > Marco
> > ___
> > vpp-dev mailing list
> > vpp-dev@lists.fd.io
> > https://lists.fd.io/mailman/listinfo/vpp-dev
> 
> ___
> vpp-dev mailing list
> vpp-dev@lists.fd.io
> https://lists.fd.io/mailman/listinfo/vpp-dev
> 
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] Test failing

2017-10-06 Thread Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
+ csit-dev

Hello Marco,

The mentioned test case is not responsible for -1 in verification as this test 
case is marked as non-critical. Please, provide links to affected jobs to find 
which TC is really failing.

Thanks,
Jan

-Original Message-
From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] On 
Behalf Of Ed Kern (ejk)
Sent: Friday, October 06, 2017 17:07
To: Marco Varlese <marco.varl...@suse.com>
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] Test failing

could you throw me some example jobs?

thanks,

Ed


> On Oct 6, 2017, at 8:54 AM, Marco Varlese <marco.varl...@suse.com> wrote:
> 
> Hi all,
> 
> I have seen this many times these days...
> I wonder if it's a infra hiccup or something is really broken?
> 
> The "recheck" is becoming the norm to get a clean +1 Verified... :(
> 
> 14:32:52 14:00:32 TC04: VPP doesn't send DHCPv4 REQUEST after OFFER with wrong
> XID :: Configure DHCPv4 client on interface to TG. If server   | FAIL |
> 14:32:52 14:00:32 Expected error 'DHCP REQUEST Rx timeout' but got 
> 'Traffic script execution failed'.
> 
> 
> Cheers,
> Marco
> ___
> vpp-dev mailing list
> vpp-dev@lists.fd.io
> https://lists.fd.io/mailman/listinfo/vpp-dev

___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] Test failing

2017-10-06 Thread Ed Kern (ejk) 
could you throw me some example jobs?

thanks,

Ed


> On Oct 6, 2017, at 8:54 AM, Marco Varlese  wrote:
> 
> Hi all,
> 
> I have seen this many times these days...
> I wonder if it's a infra hiccup or something is really broken?
> 
> The "recheck" is becoming the norm to get a clean +1 Verified... :(
> 
> 14:32:52 14:00:32 TC04: VPP doesn't send DHCPv4 REQUEST after OFFER with wrong
> XID :: Configure DHCPv4 client on interface to TG. If server   | FAIL |
> 14:32:52 14:00:32 Expected error 'DHCP REQUEST Rx timeout' but got 'Traffic
> script execution failed'.
> 
> 
> Cheers,
> Marco
> ___
> vpp-dev mailing list
> vpp-dev@lists.fd.io
> https://lists.fd.io/mailman/listinfo/vpp-dev

___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev