Re: [VDSM] FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest) fail again

2019-01-16 Thread Edward Haas
On Tue, Jan 15, 2019 at 8:43 PM Nir Soffer  wrote:

> On Tue, Jan 15, 2019 at 8:41 PM Nir Soffer  wrote:
>
>>
>> On Tue, Jan 15, 2019 at 12:56 PM Nir Soffer  wrote:
>>
>>> On Sun, Jan 13, 2019 at 10:34 AM Edward Haas  wrote:
>>>

 Thank you Nir.
 I added an assert message to this last one.
 It should not happen at all, it is very strange.

 https://gerrit.ovirt.org/#/c/96849/

 Thanks,
 Edy.

 On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer  wrote:

> Another network test that did not fail for long time, failed again today.
>
> Build:
>
> https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_standard-check-patch/runs/1484/nodes/127/steps/407/log/?start=0
>
> ==
> FAIL: test_local_auto_with_static_address_without_ra_server 
> (network.netinfo_test.TestIPv6Addresses)
> --
> Traceback (most recent call last):
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>  line 333, in wrapper
> return f(*args, **kwargs)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>  line 194, in wrapper
> return f(*args, **kwargs)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
>  line 399, in test_local_auto_with_static_address_without_ra_server
> self.assertEqual(2, len(ip_addrs))
> AssertionError: 2 != 4
>  >> begin captured logging << 
> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name 
> dummy_PU7TA type dummy (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS:  = ''; 
>  = 0 (cmdutils:141)
> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread 
>  (func= method Monitor._scan of  0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev 
> dummy_PU7TA up (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS:  = ''; 
>  = 0 (cmdutils:141)
> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread 
>  (concurrent:196)
> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add 
> dev dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS:  = ''; 
>  = 0 (cmdutils:141)
> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev 
> dummy_PU7TA (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS:  = ''; 
>  = 0 (cmdutils:141)
> - >> end captured logging << -
>
>
>
> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer  wrote:
>
>> We had this failure a lot in the past and it seems to be resolve, but
>> I see it again today:
>>
>> ==
>> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
>> --
>> Traceback (most recent call last):
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>>  line 333, in wrapper
>> return f(*args, **kwargs)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>  line 226, in test_add_delete_ipv6
>> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>  line 247, in _test_add_delete
>> self._assert_has_no_address(nic, ip_b)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>  line 344, in _assert_has_no_address
>> self._assert_address_not_in(address_with_prefixlen, addresses)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>  line 352, in _assert_address_not_in
>> self.assertNotIn(address_with_prefixlen, addresses_list)
>> AssertionError: '2002:99::1/64' unexpectedly found in ['2002:99::1/64', 
>> '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>>  >> begin captured logging << 
>> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name 
>> dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS:  = ''; 
>>  = 0 (cmdutils:141)
>> 2019-01-04 

Re: [VDSM] FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest) fail again

2019-01-15 Thread Nir Soffer
On Tue, Jan 15, 2019 at 8:41 PM Nir Soffer  wrote:

>
> On Tue, Jan 15, 2019 at 12:56 PM Nir Soffer  wrote:
>
>> On Sun, Jan 13, 2019 at 10:34 AM Edward Haas  wrote:
>>
>>>
>>> Thank you Nir.
>>> I added an assert message to this last one.
>>> It should not happen at all, it is very strange.
>>>
>>> https://gerrit.ovirt.org/#/c/96849/
>>>
>>> Thanks,
>>> Edy.
>>>
>>> On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer  wrote:
>>>
 Another network test that did not fail for long time, failed again today.

 Build:

 https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_standard-check-patch/runs/1484/nodes/127/steps/407/log/?start=0

 ==
 FAIL: test_local_auto_with_static_address_without_ra_server 
 (network.netinfo_test.TestIPv6Addresses)
 --
 Traceback (most recent call last):
   File 
 "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
  line 333, in wrapper
 return f(*args, **kwargs)
   File 
 "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
  line 194, in wrapper
 return f(*args, **kwargs)
   File 
 "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
  line 399, in test_local_auto_with_static_address_without_ra_server
 self.assertEqual(2, len(ip_addrs))
 AssertionError: 2 != 4
  >> begin captured logging << 
 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name 
 dummy_PU7TA type dummy (cwd None) (cmdutils:133)
 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS:  = ''; 
  = 0 (cmdutils:141)
 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread 
  (func=>>> method Monitor._scan of >>> 0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev 
 dummy_PU7TA up (cwd None) (cmdutils:133)
 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS:  = ''; 
  = 0 (cmdutils:141)
 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread 
  (concurrent:196)
 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev 
 dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS:  = ''; 
  = 0 (cmdutils:141)
 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev 
 dummy_PU7TA (cwd None) (cmdutils:133)
 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS:  = ''; 
  = 0 (cmdutils:141)
 - >> end captured logging << -



 On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer  wrote:

> We had this failure a lot in the past and it seems to be resolve, but
> I see it again today:
>
> ==
> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
> --
> Traceback (most recent call last):
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>  line 333, in wrapper
> return f(*args, **kwargs)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>  line 226, in test_add_delete_ipv6
> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>  line 247, in _test_add_delete
> self._assert_has_no_address(nic, ip_b)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>  line 344, in _assert_has_no_address
> self._assert_address_not_in(address_with_prefixlen, addresses)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>  line 352, in _assert_address_not_in
> self.assertNotIn(address_with_prefixlen, addresses_list)
> AssertionError: '2002:99::1/64' unexpectedly found in ['2002:99::1/64', 
> '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>  >> begin captured logging << 
> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name 
> dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS:  = ''; 
>  = 0 (cmdutils:141)
> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread 
>  (func= method Monitor._scan of  0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
> 

Re: [VDSM] FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest) fail again

2019-01-15 Thread Nir Soffer
On Tue, Jan 15, 2019 at 12:56 PM Nir Soffer  wrote:

> On Sun, Jan 13, 2019 at 10:34 AM Edward Haas  wrote:
>
>>
>> Thank you Nir.
>> I added an assert message to this last one.
>> It should not happen at all, it is very strange.
>>
>> https://gerrit.ovirt.org/#/c/96849/
>>
>> Thanks,
>> Edy.
>>
>> On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer  wrote:
>>
>>> Another network test that did not fail for long time, failed again today.
>>>
>>> Build:
>>>
>>> https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_standard-check-patch/runs/1484/nodes/127/steps/407/log/?start=0
>>>
>>> ==
>>> FAIL: test_local_auto_with_static_address_without_ra_server 
>>> (network.netinfo_test.TestIPv6Addresses)
>>> --
>>> Traceback (most recent call last):
>>>   File 
>>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>>>  line 333, in wrapper
>>> return f(*args, **kwargs)
>>>   File 
>>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>>>  line 194, in wrapper
>>> return f(*args, **kwargs)
>>>   File 
>>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
>>>  line 399, in test_local_auto_with_static_address_without_ra_server
>>> self.assertEqual(2, len(ip_addrs))
>>> AssertionError: 2 != 4
>>>  >> begin captured logging << 
>>> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name 
>>> dummy_PU7TA type dummy (cwd None) (cmdutils:133)
>>> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS:  = '';  
>>> = 0 (cmdutils:141)
>>> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread 
>>>  (func=>> method Monitor._scan of >> 0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
>>> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev 
>>> dummy_PU7TA up (cwd None) (cmdutils:133)
>>> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS:  = '';  
>>> = 0 (cmdutils:141)
>>> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread 
>>>  (concurrent:196)
>>> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev 
>>> dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
>>> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS:  = '';  
>>> = 0 (cmdutils:141)
>>> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev 
>>> dummy_PU7TA (cwd None) (cmdutils:133)
>>> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS:  = '';  
>>> = 0 (cmdutils:141)
>>> - >> end captured logging << -
>>>
>>>
>>>
>>> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer  wrote:
>>>
 We had this failure a lot in the past and it seems to be resolve, but I
 see it again today:

 ==
 FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
 --
 Traceback (most recent call last):
   File 
 "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
  line 333, in wrapper
 return f(*args, **kwargs)
   File 
 "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
  line 226, in test_add_delete_ipv6
 self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
   File 
 "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
  line 247, in _test_add_delete
 self._assert_has_no_address(nic, ip_b)
   File 
 "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
  line 344, in _assert_has_no_address
 self._assert_address_not_in(address_with_prefixlen, addresses)
   File 
 "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
  line 352, in _assert_address_not_in
 self.assertNotIn(address_with_prefixlen, addresses_list)
 AssertionError: '2002:99::1/64' unexpectedly found in ['2002:99::1/64', 
 '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
  >> begin captured logging << 
 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name 
 dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS:  = ''; 
  = 0 (cmdutils:141)
 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread 
  (func=>>> method Monitor._scan of >>> 0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev 
 dummy_NKzY1 up (cwd None) (cmdutils:133)
 2019-01-04 16:01:53,586 DEBUG (MainThread) 

Re: [VDSM] FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest) fail again

2019-01-15 Thread Nir Soffer
On Sun, Jan 13, 2019 at 10:34 AM Edward Haas  wrote:

>
> Thank you Nir.
> I added an assert message to this last one.
> It should not happen at all, it is very strange.
>
> https://gerrit.ovirt.org/#/c/96849/
>
> Thanks,
> Edy.
>
> On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer  wrote:
>
>> Another network test that did not fail for long time, failed again today.
>>
>> Build:
>>
>> https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_standard-check-patch/runs/1484/nodes/127/steps/407/log/?start=0
>>
>> ==
>> FAIL: test_local_auto_with_static_address_without_ra_server 
>> (network.netinfo_test.TestIPv6Addresses)
>> --
>> Traceback (most recent call last):
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>>  line 333, in wrapper
>> return f(*args, **kwargs)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>>  line 194, in wrapper
>> return f(*args, **kwargs)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
>>  line 399, in test_local_auto_with_static_address_without_ra_server
>> self.assertEqual(2, len(ip_addrs))
>> AssertionError: 2 != 4
>>  >> begin captured logging << 
>> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name 
>> dummy_PU7TA type dummy (cwd None) (cmdutils:133)
>> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS:  = '';  
>> = 0 (cmdutils:141)
>> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread 
>>  (func=> Monitor._scan of > 0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
>> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev 
>> dummy_PU7TA up (cwd None) (cmdutils:133)
>> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS:  = '';  
>> = 0 (cmdutils:141)
>> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread 
>>  (concurrent:196)
>> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev 
>> dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
>> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS:  = '';  
>> = 0 (cmdutils:141)
>> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev 
>> dummy_PU7TA (cwd None) (cmdutils:133)
>> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS:  = '';  
>> = 0 (cmdutils:141)
>> - >> end captured logging << -
>>
>>
>>
>> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer  wrote:
>>
>>> We had this failure a lot in the past and it seems to be resolve, but I
>>> see it again today:
>>>
>>> ==
>>> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
>>> --
>>> Traceback (most recent call last):
>>>   File 
>>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>>>  line 333, in wrapper
>>> return f(*args, **kwargs)
>>>   File 
>>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>>  line 226, in test_add_delete_ipv6
>>> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>>>   File 
>>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>>  line 247, in _test_add_delete
>>> self._assert_has_no_address(nic, ip_b)
>>>   File 
>>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>>  line 344, in _assert_has_no_address
>>> self._assert_address_not_in(address_with_prefixlen, addresses)
>>>   File 
>>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>>  line 352, in _assert_address_not_in
>>> self.assertNotIn(address_with_prefixlen, addresses_list)
>>> AssertionError: '2002:99::1/64' unexpectedly found in ['2002:99::1/64', 
>>> '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>>>  >> begin captured logging << 
>>> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name 
>>> dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
>>> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS:  = '';  
>>> = 0 (cmdutils:141)
>>> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread 
>>>  (func=>> method Monitor._scan of >> 0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
>>> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev 
>>> dummy_NKzY1 up (cwd None) (cmdutils:133)
>>> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS:  = '';  
>>> = 0 (cmdutils:141)
>>> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread 
>>>  (concurrent:196)
>>> 2019-01-04 16:01:53,597 

Re: [VDSM] FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest) fail again

2019-01-13 Thread Edward Haas
Thank you Nir.
I added an assert message to this last one.
It should not happen at all, it is very strange.

https://gerrit.ovirt.org/#/c/96849/

Thanks,
Edy.

On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer  wrote:

> Another network test that did not fail for long time, failed again today.
>
> Build:
>
> https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_standard-check-patch/runs/1484/nodes/127/steps/407/log/?start=0
>
> ==
> FAIL: test_local_auto_with_static_address_without_ra_server 
> (network.netinfo_test.TestIPv6Addresses)
> --
> Traceback (most recent call last):
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>  line 333, in wrapper
> return f(*args, **kwargs)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>  line 194, in wrapper
> return f(*args, **kwargs)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
>  line 399, in test_local_auto_with_static_address_without_ra_server
> self.assertEqual(2, len(ip_addrs))
> AssertionError: 2 != 4
>  >> begin captured logging << 
> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name 
> dummy_PU7TA type dummy (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS:  = '';  = 
> 0 (cmdutils:141)
> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread 
>  (func= Monitor._scan of  0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev 
> dummy_PU7TA up (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS:  = '';  = 
> 0 (cmdutils:141)
> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread 
>  (concurrent:196)
> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev 
> dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS:  = '';  = 
> 0 (cmdutils:141)
> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev 
> dummy_PU7TA (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS:  = '';  = 
> 0 (cmdutils:141)
> - >> end captured logging << -
>
>
>
> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer  wrote:
>
>> We had this failure a lot in the past and it seems to be resolve, but I
>> see it again today:
>>
>> ==
>> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
>> --
>> Traceback (most recent call last):
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>>  line 333, in wrapper
>> return f(*args, **kwargs)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>  line 226, in test_add_delete_ipv6
>> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>  line 247, in _test_add_delete
>> self._assert_has_no_address(nic, ip_b)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>  line 344, in _assert_has_no_address
>> self._assert_address_not_in(address_with_prefixlen, addresses)
>>   File 
>> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>>  line 352, in _assert_address_not_in
>> self.assertNotIn(address_with_prefixlen, addresses_list)
>> AssertionError: '2002:99::1/64' unexpectedly found in ['2002:99::1/64', 
>> '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>>  >> begin captured logging << 
>> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name 
>> dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS:  = '';  
>> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread 
>>  (func=> Monitor._scan of > 0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
>> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev 
>> dummy_NKzY1 up (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS:  = '';  
>> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread 
>>  (concurrent:196)
>> 2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev 
>> dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS:  = '';  

Re: [VDSM] FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest) fail again

2019-01-12 Thread Nir Soffer
Another network test that did not fail for long time, failed again today.

Build:

https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_standard-check-patch/runs/1484/nodes/127/steps/407/log/?start=0

==
FAIL: test_local_auto_with_static_address_without_ra_server
(network.netinfo_test.TestIPv6Addresses)
--
Traceback (most recent call last):
  File 
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
return f(*args, **kwargs)
  File 
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
  File 
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
line 399, in test_local_auto_with_static_address_without_ra_server
self.assertEqual(2, len(ip_addrs))
AssertionError: 2 != 4
 >> begin captured logging << 
2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_PU7TA type dummy (cwd None) (cmdutils:133)
2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS:  = '';
 = 0 (cmdutils:141)
2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread
 (func=>, args=(), kwargs={}) (concurrent:193)
2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_PU7TA up (cwd None) (cmdutils:133)
2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS:  = '';
 = 0 (cmdutils:141)
2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread

(concurrent:196)
2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add
dev dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS:  = '';
 = 0 (cmdutils:141)
2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_PU7TA (cwd None) (cmdutils:133)
2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS:  = '';
 = 0 (cmdutils:141)
- >> end captured logging << -



On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer  wrote:

> We had this failure a lot in the past and it seems to be resolve, but I
> see it again today:
>
> ==
> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
> --
> Traceback (most recent call last):
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
>  line 333, in wrapper
> return f(*args, **kwargs)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>  line 226, in test_add_delete_ipv6
> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>  line 247, in _test_add_delete
> self._assert_has_no_address(nic, ip_b)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>  line 344, in _assert_has_no_address
> self._assert_address_not_in(address_with_prefixlen, addresses)
>   File 
> "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
>  line 352, in _assert_address_not_in
> self.assertNotIn(address_with_prefixlen, addresses_list)
> AssertionError: '2002:99::1/64' unexpectedly found in ['2002:99::1/64', 
> '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>  >> begin captured logging << 
> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name 
> dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS:  = '';  = 
> 0 (cmdutils:141)
> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread 
>  (func= Monitor._scan of  0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev 
> dummy_NKzY1 up (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS:  = '';  = 
> 0 (cmdutils:141)
> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread 
>  (concurrent:196)
> 2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev 
> dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS:  = '';  = 
> 0 (cmdutils:141)
> 2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev 
> dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS:  = '';  = 
> 0 (cmdutils:141)
> 2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr del dev 
> dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,656