Re: linux wrongly treated as passing autopkgtests

2018-06-29 Thread Ben Hutchings
On Fri, 2018-06-29 at 23:21 +0100, Ben Hutchings wrote:
> Looking at
> .
> 
> I see the result:
> 
> selftestsSKIP Test requires machine-level isolation but 
> testbed does not provide that
> autopkgtest [00:39:46]:  summary
> selftestsSKIP Test requires machine-level isolation but 
> testbed does not provide that
> 
> It would be really good if you could implement machine isolation, but I
> understand that it may not be a high priority when so few packages need
> it.
> 
> However, this appears to be treated as a pass, for testing propagation
> purposes.  That's really not right - if a package's tests can't be run,
> I think this should be treated the same as a package missing tests.

dkg pointed me at bug #901847 etc., so there's no need to answer this.

Ben.

-- 
Ben Hutchings
Sturgeon's Law: Ninety percent of everything is crap.


signature.asc
Description: This is a digitally signed message part


linux wrongly treated as passing autopkgtests

2018-06-29 Thread Ben Hutchings
Looking at
.

I see the result:

selftestsSKIP Test requires machine-level isolation but testbed 
does not provide that
autopkgtest [00:39:46]:  summary
selftestsSKIP Test requires machine-level isolation but testbed 
does not provide that

It would be really good if you could implement machine isolation, but I
understand that it may not be a high priority when so few packages need
it.

However, this appears to be treated as a pass, for testing propagation
purposes.  That's really not right - if a package's tests can't be run,
I think this should be treated the same as a package missing tests.

Ben.

-- 
Ben Hutchings
Sturgeon's Law: Ninety percent of everything is crap.


signature.asc
Description: This is a digitally signed message part