I've never seen this test fail before.   We haven't changed the kqueue git
submodule version since July 20.  It looks like the next 20 runs of this CI
build didn't hit this test failure either.

I took a quick scan of the kqueue tests and like some of the other
libdispatch test cases, the kqueue test is not bulletproof if the system on
which it is run is under very unusual load.  For example, there are tests
of timer events and if the expected timers are more than a second late, the
testcase is marked as a failure.  Fairly reasonable for a testcase run on a
development machine before committing code.   Not great for running
hundreds of times in a less controlled environment.  We will get occasional
spurious failures.

As part of getting the dispatch tests running in the CI environment, we've
turned off about 20% of the test cases because they were having
non-reproducible occasional failures on the CI machines.  This probably
ties back to the discussion a few days ago on this list about the lldb
tests.  What's the best way for us to structure testcases that test
end-to-end properties or timeliness expectations for highly concurrent code
that won't cause unacceptable levels of spurious failures in the CI
environment?

--dave



From:   "Daniel A. Steffen" <dstef...@apple.com>
To:     Jordan Rose <jordan_r...@apple.com>, David P
            Grove/Watson/IBM@IBMUS, Hubertus Franke/Watson/IBM@IBMUS
Cc:     swift-corelibs-dev <swift-corelibs-dev@swift.org>, swift-dev
            <swift-...@swift.org>
Date:   08/24/2016 10:11 PM
Subject:        Re: [swift-dev] [Swift CI] Build Failure: 0. OSS - Swift
            libdispatch Incremental RA - Ubuntu 14.04 (master) #183
Sent by:        dstef...@apple.com



looks like a libkqueue test failed

dave / hubertus may have seen this before ?

make  check-TESTS
make[2]: Entering directory
`/home/buildnode/disk2/workspace/oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04/Ninja-ReleaseAssert/libdispatch-linux-x86_64/libkqueue'
make[3]: Entering directory
`/home/buildnode/disk2/workspace/oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04/Ninja-ReleaseAssert/libdispatch-linux-x86_64/libkqueue'
FAIL: kqtest


      On Aug 24, 2016, at 16:05, Jordan Rose via swift-dev <
      swift-...@swift.org> wrote:

      Not it. Dispatch folks, any idea what's up?

            On Aug 24, 2016, at 16:04, no-re...@swift.org wrote:

            [FAILURE]
            oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04 [#183]
                                                                                
                  
 Build URL: 
https://ci.swift.org/job/oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04/183/
 
                                                                                
                  
  Project:  oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04             
                  
                                                                                
                  
  Date of   Wed, 24 Aug 2016 15:36:44 -0700                                     
                  
   build:                                                                       
                  
                                                                                
                  
   Build    28 min                                                              
                  
 duration:                                                                      
                  
                                                                                
                  


            Changes
                  Commit 9fab7cb15f5584ce49b49f73e0e8ac277d7c2192 by
                  jordan_rose:


                  Fix s390x Enum load/storeMultiPayloadValue (#4461)
                        edit: stdlib/public/runtime/Enum.cpp

      _______________________________________________
      swift-dev mailing list
      swift-...@swift.org
      https://lists.swift.org/mailman/listinfo/swift-dev


_______________________________________________
swift-corelibs-dev mailing list
swift-corelibs-dev@swift.org
https://lists.swift.org/mailman/listinfo/swift-corelibs-dev

Reply via email to