See <https://ci.trafficserver.apache.org/job/tsqa-master/308/changes>
Changes: [Bryan Call] TS-3519: HTTP/2 seeing a lot of GOAWAY frames being sent ------------------------------------------ [...truncated 13210 lines...] 10 655 3280.2 0 0 48252217/4825221 2119 2119 2119 79359662 12.9 0 10 671 3359.8 0 0 49133765/4913376 2171 2171 2171 80673619 13.9 0 10 674 3371.6 0 0 49895533/4989553 2171 2171 2171 81655009 14.9 0 10 676 3384.5 0 0 51168514/5116851 2178 2178 2178 83882277 15.9 0 10 687 3439.2 0 0 50855509/5085550 2207 2207 2207 83224243 16.9 0 10 690 3456.4 0 0 50859588/5085958 2213 2213 2213 82995797 17.9 0 10 691 3457.5 0 0 52747170/5274717 2215 2215 2215 85234689 18.9 0 10 690 3455.2 0 0 52332104/5233210 2211 2211 2211 84143523 19.9 0 con new ops 1B lat bytes/per svrs new ops total time err 10 685 3428.7 0 0 52609084/5260908 2195 2195 2195 84312824 20.9 0 10 684 3425.0 0 0 53144641/5314464 2194 2194 2194 86356571 21.9 0 10 687 3439.8 0 0 53063403/5306340 2210 2210 2210 85516779 22.9 0 10 684 3425.0 0 0 53845491/5384549 2198 2198 2198 86643376 23.9 0 10 691 3456.2 0 0 53786983/5378698 2224 2224 2225 86751582 24.9 0 10 688 3446.0 0 0 54949156/5494915 2216 2216 2216 89077966 25.9 0 10 693 3467.2 0 0 54622098/5462209 2236 2236 2237 89240251 26.9 0 10 699 3498.2 0 0 54730164/5473016 2240 2240 2240 89503211 27.9 0 MSG: reloading logging configuration 10 703 3518.5 0 0 54262691/5426269 2257 2257 2257 89316337 28.9 0 10 700 3503.4 0 0 54521139/5452113 2257 2257 2256 89841451 29.9 0 10 694 3472.9 0 0 55640264/5564026 2227 2227 2228 90452780 30.9 0 10 695 3479.5 0 0 55450898/5545089 2226 2226 2226 90439788 31.9 0 10 699 3501.4 0 0 54685680/5468568 2245 2245 2245 89716430 32.9 0 10 701 3509.9 0 0 54523956/5452395 2260 2260 2260 89924127 33.9 0 10 702 3512.4 0 0 54541188/5454118 2254 2254 2254 89573320 34.9 0 10 697 3490.7 0 0 53504061/5350406 2237 2237 2238 87159933 35.9 0 10 702 3512.2 0 0 52649220/5264922 2258 2258 2258 85909356 36.9 0 10 702 3510.3 0 0 53118407/5311840 2249 2249 2249 87631165 37.9 0 10 703 3520.5 0 0 52615861/5261586 2252 2252 2252 86866643 38.9 0 10 708 3543.6 0 0 53716625/5371662 2279 2279 2278 89265250 39.9 0 con new ops 1B lat bytes/per svrs new ops total time err 10 706 3534.9 0 0 53270368/5327036 2271 2271 2271 88078344 40.9 0 10 700 3507.3 0 0 54085051/5408505 2261 2261 2261 89168571 41.9 0 10 706 3535.8 0 0 52903976/5290397 2277 2277 2278 86979507 42.9 0 10 705 3528.3 0 0 52624361/5262436 2267 2267 2267 86442763 43.9 0 10 702 3512.6 0 0 53138663/5313866 2250 2250 2250 87677291 44.9 0 10 702 3516.3 0 0 53171873/5317187 2260 2260 2261 88321522 45.9 0 10 699 3499.8 0 0 53489320/5348932 2250 2250 2250 88921487 46.9 0 10 701 3509.7 0 0 52668719/5266871 2241 2241 2241 86616351 47.9 0 10 701 3507.1 0 0 52945013/5294501 2243 2243 2243 87311152 48.9 0 10 698 3496.3 0 0 52770604/5277060 2234 2234 2234 87690232 49.9 0 10 702 3512.0 0 0 52360131/5236013 2242 2242 2242 86994687 50.9 0 10 705 3527.0 0 0 52508248/5250824 2256 2256 2256 87614699 51.9 0 10 705 3530.4 0 0 52156731/5215673 2261 2261 2261 87401913 52.9 0 10 705 3529.9 0 0 51993583/5199358 2261 2261 2260 86465660 53.9 0 10 704 3523.6 0 0 52789188/5278918 2260 2260 2260 87932110 54.9 0 10 704 3522.2 0 0 52446079/5244607 2266 2266 2266 87104006 55.9 0 10 701 3507.2 0 0 53025132/5302513 2254 2254 2254 88099485 56.9 0 10 700 3505.2 0 0 53256056/5325605 2250 2250 2250 88664728 57.9 0 MSG: reloading logging configuration 10 698 3491.7 0 0 53298431/5329843 2241 2241 2241 88697791 58.9 0 10 702 3513.4 0 0 52228136/5222813 2261 2261 2261 87517400 59.9 0 con new ops 1B lat bytes/per svrs new ops total time err 10 701 3506.3 0 0 51847588/5184758 2257 2257 2257 86322663 60.9 0 10 560 2805.0 0 0 41478071/4147807 1805 1805 1805 69058130 60.9 0 MSG: checking for crashes ... ./functions: line 177: 6548 Terminated ( tsexec traffic_cop --stdout > $log ) ./functions: line 177: 6818 Terminated reload MSG: shutting down ... Success: test-log-refcounting test-multicert-loading test-multicert-loading test-privilege-elevation test-multicert-loading test-privilege-elevation --> Starting test: test-server-intercept MSG: bootstrapped Traffic Server into /tmp/test-server-intercept.26219 PREFIX: /tmp/test-server-intercept.26219 BINDIR: /opt/jenkins/tsqa-master/bin SYSCONFDIR: /tmp/test-server-intercept.26219/etc/trafficserver LIBDIR: /tmp/test-server-intercept.26219/lib LOGDIR: /tmp/test-server-intercept.26219/var/log/trafficserver RUNTIMEDIR: /tmp/test-server-intercept.26219/var/trafficserver PLUGINDIR: /opt/jenkins/tsqa-master/libexec/trafficserver INCLUDEDIR: /tmp/test-server-intercept.26219/include SNAPSHOTDIR: /tmp/test-server-intercept.26219/etc/trafficserver/snapshots records.config: /tmp/test-server-intercept.26219/etc/trafficserver/records.config remap.config: /tmp/test-server-intercept.26219/etc/trafficserver/remap.config plugin.config: /tmp/test-server-intercept.26219/etc/trafficserver/plugin.config ssl_multicert.config: /tmp/test-server-intercept.26219/etc/trafficserver/ssl_multicert.config storage.config: /tmp/test-server-intercept.26219/etc/trafficserver/storage.config hosting.config: /tmp/test-server-intercept.26219/etc/trafficserver/hosting.config volume.config: /tmp/test-server-intercept.26219/etc/trafficserver/volume.config ip_allow.config: /tmp/test-server-intercept.26219/etc/trafficserver/ip_allow.config MSG: cop is alive MSG: manager is alive MSG: server is alive MSG: waiting 1s gethostbyname(jtest.trafficserver.apache.org): Unknown host con new ops 1B lat bytes/per svrs new ops total time err 10 76 372.6 0 0 5384770/538477 327 327 327 10453420 0.6 0 10 171 853.9 0 0 12383049/1238304 660 660 660 22277661 1.6 0 10 293 1462.7 0 0 21274278/2127427 1019 1019 1018 36355533 2.6 0 10 383 1916.0 0 0 29188197/2918819 1273 1273 1272 49115990 3.6 0 10 463 2313.0 0 0 35386096/3538609 1485 1485 1485 58297161 4.6 0 10 524 2621.6 0 0 39926464/3992646 1654 1654 1653 65855124 5.6 0 10 568 2844.3 0 0 43863046/4386304 1830 1830 1830 73501009 6.6 0 10 601 3007.2 0 0 46842232/4684223 1996 1996 1996 78805962 7.6 0 10 624 3120.4 0 0 47413259/4741325 2070 2070 2070 78936593 8.6 0 10 643 3214.7 0 0 50225505/5022550 2091 2091 2091 82530872 9.6 0 10 659 3296.0 0 0 52513875/5251387 2108 2108 2108 85900943 10.6 0 10 678 3393.6 0 0 53247703/5324770 2146 2146 2146 87548879 11.6 0 10 694 3471.7 0 0 54481001/5448100 2225 2225 2225 90398608 12.6 0 10 701 3508.5 0 0 54771102/5477110 2300 2300 2299 91510428 13.6 0 10 717 3587.2 0 0 54795904/5479590 2360 2360 2360 90830876 14.6 0 10 720 3601.4 0 0 55131908/5513190 2337 2337 2337 90797058 15.6 0 10 726 3635.9 0 0 55096753/5509675 2330 2330 2329 90484793 16.6 0 10 728 3644.7 0 0 55697186/5569718 2305 2305 2304 91018819 17.6 0 10 738 3695.6 0 0 55896420/5589642 2330 2330 2331 91569596 18.6 0 10 739 3700.5 0 0 55549247/5554924 2364 2364 2365 91490511 19.6 0 con new ops 1B lat bytes/per svrs new ops total time err 10 731 3660.2 0 0 55601027/5560102 2378 2378 2379 91778552 20.6 0 10 726 3633.7 0 0 55818706/5581870 2358 2358 2358 92046189 21.6 0 10 732 3663.0 0 0 55475697/5547569 2359 2359 2359 91201127 22.6 0 10 730 3653.4 0 0 56146295/5614629 2325 2325 2324 91992064 23.6 0 10 730 3652.3 0 0 56887527/5688752 2332 2332 2332 93581763 24.6 0 10 726 3632.6 0 0 57201270/5720127 2331 2331 2331 94179930 25.6 0 10 726 3631.7 0 0 57160954/5716095 2359 2359 2358 94480325 26.6 0 10 722 3612.2 0 0 57456054/5745605 2358 2358 2358 95043911 27.6 0 10 721 3608.1 0 0 56687863/5668786 2345 2345 2345 93814289 28.6 0 10 717 3590.1 0 0 55435239/5543523 2300 2300 2300 90556032 29.6 0 10 719 3597.9 0 0 55541630/5554163 2283 2283 2282 90528679 30.6 0 10 724 3623.3 0 0 55974568/5597456 2306 2306 2307 91946797 31.6 0 10 720 3606.6 0 0 55753212/5575321 2308 2308 2308 91137634 32.6 0 10 727 3635.9 0 0 55355629/5535562 2345 2345 2345 91091538 33.6 0 10 729 3647.1 0 0 55316995/5531699 2355 2355 2355 90265112 34.6 0 10 734 3675.7 0 0 55812605/5581260 2357 2357 2357 90993318 35.6 0 10 740 3701.2 0 0 55851906/5585190 2359 2359 2359 92044478 36.6 0 10 738 3695.3 0 0 55872898/5587289 2359 2359 2359 92100951 37.6 0 10 737 3686.3 0 0 56049629/5604962 2355 2355 2355 91982584 38.6 0 10 732 3662.0 0 0 55289441/5528944 2365 2365 2365 91378492 39.6 0 con new ops 1B lat bytes/per svrs new ops total time err 10 733 3666.6 0 0 55268750/5526875 2372 2372 2372 91368943 40.6 0 10 732 3664.9 0 0 55434383/5543438 2373 2373 2373 92051839 41.6 0 10 736 3686.9 0 0 55024533/5502453 2371 2371 2371 90639805 42.6 0 10 739 3696.9 0 0 55300796/5530079 2368 2368 2368 90944784 43.6 0 10 740 3704.1 0 0 54682332/5468233 2368 2368 2368 89396518 44.6 0 10 739 3695.9 0 0 54350024/5435002 2374 2374 2374 88770380 45.6 0 10 732 3660.5 0 0 54033938/5403393 2357 2357 2357 88133544 46.6 0 10 728 3640.0 0 0 54206554/5420655 2362 2362 2362 88329406 47.6 0 10 731 3661.2 0 0 53958538/5395853 2364 2364 2364 88779056 48.6 0 10 733 3666.4 0 0 54616743/5461674 2346 2346 2346 89883050 49.6 0 10 734 3675.1 0 0 54529824/5452982 2365 2365 2365 89695276 50.6 0 10 732 3665.5 0 0 55735552/5573555 2358 2358 2358 92088537 51.6 0 10 739 3699.8 0 0 54821147/5482114 2368 2368 2367 90554141 52.6 0 10 734 3674.4 0 0 54964318/5496431 2361 2361 2361 90795516 53.6 0 10 727 3637.3 0 0 55455974/5545597 2339 2339 2339 92126766 54.6 0 10 732 3663.7 0 0 56085733/5608573 2344 2344 2344 92555793 55.6 0 10 735 3680.9 0 0 55586551/5558655 2342 2342 2342 92088447 56.6 0 10 736 3685.8 0 0 55801546/5580154 2352 2352 2352 92694252 57.6 0 10 732 3661.8 0 0 55841269/5584126 2343 2343 2342 92217239 58.6 0 10 737 3686.8 0 0 55725910/5572591 2361 2361 2361 92278725 59.6 0 con new ops 1B lat bytes/per svrs new ops total time err 10 739 3701.9 0 0 55839658/5583965 2378 2378 2377 92706322 60.6 0 10 591 2961.5 0 0 44671726/4467172 1902 1902 1902 74165057 60.6 0 MSG: checking for crashes ... ./functions: line 177: 18632 Terminated ( tsexec traffic_cop --stdout > $log ) MSG: shutting down ... Success: test-server-intercept test-multicert-loading test-privilege-elevation --> Starting test: test-ssl-certificates MSG: bootstrapped Traffic Server into /tmp/test-ssl-certificates.20994 PREFIX: /tmp/test-ssl-certificates.20994 BINDIR: /opt/jenkins/tsqa-master/bin SYSCONFDIR: /tmp/test-ssl-certificates.20994/etc/trafficserver LIBDIR: /tmp/test-ssl-certificates.20994/lib LOGDIR: /tmp/test-ssl-certificates.20994/var/log/trafficserver RUNTIMEDIR: /tmp/test-ssl-certificates.20994/var/trafficserver PLUGINDIR: /opt/jenkins/tsqa-master/libexec/trafficserver INCLUDEDIR: /tmp/test-ssl-certificates.20994/include SNAPSHOTDIR: /tmp/test-ssl-certificates.20994/etc/trafficserver/snapshots records.config: /tmp/test-ssl-certificates.20994/etc/trafficserver/records.config remap.config: /tmp/test-ssl-certificates.20994/etc/trafficserver/remap.config plugin.config: /tmp/test-ssl-certificates.20994/etc/trafficserver/plugin.config ssl_multicert.config: /tmp/test-ssl-certificates.20994/etc/trafficserver/ssl_multicert.config storage.config: /tmp/test-ssl-certificates.20994/etc/trafficserver/storage.config hosting.config: /tmp/test-ssl-certificates.20994/etc/trafficserver/hosting.config volume.config: /tmp/test-ssl-certificates.20994/etc/trafficserver/volume.config ip_allow.config: /tmp/test-ssl-certificates.20994/etc/trafficserver/ip_allow.config MSG: cop is alive MSG: manager is alive MSG: server is alive Set proxy.config.http.server_ports, restart required Set proxy.config.diags.debug.tags MSG: waiting 2s to restart with SSL ports enabled MSG: waiting 6s for traffic_server to restart MSG: checking for the *.tsqa.trafficserver.apache.org certificate ... FAIL: openssl check for *.tsqa.trafficserver.apache.org failed unable to load certificate 140339060467616:error:0906D06C:PEM routines:PEM_read_bio:no start line:pem_lib.c:703:Expecting: TRUSTED CERTIFICATE FAIL: received certificate CN "", expected "*.tsqa.trafficserver.apache.org" MSG: checking for the sni.tsqa.trafficserver.apache.org certificate ... FAIL: openssl check for sni.tsqa.trafficserver.apache.org failed unable to load certificate 140523902674848:error:0906D06C:PEM routines:PEM_read_bio:no start line:pem_lib.c:703:Expecting: TRUSTED CERTIFICATE FAIL: received certificate CN "", expected "sni.tsqa.trafficserver.apache.org" MSG: checking for the port.tsqa.trafficserver.apache.org certificate ... FAIL: openssl check for port.tsqa.trafficserver.apache.org failed unable to load certificate 140706117339040:error:0906D06C:PEM routines:PEM_read_bio:no start line:pem_lib.c:703:Expecting: TRUSTED CERTIFICATE FAIL: received certificate CN "", expected "port.tsqa.trafficserver.apache.org" MSG: checking for the address.tsqa.trafficserver.apache.org certificate ... FAIL: openssl check for address.tsqa.trafficserver.apache.org failed unable to load certificate 140217962657696:error:0906D06C:PEM routines:PEM_read_bio:no start line:pem_lib.c:703:Expecting: TRUSTED CERTIFICATE FAIL: received certificate CN "", expected "address.tsqa.trafficserver.apache.org" ./functions: line 177: 19024 Terminated ( tsexec traffic_cop --stdout > $log ) MSG: shutting down ... Failure: test-ssl-certificates test-multicert-loading test-privilege-elevation --> Starting test: test-trafficline-metrics MSG: bootstrapped Traffic Server into /tmp/test-trafficline-metrics.2888 PREFIX: /tmp/test-trafficline-metrics.2888 BINDIR: /opt/jenkins/tsqa-master/bin SYSCONFDIR: /tmp/test-trafficline-metrics.2888/etc/trafficserver LIBDIR: /tmp/test-trafficline-metrics.2888/lib LOGDIR: /tmp/test-trafficline-metrics.2888/var/log/trafficserver RUNTIMEDIR: /tmp/test-trafficline-metrics.2888/var/trafficserver PLUGINDIR: /opt/jenkins/tsqa-master/libexec/trafficserver INCLUDEDIR: /tmp/test-trafficline-metrics.2888/include SNAPSHOTDIR: /tmp/test-trafficline-metrics.2888/etc/trafficserver/snapshots records.config: /tmp/test-trafficline-metrics.2888/etc/trafficserver/records.config remap.config: /tmp/test-trafficline-metrics.2888/etc/trafficserver/remap.config plugin.config: /tmp/test-trafficline-metrics.2888/etc/trafficserver/plugin.config ssl_multicert.config: /tmp/test-trafficline-metrics.2888/etc/trafficserver/ssl_multicert.config storage.config: /tmp/test-trafficline-metrics.2888/etc/trafficserver/storage.config hosting.config: /tmp/test-trafficline-metrics.2888/etc/trafficserver/hosting.config volume.config: /tmp/test-trafficline-metrics.2888/etc/trafficserver/volume.config ip_allow.config: /tmp/test-trafficline-metrics.2888/etc/trafficserver/ip_allow.config MSG: cop is alive MSG: manager is alive MSG: server is alive MSG: waiting 1s MSG: shutting down ... ./functions: line 202: 19442 Terminated ( tsexec traffic_cop --stdout > $log ) Success: test-trafficline-metrics RESULT SUMMARY ============== test-bootstrap ...OK test-log-configuration ...OK test-log-refcounting ...OK test-server-intercept ...OK test-trafficline-metrics ...OK test-ssl-certificates ...FAIL Build step 'Execute shell' marked build as failure
