Unfortunately, the issue is still present with the 1.8.3 ice driver. Logs are at the end of this message. Interesting that the nmea delay is much higher at all times now. This is from the same system as the previous data.
Anecdotally, it seems less frequent. I also did a little more digging around the code I referenced earlier ts2phc_slave.c ts2phc_slave_offset() if (source_ts.tv_nsec > 500000000) { source_ts.tv_sec++; } Normally the PPS ensures that tv_nsec is pretty close to the previous value, because one second has elapsed. But in cases where there is a large nmea delay spike, the tv_nsec value could be at say 100000000, because the seconds value has rolled over. The logic here in ts2phc seems to only advance the tv_sec value based on the tv_nsec value, which leads to cases like in the logs below where the second value was not incremented, even though it should be. I'm not sure what the correct solution for this would be? Should ts2phc be performing a more robust check to compute the tv_sec value? I tried something like this just to see what the behaviour would be and it prevented the master offset issue. I'm not sure what the implications of always advancing the timing might be though. if (source_ts.tv_nsec > 500000000) { source_ts.tv_sec++; } else { source_ts.tv_sec++; pr_info("Timing went weird, advancing tv_sec anyways."); } 2022-04-06T17:09:22.000 controller-0 ts2phc: info [8933.654] tv_sec 1649262489 2022-04-06T17:09:22.000 controller-0 ts2phc: info [8933.654] tv_nsec 499622726 2022-04-06T17:09:22.000 controller-0 ts2phc: info [8933.654] Timing went weird, advancing tv_sec anyways. 2022-04-06T17:09:22.000 controller-0 ts2phc: info [8933.654] enp81s0f0 extts index 0 at 1649262490.000000000 corr 0 src 1649262490.499622726 diff 0 2022-04-06T17:09:22.000 controller-0 ts2phc: info [8933.654] enp81s0f0 master offset 0 s2 freq +0 ### Reproduction of issue ethtool -i enp81s0f0 driver: ice version: 1.8.3 firmware-version: 3.10 0x80009be5 1.3086.0 expansion-rom-version: bus-info: 0000:51:00.0 supports-statistics: yes supports-test: yes supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes Logs: 2022-04-06T16:14:18.000 controller-0 ts2phc: debug [5629.712] enp138s0f0 extts index 0 at 1649259186.000000000 corr 0 src 1649259186.903003525 diff 0 2022-04-06T16:14:18.000 controller-0 ts2phc: debug [5629.712] enp138s0f0 master offset 0 s2 freq +0 2022-04-06T16:14:19.000 controller-0 ts2phc: debug [5630.711] nmea delay: 2509974014846 ns 2022-04-06T16:14:19.000 controller-0 ts2phc: debug [5630.711] enp81s0f0 extts index 0 at 1649259187.000000000 corr 0 src 1649259187.622769768 diff 0 2022-04-06T16:14:19.000 controller-0 ts2phc: debug [5630.711] enp81s0f0 master offset 0 s2 freq -0 2022-04-06T16:14:19.000 controller-0 ts2phc: debug [5630.712] enp138s0f0 extts index 0 at 1649259187.000000000 corr 0 src 1649259187.622769768 diff 0 2022-04-06T16:14:19.000 controller-0 ts2phc: debug [5630.712] enp138s0f0 master offset 0 s2 freq +0 2022-04-06T16:14:20.000 controller-0 ts2phc: debug [5631.711] nmea delay: 2509985703545 ns 2022-04-06T16:14:20.000 controller-0 ts2phc: debug [5631.711] enp81s0f0 extts index 0 at 1649259188.000000001 corr 0 src 1649259188.611065163 diff 1 2022-04-06T16:14:20.000 controller-0 ts2phc: debug [5631.711] enp81s0f0 master offset 1 s2 freq +1 2022-04-06T16:14:20.000 controller-0 ts2phc: debug [5631.712] enp138s0f0 extts index 0 at 1649259188.000000000 corr 0 src 1649259188.611065163 diff 0 2022-04-06T16:14:20.000 controller-0 ts2phc: debug [5631.712] enp138s0f0 master offset 0 s2 freq +0 2022-04-06T16:14:21.000 controller-0 ts2phc: debug [5632.711] nmea delay: 2509975679106 ns 2022-04-06T16:14:21.000 controller-0 ts2phc: debug [5632.711] enp81s0f0 extts index 0 at 1649259189.000000000 corr 0 src 1649259189.621072451 diff 0 2022-04-06T16:14:21.000 controller-0 ts2phc: debug [5632.711] enp81s0f0 master offset 0 s2 freq +0 2022-04-06T16:14:21.000 controller-0 ts2phc: debug [5632.712] enp138s0f0 extts index 0 at 1649259189.000000000 corr 0 src 1649259189.621072451 diff 0 2022-04-06T16:14:21.000 controller-0 ts2phc: debug [5632.712] enp138s0f0 master offset 0 s2 freq +0 2022-04-06T16:14:22.000 controller-0 ts2phc: debug [5633.711] nmea delay: 2510153705944 ns # Nmea delay increases by 178,026,838 ns - less than before # Issue appears here 2022-04-06T16:14:22.000 controller-0 ts2phc: debug [5633.711] enp81s0f0 extts index 0 at 1649259190.000000000 corr 0 src 1649259189.443022927 diff 1000000000 ### The src value here should have had its seconds value incremented, but because of how ts2phc is only checking the nanoseconds value, it did not. The real source time is actually ### 1649259190.443022927 2022-04-06T16:14:22.000 controller-0 ts2phc: debug [5633.711] enp81s0f0 master offset 1000000000 s2 freq +900000000 2022-04-06T16:14:22.000 controller-0 ts2phc: debug [5633.712] enp138s0f0 extts index 0 at 1649259190.000000000 corr 0 src 1649259189.443022927 diff 1000000000 2022-04-06T16:14:22.000 controller-0 ts2phc: debug [5633.712] enp138s0f0 master offset 1000000000 s2 freq +900000000 2022-04-06T16:14:23.000 controller-0 ts2phc: debug [5634.711] nmea delay: 2509910614292 ns 2022-04-06T16:14:23.000 controller-0 ts2phc: debug [5634.711] enp81s0f0 extts index 0 at 1649259190.100442268 corr 0 src 1649259191.686226081 diff -899557732 2022-04-06T16:14:23.000 controller-0 ts2phc: debug [5634.711] enp81s0f0 master offset -899557732 s2 freq -899557732 2022-04-06T16:14:23.000 controller-0 ts2phc: debug [5634.735] nmea delay: 2509910614292 ns 2022-04-06T16:14:23.000 controller-0 ts2phc: debug [5634.735] enp138s0f0 extts index 0 at 1649259190.100838162 corr 0 src 1649259191.709715088 diff -899161838 2022-04-06T16:14:23.000 controller-0 ts2phc: debug [5634.735] enp138s0f0 master offset -899161838 s2 freq -899161838 2022-04-06T16:14:24.000 controller-0 ts2phc: debug [5635.711] nmea delay: 2509934750724 ns 2022-04-06T16:14:24.000 controller-0 ts2phc: debug [5635.711] enp138s0f0 extts index 0 at 1649259191.956652053 corr 0 src 1649259192.661952069 diff -43347947 2022-04-06T16:14:24.000 controller-0 ts2phc: debug [5635.711] enp138s0f0 master offset -43347947 s2 freq -313096498 2022-04-06T16:14:24.000 controller-0 ts2phc: debug [5635.734] nmea delay: 2509934750724 ns 2022-04-06T16:14:24.000 controller-0 ts2phc: debug [5635.734] enp81s0f0 extts index 0 at 1649259191.998895877 corr 0 src 1649259192.685191330 diff -1104123 2022-04-06T16:14:24.000 controller-0 ts2phc: debug [5635.734] enp81s0f0 master offset -1104123 s2 freq -270971442 2022-04-06T16:14:25.000 controller-0 ts2phc: debug [5636.711] nmea delay: 2509932763703 ns 2022-04-06T16:14:25.000 controller-0 ts2phc: debug [5636.711] enp81s0f0 extts index 0 at 1649259193.285100826 corr 0 src 1649259193.663917395 diff 285100826 2022-04-06T16:14:25.000 controller-0 ts2phc: debug [5636.711] enp81s0f0 master offset 285100826 s2 freq +14902270 2022-04-06T16:14:25.000 controller-0 ts2phc: debug [5636.711] enp138s0f0 extts index 0 at 1649259193.270039664 corr 0 src 1649259193.663917395 diff 270039664 2022-04-06T16:14:25.000 controller-0 ts2phc: debug [5636.711] enp138s0f0 master offset 270039664 s2 freq -12713272 2022-04-06T16:14:26.000 controller-0 ts2phc: debug [5637.711] nmea delay: 2509951412014 ns 2022-04-06T16:14:26.000 controller-0 ts2phc: debug [5637.711] enp81s0f0 extts index 0 at 1649259194.270335612 corr 0 src 1649259194.645246996 diff 270335612 2022-04-06T16:14:26.000 controller-0 ts2phc: debug [5637.711] enp81s0f0 master offset 270335612 s2 freq +85667303 2022-04-06T16:14:26.000 controller-0 ts2phc: debug [5637.711] enp138s0f0 extts index 0 at 1649259194.283026443 corr 0 src 1649259194.645246996 diff 283026443 2022-04-06T16:14:26.000 controller-0 ts2phc: debug [5637.711] enp138s0f0 master offset 283026443 s2 freq +81285407 2022-04-06T16:14:27.000 controller-0 ts2phc: debug [5638.711] nmea delay: 2509955664247 ns 2022-04-06T16:14:27.000 controller-0 ts2phc: debug [5638.711] enp81s0f0 extts index 0 at 1649259195.184702116 corr 0 src 1649259195.640978094 diff 184702116 2022-04-06T16:14:27.000 controller-0 ts2phc: debug [5638.711] enp81s0f0 master offset 184702116 s2 freq +81134491 2022-04-06T16:14:27.000 controller-0 ts2phc: debug [5638.711] enp138s0f0 extts index 0 at 1649259195.201826252 corr 0 src 1649259195.640978094 diff 201826252 2022-04-06T16:14:27.000 controller-0 ts2phc: debug [5638.711] enp138s0f0 master offset 201826252 s2 freq +84993149 2022-04-06T16:14:28.000 controller-0 ts2phc: debug [5639.711] nmea delay: 2509976851503 ns 2022-04-06T16:14:28.000 controller-0 ts2phc: debug [5639.711] enp81s0f0 extts index 0 at 1649259196.103565395 corr 0 src 1649259196.619782066 diff 103565395 2022-04-06T16:14:28.000 controller-0 ts2phc: debug [5639.711] enp81s0f0 master offset 103565395 s2 freq +55408405 2022-04-06T16:14:28.000 controller-0 ts2phc: debug [5639.711] enp138s0f0 extts index 0 at 1649259196.116836545 corr 0 src 1649259196.619782066 diff 116836545 2022-04-06T16:14:28.000 controller-0 ts2phc: debug [5639.711] enp138s0f0 master offset 116836545 s2 freq +60551317 2022-04-06T16:14:29.000 controller-0 ts2phc: debug [5640.711] nmea delay: 2509968770585 ns 2022-04-06T16:14:29.000 controller-0 ts2phc: debug [5640.711] enp81s0f0 extts index 0 at 1649259197.048144368 corr 0 src 1649259197.627846823 diff 48144368 2022-04-06T16:14:29.000 controller-0 ts2phc: debug [5640.711] enp81s0f0 master offset 48144368 s2 freq +31056996 2022-04-06T16:14:29.000 controller-0 ts2phc: debug [5640.711] enp138s0f0 extts index 0 at 1649259197.056262530 corr 0 src 1649259197.627846823 diff 56262530 2022-04-06T16:14:29.000 controller-0 ts2phc: debug [5640.711] enp138s0f0 master offset 56262530 s2 freq +35028266 2022-04-06T16:14:30.000 controller-0 ts2phc: debug [5641.711] nmea delay: 2509756017458 ns 2022-04-06T16:14:30.000 controller-0 ts2phc: debug [5641.711] enp81s0f0 extts index 0 at 1649259198.017075025 corr 0 src 1649259198.840576852 diff 17075025 2022-04-06T16:14:30.000 controller-0 ts2phc: debug [5641.711] enp81s0f0 master offset 17075025 s2 freq +14430964 2022-04-06T16:14:30.000 controller-0 ts2phc: debug [5641.711] enp138s0f0 extts index 0 at 1649259198.021210240 corr 0 src 1649259198.840576852 diff 21210240 2022-04-06T16:14:30.000 controller-0 ts2phc: debug [5641.711] enp138s0f0 master offset 21210240 s2 freq +16854735 2022-04-06T16:14:31.000 controller-0 ts2phc: debug [5642.711] nmea delay: 2509827437737 ns 2022-04-06T16:14:31.000 controller-0 ts2phc: debug [5642.711] enp81s0f0 extts index 0 at 1649259199.002635929 corr 0 src 1649259199.769146714 diff 2635929 2022-04-06T16:14:31.000 controller-0 ts2phc: debug [5642.711] enp81s0f0 master offset 2635929 s2 freq +5114375 2022-04-06T16:14:31.000 controller-0 ts2phc: debug [5642.711] enp138s0f0 extts index 0 at 1649259199.004338678 corr 0 src 1649259199.769146714 diff 4338678 2022-04-06T16:14:31.000 controller-0 ts2phc: debug [5642.711] enp138s0f0 master offset 4338678 s2 freq +6346245 2022-04-06T16:14:32.000 controller-0 ts2phc: debug [5643.711] nmea delay: 2509935546499 ns 2022-04-06T16:14:32.000 controller-0 ts2phc: debug [5643.711] enp81s0f0 extts index 0 at 1649259199.997516909 corr 0 src 1649259200.661016877 diff -2483091 2022-04-06T16:14:32.000 controller-0 ts2phc: debug [5643.711] enp81s0f0 master offset -2483091 s2 freq +786134 2022-04-06T16:14:32.000 controller-0 ts2phc: debug [5643.735] nmea delay: 2509935546499 ns 2022-04-06T16:14:32.000 controller-0 ts2phc: debug [5643.735] enp138s0f0 extts index 0 at 1649259199.997982651 corr 0 src 1649259200.685558481 diff -2017349 2022-04-06T16:14:32.000 controller-0 ts2phc: debug [5643.735] enp138s0f0 master offset -2017349 s2 freq +1291821 2022-04-06T16:14:33.000 controller-0 ts2phc: debug [5644.711] nmea delay: 2509920466181 ns 2022-04-06T16:14:33.000 controller-0 ts2phc: debug [5644.711] enp81s0f0 extts index 0 at 1649259200.996728630 corr 0 src 1649259201.676078609 diff -3271370 2022-04-06T16:14:33.000 controller-0 ts2phc: debug [5644.711] enp81s0f0 master offset -3271370 s2 freq -747072 2022-04-06T16:14:33.000 controller-0 ts2phc: debug [5644.711] enp138s0f0 extts index 0 at 1649259200.996564380 corr 0 src 1649259201.676078609 diff -3435620 2022-04-06T16:14:33.000 controller-0 ts2phc: debug [5644.711] enp138s0f0 master offset -3435620 s2 freq -731655 2022-04-06T16:14:34.000 controller-0 ts2phc: debug [5645.711] nmea delay: 2509926722531 ns 2022-04-06T16:14:34.000 controller-0 ts2phc: debug [5645.711] enp81s0f0 extts index 0 at 1649259201.997474950 corr 0 src 1649259202.669808104 diff -2525050 2022-04-06T16:14:34.000 controller-0 ts2phc: debug [5645.711] enp81s0f0 master offset -2525050 s2 freq -982163 2022-04-06T16:14:34.000 controller-0 ts2phc: debug [5645.711] enp138s0f0 extts index 0 at 1649259201.997294167 corr 0 src 1649259202.669808104 diff -2705833 2022-04-06T16:14:34.000 controller-0 ts2phc: debug [5645.711] enp138s0f0 master offset -2705833 s2 freq -1032554 2022-04-06T16:14:35.000 controller-0 ts2phc: debug [5646.711] nmea delay: 2509941317000 ns 2022-04-06T16:14:35.000 controller-0 ts2phc: debug [5646.711] enp81s0f0 extts index 0 at 1649259202.998456996 corr 0 src 1649259203.655186682 diff -1543004 2022-04-06T16:14:35.000 controller-0 ts2phc: debug [5646.711] enp81s0f0 master offset -1543004 s2 freq -757632 2022-04-06T16:14:35.000 controller-0 ts2phc: debug [5646.711] enp138s0f0 extts index 0 at 1649259202.998326440 corr 0 src 1649259203.655186682 diff -1673560 2022-04-06T16:14:35.000 controller-0 ts2phc: debug [5646.711] enp138s0f0 master offset -1673560 s2 freq -812031 2022-04-06T16:14:36.000 controller-0 ts2phc: debug [5647.711] nmea delay: 2509814140165 ns 2022-04-06T16:14:36.000 controller-0 ts2phc: debug [5647.711] enp81s0f0 extts index 0 at 1649259203.999214738 corr 0 src 1649259204.782347244 diff -785262 2022-04-06T16:14:36.000 controller-0 ts2phc: debug [5647.711] enp81s0f0 master offset -785262 s2 freq -462792 2022-04-06T16:14:36.000 controller-0 ts2phc: debug [5647.711] enp138s0f0 extts index 0 at 1649259203.999138674 corr 0 src 1649259204.782347244 diff -861326 2022-04-06T16:14:36.000 controller-0 ts2phc: debug [5647.711] enp138s0f0 master offset -861326 s2 freq -501865 2022-04-06T16:14:37.000 controller-0 ts2phc: debug [5648.711] nmea delay: 2509751928748 ns 2022-04-06T16:14:37.000 controller-0 ts2phc: debug [5648.711] enp81s0f0 extts index 0 at 1649259204.999677674 corr 0 src 1649259205.844542654 diff -322326 2022-04-06T16:14:37.000 controller-0 ts2phc: debug [5648.711] enp81s0f0 master offset -322326 s2 freq -235434 2022-04-06T16:14:37.000 controller-0 ts2phc: debug [5648.711] enp138s0f0 extts index 0 at 1649259204.999640826 corr 0 src 1649259205.844542654 diff -359174 2022-04-06T16:14:37.000 controller-0 ts2phc: debug [5648.711] enp138s0f0 master offset -359174 s2 freq -258110 2022-04-06T16:14:38.000 controller-0 ts2phc: debug [5649.711] nmea delay: 2509991234371 ns 2022-04-06T16:14:38.000 controller-0 ts2phc: debug [5649.711] enp81s0f0 extts index 0 at 1649259205.999913221 corr 0 src 1649259206.605219127 diff -86779 2022-04-06T16:14:38.000 controller-0 ts2phc: debug [5649.711] enp81s0f0 master offset -86779 s2 freq -96585 2022-04-06T16:14:38.000 controller-0 ts2phc: debug [5649.711] enp138s0f0 extts index 0 at 1649259205.999899162 corr 0 src 1649259206.605219127 diff -100838 2022-04-06T16:14:38.000 controller-0 ts2phc: debug [5649.711] enp138s0f0 master offset -100838 s2 freq -107527 2022-04-06T16:14:39.000 controller-0 ts2phc: debug [5650.711] nmea delay: 2509947413836 ns 2022-04-06T16:14:39.000 controller-0 ts2phc: debug [5650.711] enp81s0f0 extts index 0 at 1649259207.000009874 corr 0 src 1649259207.649028886 diff 9874 2022-04-06T16:14:39.000 controller-0 ts2phc: debug [5650.711] enp81s0f0 master offset 9874 s2 freq -25966 2022-04-06T16:14:39.000 controller-0 ts2phc: debug [5650.711] enp138s0f0 extts index 0 at 1649259207.000006827 corr 0 src 1649259207.649028886 diff 6827 2022-04-06T16:14:39.000 controller-0 ts2phc: debug [5650.711] enp138s0f0 master offset 6827 s2 freq -30113 2022-04-06T16:14:40.000 controller-0 ts2phc: debug [5651.711] nmea delay: 2509936137470 ns 2022-04-06T16:14:40.000 controller-0 ts2phc: debug [5651.711] enp81s0f0 extts index 0 at 1649259208.000035874 corr 0 src 1649259208.660289498 diff 35874 2022-04-06T16:14:40.000 controller-0 ts2phc: debug [5651.711] enp81s0f0 master offset 35874 s2 freq +2997 2022-04-06T16:14:40.000 controller-0 ts2phc: debug [5651.711] enp138s0f0 extts index 0 at 1649259208.000037012 corr 0 src 1649259208.660289498 diff 37012 2022-04-06T16:14:40.000 controller-0 ts2phc: debug [5651.711] enp138s0f0 master offset 37012 s2 freq +2120 2022-04-06T16:14:41.000 controller-0 ts2phc: debug [5652.711] nmea delay: 2509928033738 ns 2022-04-06T16:14:41.000 controller-0 ts2phc: debug [5652.711] enp81s0f0 extts index 0 at 1649259209.000032893 corr 0 src 1649259209.668373960 diff 32893 2022-04-06T16:14:41.000 controller-0 ts2phc: debug [5652.711] enp81s0f0 master offset 32893 s2 freq +10778 2022-04-06T16:14:41.000 controller-0 ts2phc: debug [5652.712] enp138s0f0 extts index 0 at 1649259209.000034923 corr 0 src 1649259209.668373960 diff 34923 2022-04-06T16:14:41.000 controller-0 ts2phc: debug [5652.712] enp138s0f0 master offset 34923 s2 freq +11135 2022-04-06T16:14:42.000 controller-0 ts2phc: debug [5653.711] nmea delay: 2509940063772 ns 2022-04-06T16:14:42.000 controller-0 ts2phc: debug [5653.711] enp81s0f0 extts index 0 at 1649259210.000022122 corr 0 src 1649259210.656329379 diff 22122 2022-04-06T16:14:42.000 controller-0 ts2phc: debug [5653.711] enp81s0f0 master offset 22122 s2 freq +9875 2022-04-06T16:14:42.000 controller-0 ts2phc: debug [5653.711] enp138s0f0 extts index 0 at 1649259210.000023801 corr 0 src 1649259210.656329379 diff 23801 2022-04-06T16:14:42.000 controller-0 ts2phc: debug [5653.711] enp138s0f0 master offset 23801 s2 freq +10490 2022-04-06T16:14:43.000 controller-0 ts2phc: debug [5654.711] nmea delay: 2509927318786 ns 2022-04-06T16:14:43.000 controller-0 ts2phc: debug [5654.711] enp138s0f0 extts index 0 at 1649259211.000013309 corr 0 src 1649259211.669047253 diff 13309 2022-04-06T16:14:43.000 controller-0 ts2phc: debug [5654.711] enp138s0f0 master offset 13309 s2 freq +7138 2022-04-06T16:14:43.000 controller-0 ts2phc: debug [5654.711] nmea delay: 2509927318786 ns 2022-04-06T16:14:43.000 controller-0 ts2phc: debug [5654.711] enp81s0f0 extts index 0 at 1649259211.000012247 corr 0 src 1649259211.669529431 diff 12247 2022-04-06T16:14:43.000 controller-0 ts2phc: debug [5654.711] enp81s0f0 master offset 12247 s2 freq +6636 2022-04-06T16:14:44.000 controller-0 ts2phc: debug [5655.711] nmea delay: 2509787447823 ns 2022-04-06T16:14:44.000 controller-0 ts2phc: debug [5655.711] enp81s0f0 extts index 0 at 1649259212.000005608 corr 0 src 1649259212.808906417 diff 5608 2022-04-06T16:14:44.000 controller-0 ts2phc: debug [5655.711] enp81s0f0 master offset 5608 s2 freq +3671 2022-04-06T16:14:44.000 controller-0 ts2phc: debug [5655.711] enp138s0f0 extts index 0 at 1649259212.000006170 corr 0 src 1649259212.808906417 diff 6170 2022-04-06T16:14:44.000 controller-0 ts2phc: debug [5655.711] enp138s0f0 master offset 6170 s2 freq +3992 2022-04-06T16:14:45.000 controller-0 ts2phc: debug [5656.711] nmea delay: 2509951116255 ns 2022-04-06T16:14:45.000 controller-0 ts2phc: debug [5656.711] enp81s0f0 extts index 0 at 1649259213.000001935 corr 0 src 1649259213.645217296 diff 1935 2022-04-06T16:14:45.000 controller-0 ts2phc: debug [5656.711] enp81s0f0 master offset 1935 s2 freq +1681 2022-04-06T16:14:45.000 controller-0 ts2phc: debug [5656.711] enp138s0f0 extts index 0 at 1649259213.000002176 corr 0 src 1649259213.645217296 diff 2176 2022-04-06T16:14:45.000 controller-0 ts2phc: debug [5656.711] enp138s0f0 master offset 2176 s2 freq +1849 2022-04-06T16:14:46.000 controller-0 ts2phc: debug [5657.711] nmea delay: 2509962512441 ns 2022-04-06T16:14:46.000 controller-0 ts2phc: debug [5657.711] enp81s0f0 extts index 0 at 1649259214.000000255 corr 0 src 1649259214.633802454 diff 255 2022-04-06T16:14:46.000 controller-0 ts2phc: debug [5657.711] enp81s0f0 master offset 255 s2 freq +581 2022-04-06T16:14:46.000 controller-0 ts2phc: debug [5657.711] nmea delay: 2509962512441 ns 2022-04-06T16:14:46.000 controller-0 ts2phc: debug [5657.711] enp138s0f0 extts index 0 at 1649259214.000000326 corr 0 src 1649259214.634282788 diff 326 2022-04-06T16:14:46.000 controller-0 ts2phc: debug [5657.711] enp138s0f0 master offset 326 s2 freq +651 2022-04-06T16:14:47.000 controller-0 ts2phc: debug [5658.711] nmea delay: 2509993558162 ns 2022-04-06T16:14:47.000 controller-0 ts2phc: debug [5658.711] enp81s0f0 extts index 0 at 1649259214.999999672 corr 0 src 1649259215.602748084 diff -328 2022-04-06T16:14:47.000 controller-0 ts2phc: debug [5658.711] enp81s0f0 master offset -328 s2 freq +75 2022-04-06T16:14:47.000 controller-0 ts2phc: debug [5658.711] enp138s0f0 extts index 0 at 1649259214.999999673 corr 0 src 1649259215.602748084 diff -327 2022-04-06T16:14:47.000 controller-0 ts2phc: debug [5658.711] enp138s0f0 master offset -327 s2 freq +96 2022-04-06T16:14:48.000 controller-0 ts2phc: debug [5659.711] nmea delay: 2509948356591 ns 2022-04-06T16:14:48.000 controller-0 ts2phc: debug [5659.711] enp81s0f0 extts index 0 at 1649259215.999999597 corr 0 src 1649259216.647931976 diff -403 2022-04-06T16:14:48.000 controller-0 ts2phc: debug [5659.711] enp81s0f0 master offset -403 s2 freq -99 2022-04-06T16:14:48.000 controller-0 ts2phc: debug [5659.711] enp138s0f0 extts index 0 at 1649259215.999999576 corr 0 src 1649259216.647931976 diff -424 2022-04-06T16:14:48.000 controller-0 ts2phc: debug [5659.711] enp138s0f0 master offset -424 s2 freq -99 2022-04-06T16:14:49.000 controller-0 ts2phc: debug [5660.711] nmea delay: 2509934274125 ns 2022-04-06T16:14:49.000 controller-0 ts2phc: debug [5660.711] enp81s0f0 extts index 0 at 1649259216.999999695 corr 0 src 1649259217.661995587 diff -305 2022-04-06T16:14:49.000 controller-0 ts2phc: debug [5660.711] enp81s0f0 master offset -305 s2 freq -122 2022-04-06T16:14:49.000 controller-0 ts2phc: debug [5660.711] enp138s0f0 extts index 0 at 1649259216.999999675 corr 0 src 1649259217.661995587 diff -325 2022-04-06T16:14:49.000 controller-0 ts2phc: debug [5660.711] enp138s0f0 master offset -325 s2 freq -127 2022-04-06T16:14:50.000 controller-0 ts2phc: debug [5661.711] nmea delay: 2509872356945 ns 2022-04-06T16:14:50.000 controller-0 ts2phc: debug [5661.711] enp138s0f0 extts index 0 at 1649259217.999999802 corr 0 src 1649259218.723898860 diff -198 2022-04-06T16:14:50.000 controller-0 ts2phc: debug [5661.711] enp138s0f0 master offset -198 s2 freq -98 2022-04-06T16:14:50.000 controller-0 ts2phc: debug [5661.719] nmea delay: 2509872356945 ns 2022-04-06T16:14:50.000 controller-0 ts2phc: debug [5661.719] enp81s0f0 extts index 0 at 1649259217.999999817 corr 0 src 1649259218.731992063 diff -183 2022-04-06T16:14:50.000 controller-0 ts2phc: debug [5661.719] enp81s0f0 master offset -183 s2 freq -91 2022-04-06T16:14:51.000 controller-0 ts2phc: debug [5662.711] nmea delay: 2509933742082 ns 2022-04-06T16:14:51.000 controller-0 ts2phc: debug [5662.711] enp81s0f0 extts index 0 at 1649259218.999999908 corr 0 src 1649259219.662487750 diff -92 2022-04-06T16:14:51.000 controller-0 ts2phc: debug [5662.711] enp81s0f0 master offset -92 s2 freq -55 2022-04-06T16:14:51.000 controller-0 ts2phc: debug [5662.713] enp138s0f0 extts index 0 at 1649259218.999999899 corr 0 src 1649259219.662487750 diff -101 2022-04-06T16:14:51.000 controller-0 ts2phc: debug [5662.713] enp138s0f0 master offset -101 s2 freq -60 2022-04-06T16:14:52.000 controller-0 ts2phc: debug [5663.711] nmea delay: 2509775065917 ns 2022-04-06T16:14:52.000 controller-0 ts2phc: debug [5663.711] enp81s0f0 extts index 0 at 1649259219.999999963 corr 0 src 1649259220.821147460 diff -37 2022-04-06T16:14:52.000 controller-0 ts2phc: debug [5663.711] enp81s0f0 master offset -37 s2 freq -28 2022-04-06T16:14:52.000 controller-0 ts2phc: debug [5663.711] enp138s0f0 extts index 0 at 1649259219.999999959 corr 0 src 1649259220.821147460 diff -41 2022-04-06T16:14:52.000 controller-0 ts2phc: debug [5663.711] enp138s0f0 master offset -41 s2 freq -30 2022-04-06T16:14:53.000 controller-0 ts2phc: debug [5664.711] nmea delay: 2509967368784 ns 2022-04-06T16:14:53.000 controller-0 ts2phc: debug [5664.711] enp81s0f0 extts index 0 at 1649259220.999999992 corr 0 src 1649259221.628826145 diff -8 2022-04-06T16:14:53.000 controller-0 ts2phc: debug [5664.711] enp81s0f0 master offset -8 s2 freq -10 2022-04-06T16:14:53.000 controller-0 ts2phc: debug [5664.711] enp138s0f0 extts index 0 at 1649259220.999999989 corr 0 src 1649259221.628826145 diff -11 2022-04-06T16:14:53.000 controller-0 ts2phc: debug [5664.711] enp138s0f0 master offset -11 s2 freq -13 2022-04-06T16:14:54.000 controller-0 ts2phc: debug [5665.710] nmea delay: 2509977424196 ns 2022-04-06T16:14:54.000 controller-0 ts2phc: debug [5665.711] enp81s0f0 extts index 0 at 1649259222.000000000 corr 0 src 1649259222.618754760 diff 0 2022-04-06T16:14:54.000 controller-0 ts2phc: debug [5665.711] enp81s0f0 master offset 0 s2 freq -4 2022-04-06T16:14:54.000 controller-0 ts2phc: debug [5665.711] enp138s0f0 extts index 0 at 1649259222.000000002 corr 0 src 1649259222.618754760 diff 2 2022-04-06T16:14:54.000 controller-0 ts2phc: debug [5665.711] enp138s0f0 master offset 2 s2 freq -3 2022-04-06T16:14:55.000 controller-0 ts2phc: debug [5666.710] nmea delay: 2509995474831 ns 2022-04-06T16:14:55.000 controller-0 ts2phc: debug [5666.711] enp81s0f0 extts index 0 at 1649259223.000000004 corr 0 src 1649259223.600686830 diff 4 2022-04-06T16:14:55.000 controller-0 ts2phc: debug [5666.711] enp81s0f0 master offset 4 s2 freq -0 2022-04-06T16:14:55.000 controller-0 ts2phc: debug [5666.711] enp138s0f0 extts index 0 at 1649259223.000000004 corr 0 src 1649259223.600686830 diff 4 2022-04-06T16:14:55.000 controller-0 ts2phc: debug [5666.711] enp138s0f0 master offset 4 s2 freq -0 2022-04-06T16:14:56.000 controller-0 ts2phc: debug [5667.710] nmea delay: 2510018314999 ns 2022-04-06T16:14:56.000 controller-0 ts2phc: debug [5667.710] enp81s0f0 extts index 0 at 1649259224.000000004 corr 0 src 1649259224.577832227 diff 4 2022-04-06T16:14:56.000 controller-0 ts2phc: debug [5667.711] enp81s0f0 master offset 4 s2 freq +1 2022-04-06T16:14:56.000 controller-0 ts2phc: debug [5667.711] enp138s0f0 extts index 0 at 1649259224.000000005 corr 0 src 1649259224.577832227 diff 5 ________________________________ From: Keller, Jacob E <jacob.e.kel...@intel.com> Sent: March 31, 2022 8:59 PM To: Cole Walker <ce.wal...@live.com>; linuxptp-users@lists.sourceforge.net <linuxptp-users@lists.sourceforge.net> Subject: Re: [Linuxptp-users] ts2phc master offset value periodically spikes On 3/31/2022 2:44 PM, Cole Walker wrote: > Thanks for the reply, Jacob. > > The kernel is 5.10.74-200.1644 > > I am going to try the 1.8.3 ICE driver first, as that is easier than a > kernel change in my environment. > > Do you have any insight as to what could be causing the nmea delay to > increase like that? Would the driver affect it? It does seem to be a > common factor in this behaviour and I wonder if it is worth > investigating further. > > Cole Sure. Please try out the 1.8.3 ICE driver and let me see if there's any results different. I suspect that something must be going wrong with delivering the timestamps to ts2phc, either in the device or in the driver. Nothing else makes much sense. You get an incorrect timestamp, and then it ofcourse thinks there is a big delay, so it starts frequency tuning, then the next few timestamps are valid so it eventually corrects itself. I doubt this is a bug in ts2phc but perhaps it is. I am a bit suspicious of that particular line in ts2phc you brought up where that check adds to the second value. The jump in difference is almost exactly 0.5 seconds. That feels quite suspicious. Thanks, Jake
_______________________________________________ Linuxptp-users mailing list Linuxptp-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linuxptp-users