Re: OCS Providers File - High Numbers of Requests

2021-09-23 Thread Nicolás Alvarez
El jue, 23 de sep. de 2021 a la(s) 19:31, Aleix Pol (aleix...@kde.org) escribió:
>
> On Thu, Sep 23, 2021 at 10:12 PM Nicolás Alvarez
>  wrote:
> >
> > El jue, 23 de sep. de 2021 a la(s) 08:55, Aleix Pol (aleix...@kde.org) 
> > escribió:
> > >
> > > On Thu, Sep 23, 2021 at 11:52 AM Ben Cooksley  wrote:
> > > >
> > > > Hi all,
> > > >
> > > > It has recently come to our attention that the number of queries being 
> > > > handled for the endpoint https://autoconfig.kde.org/ocs/providers.xml 
> > > > on a day to day basis has gotten to the point where it is causing 
> > > > issues with server responsiveness to other traffic. This is perhaps 
> > > > best summarised by the following:
> > > >
> > > > root@nicoda /var/log/apache2 # ls -lah ...
> > > > -rw-r- 1 root adm 458M Sep 23 06:25 autoconfig.kde.org.log.1
> > > > -rw-r- 1 root adm 381M Sep 23 06:25 networkcheck.kde.org.log.1
> > > > -rw-r- 1 root adm 143M Sep 23 06:25 www.kde.org.log.1
> > > >
> > > > root@nicoda /var/log/apache2 # cat autoconfig.kde.org.log.1 | wc -l
> > > > 4,222,343
> > > >
> > > > Based on those numbers we're looking at 48-49 requests per second (on 
> > > > average - peaks are much higher by many magnitudes), which seems 
> > > > extremely excessive given that this file is only supposed to be 
> > > > retrieved by KDE software when GHNS functionality is triggered. That is 
> > > > supported by the substantial size difference it has over 
> > > > networkcheck.kde.org - which is used by plasma-nm and NetworkManager 
> > > > (on Neon) to check for whether they have a working internet connection 
> > > > - which i'd expect to be the site receiving the most traffic.
> > > >
> > > > As such, I therefore suspect we have bug(s) in software that makes use 
> > > > of GHNS functionality.
> > > >
> > > > It would therefore be appreciated if we could please review the 
> > > > software in question to determine whether it is operating correctly. 
> > > > Given that it usually runs in the background on user systems, i'd 
> > > > especially appreciate it if a detailed review could be conducted on 
> > > > Discover and other software that conducts package management operations 
> > > > or assists in managing updates.
> > > >
> > > > Unfortunately all these applications submit a fairly useless user agent 
> > > > (Mozilla/5.0) so it is impossible for Sysadmin to ascertain any further 
> > > > information. If we could get information on the software that is 
> > > > originating the request added to the user agent to assist in 
> > > > investigating these issues in the future that would be extremely 
> > > > helpful.
> > > >
> > > > Thanks,
> > > > Ben
> > >
> > > That's correct. Discover fetches them at startup. It's necessary to be
> > > able to check if there are updates on KNS-provided resources.
> > >
> > > Incidentally,  I was looking into this yesterday incidentally. We
> > > could see if caching is broken somehow. A request will still be needed
> > > though to check if the cache is out of date.
> >
> > Caching seems to be working, since the vast majority of the requests
> > are returning 304 Not Modified.
> >
> > However in *many* cases I see a single IP making multiple requests in
> > the same second, and doing it again the next minute. Here's one IP
> > address picked randomly:
> >
> > [22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:27:57 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:27:58 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:27:58 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 200
> > [22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 200
> > [22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
> > [22/Sep/2021:06:31:19 +] "GET /ocs/provid

Re: OCS Providers File - High Numbers of Requests

2021-09-23 Thread Aleix Pol
On Thu, Sep 23, 2021 at 10:12 PM Nicolás Alvarez
 wrote:
>
> El jue, 23 de sep. de 2021 a la(s) 08:55, Aleix Pol (aleix...@kde.org) 
> escribió:
> >
> > On Thu, Sep 23, 2021 at 11:52 AM Ben Cooksley  wrote:
> > >
> > > Hi all,
> > >
> > > It has recently come to our attention that the number of queries being 
> > > handled for the endpoint https://autoconfig.kde.org/ocs/providers.xml on 
> > > a day to day basis has gotten to the point where it is causing issues 
> > > with server responsiveness to other traffic. This is perhaps best 
> > > summarised by the following:
> > >
> > > root@nicoda /var/log/apache2 # ls -lah ...
> > > -rw-r- 1 root adm 458M Sep 23 06:25 autoconfig.kde.org.log.1
> > > -rw-r- 1 root adm 381M Sep 23 06:25 networkcheck.kde.org.log.1
> > > -rw-r- 1 root adm 143M Sep 23 06:25 www.kde.org.log.1
> > >
> > > root@nicoda /var/log/apache2 # cat autoconfig.kde.org.log.1 | wc -l
> > > 4,222,343
> > >
> > > Based on those numbers we're looking at 48-49 requests per second (on 
> > > average - peaks are much higher by many magnitudes), which seems 
> > > extremely excessive given that this file is only supposed to be retrieved 
> > > by KDE software when GHNS functionality is triggered. That is supported 
> > > by the substantial size difference it has over networkcheck.kde.org - 
> > > which is used by plasma-nm and NetworkManager (on Neon) to check for 
> > > whether they have a working internet connection - which i'd expect to be 
> > > the site receiving the most traffic.
> > >
> > > As such, I therefore suspect we have bug(s) in software that makes use of 
> > > GHNS functionality.
> > >
> > > It would therefore be appreciated if we could please review the software 
> > > in question to determine whether it is operating correctly. Given that it 
> > > usually runs in the background on user systems, i'd especially appreciate 
> > > it if a detailed review could be conducted on Discover and other software 
> > > that conducts package management operations or assists in managing 
> > > updates.
> > >
> > > Unfortunately all these applications submit a fairly useless user agent 
> > > (Mozilla/5.0) so it is impossible for Sysadmin to ascertain any further 
> > > information. If we could get information on the software that is 
> > > originating the request added to the user agent to assist in 
> > > investigating these issues in the future that would be extremely helpful.
> > >
> > > Thanks,
> > > Ben
> >
> > That's correct. Discover fetches them at startup. It's necessary to be
> > able to check if there are updates on KNS-provided resources.
> >
> > Incidentally,  I was looking into this yesterday incidentally. We
> > could see if caching is broken somehow. A request will still be needed
> > though to check if the cache is out of date.
>
> Caching seems to be working, since the vast majority of the requests
> are returning 304 Not Modified.
>
> However in *many* cases I see a single IP making multiple requests in
> the same second, and doing it again the next minute. Here's one IP
> address picked randomly:
>
> [22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:27:57 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:27:58 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:27:58 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 200
> [22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 200
> [22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:31:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
> [22/Sep/2021:06:31:38 +] "GET /ocs/pr

KDE CI: Frameworks » krunner » kf5-qt5 WindowsMSVCQt5.15 - Build # 174 - Still unstable!

2021-09-23 Thread CI System
BUILD UNSTABLE
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20WindowsMSVCQt5.15/174/
 Project:
kf5-qt5 WindowsMSVCQt5.15
 Date of build:
Thu, 23 Sep 2021 19:57:48 +
 Build duration:
21 min and counting
   JUnit Tests
  Name: projectroot Failed: 2 test(s), Passed: 2 test(s), Skipped: 0 test(s), Total: 4 test(s)Failed: projectroot.autotests.dbusrunnertestFailed: projectroot.autotests.runnermanagersinglerunnermodetest

Re: OCS Providers File - High Numbers of Requests

2021-09-23 Thread Nicolás Alvarez
El jue, 23 de sep. de 2021 a la(s) 08:55, Aleix Pol (aleix...@kde.org) escribió:
>
> On Thu, Sep 23, 2021 at 11:52 AM Ben Cooksley  wrote:
> >
> > Hi all,
> >
> > It has recently come to our attention that the number of queries being 
> > handled for the endpoint https://autoconfig.kde.org/ocs/providers.xml on a 
> > day to day basis has gotten to the point where it is causing issues with 
> > server responsiveness to other traffic. This is perhaps best summarised by 
> > the following:
> >
> > root@nicoda /var/log/apache2 # ls -lah ...
> > -rw-r- 1 root adm 458M Sep 23 06:25 autoconfig.kde.org.log.1
> > -rw-r- 1 root adm 381M Sep 23 06:25 networkcheck.kde.org.log.1
> > -rw-r- 1 root adm 143M Sep 23 06:25 www.kde.org.log.1
> >
> > root@nicoda /var/log/apache2 # cat autoconfig.kde.org.log.1 | wc -l
> > 4,222,343
> >
> > Based on those numbers we're looking at 48-49 requests per second (on 
> > average - peaks are much higher by many magnitudes), which seems extremely 
> > excessive given that this file is only supposed to be retrieved by KDE 
> > software when GHNS functionality is triggered. That is supported by the 
> > substantial size difference it has over networkcheck.kde.org - which is 
> > used by plasma-nm and NetworkManager (on Neon) to check for whether they 
> > have a working internet connection - which i'd expect to be the site 
> > receiving the most traffic.
> >
> > As such, I therefore suspect we have bug(s) in software that makes use of 
> > GHNS functionality.
> >
> > It would therefore be appreciated if we could please review the software in 
> > question to determine whether it is operating correctly. Given that it 
> > usually runs in the background on user systems, i'd especially appreciate 
> > it if a detailed review could be conducted on Discover and other software 
> > that conducts package management operations or assists in managing updates.
> >
> > Unfortunately all these applications submit a fairly useless user agent 
> > (Mozilla/5.0) so it is impossible for Sysadmin to ascertain any further 
> > information. If we could get information on the software that is 
> > originating the request added to the user agent to assist in investigating 
> > these issues in the future that would be extremely helpful.
> >
> > Thanks,
> > Ben
>
> That's correct. Discover fetches them at startup. It's necessary to be
> able to check if there are updates on KNS-provided resources.
>
> Incidentally,  I was looking into this yesterday incidentally. We
> could see if caching is broken somehow. A request will still be needed
> though to check if the cache is out of date.

Caching seems to be working, since the vast majority of the requests
are returning 304 Not Modified.

However in *many* cases I see a single IP making multiple requests in
the same second, and doing it again the next minute. Here's one IP
address picked randomly:

[22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:25:41 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:27:57 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:27:58 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:27:58 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:28:32 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:28:59 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 200
[22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:30:11 +] "GET /ocs/providers.xml HTTP/1.1" 200
[22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:30:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:31:19 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:31:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:31:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:31:38 +] "GET /ocs/providers.xml HTTP/1.1" 304
[22/Sep/2021:06:31:38 +] "GET /ocs/providers.xml HTTP/1.1" 304

This continues for hours. And it's not an isolated case; again, the IP
I searched f

KDE CI: Frameworks » krunner » kf5-qt5 SUSEQt5.15 - Build # 261 - Fixed!

2021-09-23 Thread CI System
BUILD SUCCESS
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20SUSEQt5.15/261/
 Project:
kf5-qt5 SUSEQt5.15
 Date of build:
Thu, 23 Sep 2021 19:57:48 +
 Build duration:
1 min 55 sec and counting
   BUILD ARTIFACTS
  acc/KF5Runner-5.87.0.xml
   JUnit Tests
  Name: (root) Failed: 0 test(s), Passed: 1 test(s), Skipped: 0 test(s), Total: 1 test(s)Name: projectroot Failed: 0 test(s), Passed: 5 test(s), Skipped: 0 test(s), Total: 5 test(s)
   Cobertura Report
  
   Project Coverage Summary
  
   Name
  PackagesFilesClassesLinesConditionalsCobertura Coverage Report67%
(2/3)84%
(16/19)84%
(16/19)67%
(1497/2233)50%
(800/1596)Coverage Breakdown by Package
Name
   FilesClassesLinesConditionalsautotests86%
(6/7)86%
(6/7)85%
(413/487)51%
(277/548)src100%
(10/10)100%
(10/10)67%
(1084/1614)55%
(523/952)src.declarative0%
(0/2)0%
(0/2)0%
(0/132)0%
(0/96)

KDE CI: Frameworks » krunner » kf5-qt5 FreeBSDQt5.15 - Build # 235 - Fixed!

2021-09-23 Thread CI System
BUILD SUCCESS
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20FreeBSDQt5.15/235/
 Project:
kf5-qt5 FreeBSDQt5.15
 Date of build:
Thu, 23 Sep 2021 19:57:48 +
 Build duration:
45 sec and counting
   JUnit Tests
  Name: projectroot Failed: 0 test(s), Passed: 5 test(s), Skipped: 0 test(s), Total: 5 test(s)

KDE CI: Frameworks » krunner » kf5-qt5 WindowsMSVCQt5.15 - Build # 173 - Still Failing!

2021-09-23 Thread CI System
BUILD FAILURE
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20WindowsMSVCQt5.15/173/
 Project:
kf5-qt5 WindowsMSVCQt5.15
 Date of build:
Thu, 23 Sep 2021 17:36:35 +
 Build duration:
34 sec and counting
   CONSOLE OUTPUT
  [...truncated 283 lines...][2021-09-23T17:37:07.012Z] [2021-09-23T17:37:07.012Z] -- The following REQUIRED packages have been found:[2021-09-23T17:37:07.012Z] [2021-09-23T17:37:07.012Z]  * ECM (required version >= 5.86.0), Extra CMake Modules., [2021-09-23T17:37:07.012Z]  * Qt5Qml (required version >= 5.15.2)[2021-09-23T17:37:07.012Z]  * Qt5QmlModels (required version >= 5.15.2)[2021-09-23T17:37:07.012Z]  * Qt5Quick[2021-09-23T17:37:07.012Z]  * Gettext[2021-09-23T17:37:07.012Z]  * KF5I18n (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5Completion (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5ItemViews (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5JobWidgets (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5Solid (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5Auth (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5Codecs (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5ConfigWidgets (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5XmlGui (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5WidgetsAddons (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * Qt5Network (required version >= 5.15.2)[2021-09-23T17:37:07.012Z]  * KF5KIO (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5Package (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5CoreAddons (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5Service (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * Qt5Gui (required version >= 5.15.2)[2021-09-23T17:37:07.012Z]  * Qt5Widgets (required version >= 5.15.2)[2021-09-23T17:37:07.012Z]  * KF5WindowSystem (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5Plasma (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * KF5ThreadWeaver (required version >= 5.86.0)[2021-09-23T17:37:07.012Z]  * Doxygen (required version >= 1.8.13)[2021-09-23T17:37:07.012Z]Needed for API dox QCH file generation[2021-09-23T17:37:07.012Z]  * QHelpGenerator, Part of Qt5 tools[2021-09-23T17:37:07.012Z]Needed for API dox QCH file generation[2021-09-23T17:37:07.012Z]  * Qt5Core[2021-09-23T17:37:07.012Z]  * Qt5Test[2021-09-23T17:37:07.012Z]  * Qt5 (required version >= 5.15.2)[2021-09-23T17:37:07.012Z] [2021-09-23T17:37:07.012Z] -- Configuring done[2021-09-23T17:37:07.273Z] -- Generating done[2021-09-23T17:37:07.273Z] -- Build files have been written to: C:/CI/Job Build/build[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (Compiling)[Pipeline] bat[2021-09-23T17:37:07.608Z] [2021-09-23T17:37:07.608Z] C:\CI\Job Build>call "C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Auxiliary/Build/vcvars64.bat" [2021-09-23T17:37:07.608Z] **[2021-09-23T17:37:07.608Z] ** Visual Studio 2019 Developer Command Prompt v16.10.2[2021-09-23T17:37:07.608Z] ** Copyright (c) 2021 Microsoft Corporation[2021-09-23T17:37:07.608Z] **[2021-09-23T17:37:08.552Z] [vcvarsall.bat] Environment initialized for: 'x64'[2021-09-23T17:37:08.552Z] [0/2] Re-checking globbed directories...[2021-09-23T17:37:08.552Z] [1/43] Generating runnerpython.tar.bz2[2021-09-23T17:37:08.552Z] .[2021-09-23T17:37:08.552Z] ./%{APPNAMELC}.py[2021-09-23T17:37:08.552Z] ./install.sh[2021-09-23T17:37:08.552Z] ./org.kde.%{APPNAMELC}.service[2021-09-23T17:37:08.552Z] ./plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:37:08.552Z] ./README.md[2021-09-23T17:37:08.552Z] ./runnerpy.kdevtemplate[2021-09-23T17:37:08.552Z] ./uninstall.sh[2021-09-23T17:37:08.552Z] [2/43] Generating runner.tar.bz2[2021-09-23T17:37:08.552Z] .[2021-09-23T17:37:08.552Z] ./CMakeLists.txt[2021-09-23T17:37:08.552Z] ./install.sh[2021-09-23T17:37:08.552Z] ./LICENSES[2021-09-23T17:37:08.552Z] ./LICENSES/LGPL-2.1-or-later.txt[2021-09-23T17:37:08.552Z] ./Messages.sh[2021-09-23T17:37:08.552Z] ./README.md[2021-09-23T17:37:08.552Z] ./runner.kdevtemplate[2021-09-23T17:37:08.552Z] ./runner.png[2021-09-23T17:37:08.552Z] ./src[2021-09-23T17:37:08.552Z] ./src/%{APPNAMELC}.cpp[2021-09-23T17:37:08.552Z] ./src/%{APPNAMELC}.h[2021-09-23T17:37:08.552Z] ./src/CMakeLists.txt[2021-09-23T17:37:08.552Z] ./src/plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:37:08.552Z] ./uninstall.sh[2021-09-23T17:37:08.812Z] [3/43] Automatic MOC for target KF5Runner[2021-09-23T17:37:09.073Z] [4/43] Generating src/KF5Runner.qch, src/KF5Runner.tags[2021-09-23T17:37:10.020Z] [5/43] Building CXX object src\CMakeFiles\KF5Runner.dir\runnersyntax.cpp.obj[2021-09-23T17:37:10.021Z] [6/43] Building CXX object src\CMakeFiles\KF5Runner.dir\krunner_debug.cpp.obj[2021-09-

KDE CI: Frameworks » krunner » kf5-qt5 SUSEQt5.15 - Build # 260 - Still Failing!

2021-09-23 Thread CI System
BUILD FAILURE
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20SUSEQt5.15/260/
 Project:
kf5-qt5 SUSEQt5.15
 Date of build:
Thu, 23 Sep 2021 17:36:01 +
 Build duration:
39 sec and counting
   CONSOLE OUTPUT
  [...truncated 291 lines...][2021-09-23T17:36:37.431Z]  * KF5ItemViews (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5JobWidgets (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5Solid (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5Auth (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5Codecs (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5ConfigWidgets (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5XmlGui (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5WidgetsAddons (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * Qt5Network (required version >= 5.15.2)[2021-09-23T17:36:37.431Z]  * KF5KIO (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5Package (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5CoreAddons (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5Service (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * Qt5Gui (required version >= 5.15.2)[2021-09-23T17:36:37.431Z]  * Qt5Widgets (required version >= 5.15.2)[2021-09-23T17:36:37.431Z]  * KF5Plasma (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * KF5ThreadWeaver (required version >= 5.86.0)[2021-09-23T17:36:37.431Z]  * Doxygen (required version >= 1.8.13)[2021-09-23T17:36:37.431Z]Needed for API dox QCH file generation[2021-09-23T17:36:37.431Z]  * QHelpGenerator, Part of Qt5 tools[2021-09-23T17:36:37.431Z]Needed for API dox QCH file generation[2021-09-23T17:36:37.431Z]  * Qt5Core[2021-09-23T17:36:37.431Z]  * Qt5Test[2021-09-23T17:36:37.431Z]  * Qt5 (required version >= 5.15.2)[2021-09-23T17:36:37.431Z] [2021-09-23T17:36:37.431Z] -- Configuring done[2021-09-23T17:36:37.431Z] -- Generating done[2021-09-23T17:36:37.431Z] -- Build files have been written to: /home/jenkins/workspace/Frameworks/krunner/kf5-qt5 SUSEQt5.15/build[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (Compiling)[Pipeline] sh[2021-09-23T17:36:37.978Z] + python3 -u ci-tooling/helpers/compile-build.py --product Frameworks --project krunner --branchGroup kf5-qt5 --platform SUSEQt5.15 --usingInstall /home/jenkins//install-prefix/[2021-09-23T17:36:37.978Z] [  2%] Automatic MOC for target KF5Runner[2021-09-23T17:36:37.978Z] [  4%] Generating src/KF5Runner.qch, src/KF5Runner.tags[2021-09-23T17:36:37.978Z] [  6%] Generating runnerpython.tar.bz2[2021-09-23T17:36:37.978Z] [  8%] Generating runner.tar.bz2[2021-09-23T17:36:37.978Z] ./[2021-09-23T17:36:37.978Z] ./%{APPNAMELC}.py[2021-09-23T17:36:37.978Z] ./README.md[2021-09-23T17:36:37.978Z] ./install.sh[2021-09-23T17:36:37.978Z] ./org.kde.%{APPNAMELC}.service[2021-09-23T17:36:37.978Z] ./plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:36:37.978Z] ./runnerpy.kdevtemplate[2021-09-23T17:36:37.978Z] ./uninstall.sh[2021-09-23T17:36:37.978Z] ./[2021-09-23T17:36:37.978Z] ./CMakeLists.txt[2021-09-23T17:36:37.978Z] ./LICENSES/[2021-09-23T17:36:37.978Z] ./LICENSES/LGPL-2.1-or-later.txt[2021-09-23T17:36:37.978Z] ./Messages.sh[2021-09-23T17:36:37.978Z] ./README.md[2021-09-23T17:36:37.978Z] ./install.sh[2021-09-23T17:36:37.978Z] ./runner.kdevtemplate[2021-09-23T17:36:37.978Z] ./runner.png[2021-09-23T17:36:37.978Z] ./src/[2021-09-23T17:36:37.979Z] ./src/%{APPNAMELC}.cpp[2021-09-23T17:36:37.979Z] ./src/%{APPNAMELC}.h[2021-09-23T17:36:37.979Z] ./src/CMakeLists.txt[2021-09-23T17:36:37.979Z] ./src/plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:36:37.979Z] ./uninstall.sh[2021-09-23T17:36:38.238Z] [  8%] Built target runnerpython[2021-09-23T17:36:38.238Z] [  8%] Built target runner[2021-09-23T17:36:38.238Z] [  8%] Built target KF5Runner_autogen[2021-09-23T17:36:38.238Z] [ 10%] Building CXX object src/CMakeFiles/KF5Runner.dir/KF5Runner_autogen/mocs_compilation.cpp.o[2021-09-23T17:36:38.238Z] [ 12%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnercontext.cpp.o[2021-09-23T17:36:38.238Z] [ 14%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnermanager.cpp.o[2021-09-23T17:36:38.238Z] [ 17%] Building CXX object src/CMakeFiles/KF5Runner.dir/abstractrunner.cpp.o[2021-09-23T17:36:38.238Z] [ 19%] Building CXX object src/CMakeFiles/KF5Runner.dir/krunner_debug.cpp.o[2021-09-23T17:36:38.238Z] [ 21%] Building CXX object src/CMakeFiles/KF5Runner.dir/dbusrunner.cpp.o[2021-09-23T17:36:38.238Z] [ 25%] Building CXX object src/CMakeFiles/KF5Runner.dir/querymatch.cpp.o[2021-09-23T17:36:38.238Z] [ 25%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnerjobs.cpp.o[2021-09-23T17:36:38.238Z] [ 27%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnersyntax.cpp.o[2021-09-23T17:36:38.497Z] Building up file structure...[2021-09-23T17:36:38.497Z] Insert custom filters...[2021-09-23T17:36:38.497Z] Insert help data for filter section (1 of 

KDE CI: Frameworks » krunner » kf5-qt5 WindowsMSVCQt5.15 - Build # 172 - Failure!

2021-09-23 Thread CI System
BUILD FAILURE
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20WindowsMSVCQt5.15/172/
 Project:
kf5-qt5 WindowsMSVCQt5.15
 Date of build:
Thu, 23 Sep 2021 17:35:22 +
 Build duration:
1 min 7 sec and counting
   CONSOLE OUTPUT
  [...truncated 283 lines...][2021-09-23T17:36:24.161Z] [2021-09-23T17:36:24.161Z] -- The following REQUIRED packages have been found:[2021-09-23T17:36:24.161Z] [2021-09-23T17:36:24.161Z]  * ECM (required version >= 5.86.0), Extra CMake Modules., [2021-09-23T17:36:24.161Z]  * Qt5Qml (required version >= 5.15.2)[2021-09-23T17:36:24.161Z]  * Qt5QmlModels (required version >= 5.15.2)[2021-09-23T17:36:24.161Z]  * Qt5Quick[2021-09-23T17:36:24.161Z]  * Gettext[2021-09-23T17:36:24.161Z]  * KF5I18n (required version >= 5.86.0)[2021-09-23T17:36:24.161Z]  * KF5Completion (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5ItemViews (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5JobWidgets (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5Solid (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5Auth (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5Codecs (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5ConfigWidgets (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5XmlGui (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5WidgetsAddons (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * Qt5Network (required version >= 5.15.2)[2021-09-23T17:36:24.162Z]  * KF5KIO (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5Package (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5CoreAddons (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5Service (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * Qt5Gui (required version >= 5.15.2)[2021-09-23T17:36:24.162Z]  * Qt5Widgets (required version >= 5.15.2)[2021-09-23T17:36:24.162Z]  * KF5WindowSystem (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5Plasma (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * KF5ThreadWeaver (required version >= 5.86.0)[2021-09-23T17:36:24.162Z]  * Doxygen (required version >= 1.8.13)[2021-09-23T17:36:24.162Z]Needed for API dox QCH file generation[2021-09-23T17:36:24.162Z]  * QHelpGenerator, Part of Qt5 tools[2021-09-23T17:36:24.162Z]Needed for API dox QCH file generation[2021-09-23T17:36:24.162Z]  * Qt5Core[2021-09-23T17:36:24.162Z]  * Qt5Test[2021-09-23T17:36:24.162Z]  * Qt5 (required version >= 5.15.2)[2021-09-23T17:36:24.162Z] [2021-09-23T17:36:24.162Z] -- Configuring done[2021-09-23T17:36:25.173Z] -- Generating done[2021-09-23T17:36:25.173Z] -- Build files have been written to: C:/CI/Job Build/build[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (Compiling)[Pipeline] bat[2021-09-23T17:36:25.784Z] [2021-09-23T17:36:25.784Z] C:\CI\Job Build>call "C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Auxiliary/Build/vcvars64.bat" [2021-09-23T17:36:26.060Z] **[2021-09-23T17:36:26.061Z] ** Visual Studio 2019 Developer Command Prompt v16.10.2[2021-09-23T17:36:26.061Z] ** Copyright (c) 2021 Microsoft Corporation[2021-09-23T17:36:26.061Z] **[2021-09-23T17:36:27.009Z] [vcvarsall.bat] Environment initialized for: 'x64'[2021-09-23T17:36:27.271Z] [0/2] Re-checking globbed directories...[2021-09-23T17:36:27.538Z] [1/43] Generating runnerpython.tar.bz2[2021-09-23T17:36:27.538Z] .[2021-09-23T17:36:27.538Z] ./%{APPNAMELC}.py[2021-09-23T17:36:27.538Z] ./install.sh[2021-09-23T17:36:27.538Z] ./org.kde.%{APPNAMELC}.service[2021-09-23T17:36:27.538Z] ./plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:36:27.538Z] ./README.md[2021-09-23T17:36:27.538Z] ./runnerpy.kdevtemplate[2021-09-23T17:36:27.538Z] ./uninstall.sh[2021-09-23T17:36:27.538Z] [2/43] Generating runner.tar.bz2[2021-09-23T17:36:27.538Z] .[2021-09-23T17:36:27.538Z] ./CMakeLists.txt[2021-09-23T17:36:27.538Z] ./install.sh[2021-09-23T17:36:27.538Z] ./LICENSES[2021-09-23T17:36:27.538Z] ./LICENSES/LGPL-2.1-or-later.txt[2021-09-23T17:36:27.538Z] ./Messages.sh[2021-09-23T17:36:27.538Z] ./README.md[2021-09-23T17:36:27.538Z] ./runner.kdevtemplate[2021-09-23T17:36:27.538Z] ./runner.png[2021-09-23T17:36:27.538Z] ./src[2021-09-23T17:36:27.538Z] ./src/%{APPNAMELC}.cpp[2021-09-23T17:36:27.538Z] ./src/%{APPNAMELC}.h[2021-09-23T17:36:27.538Z] ./src/CMakeLists.txt[2021-09-23T17:36:27.538Z] ./src/plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:36:27.538Z] ./uninstall.sh[2021-09-23T17:36:27.799Z] [3/43] Automatic MOC for target KF5Runner[2021-09-23T17:36:28.385Z] [4/43] Generating src/KF5Runner.qch, src/KF5Runner.tags[2021-09-23T17:36:29.340Z] [5/43] Building CXX object src\CMakeFiles\KF5Runner.dir\krunner_debug.cpp.obj[2021-09-23T17:36:29.340Z] [6/43] Building CXX object src\CMakeFiles\KF5Runner.dir\runnersyntax.cpp.obj[202

KDE CI: Frameworks » krunner » kf5-qt5 FreeBSDQt5.15 - Build # 234 - Still Failing!

2021-09-23 Thread CI System
BUILD FAILURE
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20FreeBSDQt5.15/234/
 Project:
kf5-qt5 FreeBSDQt5.15
 Date of build:
Thu, 23 Sep 2021 17:36:06 +
 Build duration:
18 sec and counting
   CONSOLE OUTPUT
  [...truncated 257 lines...][2021-09-23T17:36:21.523Z]  * KF5KIO (required version >= 5.86.0)[2021-09-23T17:36:21.523Z]  * KF5Package (required version >= 5.86.0)[2021-09-23T17:36:21.523Z]  * KF5CoreAddons (required version >= 5.86.0)[2021-09-23T17:36:21.523Z]  * KF5Service (required version >= 5.86.0)[2021-09-23T17:36:21.523Z]  * Qt5Gui (required version >= 5.15.2)[2021-09-23T17:36:21.523Z]  * Qt5Widgets (required version >= 5.15.2)[2021-09-23T17:36:21.523Z]  * KF5Plasma (required version >= 5.86.0)[2021-09-23T17:36:21.523Z]  * KF5ThreadWeaver (required version >= 5.86.0)[2021-09-23T17:36:21.523Z]  * Doxygen (required version >= 1.8.13)[2021-09-23T17:36:21.523Z]Needed for API dox QCH file generation[2021-09-23T17:36:21.523Z]  * QHelpGenerator, Part of Qt5 tools[2021-09-23T17:36:21.523Z]Needed for API dox QCH file generation[2021-09-23T17:36:21.523Z]  * Qt5Core[2021-09-23T17:36:21.523Z]  * Qt5Test[2021-09-23T17:36:21.523Z]  * Qt5 (required version >= 5.15.2)[2021-09-23T17:36:21.523Z] [2021-09-23T17:36:21.523Z] CMake Warning at /usr/home/jenkins/install-prefix/share/ECM/kde-modules/KDEGitCommitHooks.cmake:70 (message):[2021-09-23T17:36:21.523Z]   No clang-format executable was found, skipping the formatting pre-commit[2021-09-23T17:36:21.523Z]   hook[2021-09-23T17:36:21.523Z] Call Stack (most recent call first):[2021-09-23T17:36:21.523Z]   CMakeLists.txt:124 (kde_configure_git_pre_commit_hook)[2021-09-23T17:36:21.523Z] [2021-09-23T17:36:21.523Z] [2021-09-23T17:36:21.523Z] -- Configuring done[2021-09-23T17:36:21.780Z] -- Generating done[2021-09-23T17:36:21.780Z] -- Build files have been written to: /usr/home/jenkins/workspace/Frameworks/krunner/kf5-qt5 FreeBSDQt5.15/build[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (Compiling)[Pipeline] sh[2021-09-23T17:36:22.091Z] + python3 -u ci-tooling/helpers/compile-build.py --product Frameworks --project krunner --branchGroup kf5-qt5 --platform FreeBSDQt5.15 --usingInstall /home/jenkins/install-prefix/[2021-09-23T17:36:22.091Z] [  2%] Automatic MOC for target KF5Runner[2021-09-23T17:36:22.091Z] [  4%] Built target Qt5Core_QCH[2021-09-23T17:36:22.091Z] [  4%] Generating runner.tar.bz2[2021-09-23T17:36:22.091Z] [  6%] Generating runnerpython.tar.bz2[2021-09-23T17:36:22.091Z] .[2021-09-23T17:36:22.091Z] ./uninstall.sh[2021-09-23T17:36:22.091Z] ./install.sh[2021-09-23T17:36:22.091Z] ./org.kde.%{APPNAMELC}.service[2021-09-23T17:36:22.091Z] ./%{APPNAMELC}.py[2021-09-23T17:36:22.091Z] ./runnerpy.kdevtemplate[2021-09-23T17:36:22.091Z] ./README.md[2021-09-23T17:36:22.091Z] ./plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:36:22.091Z] .[2021-09-23T17:36:22.091Z] ./runner.kdevtemplate[2021-09-23T17:36:22.091Z] ./src[2021-09-23T17:36:22.091Z] ./src/plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:36:22.091Z] ./src/%{APPNAMELC}.h[2021-09-23T17:36:22.091Z] ./src/CMakeLists.txt[2021-09-23T17:36:22.091Z] ./src/%{APPNAMELC}.cpp[2021-09-23T17:36:22.091Z] ./install.sh[2021-09-23T17:36:22.091Z] ./README.md[2021-09-23T17:36:22.091Z] ./uninstall.sh[2021-09-23T17:36:22.091Z] ./CMakeLists.txt[2021-09-23T17:36:22.091Z] ./runner.png[2021-09-23T17:36:22.091Z] ./LICENSES[2021-09-23T17:36:22.091Z] ./LICENSES/LGPL-2.1-or-later.txt[2021-09-23T17:36:22.091Z] ./Messages.sh[2021-09-23T17:36:22.091Z] [  6%] Built target runnerpython[2021-09-23T17:36:22.092Z] [  8%] Generating src/KF5Runner.qch, src/KF5Runner.tags[2021-09-23T17:36:22.092Z] [  8%] Built target runner[2021-09-23T17:36:22.661Z] Building up file structure...[2021-09-23T17:36:22.661Z] Insert custom filters...[2021-09-23T17:36:22.661Z] Insert help data for filter section (1 of 1)...[2021-09-23T17:36:22.661Z] Insert files...[2021-09-23T17:36:22.661Z] Insert contents...[2021-09-23T17:36:22.661Z] Insert indices...[2021-09-23T17:36:22.661Z] Documentation successfully generated.[2021-09-23T17:36:22.661Z] [  8%] Built target KF5Runner_autogen[2021-09-23T17:36:22.661Z] [ 10%] Building CXX object src/CMakeFiles/KF5Runner.dir/querymatch.cpp.o[2021-09-23T17:36:22.661Z] [ 12%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnerjobs.cpp.o[2021-09-23T17:36:22.661Z] [ 17%] Building CXX object src/CMakeFiles/KF5Runner.dir/krunner_debug.cpp.o[2021-09-23T17:36:22.661Z] [ 17%] Building CXX object src/CMakeFiles/KF5Runner.dir/KF5Runner_autogen/mocs_compilation.cpp.o[2021-09-23T17:36:22.661Z] [ 19%] Building CXX object src/CMakeFiles/KF5Runner.dir/dbusrunner.cpp.o[2021-09-23T17:36:22.661Z] [ 21%] Building CXX object src/CMakeFiles/KF5Runner.dir/abstractrunner.cpp.o[2021-09-23T17:36:22.661Z] [ 25%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnercontext.cpp.o[2021-09-23T17:36:22.661Z] [ 25%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnermanage

KDE CI: Frameworks » krunner » kf5-qt5 SUSEQt5.15 - Build # 259 - Failure!

2021-09-23 Thread CI System
BUILD FAILURE
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20SUSEQt5.15/259/
 Project:
kf5-qt5 SUSEQt5.15
 Date of build:
Thu, 23 Sep 2021 17:35:22 +
 Build duration:
38 sec and counting
   CONSOLE OUTPUT
  [...truncated 291 lines...][2021-09-23T17:35:58.119Z]  * KF5ItemViews (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5JobWidgets (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5Solid (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5Auth (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5Codecs (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5ConfigWidgets (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5XmlGui (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5WidgetsAddons (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * Qt5Network (required version >= 5.15.2)[2021-09-23T17:35:58.119Z]  * KF5KIO (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5Package (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5CoreAddons (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5Service (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * Qt5Gui (required version >= 5.15.2)[2021-09-23T17:35:58.119Z]  * Qt5Widgets (required version >= 5.15.2)[2021-09-23T17:35:58.119Z]  * KF5Plasma (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * KF5ThreadWeaver (required version >= 5.86.0)[2021-09-23T17:35:58.119Z]  * Doxygen (required version >= 1.8.13)[2021-09-23T17:35:58.119Z]Needed for API dox QCH file generation[2021-09-23T17:35:58.119Z]  * QHelpGenerator, Part of Qt5 tools[2021-09-23T17:35:58.119Z]Needed for API dox QCH file generation[2021-09-23T17:35:58.119Z]  * Qt5Core[2021-09-23T17:35:58.119Z]  * Qt5Test[2021-09-23T17:35:58.119Z]  * Qt5 (required version >= 5.15.2)[2021-09-23T17:35:58.119Z] [2021-09-23T17:35:58.119Z] -- Configuring done[2021-09-23T17:35:58.119Z] -- Generating done[2021-09-23T17:35:58.119Z] -- Build files have been written to: /home/jenkins/workspace/Frameworks/krunner/kf5-qt5 SUSEQt5.15/build[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (Compiling)[Pipeline] sh[2021-09-23T17:35:58.456Z] + python3 -u ci-tooling/helpers/compile-build.py --product Frameworks --project krunner --branchGroup kf5-qt5 --platform SUSEQt5.15 --usingInstall /home/jenkins//install-prefix/[2021-09-23T17:35:58.456Z] [  2%] Generating src/KF5Runner.qch, src/KF5Runner.tags[2021-09-23T17:35:58.456Z] [  4%] Automatic MOC for target KF5Runner[2021-09-23T17:35:58.456Z] [  6%] Generating runner.tar.bz2[2021-09-23T17:35:58.456Z] [  8%] Generating runnerpython.tar.bz2[2021-09-23T17:35:58.456Z] ./[2021-09-23T17:35:58.456Z] ./CMakeLists.txt[2021-09-23T17:35:58.456Z] ./LICENSES/[2021-09-23T17:35:58.456Z] ./LICENSES/LGPL-2.1-or-later.txt[2021-09-23T17:35:58.456Z] ./Messages.sh[2021-09-23T17:35:58.456Z] ./README.md[2021-09-23T17:35:58.456Z] ./install.sh[2021-09-23T17:35:58.456Z] ./runner.kdevtemplate[2021-09-23T17:35:58.456Z] ./runner.png[2021-09-23T17:35:58.456Z] ./src/[2021-09-23T17:35:58.456Z] ./src/%{APPNAMELC}.cpp[2021-09-23T17:35:58.456Z] ./src/%{APPNAMELC}.h[2021-09-23T17:35:58.456Z] ./src/CMakeLists.txt[2021-09-23T17:35:58.456Z] ./src/plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:35:58.456Z] ./uninstall.sh[2021-09-23T17:35:58.456Z] ./[2021-09-23T17:35:58.456Z] ./%{APPNAMELC}.py[2021-09-23T17:35:58.456Z] ./README.md[2021-09-23T17:35:58.456Z] ./install.sh[2021-09-23T17:35:58.456Z] ./org.kde.%{APPNAMELC}.service[2021-09-23T17:35:58.456Z] ./plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:35:58.456Z] ./runnerpy.kdevtemplate[2021-09-23T17:35:58.456Z] ./uninstall.sh[2021-09-23T17:35:58.456Z] [  8%] Built target runner[2021-09-23T17:35:58.456Z] [  8%] Built target runnerpython[2021-09-23T17:35:58.713Z] [  8%] Built target KF5Runner_autogen[2021-09-23T17:35:58.713Z] Building up file structure...[2021-09-23T17:35:58.713Z] Insert custom filters...[2021-09-23T17:35:58.713Z] Insert help data for filter section (1 of 1)...[2021-09-23T17:35:58.713Z] Insert files...[2021-09-23T17:35:58.713Z] Insert contents...[2021-09-23T17:35:58.713Z] Insert indices...[2021-09-23T17:35:58.713Z] Documentation successfully generated.[2021-09-23T17:35:58.713Z] [ 10%] Building CXX object src/CMakeFiles/KF5Runner.dir/abstractrunner.cpp.o[2021-09-23T17:35:58.713Z] [ 12%] Building CXX object src/CMakeFiles/KF5Runner.dir/dbusrunner.cpp.o[2021-09-23T17:35:58.713Z] [ 14%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnercontext.cpp.o[2021-09-23T17:35:58.713Z] [ 17%] Building CXX object src/CMakeFiles/KF5Runner.dir/KF5Runner_autogen/mocs_compilation.cpp.o[2021-09-23T17:35:58.713Z] [ 19%] Building CXX object src/CMakeFiles/KF5Runner.dir/querymatch.cpp.o[2021-09-23T17:35:58.713Z] [ 23%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnermanager.cpp.o[2021-09-23T17:35:58.713Z] [ 23%] Building CXX object src/CMakeFiles/KF5Runner.dir/krunner_debug.cpp.o

KDE CI: Frameworks » krunner » kf5-qt5 FreeBSDQt5.15 - Build # 233 - Failure!

2021-09-23 Thread CI System
BUILD FAILURE
 Build URL
https://build.kde.org/job/Frameworks/job/krunner/job/kf5-qt5%20FreeBSDQt5.15/233/
 Project:
kf5-qt5 FreeBSDQt5.15
 Date of build:
Thu, 23 Sep 2021 17:35:22 +
 Build duration:
26 sec and counting
   CONSOLE OUTPUT
  [...truncated 257 lines...][2021-09-23T17:35:44.483Z]  * KF5KIO (required version >= 5.86.0)[2021-09-23T17:35:44.483Z]  * KF5Package (required version >= 5.86.0)[2021-09-23T17:35:44.483Z]  * KF5CoreAddons (required version >= 5.86.0)[2021-09-23T17:35:44.483Z]  * KF5Service (required version >= 5.86.0)[2021-09-23T17:35:44.483Z]  * Qt5Gui (required version >= 5.15.2)[2021-09-23T17:35:44.483Z]  * Qt5Widgets (required version >= 5.15.2)[2021-09-23T17:35:44.483Z]  * KF5Plasma (required version >= 5.86.0)[2021-09-23T17:35:44.483Z]  * KF5ThreadWeaver (required version >= 5.86.0)[2021-09-23T17:35:44.483Z]  * Doxygen (required version >= 1.8.13)[2021-09-23T17:35:44.483Z]Needed for API dox QCH file generation[2021-09-23T17:35:44.484Z]  * QHelpGenerator, Part of Qt5 tools[2021-09-23T17:35:44.484Z]Needed for API dox QCH file generation[2021-09-23T17:35:44.484Z]  * Qt5Core[2021-09-23T17:35:44.484Z]  * Qt5Test[2021-09-23T17:35:44.484Z]  * Qt5 (required version >= 5.15.2)[2021-09-23T17:35:44.484Z] [2021-09-23T17:35:44.484Z] CMake Warning at /usr/home/jenkins/install-prefix/share/ECM/kde-modules/KDEGitCommitHooks.cmake:70 (message):[2021-09-23T17:35:44.484Z]   No clang-format executable was found, skipping the formatting pre-commit[2021-09-23T17:35:44.484Z]   hook[2021-09-23T17:35:44.484Z] Call Stack (most recent call first):[2021-09-23T17:35:44.484Z]   CMakeLists.txt:124 (kde_configure_git_pre_commit_hook)[2021-09-23T17:35:44.484Z] [2021-09-23T17:35:44.484Z] [2021-09-23T17:35:44.484Z] -- Configuring done[2021-09-23T17:35:44.744Z] -- Generating done[2021-09-23T17:35:44.744Z] -- Build files have been written to: /usr/home/jenkins/workspace/Frameworks/krunner/kf5-qt5 FreeBSDQt5.15/build[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (Compiling)[Pipeline] sh[2021-09-23T17:35:45.149Z] + python3 -u ci-tooling/helpers/compile-build.py --product Frameworks --project krunner --branchGroup kf5-qt5 --platform FreeBSDQt5.15 --usingInstall /home/jenkins/install-prefix/[2021-09-23T17:35:45.412Z] [  2%] Automatic MOC for target KF5Runner[2021-09-23T17:35:45.412Z] [  4%] Generating runnerpython.tar.bz2[2021-09-23T17:35:45.412Z] [  4%] Built target Qt5Core_QCH[2021-09-23T17:35:45.412Z] [  6%] Generating runner.tar.bz2[2021-09-23T17:35:45.412Z] .[2021-09-23T17:35:45.412Z] ./org.kde.%{APPNAMELC}.service[2021-09-23T17:35:45.412Z] ./uninstall.sh[2021-09-23T17:35:45.412Z] ./runnerpy.kdevtemplate[2021-09-23T17:35:45.412Z] ./%{APPNAMELC}.py[2021-09-23T17:35:45.412Z] ./README.md[2021-09-23T17:35:45.412Z] ./plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:35:45.412Z] ./install.sh[2021-09-23T17:35:45.412Z] [  6%] Built target runnerpython[2021-09-23T17:35:45.412Z] .[2021-09-23T17:35:45.412Z] ./README.md[2021-09-23T17:35:45.412Z] ./CMakeLists.txt[2021-09-23T17:35:45.412Z] ./LICENSES[2021-09-23T17:35:45.412Z] ./LICENSES/LGPL-2.1-or-later.txt[2021-09-23T17:35:45.412Z] ./runner.png[2021-09-23T17:35:45.412Z] ./Messages.sh[2021-09-23T17:35:45.412Z] ./install.sh[2021-09-23T17:35:45.412Z] ./src[2021-09-23T17:35:45.412Z] ./src/%{APPNAMELC}.cpp[2021-09-23T17:35:45.412Z] ./src/%{APPNAMELC}.h[2021-09-23T17:35:45.412Z] ./src/CMakeLists.txt[2021-09-23T17:35:45.412Z] ./src/plasma-runner-%{APPNAMELC}.desktop[2021-09-23T17:35:45.412Z] ./runner.kdevtemplate[2021-09-23T17:35:45.412Z] ./uninstall.sh[2021-09-23T17:35:45.412Z] [  8%] Generating src/KF5Runner.qch, src/KF5Runner.tags[2021-09-23T17:35:45.412Z] [  8%] Built target runner[2021-09-23T17:35:46.369Z] Building up file structure...[2021-09-23T17:35:46.369Z] Insert custom filters...[2021-09-23T17:35:46.369Z] Insert help data for filter section (1 of 1)...[2021-09-23T17:35:46.369Z] Insert files...[2021-09-23T17:35:46.369Z] Insert contents...[2021-09-23T17:35:46.369Z] Insert indices...[2021-09-23T17:35:46.369Z] Documentation successfully generated.[2021-09-23T17:35:46.369Z] [  8%] Built target KF5Runner_autogen[2021-09-23T17:35:46.369Z] [ 10%] Built target KF5Runner_QCH[2021-09-23T17:35:46.369Z] [ 10%] Building CXX object src/CMakeFiles/KF5Runner.dir/KF5Runner_autogen/mocs_compilation.cpp.o[2021-09-23T17:35:46.369Z] [ 14%] Building CXX object src/CMakeFiles/KF5Runner.dir/dbusrunner.cpp.o[2021-09-23T17:35:46.369Z] [ 14%] Building CXX object src/CMakeFiles/KF5Runner.dir/abstractrunner.cpp.o[2021-09-23T17:35:46.369Z] [ 21%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnerjobs.cpp.o[2021-09-23T17:35:46.369Z] [ 21%] Building CXX object src/CMakeFiles/KF5Runner.dir/querymatch.cpp.o[2021-09-23T17:35:46.369Z] [ 21%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnercontext.cpp.o[2021-09-23T17:35:46.369Z] [ 23%] Building CXX object src/CMakeFiles/KF5Runner.dir/runnermanager.cpp.o[2021-09-23T17:35:46.369Z] [ 27%] B

KDE CI: Frameworks » attica » kf5-qt5 WindowsMSVCQt5.15 - Build # 78 - Unstable!

2021-09-23 Thread CI System
BUILD UNSTABLE
 Build URL
https://build.kde.org/job/Frameworks/job/attica/job/kf5-qt5%20WindowsMSVCQt5.15/78/
 Project:
kf5-qt5 WindowsMSVCQt5.15
 Date of build:
Thu, 23 Sep 2021 17:24:12 +
 Build duration:
2 min 44 sec and counting
   JUnit Tests
  Name: projectroot Failed: 1 test(s), Passed: 2 test(s), Skipped: 0 test(s), Total: 3 test(s)Failed: projectroot.autotests.providertest

KDE CI: Frameworks » attica » kf5-qt5 FreeBSDQt5.15 - Build # 85 - Unstable!

2021-09-23 Thread CI System
BUILD UNSTABLE
 Build URL
https://build.kde.org/job/Frameworks/job/attica/job/kf5-qt5%20FreeBSDQt5.15/85/
 Project:
kf5-qt5 FreeBSDQt5.15
 Date of build:
Thu, 23 Sep 2021 17:24:12 +
 Build duration:
1 min 5 sec and counting
   JUnit Tests
  Name: projectroot Failed: 1 test(s), Passed: 2 test(s), Skipped: 0 test(s), Total: 3 test(s)Failed: projectroot.autotests.providertest

KDE CI: Frameworks » kirigami » kf5-qt5 FreeBSDQt5.15 - Build # 598 - Fixed!

2021-09-23 Thread CI System
BUILD SUCCESS
 Build URL
https://build.kde.org/job/Frameworks/job/kirigami/job/kf5-qt5%20FreeBSDQt5.15/598/
 Project:
kf5-qt5 FreeBSDQt5.15
 Date of build:
Thu, 23 Sep 2021 17:22:02 +
 Build duration:
43 sec and counting
   JUnit Tests
  Name: projectroot.usr.home.jenkins.workspace.Frameworks.kirigami.kf5-qt5_FreeBSDQt515 Failed: 0 test(s), Passed: 12 test(s), Skipped: 0 test(s), Total: 12 test(s)

KDE CI: Frameworks » kirigami » kf5-qt5 WindowsMSVCQt5.15 - Build # 476 - Unstable!

2021-09-23 Thread CI System
BUILD UNSTABLE
 Build URL
https://build.kde.org/job/Frameworks/job/kirigami/job/kf5-qt5%20WindowsMSVCQt5.15/476/
 Project:
kf5-qt5 WindowsMSVCQt5.15
 Date of build:
Thu, 23 Sep 2021 17:01:02 +
 Build duration:
1 min 34 sec and counting
   JUnit Tests
  Name: projectrootC_.CI.Job_Build Failed: 1 test(s), Passed: 11 test(s), Skipped: 0 test(s), Total: 12 test(s)Failed: projectrootC_.CI.Job_Build.autotests.pagepool/tst_layers.qml

KDE CI: Frameworks » kirigami » kf5-qt5 FreeBSDQt5.15 - Build # 597 - Unstable!

2021-09-23 Thread CI System
BUILD UNSTABLE
 Build URL
https://build.kde.org/job/Frameworks/job/kirigami/job/kf5-qt5%20FreeBSDQt5.15/597/
 Project:
kf5-qt5 FreeBSDQt5.15
 Date of build:
Thu, 23 Sep 2021 17:01:02 +
 Build duration:
49 sec and counting
   JUnit Tests
  Name: projectroot.usr.home.jenkins.workspace.Frameworks.kirigami.kf5-qt5_FreeBSDQt515 Failed: 1 test(s), Passed: 11 test(s), Skipped: 0 test(s), Total: 12 test(s)Failed: projectroot.usr.home.jenkins.workspace.Frameworks.kirigami.kf5-qt5_FreeBSDQt515.autotests.pagepool/tst_layers.qml

Re: Extending the license policy to include ODbL-1.0

2021-09-23 Thread Volker Krause
done

On Mittwoch, 22. September 2021 23:20:56 CEST Alexander Potashev wrote:
> Thanks!
> 
> Could you please update the changelog section
> https://community.kde.org/Policies/Licensing_Policy#Changelog ?
> 
> On Wed, Sep 22, 2021 at 5:38 PM Volker Krause  wrote:
> > Thanks everyone, I've added the suggested change to the wiki now.
> > 
> > Regards,
> > Volker
> > 
> > On Mittwoch, 15. September 2021 17:26:57 CEST Volker Krause wrote:
> > > Hi,
> > > 
> > > there's a MR [1] for ki18n containing data tables generated from OSM
> > > data,
> > > which implies the ODbL-1.0 license [2]. We also already have other
> > > places
> > > ([3], [4]) actually doing this.
> > > 
> > > However that's a license not yet covered by our license policy, so I
> > > suggest we add it.
> > > 
> > > ODbL is essentially LGPL-y but for data rather than code, so
> > > conceptually
> > > compatible with our existing licensing.
> > > 
> > > It's also not like there's any viable alternative to OSM data, so not
> > > doing
> > > this would imply not being able to implement features integrating
> > > OSM-derived data.
> > > 
> > > The proposed addition to the policy section of
> > > https://community.kde.org/
> > > Policies/Licensing_Policy would be:
> > > 
> > > 
> > > # ''Geographic data'', in particular data based on or derived from
> > > OpenStreetMap may be licensed under the '''[https://spdx.org/licenses/
> > > ODbL-1.0.html Open Data Commons Open Database License v1.0]'''.
> > > 
> > > 
> > > What do you think?
> > > 
> > > Regards,
> > > Volker
> > > 
> > > [1] https://invent.kde.org/frameworks/ki18n/-/merge_requests/19
> > > [2] https://spdx.org/licenses/ODbL-1.0.html
> > > [3]
> > > https://invent.kde.org/pim/kitinerary/-/blob/master/src/lib/knowledgedb
> > > / timezonedb_data.cpp
> > > [4]
> > > https://invent.kde.org/libraries/kpublictransport/-/blob/master/src/lib
> > > / knowledgedb/linemetadata_data.cpp



signature.asc
Description: This is a digitally signed message part.


Re: OCS Providers File - High Numbers of Requests

2021-09-23 Thread Aleix Pol
On Thu, Sep 23, 2021 at 1:54 PM Aleix Pol  wrote:
>
> On Thu, Sep 23, 2021 at 11:52 AM Ben Cooksley  wrote:
> >
> > Hi all,
> >
> > It has recently come to our attention that the number of queries being 
> > handled for the endpoint https://autoconfig.kde.org/ocs/providers.xml on a 
> > day to day basis has gotten to the point where it is causing issues with 
> > server responsiveness to other traffic. This is perhaps best summarised by 
> > the following:
> >
> > root@nicoda /var/log/apache2 # ls -lah ...
> > -rw-r- 1 root adm 458M Sep 23 06:25 autoconfig.kde.org.log.1
> > -rw-r- 1 root adm 381M Sep 23 06:25 networkcheck.kde.org.log.1
> > -rw-r- 1 root adm 143M Sep 23 06:25 www.kde.org.log.1
> >
> > root@nicoda /var/log/apache2 # cat autoconfig.kde.org.log.1 | wc -l
> > 4,222,343
> >
> > Based on those numbers we're looking at 48-49 requests per second (on 
> > average - peaks are much higher by many magnitudes), which seems extremely 
> > excessive given that this file is only supposed to be retrieved by KDE 
> > software when GHNS functionality is triggered. That is supported by the 
> > substantial size difference it has over networkcheck.kde.org - which is 
> > used by plasma-nm and NetworkManager (on Neon) to check for whether they 
> > have a working internet connection - which i'd expect to be the site 
> > receiving the most traffic.
> >
> > As such, I therefore suspect we have bug(s) in software that makes use of 
> > GHNS functionality.
> >
> > It would therefore be appreciated if we could please review the software in 
> > question to determine whether it is operating correctly. Given that it 
> > usually runs in the background on user systems, i'd especially appreciate 
> > it if a detailed review could be conducted on Discover and other software 
> > that conducts package management operations or assists in managing updates.
> >
> > Unfortunately all these applications submit a fairly useless user agent 
> > (Mozilla/5.0) so it is impossible for Sysadmin to ascertain any further 
> > information. If we could get information on the software that is 
> > originating the request added to the user agent to assist in investigating 
> > these issues in the future that would be extremely helpful.
> >
> > Thanks,
> > Ben
>
> That's correct. Discover fetches them at startup. It's necessary to be
> able to check if there are updates on KNS-provided resources.
>
> Incidentally,  I was looking into this yesterday incidentally. We
> could see if caching is broken somehow. A request will still be needed
> though to check if the cache is out of date.
>
> Or we can prefer the cached version of the file for a few days and
> assume they don't change that much.
>
> I've seen some of them point at
> "https://download.kde.org/ocs/providers.xml";, I don't know if this is
> any better.
>
> Aleix

https://invent.kde.org/frameworks/attica/-/merge_requests/15/
https://invent.kde.org/frameworks/knewstuff/-/merge_requests/141
https://invent.kde.org/plasma/discover/-/merge_requests/165

This should lessen the problem from Discover's side. Still that one
providers.xml request at startup remains.

Aleix


Re: OCS Providers File - High Numbers of Requests

2021-09-23 Thread Aleix Pol
On Thu, Sep 23, 2021 at 11:52 AM Ben Cooksley  wrote:
>
> Hi all,
>
> It has recently come to our attention that the number of queries being 
> handled for the endpoint https://autoconfig.kde.org/ocs/providers.xml on a 
> day to day basis has gotten to the point where it is causing issues with 
> server responsiveness to other traffic. This is perhaps best summarised by 
> the following:
>
> root@nicoda /var/log/apache2 # ls -lah ...
> -rw-r- 1 root adm 458M Sep 23 06:25 autoconfig.kde.org.log.1
> -rw-r- 1 root adm 381M Sep 23 06:25 networkcheck.kde.org.log.1
> -rw-r- 1 root adm 143M Sep 23 06:25 www.kde.org.log.1
>
> root@nicoda /var/log/apache2 # cat autoconfig.kde.org.log.1 | wc -l
> 4,222,343
>
> Based on those numbers we're looking at 48-49 requests per second (on average 
> - peaks are much higher by many magnitudes), which seems extremely excessive 
> given that this file is only supposed to be retrieved by KDE software when 
> GHNS functionality is triggered. That is supported by the substantial size 
> difference it has over networkcheck.kde.org - which is used by plasma-nm and 
> NetworkManager (on Neon) to check for whether they have a working internet 
> connection - which i'd expect to be the site receiving the most traffic.
>
> As such, I therefore suspect we have bug(s) in software that makes use of 
> GHNS functionality.
>
> It would therefore be appreciated if we could please review the software in 
> question to determine whether it is operating correctly. Given that it 
> usually runs in the background on user systems, i'd especially appreciate it 
> if a detailed review could be conducted on Discover and other software that 
> conducts package management operations or assists in managing updates.
>
> Unfortunately all these applications submit a fairly useless user agent 
> (Mozilla/5.0) so it is impossible for Sysadmin to ascertain any further 
> information. If we could get information on the software that is originating 
> the request added to the user agent to assist in investigating these issues 
> in the future that would be extremely helpful.
>
> Thanks,
> Ben

That's correct. Discover fetches them at startup. It's necessary to be
able to check if there are updates on KNS-provided resources.

Incidentally,  I was looking into this yesterday incidentally. We
could see if caching is broken somehow. A request will still be needed
though to check if the cache is out of date.

Or we can prefer the cached version of the file for a few days and
assume they don't change that much.

I've seen some of them point at
"https://download.kde.org/ocs/providers.xml";, I don't know if this is
any better.

Aleix


OCS Providers File - High Numbers of Requests

2021-09-23 Thread Ben Cooksley
Hi all,

It has recently come to our attention that the number of queries being
handled for the endpoint https://autoconfig.kde.org/ocs/providers.xml on a
day to day basis has gotten to the point where it is causing issues with
server responsiveness to other traffic. This is perhaps best summarised by
the following:

root@nicoda /var/log/apache2 # ls -lah ...
-rw-r- 1 root adm 458M Sep 23 06:25 autoconfig.kde.org.log.1
-rw-r- 1 root adm 381M Sep 23 06:25 networkcheck.kde.org.log.1
-rw-r- 1 root adm 143M Sep 23 06:25 www.kde.org.log.1

root@nicoda /var/log/apache2 # cat autoconfig.kde.org.log.1 | wc -l
4,222,343

Based on those numbers we're looking at 48-49 requests per second (on
average - peaks are much higher by many magnitudes), which seems extremely
excessive given that this file is only supposed to be retrieved by KDE
software when GHNS functionality is triggered. That is supported by the
substantial size difference it has over networkcheck.kde.org - which is
used by plasma-nm and NetworkManager (on Neon) to check for whether they
have a working internet connection - which i'd expect to be the site
receiving the most traffic.

As such, I therefore suspect we have bug(s) in software that makes use of
GHNS functionality.

It would therefore be appreciated if we could please review the software in
question to determine whether it is operating correctly. Given that it
usually runs in the background on user systems, i'd especially appreciate
it if a detailed review could be conducted on Discover and other software
that conducts package management operations or assists in managing updates.

Unfortunately all these applications submit a fairly useless user agent
(Mozilla/5.0) so it is impossible for Sysadmin to ascertain any further
information. If we could get information on the software that is
originating the request added to the user agent to assist in investigating
these issues in the future that would be extremely helpful.

Thanks,
Ben