[Development] CI problems being solved

2016-05-29 Thread Tony Sarajärvi
of restarting stuff then, then all should come back within an hour. Regards, -Tony Tony Sarajärvi CI Tech Lead The Qt Company - Elektroniikkatie 13, 90590 Oulu, Finland Email: tony.saraja...@theqtcompany.com<mailto:tony.saraja...@theqtcompany.com> http://qt.io Qt Facebook: www.facebook.com/q

Re: [Development] CI problems being solved

2016-05-29 Thread Tony Sarajärvi
: Development [mailto:development-bounces+tony.sarajarvi=qt...@qt-project.org] On Behalf Of Tony Sarajärvi Sent: 29. toukokuuta 2016 19:58 To: development@qt-project.org Subject: [Development] CI problems being solved Hi all! The CI is suffering from technical problems in the world of virtualization

Re: [Development] Qt 5.8 branching & Feature Freeze

2016-06-16 Thread Tony Sarajärvi
Hi, Our aim was to get new platforms in immediately after the previous platforms branched away from dev branch. Meaning, when 5.7 branch was created and it branched away from dev branch, all new platforms aiming for 5.8 should have been put into dev branch. However, in practice it didn't quite

Re: [Development] Qt3D CI wedged

2016-04-26 Thread Tony Sarajärvi
Hi, We ran out of disk space on the CI master. Problem has been fixed now and things are being restarted. -Tony > -Original Message- > From: Development [mailto:development- > bounces+tony.sarajarvi=qt...@qt-project.org] On Behalf Of Marc Mutz > Sent: 26. huhtikuuta 2016 10:15 > To:

[Development] CI maintenance break next weekend 4 - 5 Mar 2017

2017-03-01 Thread Tony Sarajärvi
Hi We have scheduled a maintenance break for the CI next weekend. This will cause the CI to be totally offline at least during Sat and could extend over Sun as well. We've planned to do extensive wipe or cleanup to local stored distro images. We have accumulated garbage over the years and the

[Development] CI has workitem creation problems

2016-11-08 Thread Tony Sarajärvi
for the inconvenience this causes -Tony Tony Sarajärvi CI Tech Lead The Qt Company Elektroniikkatie 10 90590, Oulu Finland tony.saraja...@qt.io +358 50 4821416 http://qt.io<http://qt.io/> [http://s3-eu-west-1.amazonaws.com/qt-files/logos/qt_logo_with_text_green_rgb_400x141.png]<http://qt.io/

Re: [Development] CI suffering from an unknown problem

2016-11-22 Thread Tony Sarajärvi
to do the trick. So stage ahead :) -Tony From: Development [mailto:development-bounces+tony.sarajarvi=qt...@qt-project.org] On Behalf Of Tony Sarajärvi Sent: 22. marraskuuta 2016 9:12 To: development@qt-project.org Subject: [Development] CI suffering from an unknown problem Hi There's something

[Development] CI suffering from an unknown problem

2016-11-21 Thread Tony Sarajärvi
Hi There's something off in the CI currently and we're investigating. -Tony Tony Sarajärvi CI Tech Lead The Qt Company Elektroniikkatie 10 90590, Oulu Finland tony.saraja...@qt.io +358 50 4821416 http://qt.io<http://qt.io/> [http://s3-eu-west-1.amazonaws.com/qt-files

Re: [Development] Coin update

2016-10-28 Thread Tony Sarajärvi
Pardon... we forgot to trigger a garbage collector so the Coin is down for a while. Should come up in a moment. Aplogies for the disturbance. -Tony > -Original Message- > From: Development [mailto:development- > bounces+tony.sarajarvi=qt...@qt-project.org] On Behalf Of Jedrzej Nowacki >

Re: [Development] State of dev branch in CI

2017-01-10 Thread Tony Sarajärvi
Hi, Sounds good to me. I'll proceed with that. Funny that the only platform we've managed to get in during the last half a year or year is immediately causing problems so that we have to remove it ;) -Tony From: Development [mailto:development-bounces+tony.sarajarvi=qt...@qt-project.org] On

Re: [Development] Need advise on acceptable timeouts for autotests

2017-03-16 Thread Tony Sarajärvi
Hi 1. We don't know to be frank. The VMs aren't live migrated, the SAN hasn't been proved to be down or even the bottleneck, at least for standard hardware. Apple hardware is another issue, and here SAN seems to either slow down or possibly even break up sometimes. Some Macs slow down to the

Re: [Development] CI maintenance break next weekend 4 - 5 Mar 2017

2017-03-05 Thread Tony Sarajärvi
and recovered over 15 TB of wasted space on our Compellent. Have fun! -Tony From: Development [mailto:development-bounces+tony.sarajarvi=qt...@qt-project.org] On Behalf Of Tony Sarajärvi Sent: keskiviikkona 1. maaliskuuta 2017 12.57 To: development@qt-project.org Subject: [Development] CI maintenance break

[Development] CI has infra problems

2017-08-01 Thread Tony Sarajärvi
Hi Windows provisionings are failing currently. Most likely culprit is some DHCP or router misconfiguration. We'll begin investigating immediately. -T ___ Development mailing list Development@qt-project.org

Re: [Development] CI has infra problems

2017-08-01 Thread Tony Sarajärvi
Fixed! Thanks for your patience  -T From: Tony Sarajärvi Sent: tiistai 1. elokuuta 2017 10.49 To: development@qt-project.org Cc: Qt Development <qt.developm...@qt.io> Subject: CI has infra problems Hi Windows provisionings are failing currently. Most likely culprit is some DHCP or

Re: [Development] CI problems

2017-05-19 Thread Tony Sarajärvi
Hi again ☹ Something hit the fan again, and all CI systems came to a halt. IT has been contacted who will contact Dell immediately. I’ll keep you updated as I have receive info. -Tony From: Tuukka Turunen Sent: perjantaina 19. toukokuuta 2017 0.54 To: Tony Sarajärvi <tony.saraja...@qt

Re: [Development] CI is down again

2017-05-18 Thread Tony Sarajärvi
Update: We're unsure why we a going at crawling speed on some parts of our infra. We could be facing hardware issues since we have restarted almost everything we have. Investigations are ongoing, and I can't give an ETA currently as to when we come back online. We need to find the reason

Re: [Development] CI is down again

2017-05-18 Thread Tony Sarajärvi
Update: Dell is investigating problems with the Compellent (our backend storage system). We're seeing huge latencies over our fiber optics there and the system can't be used atm. Their 24/7 crew is working on it as their P1. -Tony -- Update: We're unsure why we a going at

[Development] CI problems

2017-05-18 Thread Tony Sarajärvi
Hi Seems my earlier 2 mails haven't reached you. I hope this one does. We've suffered hardware malfunction today. Our CI environment began behaving oddly aprox 20 hours ago and early this morning we noticed that not everything was OK. To prevent data loss and further problems, we shut down the

[Development] CI is down again

2017-05-24 Thread Tony Sarajärvi
We seem to have hardware issues which are under investigation. We'll be back online as soon as possible. -Tony ___ Development mailing list Development@qt-project.org http://lists.qt-project.org/mailman/listinfo/development

Re: [Development] CI problems

2017-05-19 Thread Tony Sarajärvi
...@qt-project.org] On Behalf Of Tony Sarajärvi Sent: perjantaina 19. toukokuuta 2017 12.17 To: development@qt-project.org Subject: Re: [Development] CI problems Hi again ☹ Something hit the fan again, and all CI systems came to a halt. IT has been contacted who will contact Dell immediately. I’ll

Re: [Development] CI problems

2017-05-18 Thread Tony Sarajärvi
[mailto:development-bounces+tony.sarajarvi=qt...@qt-project.org] On Behalf Of Tony Sarajärvi Sent: torstaina 18. toukokuuta 2017 20.17 To: development@qt-project.org Subject: [Development] CI problems Hi Seems my earlier 2 mails haven’t reached you. I hope this one does. We’ve suffered hardware

[Development] Periodical digest from the CI (2017/05) - CI Performance, HW and SW changes

2017-05-30 Thread Tony Sarajärvi
be more capable of producing packages faster. I hope you found this interesting. If you have any questions feel free to ask in public or in private. I’ll be happy to answer if I can  Have a great summer! -Tony Tony Sarajärvi CI Tech Lead

[Development] Hardware failure again, several systems affected

2017-06-01 Thread Tony Sarajärvi
Hi We have problems with our hardware again. Investigations are ongoing. At least the CI is down for the moment, and other systems should be affected to some degree as well. -Tony ___ Development mailing list Development@qt-project.org

Re: [Development] CI problems

2017-06-16 Thread Tony Sarajärvi
Hi All seem to be working again. We also had some problems with servers not seeing LUNs for some reason, and we fixed those as well. -T From: Development [mailto:development-bounces+tony.sarajarvi=qt...@qt-project.org] On Behalf Of Tony Sarajärvi Sent: perjantai 16. kesäkuuta 2017 9.44

Re: [Development] Flaky auto tests on macOS 10.12

2017-06-19 Thread Tony Sarajärvi
It is the intention that we do this. But we're constantly running, not beside our horse, but after it. We have just begun activating ourselves to discuss about 5.10 platforms and we have FF coming up in two weeks (counting out July here). It took months to blacklist all the cases for 10.12

Re: [Development] What changed in the RHEL 6.6 machines that cause tst_QUdpSocket::linkLocalIPv6 to fail?

2017-09-13 Thread Tony Sarajärvi
This is information I could look up, but would take time, so let's see if you already have the answers  Does this fail 100% of the time now, and since when? Or when did it become flaky? We noticed on our servers, that when we moved the VMs to run on different physical machines in different

[Development] IT service break going on right now

2017-10-12 Thread Tony Sarajärvi
Hi Better late than never they say? We on moving bits and pieces from our old facilities maintaining our hardware to the new one. You’ve probably read about these moves earlier as we moved some of the infra. Now we try to move the last pieces. Today we move CI master server, our VPN,

Re: [Development] Infra problems today

2017-10-12 Thread Tony Sarajärvi
With some luck we found the problem and fixed it. I had one misleading warning which confused me which brought me to believe that everything might be going down today. I'll keep an extra eye on things today though. -T From: Tony Sarajärvi Sent: torstai 12. lokakuuta 2017 11.15 To: development

[Development] Infra problems today

2017-10-12 Thread Tony Sarajärvi
Hi We are experiencing some infra problems currently. The CI is down, and by the symptoms over there, I'd expect other services might follow soon. We're investigating. -Tony ___ Development mailing list Development@qt-project.org

Re: [Development] IT service break going on right now

2017-10-13 Thread Tony Sarajärvi
CI master is up and running. IT began work on WLANs next and after that VPN. -T From: Tony Sarajärvi Sent: perjantai 13. lokakuuta 2017 8.05 To: 'development@qt-project.org' <development@qt-project.org> Subject: IT service break going on right now Hi Better late than never they s

[Development] Maintenance break tonight and tomorrow

2017-08-25 Thread Tony Sarajärvi
Hi IT will transfer over some infra related services from the old facilities to the new one this weekend. Jenkins, Coin, IRC, mail services are affected in such that we will shut them down for ~15 minutes while the move is being made. We scheduled these to happen late in the evening, around

Re: [Development] Maintenance break tonight and tomorrow

2017-08-25 Thread Tony Sarajärvi
Good morning. We seem to suffer a loss of the network test server. That's why autotests haven't passed last night. We're on it, and hopefully will get it online again. -Tony From: Tony Sarajärvi Sent: perjantai 25. elokuuta 2017 13.44 To: 'development@qt-project.org' <development

[Development] Infra problems under investigation

2017-08-28 Thread Tony Sarajärvi
Hi We're experiencing internal network problems which are under investigation. An unknown amount of services could be affected. -Tony ___ Development mailing list Development@qt-project.org http://lists.qt-project.org/mailman/listinfo/development

Re: [Development] Maintenance break tonight and tomorrow

2017-08-28 Thread Tony Sarajärvi
until fixed on Sunday. Shorter version: all works now (except for today’s new problems that are unrelated)  -T From: Tony Sarajärvi Sent: lauantai 26. elokuuta 2017 8.40 To: 'development@qt-project.org' <development@qt-project.org> Subject: RE: Maintenance break tonight and tomorrow

[Development] Builds missing qmake?

2017-12-13 Thread Tony Sarajärvi
Hi If you stumble upon a problem in your build where the error message says that it can't find qmake, contact us maintaining the CI immediately. It's not a random failure in such that it goes away by restaging a few times. It means that for some reason (still unclear) we have a pointer

Re: [Development] Module "" () : on QtRemoteObjects

2017-12-13 Thread Tony Sarajärvi
Hi, Dev has been fixes as well now: https://testresults.qt.io/coin/integration/qt/qt5/tasks/1513105251 -T From: Development [mailto:development-bounces+tony.sarajarvi=qt...@qt-project.org] On Behalf Of Alexandru Croitor Sent: tiistai 12. joulukuuta 2017 20.42 To: Stottlemyer, Brett (B.S.)

Re: [Development] Builds missing qmake?

2017-12-13 Thread Tony Sarajärvi
ur commit and the next time around the sources might be retrieved. I apologize for the inconvenience -Tony From: Tony Sarajärvi Sent: keskiviikko 13. joulukuuta 2017 11.26 To: 'development@qt-project.org' <development@qt-project.org> Subject: Builds missing qmake? Hi If you stumble upon a

[Development] Provisioning problems with macOS currently

2017-12-08 Thread Tony Sarajärvi
Hi You might have noticed provisionings failing with "" messages etc. Further investigations will show you that command line tools are needed in macOS. We have a script for that, but we've had problems getting it in. That's our P0 currently. Until we get

[Development] QtBase broken in 5.9 and 5.10. Fix is already inbound.

2017-12-11 Thread Tony Sarajärvi
Hi QtBase in 5.9 and 5.10 are broken currently. We found the bug, and it was sadly approved by yours sincerely :/ Fix is inbound: https://codereview.qt-project.org/#/c/214032/ -Tony ___ Development mailing list Development@qt-project.org

[Development] CI is crippled currently

2017-10-31 Thread Tony Sarajärvi
Hi We are currently building with just one host. There's something off in OpenNebula and we're investigating. -Tony ___ Development mailing list Development@qt-project.org http://lists.qt-project.org/mailman/listinfo/development

[Development] Performing infra upgrade in the CI

2018-05-22 Thread Tony Sarajärvi
Hi I'm performing a small infra upgrade. I'll be upgrading MAAS to the latest version. This shouldn't cause any CI downtime. If something goes badly wrong, I'll just revert my change and let's get back to business as usual. Fingers crossed, -Tony ___

Re: [Development] Maintenance in network aprox between the 25th and 27th of April

2018-04-26 Thread Tony Sarajärvi
mailto:qt...@qt.io> With regards, -Tony From: Tony Sarajärvi Sent: perjantai 6. huhtikuuta 2018 9.36 To: 'development@qt-project.org' <development@qt-project.org<mailto:development@qt-project.org>> Subject: Maintenance in network aprox between the 25th and 27th of April Hi

[Development] Gerrit problems fixed (?)

2017-12-21 Thread Tony Sarajärvi
adjusted optimizing file access * I/O scheduler is now 'noop' With these changes the symptoms are for now gone. If they start appearing again, just hit reply to this thread and let's see if we can reproduce and fix it. Thank you, -Tony From: Tony Sarajärvi Sent: keskiviikko 13. joulukuuta 2017

Re: [Development] Reporting errors for powershell scripts executed by Coin

2017-12-22 Thread Tony Sarajärvi
Hi We ignore the results of PS1 scripts because A) We have bad scripts that try to remove folders that don't exists anymore (should be cleaned) and B) as your example said, if we enabled enforcing of them now, things would break apart (fix needed as well ) -T -Original Message-

[Development] CI down for a moment

2018-01-04 Thread Tony Sarajärvi
Hi all! We had situation where it seems like cachefilesd bugged and didn't do cache culling. Our hosts filled up and caches got messed up. After cleaning the corrupted images, we still had hosts having incorrect data in caches. So as a quick fix I'm redeploying all hosts now. It takes some

[Development] CI updates ongoing

2018-01-26 Thread Tony Sarajärvi
Hi Our CI hosts run on Ubuntu, but sadly not on the latest version. We have 16.04 and 16.10 releases in use which need to be updated quickly. As we transition over, we will move hosts gradually to a new version of the CI running on 17.10. So during the next few days the CI will be a bit slower

[Development] CI down. OpenNebula VM has crashed.

2018-01-11 Thread Tony Sarajärvi
Hi We've had a breakdown of the hypervisor we are using in the CI. We began investigations. Regards, -Tony ___ Development mailing list Development@qt-project.org http://lists.qt-project.org/mailman/listinfo/development

Re: [Development] CI down. OpenNebula VM has crashed.

2018-01-11 Thread Tony Sarajärvi
We're back online, but don't know the reason for the crash yet. We'll monitor. -T From: Tony Sarajärvi Sent: perjantai 12. tammikuuta 2018 8.26 To: development@qt-project.org Subject: CI down. OpenNebula VM has crashed. Hi We've had a breakdown of the hypervisor we are using in the CI. We

Re: [Development] CI infra broken

2018-01-30 Thread Tony Sarajärvi
Hi Seems we ran out of luck again. The openNebula VM seems to be broken. We reached a bug in vSphere that's still unresolved by VMware. We have to recreate the VM, and that will take some time. Estimate for getting the CI up is tomorrow. WR, -Tony From: Tony Sarajärvi Sent: tiistai 30

Re: [Development] CI updates ongoing

2018-01-26 Thread Tony Sarajärvi
, Tony Sarajärvi <tony.saraja...@qt.io> wrote: > Hi > > > > Our CI hosts run on Ubuntu, but sadly not on the latest version. We have > 16.04 and 16.10 releases in use which need to be updated quickly. > > As we transition over, we will move hosts gradually to a n

Re: [Development] CI infra broken

2018-01-30 Thread Tony Sarajärvi
. Hopefully during tomorrow we’ll have all hosts available again…with the new version of openNebula running newer KVM hosts (hopefully more stable). A lot of hopes there  With regards, -Tony From: Tony Sarajärvi Sent: tiistai 30. tammikuuta 2018 14.33 To: 'development@qt-project.org' <development

Re: [Development] CI infra broken

2018-01-31 Thread Tony Sarajärvi
Finally figured out the problem with the network test server. Sorry about the delay. QtBase's autotests have a greater chance of passing again (note: didn't say they will pass ) -Tony -Original Message- From: Tony Sarajärvi Sent: keskiviikko 31. tammikuuta 2018 13.42 To: 'Michal

Re: [Development] CI infra broken

2018-01-31 Thread Tony Sarajärvi
-project.org Subject: Re: [Development] CI infra broken Hi Please let us know if we can use ci already or not. I also get: "Timeout while creating source archives. Probably Coin issue, you can re-stage and ping Coin admin." Br Michal On 01/31/2018 05:42 AM, Tony Sarajärvi w

[Development] CI infra broken

2018-01-30 Thread Tony Sarajärvi
Hi We have problems with our infra currently. We're working on it. For the time being, the CI is down. -Tony ___ Development mailing list Development@qt-project.org http://lists.qt-project.org/mailman/listinfo/development

[Development] CI going down for update

2018-02-15 Thread Tony Sarajärvi
Hi We'll take the CI down for update for a short while. The web page won't work at all during that time, since we'll close the whole server. Thanks for your patience. -Tony ___ Development mailing list Development@qt-project.org

Re: [Development] CI going down for update

2018-02-19 Thread Tony Sarajärvi
problem where the hosts that’s running all the virtual machines kept crashing and failing all the builds. Let’s hope this trend continues. Happy building! -Tony From: Simon Hausmann Sent: perjantai 16. helmikuuta 2018 17.10 To: Tony Sarajärvi <tony.saraja...@qt.io>; development@qt-project.org S

Re: [Development] CI going down for update

2018-02-16 Thread Tony Sarajärvi
Hi We have to do things the hard way, meaning copying over a lot of stuff instead of just converting stuff. No unexpected things have poped up during the hard way however, but the copy phase takes a lot of time. ETA (or nothing really arrives now... so EToC): in a few hours. -T From: Tony

Re: [Development] CI is suffering from problems

2017-12-21 Thread Tony Sarajärvi
100% full, and we have to be more careful with that. Monitoring didn’t help here as we ignored the warnings we received ☹ -T From: Tony Sarajärvi Sent: torstai 21. joulukuuta 2017 14.19 To: development@qt-project.org Subject: CI is suffering from problems Hi You have probably already noticed

[Development] CI is suffering from problems

2017-12-21 Thread Tony Sarajärvi
Hi You have probably already noticed this, but here's an email notifying you that we're on it. Our OpenNebula isn't able to clone any new virtual machines, complaining that the disk is full even though it isn't. As said...we continue investigating. Regards, -Tony

[Development] Redeploying hosts with original kernel

2018-08-14 Thread Tony Sarajärvi
Hi It seems like a culprit for our extremely odd behaving windows VMs might be the custom kernel we are applying (that tried to fix an NFS issue). After using the original kernel again, it seems at least for now we can run full speed on a host again. So I'll redeploy all hosts (some done

Re: [Development] Upgrade the XCode running in the CI's macOS 10.11

2018-08-22 Thread Tony Sarajärvi
The timing  https://codereview.qt-project.org/#/c/237412/ -Tony -Original Message- From: Development On Behalf Of Thiago Macieira Sent: keskiviikko 22. elokuuta 2018 3.15 To: development@qt-project.org Subject: Re: [Development] Upgrade the XCode running in the CI's macOS 10.11

[Development] Coin momentarily down

2018-08-29 Thread Tony Sarajärvi
Hi We have a small glitch in the CI currently. We keep spawning VMs like crazy. The CI is down for a while as we figure out why and clean up the mess. Shouldn’t take more than say 30 minutes…. shouldn’t  -Tony ___ Development mailing list

[Development] QT infra weekly report

2018-08-29 Thread Tony Sarajärvi
Hi We’ve decided to start sharing a bit more information about the state of our infra and what we’re up to. This will be a brief e-mail that will cover the main topics. State of the CI - We've been running 2 weeks now with a stable kernel. The hosts have actually been up without reboots now

[Development] Recall: QT infra weekly report

2018-08-29 Thread Tony Sarajärvi
Tony Sarajärvi would like to recall the message, "QT infra weekly report". ___ Development mailing list Development@qt-project.org http://lists.qt-project.org/mailman/listinfo/development

[Development] CI still down a while

2018-09-11 Thread Tony Sarajärvi
Hi We encountered a problem last evening Finnish time. We overallocated our hard disk space on our infra backend and it led to us running out of disk space. All services were brought to a halt. We're restoring systems right now. A while longer and we'll be back online. -Tony

[Development] About our CI update notifications

2018-03-15 Thread Tony Sarajärvi
Hi We're trying to improve our communication toward you regarding our CI and what's going on with it. So our suggestion comes as follows: · - In case of a scheduled update, we send an e-mail to the public developer mailing list the day before · - In case of emergency update or

[Development] CI maintenance break on March 21 @ 8:00 - 9:00 EET

2018-03-09 Thread Tony Sarajärvi
Hi We'd like to have a small maintenance break. If the suggested time doesn't fit you at all, please contact us and we'll reschedule. Purpose: We'd like to update the firmware on the hardware running Coin. -Tony ___ Development mailing list

[Development] Maintenance in network aprox between the 25th and 27th of April

2018-04-06 Thread Tony Sarajärvi
Hi We are going to perform maintenance on our switches which will probably cause interruptions in all Qt services not located in AWS. New switches are estimated to arrive so that the work can begin approximately on the 25th. We'll inform you with more precise data as we get it. -Tony

Re: [Development] Maintenance in network aprox between the 25th and 27th of April

2018-04-24 Thread Tony Sarajärvi
: * MacMinis are brought back online * Troubleshooting In case of questions, contact qt...@qt.io With regards, -Tony From: Tony Sarajärvi Sent: perjantai 6. huhtikuuta 2018 9.36 To: 'development@qt-project.org' <development@qt-project.org> Subject: Maintenance in network aprox b

[Development] The CI is down atm

2018-03-17 Thread Tony Sarajärvi
Hi The CI is down atm and I can't even log in to the server right now. I'm trying to fix this somehow right away. -Tony ___ Development mailing list Development@qt-project.org http://lists.qt-project.org/mailman/listinfo/development

Re: [Development] The CI is down atm

2018-03-17 Thread Tony Sarajärvi
is heavily reduced before the crashed servers are deployed back. And a long queue is in already naturally. ☹ We aren’t monitoring 24/7, so please inform at qt...@qt.io<mailto:qt...@qt.io> if you suspect the CI has crashed. Thank you! From: Tony Sarajärvi Sent: lauantai 17. maaliskuuta 201

Re: [Development] CI maintenance break on March 21 @ 8:00 - 9:00 EET

2018-03-21 Thread Tony Sarajärvi
All back up again! If you see unexpected problems, due contact us again at qt...@qt.io<mailto:qt...@qt.io> -Tony From: Tony Sarajärvi Sent: keskiviikko 21. maaliskuuta 2018 8.53 To: 'development@qt-project.org' <development@qt-project.org> Cc: Qt Development <qt.developm...@qt.

Re: [Development] CI maintenance break on March 21 @ 8:00 - 9:00 EET

2018-03-21 Thread Tony Sarajärvi
Hi Reminding you all that this maintenance break is about to happen now. Good luck to us all. -T From: Tony Sarajärvi Sent: perjantai 9. maaliskuuta 2018 14.08 To: development@qt-project.org Cc: Qt Development <qt.developm...@qt.io> Subject: CI maintenance break on March 21 @ 8:00 - 9:

[Development] Problems in provisioning

2018-03-17 Thread Tony Sarajärvi
Hi You probably have seen that we have problems in provisioning. grub-update command isn't found and hdiutil can't unmount while installing Java on macOS'es. I'm suspecting the culprit for these problems is an update in Coin where it began enforcing errors in the scripts. Yes, we had the

Re: [Development] The CI is down atm

2018-03-17 Thread Tony Sarajärvi
these qcow2 images to the hosts beforehand, and we don't have the storage space on the hosts to store the images either ☹ -Tony -Original Message- From: Allan Jensen Sent: lauantai 17. maaliskuuta 2018 11.25 To: Tony Sarajärvi <tony.saraja...@qt.io> Cc: development@qt-project.org Subje

[Development] Bug in Ubuntu 18.04 provisioning preventing builds in dev branch currently

2018-10-07 Thread Tony Sarajärvi
Hi A small bug in the provisioning scripts of Ubuntu 18.04 prevents the builds from going through in dev branch currently. We run apt update only after we try to install the packages. So it's trying to install a package so old it doesn't exist in the repos anymore. A fix has landed in 5.12

Re: [Development] Shutting down the CI right now!

2018-10-12 Thread Tony Sarajärvi
is in effect. See if that helps. -Tony -Original Message- From: Liang Qi Sent: perjantai 12. lokakuuta 2018 8.21 To: Tony Sarajärvi Cc: development@qt-project.org Subject: Re: [Development] Shutting down the CI right now! Thanks for the work, and sometimes in spare time

Re: [Development] Shutting down the CI right now!

2018-10-11 Thread Tony Sarajärvi
From: Tony Sarajärvi Sent: torstai 11. lokakuuta 2018 14.49 To: development@qt-project.org Subject: Shutting down the CI right now! Hi Due to a lot of changes while developing and snapshots being huge, our Compellent backend is nearly 100% full. I'll shut down the CI for a few hours to avoid

Re: [Development] CI machines out of disk space

2018-10-31 Thread Tony Sarajärvi
Yeah, we were already wondering about that. Before the builds starts, it has 160 GB of free disk space. Could the build really eat up all that? We've had kernel crashing on the host side of the VM, and that has caused the VM to put its disks on read-only mode. That has then created errors that

Re: [Development] Coin go version has been updated

2018-10-20 Thread Tony Sarajärvi
I’m also interested in what you thought had fixed the issues, as they clearly state they remove the compatibility with the old distros? And what features do we need from the new go-lang versions? -T From: Development On Behalf Of Aapo Keskimölö Sent: lauantai 20. lokakuuta 2018 15.37 To:

[Development] Qt infra "weekly" report

2018-11-16 Thread Tony Sarajärvi
Hi With me being extremely busy lately, I've forgotten all about this report I promised to send out. Sorry about that! State of the CI * The kernels we updated back in august were a minor success. They don't crash anymore, and that leaves us with more time to do something else than just

Re: [Development] MSVC 2017 32bit pre-built binaries for Qt 5.12 (replacing MSVC2015 32bit)

2018-10-03 Thread Tony Sarajärvi
We currently work like this in 5.12 For all submodule builds we do: MSVC 2015 x64 - a DeveloperBuild that isn't a DebugAndRelease build that's _not_ exported to release MSVC 2015 x86 - a DebugAndRelease build that's exported to release MSVC 2015 x64 - a DebugAndRelease build that's exported to

[Development] Maintenance break for the CI

2018-10-10 Thread Tony Sarajärvi
Hi Let's do a small maintenance break for the CI right away. It's quite unstable currently, and a reset of all the hosts usually helps. While I do that, I'll also enable nested virtual machines. This will enable a few things we are working on. -Tony

[Development] Shutting down the CI right now!

2018-10-11 Thread Tony Sarajärvi
Hi Due to a lot of changes while developing and snapshots being huge, our Compellent backend is nearly 100% full. I'll shut down the CI for a few hours to avoid everything breaking due to lack of disk space. We'll be back after snapshots have been deleted. -Tony

[Development] Coin production update

2018-09-20 Thread Tony Sarajärvi
Coin production was updated today at Fri Sep 21 7:00 EEST 2018 with new baseline. For CI related issues, you may create bug report as instructed in https://wiki.qt.io/Reporting_Bugs#Reporting_bugs_for_Coin and/or consult the internal #qtci IRC-channel. See change-list attached for related

[Development] Retry problems in the CI

2018-09-24 Thread Tony Sarajärvi
Hi You all might have noticed that it's almost impossible to get anything through the CI, especially into QtBase. The reason seems to be our 'retry' mechanism that has vanished. We don't retry failing cases currently. Thus every flaky case that fails, now immediately fails the entire

[Development] QT infra weekly report 2018-09-27

2018-09-27 Thread Tony Sarajärvi
Hi State of the CI - Somewhere along the axis of Ubuntu 17.10 - KVM we're hitting a SNAFU in a cycle of about 2 weeks. After that the virtual machines done on our hosts start slowing down enormously. We're working on replacing 17.10 with 18.04, but the work has been slowed down by us giving

Re: [Development] CI upgrade

2019-01-01 Thread Tony Sarajärvi
https://bugreports.qt.io/browse/QTBUG-72782 https://bugreports.qt.io/browse/QTBUG-72790 -Tony From: Tony Sarajärvi Sent: maanantai 31. joulukuuta 2018 8.28 To: development@qt-project.org Subject: CI upgrade Good morning. Since our last verifications of 3 main branches show green light to make

Re: [Development] CI upgrade

2019-01-03 Thread Tony Sarajärvi
>On Wednesday, 2 January 2019 04:34:43 -02 Tony Sarajärvi wrote: >> agent:2019/01/01 20:15:26 build.go:193: Config: Using QtTest library >> 5.12.0, Qt 5.12.0 (x86_64-little_endian-lp64 shared (dynamic) release >> build; by GCC >> 5.3.1 20160406 (Red Hat 5.3.1-6)

[Development] Good idea to update Windows 10 to 1809 - Redstone 5?

2019-01-17 Thread Tony Sarajärvi
Hi We have this thing that we like to try to update things to the latest. But regarding Windows 10 I was told we shouldn't perhaps do that, because Qt's code will select and different path depending on the API levels available from Windows. Does this community want to have their say and give

Re: [Development] Qt infra "weekly" report

2019-01-14 Thread Tony Sarajärvi
Hi Just as we say everything is working, we had 2 crashes yesterday in openNebula. As always when you fix one bottle neck (the hosts in this case) the bottle neck is somewhere else. But hey…it worked for over 2 weeks  -Tony From: Tony Sarajärvi Sent: maanantai 14. tammikuuta 2019 12.09

[Development] Qt infra "weekly" report

2019-01-23 Thread Tony Sarajärvi
Hi State of the CI * Currently all OK again. We had issues with Coin update breaking the code that re-runs flaky tests, but that was caught and fixed. Then we also had Google changing the way Android’s SDK manager is used, so we had to create a patch for all branches. 5.12 is at the time

Re: [Development] Maintenance break right now

2019-01-22 Thread Tony Sarajärvi
Hi If I forgot to tell you that we have a maintenance break, so did I also forget to tell you that it is over. Aprox 8-9 hours ago I launched the CI and builds began passing again. -Tony From: Tony Sarajärvi Sent: tiistai 22. tammikuuta 2019 18.24 To: development@qt-project.org Subject

[Development] Maintenance break tomorrow morning on the 19th Dec

2018-12-18 Thread Tony Sarajärvi
Hi We’ll perform some firewall switch overs tomorrow morning. While at it, we’ll move some infra services from one address space to an other enabling us to create better rules for traffic. We’ll probably perform a shutdown of the CI at 9 o’clock EET, and we’ll probably be done with it in an

[Development] Qt infra "weekly" report

2018-12-17 Thread Tony Sarajärvi
Hi State of the CI * We're still running Ubuntu 17.10. * The setup of the secondary CI network is complete (as far as we know currently) * There was a small bug in MAAS which took some time to find which delayed my work for about a day. I'm back on track and new hosts in new

[Development] Scheduled maintenance

2018-11-20 Thread Tony Sarajärvi
Good morning This morning we had a scheduled maintenance "break" where we started using a new firewall. This shouldn't have caused interruptions if we had preconfigured everything correctly. That however wasn't the case. We have a few ports which we need to open in the wall so that traffic

Re: [Development] CI upgrade

2019-01-04 Thread Tony Sarajärvi
> >On Thursday, 3 January 2019 08:10:14 -02 Tony Sarajärvi wrote: >> openNebula uses QEMU that uses libvirt to create a VM using KVM: >Despite the name, in this mode QEMU is not emulating anything. When assisted >by KVM this is real hardware virtualisation >and qemu o

[Development] Qt infra "weekly" report

2019-01-14 Thread Tony Sarajärvi
Hi State of the CI * 18.04 hosts seem to be working! The virtual machines don't slow down now and we're hoping this will solve a few of the mysteries we've had. * The feedback we've received have all been positive. The infra is working better than ever now. * The vmx

Re: [Development] CI still down a while

2018-09-11 Thread Tony Sarajärvi
Ok, systems seem to be up and running. There still might be services here and there that we haven't caught yet being offline. Keeping a third eye on the CI today for you. -Tony From: Tony Sarajärvi Sent: keskiviikko 12. syyskuuta 2018 7.32 To: 'development@qt-project.org' Subject: CI still

[Development] Maintenance break right now

2019-01-22 Thread Tony Sarajärvi
Sorry all, but we forgot to publicly announce that our firewall change is proceeding to the next phase right now. This means that for the next hours some of our web pages are going offline and the CI is brought down. I'll inform you when all is up and running again. -Tony

  1   2   >