Re: Gitlab CI Dashboards and retirement of build.kde.org

[Ingo Klöcker]

On Samstag, 3. September 2022 21:29:17 CEST Ben Cooksley wrote:
> At this time the Binary Factory is unaffected by these changes, however
> steps will be made in the coming weeks/months to migrate away from the
> Binary Factory to equivalent Gitlab jobs (although they won't be available
> for Merge Requests due to various technical limitations)

Is there some more information on this somewhere? In particular, I might be 
able to help with this as part of my role in the Bring KDE apps to the App 
Stores story.

I found https://invent.kde.org/sysadmin/task-queue/-/issues/10 (binary-
factory.kde.org migration to the Gitlab CI), but that hasn't been touched in 
the last 18 months. And neither has
https://invent.kde.org/sysadmin/task-queue/-/issues/9 (build.kde.org migration 
to Gitlab CI) which can be closed now, I suppose.

Regards,
Ingo


signature.asc
Description: This is a digitally signed message part.

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Ben Cooksley]

On Sun, Sep 4, 2022 at 8:51 PM Gilles Caulier 
wrote:

> Hi Ben,
>

HI Gilles,


>
> With build/binary-factory , it was possible to get an Embeddable Build
> Status Icon as this one :
>
>
> https://binary-factory.kde.org/view/AppImage/job/Digikam_Nightly_appimage-centos7/badge/
>
> Does this feature still exist with Gitlab infrastructure ?
>

Yes, quoting my earlier email:

[quote]
Gitlab provides a limited selection of badges - which can be found at:
- https://invent.kde.org/multimedia/kdenlive/badges/master/pipeline.svg
- https://invent.kde.org/multimedia/kdenlive/badges/master/coverage.svg
- https://invent.kde.org/multimedia/kdenlive/-/badges/release.svg
[/quote]

You'll need to swap multimedia/kdenlive to graphics/digikam but otherwise
that should work fine.

Please note that the Binary Factory is not impacted by this, so anything
relating to the Binary Factory is unchanged at this time.


>
> Thanks
>
> Gilles
>

Regards,
Ben


>
> Le sam. 27 août 2022 à 11:45, Ben Cooksley  a écrit :
> >
> > Hi all,
> >
> > This evening I completed the necessary setup required to complete our
> Gitlab CI dashboards, which can now be found at
> https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer
> account login required)
> >
> > These allow any developer to get a view on the current CI status of
> projects and groups of projects on a branch and platform basis - and should
> hopefully provide useful insight into the overall status that can currently
> be obtained from Jenkins.
> >
> > As this was the last thing holding us back from shutting down
> build.kde.org, i'd like to proceed with retiring and shutting down
> build.kde.org as soon as possible so the capacity it occupies can be
> released and reallocated to Gitlab.
> >
> > If anyone would like to experiment with customised views for their own
> purposes (where the above provided ones are insufficient) please file a
> Sysadmin ticket.
> >
> > Please let me know if there are any questions on the above.
> >
> > Thanks,
> > Ben
>

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Gilles Caulier]

Hi Ben,

With build/binary-factory , it was possible to get an Embeddable Build
Status Icon as this one :

https://binary-factory.kde.org/view/AppImage/job/Digikam_Nightly_appimage-centos7/badge/

Does this feature still exist with Gitlab infrastructure ?

Thanks

Gilles

Le sam. 27 août 2022 à 11:45, Ben Cooksley  a écrit :
>
> Hi all,
>
> This evening I completed the necessary setup required to complete our Gitlab 
> CI dashboards, which can now be found at 
> https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer 
> account login required)
>
> These allow any developer to get a view on the current CI status of projects 
> and groups of projects on a branch and platform basis - and should hopefully 
> provide useful insight into the overall status that can currently be obtained 
> from Jenkins.
>
> As this was the last thing holding us back from shutting down build.kde.org, 
> i'd like to proceed with retiring and shutting down build.kde.org as soon as 
> possible so the capacity it occupies can be released and reallocated to 
> Gitlab.
>
> If anyone would like to experiment with customised views for their own 
> purposes (where the above provided ones are insufficient) please file a 
> Sysadmin ticket.
>
> Please let me know if there are any questions on the above.
>
> Thanks,
> Ben

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Ben Cooksley]

On Sun, Sep 4, 2022 at 7:54 AM Johnny Jazeix  wrote:

>
>
> Le sam. 3 sept. 2022 à 21:28, Ben Cooksley  a écrit :
>
>> On Sat, Sep 3, 2022 at 9:29 PM Gleb Popov <6year...@gmail.com> wrote:
>>
>>> On Sat, Sep 3, 2022 at 7:46 AM Ben Cooksley  wrote:
>>> >
>>> > As previously indicated, I have now shutdown build.kde.org along with
>>> the domain that supported it's version of the CI tooling.
>>> > The repository containing that tooling has now also been archived, and
>>> the former build.kde.org domain has been redirected to metrics.kde.org.
>>> >
>>> > The server which was acting as a builder for build.kde.org will be
>>> rebuilt in the coming days and reallocated to support Gitlab CI workloads.
>>> >
>>> > Thanks,
>>> > Ben
>>>
>>> What should be used instead of binary-factory? How do I transform this
>>> link?
>>>
>>>
>>> https://binary-factory.kde.org/view/Windows%2064-bit/job/Kate_Release_win64/1762/artifact/kate-22.08.0-1762-windows-msvc2019_64-cl.exe
>>
>>
>> At this time the Binary Factory is not impacted by this.
>>
>> Regards,
>> Ben
>>
>
> Hi,
>
> I think the issue mentioned by Glen is that this link (and all other
> artifacts from binary-factory) is redirected to
> https://build-artifacts.kde.org/binary-factory/Kate_Release_win64/1762/kate-22.08.0-1762-windows-msvc2019_64-cl.exe
> which does not exist.
>

Oops. That is an oversight on my part - apologies - and has now been
corrected (although the URLs will have changed)

Cheers,
Ben


>
>
> Cheers,
> Johnny
>

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Johnny Jazeix]

Le sam. 3 sept. 2022 à 21:28, Ben Cooksley  a écrit :

> On Sat, Sep 3, 2022 at 9:29 PM Gleb Popov <6year...@gmail.com> wrote:
>
>> On Sat, Sep 3, 2022 at 7:46 AM Ben Cooksley  wrote:
>> >
>> > As previously indicated, I have now shutdown build.kde.org along with
>> the domain that supported it's version of the CI tooling.
>> > The repository containing that tooling has now also been archived, and
>> the former build.kde.org domain has been redirected to metrics.kde.org.
>> >
>> > The server which was acting as a builder for build.kde.org will be
>> rebuilt in the coming days and reallocated to support Gitlab CI workloads.
>> >
>> > Thanks,
>> > Ben
>>
>> What should be used instead of binary-factory? How do I transform this
>> link?
>>
>>
>> https://binary-factory.kde.org/view/Windows%2064-bit/job/Kate_Release_win64/1762/artifact/kate-22.08.0-1762-windows-msvc2019_64-cl.exe
>
>
> At this time the Binary Factory is not impacted by this.
>
> Regards,
> Ben
>

Hi,

I think the issue mentioned by Glen is that this link (and all other
artifacts from binary-factory) is redirected to
https://build-artifacts.kde.org/binary-factory/Kate_Release_win64/1762/kate-22.08.0-1762-windows-msvc2019_64-cl.exe
which does not exist.

Cheers,
Johnny

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Ben Cooksley]

On Sun, Sep 4, 2022 at 2:13 AM Michael Reeves  wrote:

> I now have no way to even test macosx builds for kdiff3, I have no access
> to a 64bit Intel mac. What are the plans for this and Windows
> builds. I have a functional windows based craft installed locally.
>

At this time the Binary Factory is unaffected by these changes, however
steps will be made in the coming weeks/months to migrate away from the
Binary Factory to equivalent Gitlab jobs (although they won't be available
for Merge Requests due to various technical limitations)

Regards,
Ben


>
>
> Sep 3, 2022 12:47:06 AM Ben Cooksley :
>
> On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley  wrote:
>
>> Hi all,
>>
>> This evening I completed the necessary setup required to complete our
>> Gitlab CI dashboards, which can now be found at
>> https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer
>> account login required)
>>
>> These allow any developer to get a view on the current CI status of
>> projects and groups of projects on a branch and platform basis - and should
>> hopefully provide useful insight into the overall status that can currently
>> be obtained from Jenkins.
>>
>> As this was the last thing holding us back from shutting down
>> build.kde.org, i'd like to proceed with retiring and shutting down
>> build.kde.org as soon as possible so the capacity it occupies can be
>> released and reallocated to Gitlab.
>>
>
> As previously indicated, I have now shutdown build.kde.org along with the
> domain that supported it's version of the CI tooling.
> The repository containing that tooling has now also been archived, and the
> former build.kde.org domain has been redirected to metrics.kde.org.
>
> The server which was acting as a builder for build.kde.org will be
> rebuilt in the coming days and reallocated to support Gitlab CI workloads.
>
>
>>
>> If anyone would like to experiment with customised views for their own
>> purposes (where the above provided ones are insufficient) please file a
>> Sysadmin ticket.
>>
>> Please let me know if there are any questions on the above.
>>
>> Thanks,
>> Ben
>>
>
> Thanks,
> Ben
>
>

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Ben Cooksley]

On Sat, Sep 3, 2022 at 9:29 PM Gleb Popov <6year...@gmail.com> wrote:

> On Sat, Sep 3, 2022 at 7:46 AM Ben Cooksley  wrote:
> >
> > As previously indicated, I have now shutdown build.kde.org along with
> the domain that supported it's version of the CI tooling.
> > The repository containing that tooling has now also been archived, and
> the former build.kde.org domain has been redirected to metrics.kde.org.
> >
> > The server which was acting as a builder for build.kde.org will be
> rebuilt in the coming days and reallocated to support Gitlab CI workloads.
> >
> > Thanks,
> > Ben
>
> What should be used instead of binary-factory? How do I transform this
> link?
>
>
> https://binary-factory.kde.org/view/Windows%2064-bit/job/Kate_Release_win64/1762/artifact/kate-22.08.0-1762-windows-msvc2019_64-cl.exe


At this time the Binary Factory is not impacted by this.

Regards,
Ben

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Nicolas Fella]

Only build.kde.org is shut down, binary-factory.kde.org is unaffected

On 9/3/22 16:12, Michael Reeves wrote:

I now have no way to even test macosx builds for kdiff3, I have no
access to a 64bit Intel mac. What are the plans for this and Windows
builds. I have a functional windows based craft installed locally.

Sep 3, 2022 12:47:06 AM Ben Cooksley :

On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley 
wrote:

Hi all,

This evening I completed the necessary setup required to
complete our Gitlab CI dashboards, which can now be found at
https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE
Developer account login required)

These allow any developer to get a view on the current CI
status of projects and groups of projects on a branch and
platform basis - and should hopefully provide useful insight
into the overall status that can currently be obtained from
Jenkins.

As this was the last thing holding us back from shutting down
build.kde.org , i'd like to proceed with
retiring and shutting down build.kde.org
 as soon as possible so the capacity it
occupies can be released and reallocated to Gitlab.


As previously indicated, I have now shutdown build.kde.org
 along with the domain that supported it's
version of the CI tooling.
The repository containing that tooling has now also been archived,
and the former build.kde.org  domain has
been redirected to metrics.kde.org .

The server which was acting as a builder for build.kde.org
 will be rebuilt in the coming days and
reallocated to support Gitlab CI workloads.


If anyone would like to experiment with customised views for
their own purposes (where the above provided ones are
insufficient) please file a Sysadmin ticket.

Please let me know if there are any questions on the above.

Thanks,
Ben


Thanks,
Ben

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Michael Reeves]

I now have no way to even test macosx builds for kdiff3, I have no access to a 
64bit Intel mac. What are the plans for this and Windows
builds. I have a functional windows based craft installed locally.

Sep 3, 2022 12:47:06 AM Ben Cooksley :

> On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley  wrote:
>> Hi all,
>> 
>> This evening I completed the necessary setup required to complete our Gitlab 
>> CI dashboards, which can now be found at 
>> https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer 
>> account login required)
>> 
>> These allow any developer to get a view on the current CI status of projects 
>> and groups of projects on a branch and platform basis - and should hopefully 
>> provide useful insight into the overall status that can currently be 
>> obtained from Jenkins.
>> 
>> As this was the last thing holding us back from shutting down 
>> build.kde.org[http://build.kde.org], i'd like to proceed with retiring and 
>> shutting down build.kde.org[http://build.kde.org] as soon as possible so the 
>> capacity it occupies can be released and reallocated to Gitlab.
> 
> As previously indicated, I have now shutdown 
> build.kde.org[http://build.kde.org] along with the domain that supported it's 
> version of the CI tooling.
> The repository containing that tooling has now also been archived, and the 
> former build.kde.org[http://build.kde.org] domain has been redirected to 
> metrics.kde.org[http://metrics.kde.org].
> 
> The server which was acting as a builder for 
> build.kde.org[http://build.kde.org] will be rebuilt in the coming days and 
> reallocated to support Gitlab CI workloads.
>  
>> 
>> If anyone would like to experiment with customised views for their own 
>> purposes (where the above provided ones are insufficient) please file a 
>> Sysadmin ticket.
>> 
>> Please let me know if there are any questions on the above.
>> 
>> Thanks,
>> Ben
> 
> Thanks,
> Ben 


signature.asc
Description: PGP signature

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Gleb Popov]

On Sat, Sep 3, 2022 at 7:46 AM Ben Cooksley  wrote:
>
> As previously indicated, I have now shutdown build.kde.org along with the 
> domain that supported it's version of the CI tooling.
> The repository containing that tooling has now also been archived, and the 
> former build.kde.org domain has been redirected to metrics.kde.org.
>
> The server which was acting as a builder for build.kde.org will be rebuilt in 
> the coming days and reallocated to support Gitlab CI workloads.
>
> Thanks,
> Ben

What should be used instead of binary-factory? How do I transform this link?

https://binary-factory.kde.org/view/Windows%2064-bit/job/Kate_Release_win64/1762/artifact/kate-22.08.0-1762-windows-msvc2019_64-cl.exe

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Ben Cooksley]

On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley  wrote:

> Hi all,
>
> This evening I completed the necessary setup required to complete our
> Gitlab CI dashboards, which can now be found at
> https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer
> account login required)
>
> These allow any developer to get a view on the current CI status of
> projects and groups of projects on a branch and platform basis - and should
> hopefully provide useful insight into the overall status that can currently
> be obtained from Jenkins.
>
> As this was the last thing holding us back from shutting down
> build.kde.org, i'd like to proceed with retiring and shutting down
> build.kde.org as soon as possible so the capacity it occupies can be
> released and reallocated to Gitlab.
>

As previously indicated, I have now shutdown build.kde.org along with the
domain that supported it's version of the CI tooling.
The repository containing that tooling has now also been archived, and the
former build.kde.org domain has been redirected to metrics.kde.org.

The server which was acting as a builder for build.kde.org will be rebuilt
in the coming days and reallocated to support Gitlab CI workloads.


>
> If anyone would like to experiment with customised views for their own
> purposes (where the above provided ones are insufficient) please file a
> Sysadmin ticket.
>
> Please let me know if there are any questions on the above.
>
> Thanks,
> Ben
>

Thanks,
Ben

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Ben Cooksley]

On Sun, Aug 28, 2022 at 4:40 AM Albert Astals Cid  wrote:

> El dissabte, 27 d’agost de 2022, a les 11:44:47 (CEST), Ben Cooksley va
> escriure:
> > Hi all,
> >
> > This evening I completed the necessary setup required to complete our
> > Gitlab CI dashboards, which can now be found at
> > https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer
> > account login required)
> >
> > These allow any developer to get a view on the current CI status of
> > projects and groups of projects on a branch and platform basis - and
> should
> > hopefully provide useful insight into the overall status that can
> currently
> > be obtained from Jenkins.
> >
> > As this was the last thing holding us back from shutting down
> build.kde.org,
> > i'd like to proceed with retiring and shutting down build.kde.org as
> soon
> > as possible so the capacity it occupies can be released and reallocated
> to
> > Gitlab.
> >
> > If anyone would like to experiment with customised views for their own
> > purposes (where the above provided ones are insufficient) please file a
> > Sysadmin ticket.
> >
> > Please let me know if there are any questions on the above.
>
> Looks great.
>

Yay!


>
> One thing that i'm not sure i understand correctly, currently in the
> General
> Overview, it says that there are 3 projects currently failing kwin,
> kpackage
> and kphotoalbum, but then if i go to the Per Platform View i get that
> rkward
> is failing on windows. Shouldn't rkward also be listed as failing on the
> general overview?
>

That is a rather curious bug, caused by the fact it was looking at things
on a Pipeline vs. Job basis.

The query you were looking at was looking at the list of most recent
pipeline runs on a per project basis, which in the case of rkward means the
last push by scripty - which was skipped (so not a failure).
I've tweaked the query to look at things on a per job basis now, which
skips over that issue.


>
> Cheers,
>   Albert
>

Cheers,
Ben


>
> >
> > Thanks,
> > Ben
>
>
>
>
>

Re: Gitlab CI Dashboards and retirement of build.kde.org

[Albert Astals Cid]

El dissabte, 27 d’agost de 2022, a les 11:44:47 (CEST), Ben Cooksley va 
escriure:
> Hi all,
> 
> This evening I completed the necessary setup required to complete our
> Gitlab CI dashboards, which can now be found at
> https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer
> account login required)
> 
> These allow any developer to get a view on the current CI status of
> projects and groups of projects on a branch and platform basis - and should
> hopefully provide useful insight into the overall status that can currently
> be obtained from Jenkins.
> 
> As this was the last thing holding us back from shutting down build.kde.org,
> i'd like to proceed with retiring and shutting down build.kde.org as soon
> as possible so the capacity it occupies can be released and reallocated to
> Gitlab.
> 
> If anyone would like to experiment with customised views for their own
> purposes (where the above provided ones are insufficient) please file a
> Sysadmin ticket.
> 
> Please let me know if there are any questions on the above.

Looks great.

One thing that i'm not sure i understand correctly, currently in the General 
Overview, it says that there are 3 projects currently failing kwin, kpackage 
and kphotoalbum, but then if i go to the Per Platform View i get that rkward 
is failing on windows. Shouldn't rkward also be listed as failing on the 
general overview?

Cheers,
  Albert

> 
> Thanks,
> Ben

Gitlab CI Dashboards and retirement of build.kde.org

[Ben Cooksley]

Hi all,

This evening I completed the necessary setup required to complete our
Gitlab CI dashboards, which can now be found at
https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer
account login required)

These allow any developer to get a view on the current CI status of
projects and groups of projects on a branch and platform basis - and should
hopefully provide useful insight into the overall status that can currently
be obtained from Jenkins.

As this was the last thing holding us back from shutting down build.kde.org,
i'd like to proceed with retiring and shutting down build.kde.org as soon
as possible so the capacity it occupies can be released and reallocated to
Gitlab.

If anyone would like to experiment with customised views for their own
purposes (where the above provided ones are insufficient) please file a
Sysadmin ticket.

Please let me know if there are any questions on the above.

Thanks,
Ben