Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Karl Tomlinson]

> Could the lack of failure emails be specific to taskcluster jobs?

https://bugzilla.mozilla.org/show_bug.cgi?id=1275774
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Lawrence Mandel]

On Fri, May 20, 2016 at 11:27 AM, Nathan Froyd  wrote:

> On Fri, May 20, 2016 at 11:18 AM, Armen Zambrano G. 
> wrote:
> > On 2016-05-19 08:29 PM, Mike Hommey wrote:
> >> It's also not possible to *trigger* new TC jobs on treeherder ; like,
> >> pushing with no try syntax and filling what you want with "Add new
> >> jobs". Or using "Add new job" after realizing you forgot a job in your
> >> try syntax.
> >
> > martianwars is working on it:
> > https://bugzilla.mozilla.org/show_bug.cgi?id=1254325
> >
> > I believe we should have it by the end of June.
>
> Why are we moving to a new system when it's lacking user-facing
> functionality that the old system had (T pushes on try comes to mind
> also, but I believe that's been fixed...perhaps there are others,
> too)?  I can believe taskcluster-based jobs bring a whole host of
> benefits (having things in-tree seems fantastic, for one), but it's
> hard to understand the enthusiasm for pushing forward when we have
> useful features disappearing.
>
>
There will be some pain with this port and we're going to break some things
unintentionally and possibly some thing intentionally. I apologize for the
inconvenience, promise that we'll do our best to keep the irritations to a
minimum, and ask for your help in flagging issues that come up so that we
can get the system into a good state.

Thank you to everyone who has already provided feedback in this thread.

Lawrence
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Dustin Mitchell]

> BTW, starting yesterday, there was a "TaskClusterRobot" comment on my m-i
> push on GitHub with message "TaskCluster: @upsuper does not have permission
> to trigger tasks." [1][2]

This was due to an unfortunate interaction of the mirroring of gecko
to github, and the taskcluster-github component, which tried to run
it.  We've since fixed tc-github to ignore github pushes without any
github-specific configuration, so this is no longer an issue.

Please do file bugs for any remaining issues -- comments are easily
missed or forgotten on a mailing list.

Dustin
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Nathan Froyd]

On Fri, May 20, 2016 at 11:18 AM, Armen Zambrano G.  wrote:
> On 2016-05-19 08:29 PM, Mike Hommey wrote:
>> It's also not possible to *trigger* new TC jobs on treeherder ; like,
>> pushing with no try syntax and filling what you want with "Add new
>> jobs". Or using "Add new job" after realizing you forgot a job in your
>> try syntax.
>
> martianwars is working on it:
> https://bugzilla.mozilla.org/show_bug.cgi?id=1254325
>
> I believe we should have it by the end of June.

Why are we moving to a new system when it's lacking user-facing
functionality that the old system had (T pushes on try comes to mind
also, but I believe that's been fixed...perhaps there are others,
too)?  I can believe taskcluster-based jobs bring a whole host of
benefits (having things in-tree seems fantastic, for one), but it's
hard to understand the enthusiasm for pushing forward when we have
useful features disappearing.

Thanks,
-Nathan
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Armen Zambrano G.]

On 2016-05-19 08:29 PM, Mike Hommey wrote:

On Thu, May 19, 2016 at 07:20:30PM -0500, J. Ryan Stinnett wrote:

On Thu, May 19, 2016 at 6:24 PM, Xidorn Quan  wrote:

2. I cannot retrigger any TC task.

This is pretty annoying when I was debugging intermittent issues. Hopefully
they could get fix before we migrate all Linux builds to TaskCluster,
otherwise we will lose the ability to debug certain kinds of bugs with
Linux builds.


Other people have also mentioned that they can't retrigger these TC
tasks, so this part sounds accurate. Bug 1274176 was filed recently
about this. I hope it will be prioritized, I agree it's frustrating
when working on intermittents.


It's also not possible to *trigger* new TC jobs on treeherder ; like,
pushing with no try syntax and filling what you want with "Add new
jobs". Or using "Add new job" after realizing you forgot a job in your
try syntax.

Mike



martianwars is working on it:
https://bugzilla.mozilla.org/show_bug.cgi?id=1254325

I believe we should have it by the end of June.

--
Zambrano Gasparnian, Armen
Automation & Tools Engineer
http://armenzg.blogspot.ca
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Amy Rich]

On 19 May 2016, at 18:16, Selena Deckelmann wrote:

Closing out this thread - we made Linux 64 Debug builds Tier 1 
mid-April,

and last week we turned off the related buildbot jobs.


This is a fantastic, and incredibly important, milestone! 
Congratulations to everyone who's put so much work into this. I'm 
eagerly anticipating the long list of improvements we'll experience as 
we migrate our other platforms off of our legacy buildbot system.

___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Karl Tomlinson]

Could the lack of failure emails be specific to taskcluster jobs?

https://treeherder.mozilla.org/#/jobs?repo=try=a8c6ab15dd8f
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Gregory Arndt]

Retriggering was unintentionally broke earlier this week. We will be
making it a priority to fix this.

I'm sorry that it has caused a great deal of frustration and soon
we'll have it back!

-Greg

> On May 19, 2016, at 7:21 PM, J. Ryan Stinnett  wrote:
>
>> On Thu, May 19, 2016 at 6:24 PM, Xidorn Quan  wrote:
>> 2. I cannot retrigger any TC task.
>>
>> This is pretty annoying when I was debugging intermittent issues. Hopefully
>> they could get fix before we migrate all Linux builds to TaskCluster,
>> otherwise we will lose the ability to debug certain kinds of bugs with
>> Linux builds.
>
> Other people have also mentioned that they can't retrigger these TC
> tasks, so this part sounds accurate. Bug 1274176 was filed recently
> about this. I hope it will be prioritized, I agree it's frustrating
> when working on intermittents.
>
> - Ryan
> ___
> tools-taskcluster mailing list
> tools-taskclus...@lists.mozilla.org
> https://lists.mozilla.org/listinfo/tools-taskcluster
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Mike Hommey]

On Thu, May 19, 2016 at 07:20:30PM -0500, J. Ryan Stinnett wrote:
> On Thu, May 19, 2016 at 6:24 PM, Xidorn Quan  wrote:
> > 2. I cannot retrigger any TC task.
> >
> > This is pretty annoying when I was debugging intermittent issues. Hopefully
> > they could get fix before we migrate all Linux builds to TaskCluster,
> > otherwise we will lose the ability to debug certain kinds of bugs with
> > Linux builds.
> 
> Other people have also mentioned that they can't retrigger these TC
> tasks, so this part sounds accurate. Bug 1274176 was filed recently
> about this. I hope it will be prioritized, I agree it's frustrating
> when working on intermittents.

It's also not possible to *trigger* new TC jobs on treeherder ; like,
pushing with no try syntax and filling what you want with "Add new
jobs". Or using "Add new job" after realizing you forgot a job in your
try syntax.

Mike
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Xidorn Quan]

On Fri, May 20, 2016 at 10:20 AM, J. Ryan Stinnett  wrote:

> On Thu, May 19, 2016 at 6:24 PM, Xidorn Quan 
> wrote:
> > 2. I cannot retrigger any TC task.
> >
> > This is pretty annoying when I was debugging intermittent issues.
> Hopefully
> > they could get fix before we migrate all Linux builds to TaskCluster,
> > otherwise we will lose the ability to debug certain kinds of bugs with
> > Linux builds.
>
> Other people have also mentioned that they can't retrigger these TC
> tasks, so this part sounds accurate. Bug 1274176 was filed recently
> about this. I hope it will be prioritized, I agree it's frustrating
> when working on intermittents.


Oh, and forgot to mention, TC jobs are not triggerable via the "Add new
Jobs" menu, either.

- Xidorn
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[J. Ryan Stinnett]

On Thu, May 19, 2016 at 6:24 PM, Xidorn Quan  wrote:
> 2. I cannot retrigger any TC task.
>
> This is pretty annoying when I was debugging intermittent issues. Hopefully
> they could get fix before we migrate all Linux builds to TaskCluster,
> otherwise we will lose the ability to debug certain kinds of bugs with
> Linux builds.

Other people have also mentioned that they can't retrigger these TC
tasks, so this part sounds accurate. Bug 1274176 was filed recently
about this. I hope it will be prioritized, I agree it's frustrating
when working on intermittents.

- Ryan
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Xidorn Quan]

On Fri, May 20, 2016 at 8:16 AM, Selena Deckelmann 
wrote:

> Closing out this thread - we made Linux 64 Debug builds Tier 1 mid-April,
> and last week we turned off the related buildbot jobs.
>
> All Linux 64 Debug builds and tests now happen exclusively in TaskCluster!
>
> Thank you all the teams and individuals that contributed to getting this
> done! We NI'd quite a few people throughout Platform on test and build
> system errors, and we appreciated all of the attention and help.
>
> *Project update:*
> We're now working steadily toward getting all remaining Linux builds and
> tests into TaskCluster and to Tier 2, and Windows builds to Tier 2 in
> TaskCluster by the end of the quarter. We're also alpha testing OS X tests
> on data center hardware using TC workers.
>
> We've also started supporting a few smaller projects, in addition to a few
> groups that have migrated their builds and tests to TaskCluster. Those
> projects are still at an experimental level of support, but we're open to
> discussing support with any teams interested in building with us. We're
> primarily able to support pushes to try and Github users "out of the box."
>
> We've got a dashboard to track progress under development that we'll share
> with everyone at London.
>
> Meanwhile, the project team meets weekly on Thursdays and keeps an updated
> Trello board here: https://trello.com/b/asIJ2pGC/taskcluster-migration
>
> Questions? Please get in touch! irc:selenamarie or email or schedule a
> meeting.
>

BTW, starting yesterday, there was a "TaskClusterRobot" comment on my m-i
push on GitHub with message "TaskCluster: @upsuper does not have permission
to trigger tasks." [1][2]

I have no idea what it is talking...

[1]
https://github.com/mozilla/gecko-dev/commit/744f2efb4ac3f8502ae2f26a22831d23b7975657#commitcomment-17533456
[2]
https://github.com/mozilla/gecko-dev/commit/d076cfb56121cb6190a7aedafdd5c3e756d9d819#commitcomment-17537620

- Xidorn
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Xidorn Quan]

On Fri, May 20, 2016 at 9:36 AM, Gregory Szorc  wrote:

> On Thu, May 19, 2016 at 4:24 PM, Xidorn Quan 
> wrote:
>
>> On Fri, May 20, 2016 at 8:16 AM, Selena Deckelmann 
>> wrote:
>>
>> > Closing out this thread - we made Linux 64 Debug builds Tier 1
>> mid-April,
>> > and last week we turned off the related buildbot jobs.
>> >
>> > All Linux 64 Debug builds and tests now happen exclusively in
>> TaskCluster!
>> >
>> > Thank you all the teams and individuals that contributed to getting this
>> > done! We NI'd quite a few people throughout Platform on test and build
>> > system errors, and we appreciated all of the attention and help.
>> >
>> > *Project update:*
>> > We're now working steadily toward getting all remaining Linux builds and
>> > tests into TaskCluster and to Tier 2, and Windows builds to Tier 2 in
>> > TaskCluster by the end of the quarter. We're also alpha testing OS X
>> tests
>> > on data center hardware using TC workers.
>> >
>> > We've also started supporting a few smaller projects, in addition to a
>> few
>> > groups that have migrated their builds and tests to TaskCluster. Those
>> > projects are still at an experimental level of support, but we're open
>> to
>> > discussing support with any teams interested in building with us. We're
>> > primarily able to support pushes to try and Github users "out of the
>> box."
>> >
>> > We've got a dashboard to track progress under development that we'll
>> share
>> > with everyone at London.
>> >
>> > Meanwhile, the project team meets weekly on Thursdays and keeps an
>> updated
>> > Trello board here: https://trello.com/b/asIJ2pGC/taskcluster-migration
>> >
>> > Questions? Please get in touch! irc:selenamarie or email or schedule a
>> > meeting.
>>
>>
>> There are several issues with TC:
>> 1. Try syntax cannot control TC tasks,
>> 2. I cannot retrigger any TC task.
>>
>
> I've seen the TC code for parsing Try syntax and deriving scheduling from
> it. And I've retriggered TC tasks from Treeherder. I reckon you are hitting
> a bug or your claim is outdated.
>

I think I saw those issues several days ago... Actually 3 days ago. So
there is an example:
https://treeherder.mozilla.org/#/jobs?repo=try=e41281966765

You can see that tc-M and tc-M-e10s on Linux x64 opt and debug has far more
tests than others.

I didn't try retriggering the tc tasks here, though, because I could not
find the test I needed to retrigger. You can see that all buildbot jobs I
retriggered there had test_pointerlock-api.html run, but I could not find
that test in log of any of the tc jobs. I have no idea why. This is another
issue I forgot to mention.

For retriggering, I just found it yesterday with this try push:
https://treeherder.mozilla.org/#/jobs?repo=try=05f8b545cb23

I was debugging an failure on tc-M(c3), but I could not retrigger that task
at all in this push.

So I don't think the claim is outdated...

- Xidorn
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Gregory Szorc]

On Thu, May 19, 2016 at 4:24 PM, Xidorn Quan  wrote:

> On Fri, May 20, 2016 at 8:16 AM, Selena Deckelmann 
> wrote:
>
> > Closing out this thread - we made Linux 64 Debug builds Tier 1 mid-April,
> > and last week we turned off the related buildbot jobs.
> >
> > All Linux 64 Debug builds and tests now happen exclusively in
> TaskCluster!
> >
> > Thank you all the teams and individuals that contributed to getting this
> > done! We NI'd quite a few people throughout Platform on test and build
> > system errors, and we appreciated all of the attention and help.
> >
> > *Project update:*
> > We're now working steadily toward getting all remaining Linux builds and
> > tests into TaskCluster and to Tier 2, and Windows builds to Tier 2 in
> > TaskCluster by the end of the quarter. We're also alpha testing OS X
> tests
> > on data center hardware using TC workers.
> >
> > We've also started supporting a few smaller projects, in addition to a
> few
> > groups that have migrated their builds and tests to TaskCluster. Those
> > projects are still at an experimental level of support, but we're open to
> > discussing support with any teams interested in building with us. We're
> > primarily able to support pushes to try and Github users "out of the
> box."
> >
> > We've got a dashboard to track progress under development that we'll
> share
> > with everyone at London.
> >
> > Meanwhile, the project team meets weekly on Thursdays and keeps an
> updated
> > Trello board here: https://trello.com/b/asIJ2pGC/taskcluster-migration
> >
> > Questions? Please get in touch! irc:selenamarie or email or schedule a
> > meeting.
>
>
> There are several issues with TC:
> 1. Try syntax cannot control TC tasks,
> 2. I cannot retrigger any TC task.
>

I've seen the TC code for parsing Try syntax and deriving scheduling from
it. And I've retriggered TC tasks from Treeherder. I reckon you are hitting
a bug or your claim is outdated.
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Xidorn Quan]

On Fri, May 20, 2016 at 8:16 AM, Selena Deckelmann 
wrote:

> Closing out this thread - we made Linux 64 Debug builds Tier 1 mid-April,
> and last week we turned off the related buildbot jobs.
>
> All Linux 64 Debug builds and tests now happen exclusively in TaskCluster!
>
> Thank you all the teams and individuals that contributed to getting this
> done! We NI'd quite a few people throughout Platform on test and build
> system errors, and we appreciated all of the attention and help.
>
> *Project update:*
> We're now working steadily toward getting all remaining Linux builds and
> tests into TaskCluster and to Tier 2, and Windows builds to Tier 2 in
> TaskCluster by the end of the quarter. We're also alpha testing OS X tests
> on data center hardware using TC workers.
>
> We've also started supporting a few smaller projects, in addition to a few
> groups that have migrated their builds and tests to TaskCluster. Those
> projects are still at an experimental level of support, but we're open to
> discussing support with any teams interested in building with us. We're
> primarily able to support pushes to try and Github users "out of the box."
>
> We've got a dashboard to track progress under development that we'll share
> with everyone at London.
>
> Meanwhile, the project team meets weekly on Thursdays and keeps an updated
> Trello board here: https://trello.com/b/asIJ2pGC/taskcluster-migration
>
> Questions? Please get in touch! irc:selenamarie or email or schedule a
> meeting.


There are several issues with TC:
1. Try syntax cannot control TC tasks,
2. I cannot retrigger any TC task.

This is pretty annoying when I was debugging intermittent issues. Hopefully
they could get fix before we migrate all Linux builds to TaskCluster,
otherwise we will lose the ability to debug certain kinds of bugs with
Linux builds.

- Xidorn
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Selena Deckelmann]

Closing out this thread - we made Linux 64 Debug builds Tier 1 mid-April,
and last week we turned off the related buildbot jobs.

All Linux 64 Debug builds and tests now happen exclusively in TaskCluster!

Thank you all the teams and individuals that contributed to getting this
done! We NI'd quite a few people throughout Platform on test and build
system errors, and we appreciated all of the attention and help.

*Project update:*
We're now working steadily toward getting all remaining Linux builds and
tests into TaskCluster and to Tier 2, and Windows builds to Tier 2 in
TaskCluster by the end of the quarter. We're also alpha testing OS X tests
on data center hardware using TC workers.

We've also started supporting a few smaller projects, in addition to a few
groups that have migrated their builds and tests to TaskCluster. Those
projects are still at an experimental level of support, but we're open to
discussing support with any teams interested in building with us. We're
primarily able to support pushes to try and Github users "out of the box."

We've got a dashboard to track progress under development that we'll share
with everyone at London.

Meanwhile, the project team meets weekly on Thursdays and keeps an updated
Trello board here: https://trello.com/b/asIJ2pGC/taskcluster-migration

Questions? Please get in touch! irc:selenamarie or email or schedule a
meeting.

-selena

On Fri, Mar 18, 2016 at 3:05 PM Selena Deckelmann 
wrote:

> The two outstanding bugs are closed!
>
> We have one bug remaining that we are tracking related to metrics. I've
> consulted the owners of that issue and they've agreed that it is ok if that
> work lands shortly after we switch to Tier 1 for Linux Debug builds.
>
> We're now planning to switch TC builds to Tier 1 on March 23. Next email
> should be notification that the switch is complete.
>
> Thank you for your patience!
>
> -selena
>
>
>
>
> On Mon, Mar 14, 2016 at 2:41 PM Selena Deckelmann 
> wrote:
>
>> We've got two outstanding bugs (
>> https://bugzilla.mozilla.org/show_bug.cgi?id=1231320 and
>> https://bugzilla.mozilla.org/show_bug.cgi?id=1174263), and so are
>> postponing this for at least a week. I will give an update this Friday if
>> we're able to set a date for the switch over.
>>
>> Sorry for the noise!
>>
>> -selena
>>
>>
>> On Tue, Mar 8, 2016 at 2:06 PM Selena Deckelmann 
>> wrote:
>>
>>> The time has come! We are planning to switch to Tier-1 on Treeherder for
>>> TaskCluster Linux 64 Debug build jobs on March 14. At the same time, we
>>> will hide the Buildbot build jobs, but continue running them.
>>>
>>> On March 21, we plan to switch the Linux 64 Debug tests to Tier-1 and
>>> hide the related Buildbot test jobs.
>>>
>>> After about 30 days, we plan to disable and remove all Buildbot jobs
>>> related to Linux Debug.
>>>
>>>
>>>
>>> Background:
>>>
>>> We've been running Linux 64 Debug builds and tests using TaskCluster
>>> side-by-side with Buildbot jobs since February 18th. Some of the project
>>> work that was done to green up the tests is documented here:
>>> https://public.etherpad-mozilla.org/p/buildbot-to-taskcluster-migration
>>>
>>> The new tests are running in Docker-ized environments, and the Docker
>>> images we use are defined in-tree and publicly accessible.
>>>
>>> This work was the culmination of many months of effort, with Joel Maher,
>>> Dustin Mitchell and Armen Zambrano primarily focused on test migration this
>>> quarter. Thank you to everyone who responded to NEEDINFOs, emails and pings
>>> on IRC to help with untangling busted test runs.
>>>
>>> On performance, we're taking a 14% hit across all the new test jobs vs.
>>> the old jobs in Buildbot. We ran two large-scale tests to help determine
>>> where slowness might still be lurking, and were able to find and fix many
>>> issues. There are a handful of jobs remaining that seem significantly
>>> slower, while others are significantly faster.  We decided that it was more
>>> important to deprecate the old jobs and start exclusively maintaining the
>>> new jobs now, rather than wait to resolve the remaining performance issues.
>>> Over time we hope to address issues with the owners of the affected test
>>> suites.
>>>
>>
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Selena Deckelmann]

The two outstanding bugs are closed!

We have one bug remaining that we are tracking related to metrics. I've
consulted the owners of that issue and they've agreed that it is ok if that
work lands shortly after we switch to Tier 1 for Linux Debug builds.

We're now planning to switch TC builds to Tier 1 on March 23. Next email
should be notification that the switch is complete.

Thank you for your patience!

-selena



On Mon, Mar 14, 2016 at 2:41 PM Selena Deckelmann 
wrote:

> We've got two outstanding bugs (
> https://bugzilla.mozilla.org/show_bug.cgi?id=1231320 and
> https://bugzilla.mozilla.org/show_bug.cgi?id=1174263), and so are
> postponing this for at least a week. I will give an update this Friday if
> we're able to set a date for the switch over.
>
> Sorry for the noise!
>
> -selena
>
>
> On Tue, Mar 8, 2016 at 2:06 PM Selena Deckelmann 
> wrote:
>
>> The time has come! We are planning to switch to Tier-1 on Treeherder for
>> TaskCluster Linux 64 Debug build jobs on March 14. At the same time, we
>> will hide the Buildbot build jobs, but continue running them.
>>
>> On March 21, we plan to switch the Linux 64 Debug tests to Tier-1 and
>> hide the related Buildbot test jobs.
>>
>> After about 30 days, we plan to disable and remove all Buildbot jobs
>> related to Linux Debug.
>>
>>
>>
>> Background:
>>
>> We've been running Linux 64 Debug builds and tests using TaskCluster
>> side-by-side with Buildbot jobs since February 18th. Some of the project
>> work that was done to green up the tests is documented here:
>> https://public.etherpad-mozilla.org/p/buildbot-to-taskcluster-migration
>>
>> The new tests are running in Docker-ized environments, and the Docker
>> images we use are defined in-tree and publicly accessible.
>>
>> This work was the culmination of many months of effort, with Joel Maher,
>> Dustin Mitchell and Armen Zambrano primarily focused on test migration this
>> quarter. Thank you to everyone who responded to NEEDINFOs, emails and pings
>> on IRC to help with untangling busted test runs.
>>
>> On performance, we're taking a 14% hit across all the new test jobs vs.
>> the old jobs in Buildbot. We ran two large-scale tests to help determine
>> where slowness might still be lurking, and were able to find and fix many
>> issues. There are a handful of jobs remaining that seem significantly
>> slower, while others are significantly faster.  We decided that it was more
>> important to deprecate the old jobs and start exclusively maintaining the
>> new jobs now, rather than wait to resolve the remaining performance issues.
>> Over time we hope to address issues with the owners of the affected test
>> suites.
>>
>
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Re: Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Selena Deckelmann]

We've got two outstanding bugs (
https://bugzilla.mozilla.org/show_bug.cgi?id=1231320 and
https://bugzilla.mozilla.org/show_bug.cgi?id=1174263), and so are
postponing this for at least a week. I will give an update this Friday if
we're able to set a date for the switch over.

Sorry for the noise!

-selena

On Tue, Mar 8, 2016 at 2:06 PM Selena Deckelmann  wrote:

> The time has come! We are planning to switch to Tier-1 on Treeherder for
> TaskCluster Linux 64 Debug build jobs on March 14. At the same time, we
> will hide the Buildbot build jobs, but continue running them.
>
> On March 21, we plan to switch the Linux 64 Debug tests to Tier-1 and hide
> the related Buildbot test jobs.
>
> After about 30 days, we plan to disable and remove all Buildbot jobs
> related to Linux Debug.
>
>
>
> Background:
>
> We've been running Linux 64 Debug builds and tests using TaskCluster
> side-by-side with Buildbot jobs since February 18th. Some of the project
> work that was done to green up the tests is documented here:
> https://public.etherpad-mozilla.org/p/buildbot-to-taskcluster-migration
>
> The new tests are running in Docker-ized environments, and the Docker
> images we use are defined in-tree and publicly accessible.
>
> This work was the culmination of many months of effort, with Joel Maher,
> Dustin Mitchell and Armen Zambrano primarily focused on test migration this
> quarter. Thank you to everyone who responded to NEEDINFOs, emails and pings
> on IRC to help with untangling busted test runs.
>
> On performance, we're taking a 14% hit across all the new test jobs vs.
> the old jobs in Buildbot. We ran two large-scale tests to help determine
> where slowness might still be lurking, and were able to find and fix many
> issues. There are a handful of jobs remaining that seem significantly
> slower, while others are significantly faster.  We decided that it was more
> important to deprecate the old jobs and start exclusively maintaining the
> new jobs now, rather than wait to resolve the remaining performance issues.
> Over time we hope to address issues with the owners of the affected test
> suites.
>
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Tier-1 for Linux 64 Debug builds in TaskCluster on March 14 (and more!)

[Selena Deckelmann]

The time has come! We are planning to switch to Tier-1 on Treeherder for
TaskCluster Linux 64 Debug build jobs on March 14. At the same time, we
will hide the Buildbot build jobs, but continue running them.

On March 21, we plan to switch the Linux 64 Debug tests to Tier-1 and hide
the related Buildbot test jobs.

After about 30 days, we plan to disable and remove all Buildbot jobs
related to Linux Debug.



Background:

We've been running Linux 64 Debug builds and tests using TaskCluster
side-by-side with Buildbot jobs since February 18th. Some of the project
work that was done to green up the tests is documented here:
https://public.etherpad-mozilla.org/p/buildbot-to-taskcluster-migration

The new tests are running in Docker-ized environments, and the Docker
images we use are defined in-tree and publicly accessible.

This work was the culmination of many months of effort, with Joel Maher,
Dustin Mitchell and Armen Zambrano primarily focused on test migration this
quarter. Thank you to everyone who responded to NEEDINFOs, emails and pings
on IRC to help with untangling busted test runs.

On performance, we're taking a 14% hit across all the new test jobs vs. the
old jobs in Buildbot. We ran two large-scale tests to help determine where
slowness might still be lurking, and were able to find and fix many issues.
There are a handful of jobs remaining that seem significantly slower, while
others are significantly faster.  We decided that it was more important to
deprecate the old jobs and start exclusively maintaining the new jobs now,
rather than wait to resolve the remaining performance issues. Over time we
hope to address issues with the owners of the affected test suites.
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform