Re: To what extent is sccache's distributed compilation usable?

2020-03-13 Thread Nicholas Alexander
On Thu, Mar 12, 2020 at 5:30 PM Marcos Caceres wrote: > On Wednesday, October 30, 2019 at 11:59:45 PM UTC+11, Jeff Muizelaar wrote: > > On Tue, Oct 29, 2019 at 9:45 PM Marcos Caceres > wrote: > > sccache supports doing cross compilation so you don't actually need to > > buy a fast Mac to get

Re: To what extent is sccache's distributed compilation usable?

2020-03-12 Thread Marcos Caceres
On Wednesday, October 30, 2019 at 11:59:45 PM UTC+11, Jeff Muizelaar wrote: > On Tue, Oct 29, 2019 at 9:45 PM Marcos Caceres wrote: > sccache supports doing cross compilation so you don't actually need to > buy a fast Mac to get fast Mac builds. A fast cheap Linux desktop will > get you much

Re: To what extent is sccache's distributed compilation usable?

2019-10-30 Thread Jeff Muizelaar
On Tue, Oct 29, 2019 at 9:45 PM Marcos Caceres wrote: > Thanks Steve... so it does really sound like perhaps just investing in more > individual computing power might be the way to go. I think that's ok... even > if it means, in my own case, personally paying the extra "Apple Tax" for a > Mac

Re: To what extent is sccache's distributed compilation usable?

2019-10-30 Thread Gabriele Svelto
Hi all, when dealing with builds on slower machines I usually run a build every morning (4AM) so that when I wake up I've got it ready (together with a warm cache) and following builds won't be as bad. This can be done easily on a Mac by setting up a cronjob that will run a build on a freshly

Re: To what extent is sccache's distributed compilation usable?

2019-10-30 Thread Reuben Morais
> On 29. Oct 2019, at 18:53, Steve Fink wrote: > > On 10/28/19 9:17 PM, Marcos Caceres wrote: >> On Tuesday, October 29, 2019 at 3:27:52 AM UTC+11, smaug wrote: >>> Quite often one has just a laptop. Not compiling tons of Rust stuff all the >>> time would be really nice. >>> (I haven't figured

Re: To what extent is sccache's distributed compilation usable?

2019-10-29 Thread Marcos Caceres
On Wednesday, October 30, 2019 at 4:53:55 AM UTC+11, Steve Fink wrote: > I really ought to put my decade-old desktop into action again. My last > attempt was with icecc, and though it worked pretty well when it worked, > the pain in keeping it alive wasn't worth the benefit. Thanks Steve... so

Re: To what extent is sccache's distributed compilation usable?

2019-10-29 Thread Steve Fink
On 10/28/19 9:17 PM, Marcos Caceres wrote: On Tuesday, October 29, 2019 at 3:27:52 AM UTC+11, smaug wrote: Quite often one has just a laptop. Not compiling tons of Rust stuff all the time would be really nice. (I haven't figured out when stylo decides to recompile itself - it seems to be

Re: To what extent is sccache's distributed compilation usable?

2019-10-29 Thread Simon Sapin
On 28/10/2019 17:27, smaug wrote: Quite often one has just a laptop. Not compiling tons of Rust stuff all the time would be really nice. (I haven't figured out when stylo decides to recompile itself - it seems to be somewhat random.) I’m pretty sure there is no call to a random number

Re: To what extent is sccache's distributed compilation usable?

2019-10-28 Thread Gerald Squelart
On Tuesday, October 29, 2019 at 3:27:52 AM UTC+11, smaug wrote: > On 10/24/19 9:17 AM, Marcos Caceres wrote: > > On Thursday, October 24, 2019 at 6:46:08 AM UTC+11, Christopher Manchester > > wrote: > >> As announced in this week's project call, sccache-dist schedulers have been > >> deployed to

Re: To what extent is sccache's distributed compilation usable?

2019-10-28 Thread smaug
On 10/24/19 9:17 AM, Marcos Caceres wrote: On Thursday, October 24, 2019 at 6:46:08 AM UTC+11, Christopher Manchester wrote: As announced in this week's project call, sccache-dist schedulers have been deployed to mozilla offices, and those with hardware available can enroll servers based on

Re: To what extent is sccache's distributed compilation usable?

2019-10-27 Thread Marcos Caceres
On Saturday, October 26, 2019 at 11:47:51 PM UTC+11, Emilio Cobos Álvarez wrote: > So you have two options, I think: > > * Setup a Linux box as an sccache-dist scheduler and builder. This > should require no SDKs or what not, but requires some setup in your mac > as described here[1]. Then

Re: To what extent is sccache's distributed compilation usable?

2019-10-26 Thread Emilio Cobos Álvarez
On 10/25/19 2:54 AM, Marcos Caceres wrote: Do you know if it's possible to cross compile on one of those for to target MacOS? I'd like to build on, and for, MacOS. Our official mac builds are cross-compiled from Linux, IIRC. So yeah, it should be possible to do that. Cross-compiling to

Re: To what extent is sccache's distributed compilation usable?

2019-10-25 Thread Jeff Gilbert
I don't know. If nothing else, it looks like it's possible to run macOS in a VM in some cases, so maybe that's worth someone exploring. Unfortunately, the upcoming Mac Pros look to be over four times as expensive as my machine. On Thu, Oct 24, 2019 at 5:55 PM Marcos Caceres wrote: > On Friday,

Re: To what extent is sccache's distributed compilation usable?

2019-10-24 Thread Marcos Caceres
On Friday, October 25, 2019 at 4:14:05 AM UTC+11, Jeff Gilbert wrote: > My home Ryzen 3900x builds windows debug clobbers in under 10 minutes. Whoa, that's awesome! > Beefy desktops are relatively cheap, and I believe we continue to encourage > firefox-builders to request desktop workstations

Re: To what extent is sccache's distributed compilation usable?

2019-10-24 Thread Jeff Gilbert
My home Ryzen 3900x builds windows debug clobbers in under 10 minutes. Beefy desktops are relatively cheap, and I believe we continue to encourage firefox-builders to request desktop workstations for builds. On Wed, Oct 23, 2019 at 11:20 PM Marcos Caceres wrote: > On Thursday, October 24, 2019

Re: To what extent is sccache's distributed compilation usable?

2019-10-24 Thread Marcos Caceres
On Thursday, October 24, 2019 at 6:46:08 AM UTC+11, Christopher Manchester wrote: > As announced in this week's project call, sccache-dist schedulers have been > deployed to mozilla offices, and those with hardware available can enroll > servers based on the documentation here >

Re: To what extent is sccache's distributed compilation usable?

2019-10-23 Thread Christopher Manchester
As announced in this week's project call, sccache-dist schedulers have been deployed to mozilla offices, and those with hardware available can enroll servers based on the documentation here .

Re: To what extent is sccache's distributed compilation usable?

2019-06-10 Thread Jonathan Watt
Just in case you're not aware of it, there are a couple of perf issues that may make people prefer ccache for now: https://github.com/mozilla/sccache/issues/219 https://github.com/mozilla/sccache/issues/160 Jonathan On 07/06/2019 18:13, Chris M. wrote: > I've been working through issues with

Re: To what extent is sccache's distributed compilation usable?

2019-06-07 Thread Chris M.
I've been working through issues with distributed sccache, but I've recently sent instructions to people currently running icecream in the SF office on how to switch to running sccache-dist with IT managed hardware. We're going to use that as a test bed before rolling out more widely, and if all

Re: To what extent is sccache's distributed compilation usable?

2019-06-05 Thread Miko Mynttinen
Has there been any progress with this? Bug 1524533 is still restricted. Miko > On Apr 2, 2019, at 10:39 PM, Jeff Muizelaar wrote: > > That bug is restricted. Does it need to be? > > -Jeff > > On Tue, Apr 2, 2019 at 4:22 PM Kim Moir wrote: >> >> The tracking bug for sccache being deployed

Re: To what extent is sccache's distributed compilation usable?

2019-04-02 Thread Jeff Muizelaar
That bug is restricted. Does it need to be? -Jeff On Tue, Apr 2, 2019 at 4:22 PM Kim Moir wrote: > > The tracking bug for sccache being deployed to offices is here > > https://bugzilla.mozilla.org/show_bug.cgi?id=1524533 > > Kim > > On Tue, Apr 2, 2019 at 3:22 AM Frederik Braun wrote: > > > Am

Re: To what extent is sccache's distributed compilation usable?

2019-04-02 Thread Kim Moir
The tracking bug for sccache being deployed to offices is here https://bugzilla.mozilla.org/show_bug.cgi?id=1524533 Kim On Tue, Apr 2, 2019 at 3:22 AM Frederik Braun wrote: > Am 01.04.19 um 22:16 schrieb Chris M.: > > Hi Emilio, if you're interested you're encouraged to try it out, however >

Re: To what extent is sccache's distributed compilation usable?

2019-04-02 Thread Frederik Braun
Am 01.04.19 um 22:16 schrieb Chris M.: > Hi Emilio, if you're interested you're encouraged to try it out, however > we're shipping machines to offices now to run the schedulers, the first of > which I'll be testing in the SF office this week, so we're planning an > officially supported setup in

Re: To what extent is sccache's distributed compilation usable?

2019-04-01 Thread Nicholas Alexander
On Mon, Apr 1, 2019 at 1:03 PM Emilio Cobos Álvarez wrote: > On 01/04/2019 21:40, Bobby Holley wrote: > > My (possibly outdated) understanding is that the sccache distributed > > compilation stuff is restricted to the build machines we control. > Naively, > > I'm not sure there's a secure way to

Re: To what extent is sccache's distributed compilation usable?

2019-04-01 Thread Chris M.
On Mon, Apr 1, 2019 at 12:23 PM Emilio Cobos Álvarez wrote: > Hi, > > Over in #layout people were ranting about how much of a pain it was to > set up icecc on MacOS. I pointed out that sccache in theory does support > distributed compilation[1] and in theory also supports MacOS clients. > > Does

Re: To what extent is sccache's distributed compilation usable?

2019-04-01 Thread Emilio Cobos Álvarez
On 01/04/2019 21:40, Bobby Holley wrote: > My (possibly outdated) understanding is that the sccache distributed > compilation stuff is restricted to the build machines we control. Naively, > I'm not sure there's a secure way to have machines in the wild contribute > build artifacts, given the risk

Re: To what extent is sccache's distributed compilation usable?

2019-04-01 Thread Bobby Holley
My (possibly outdated) understanding is that the sccache distributed compilation stuff is restricted to the build machines we control. Naively, I'm not sure there's a secure way to have machines in the wild contribute build artifacts, given the risk of malicious code. It seems plausible that we

To what extent is sccache's distributed compilation usable?

2019-04-01 Thread Emilio Cobos Álvarez
Hi, Over in #layout people were ranting about how much of a pain it was to set up icecc on MacOS. I pointed out that sccache in theory does support distributed compilation[1] and in theory also supports MacOS clients. Does anybody know to what extent is it in a usable state? Can it replace