Re: [gentoo-user] distributed emerge

[Adam Carter]

>
> Distcc seems to work for some people, but other setups have lots of
> issues with it.
>

Just works for me, all the time. I use the same gcc, bintutils etc versions
on all hosts and use the same USE flags for those packages. I dont use
-march=native of course. OP will also need to take extra care to set CFLAGS
to the lowest common function set across his fleet, since he wants to use
the same binaries on each system.

Re: [gentoo-user] distributed emerge

[R0b0t1]

On Tue, Sep 26, 2017 at 1:20 AM, Damo Brisbane  wrote:
> Thanks, digesting it!
>
> On Tue, Sep 26, 2017 at 12:59 AM, Andrés Becerra Sandoval
>  wrote:
>>
>>
>>
>> 2017-09-25 6:35 GMT-05:00 Damo Brisbane :
>>>
>>> hi,
>>>
>>> Can someone point where I might go for parallel @world build, it is
>>> really for my own curiositynat this time. Currently I stage binaries for
>>> multiple machines on a single nfs share, but the assumption is to use
>>> instead some distributed filesystem. So I think I just need a recipie,
>>> pointers or ideas on how to distribute emerge on an @world set? I am
>>> thinking granular first, ie per package rather than eg distributed gcc
>>> within a single package.
>>>
>>> thank you
>>
>>
>>
>> Hello,
>>
>> I think distcc might be what you look for the merging part:
>> https://wiki.gentoo.org/wiki/Distcc
>>

Distcc seems to work for some people, but other setups have lots of
issues with it. Not all build scripts provide all of the hooks
necessary to do certain things. Sometimes there is corruption when
communicating results, or subtle flag or optimization differences that
lead to bugs.

When distcc works it works well, but a single package host may be the
more robust solution. You could write some shell script to take
/var/lib/portage/world and only build e.g. half the packages.

Cheers,
 R0b0t1

Re: [gentoo-user] distributed emerge

[Damo Brisbane]

Thanks, digesting it!

On Tue, Sep 26, 2017 at 12:59 AM, Andrés Becerra Sandoval <
andres.bece...@gmail.com> wrote:

>
>
> 2017-09-25 6:35 GMT-05:00 Damo Brisbane :
>
>> hi,
>>
>> Can someone point where I might go for parallel @world build, it is
>> really for my own curiositynat this time. Currently I stage binaries for
>> multiple machines on a single nfs share, but the assumption is to use
>> instead some distributed filesystem. So I think I just need a recipie,
>> pointers or ideas on how to distribute emerge on an @world set? I am
>> thinking granular first, ie per package rather than eg distributed gcc
>> within a single package.
>>
>> thank you
>>
>
>
> ​Hello,
>
> I think distcc might be what you look for the merging part:
> ​https://wiki.gentoo.org/wiki/Distcc
>
> --
>   Andrés Becerra Sandoval
>
>

Re: [gentoo-user] distributed emerge

[Andrés Becerra Sandoval]

2017-09-25 6:35 GMT-05:00 Damo Brisbane :

> hi,
>
> Can someone point where I might go for parallel @world build, it is really
> for my own curiositynat this time. Currently I stage binaries for multiple
> machines on a single nfs share, but the assumption is to use instead some
> distributed filesystem. So I think I just need a recipie, pointers or ideas
> on how to distribute emerge on an @world set? I am thinking granular first,
> ie per package rather than eg distributed gcc within a single package.
>
> thank you
>


​Hello,

I think distcc might be what you look for the merging part:
​https://wiki.gentoo.org/wiki/Distcc

-- 
  Andrés Becerra Sandoval

[gentoo-user] distributed emerge

[Damo Brisbane]

hi,

Can someone point where I might go for parallel @world build, it is really
for my own curiositynat this time. Currently I stage binaries for multiple
machines on a single nfs share, but the assumption is to use instead some
distributed filesystem. So I think I just need a recipie, pointers or ideas
on how to distribute emerge on an @world set? I am thinking granular first,
ie per package rather than eg distributed gcc within a single package.

thank you