Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread William Kenworthy
On 5/9/23 22:58, Walter Dnes wrote: On Tue, Sep 05, 2023 at 08:04:19AM +0100, Neil Bothwick wrote On Mon, 4 Sep 2023 22:54:38 -0400, Walter Dnes wrote: It looks like remote-mounting /var/cache/distfiles might be the quick-n-dirty solution like Alan suggested. And I never have a need to

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread Michael
On Tuesday, 5 September 2023 16:33:43 BST Walter Dnes wrote: > On Tue, Sep 05, 2023 at 04:07:16PM +0100, Michael wrote > > > On Tuesday, 5 September 2023 15:58:05 BST Walter Dnes wrote: > > > And while we're at it, howsabout "emerge --sync" on one host, and then > > > > > > remote-mounting

RE: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread Laurence Perkins
> > > From: Alan McKinnon alan.mckin...@gmail.com<mailto:alan.mckin...@gmail.com> > Sent: Monday, September 4, 2023 12:38 PM > To: gentoo-user@lists.gentoo.org<mailto:gentoo-user@lists.gentoo.org> > Subject: Re: [gentoo-user] Is distfile partial mirror with failover

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread Walter Dnes
On Tue, Sep 05, 2023 at 04:07:16PM +0100, Michael wrote > On Tuesday, 5 September 2023 15:58:05 BST Walter Dnes wrote: > > > > And while we're at it, howsabout "emerge --sync" on one host, and then > > remote-mounting /var/db/repos/gentoo ? > > Take a look here: > >

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread Neil Bothwick
On Tue, 05 Sep 2023 16:07:16 +0100, Michael wrote: > > And while we're at it, howsabout "emerge --sync" on one host, and > > then remote-mounting /var/db/repos/gentoo ? > > Take a look here: > > https://wiki.gentoo.org/wiki/Local_Mirror I used to do that, the server syncing with Gentoo

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread Michael
On Tuesday, 5 September 2023 15:58:05 BST Walter Dnes wrote: > On Tue, Sep 05, 2023 at 08:04:19AM +0100, Neil Bothwick wrote > > > On Mon, 4 Sep 2023 22:54:38 -0400, Walter Dnes wrote: > > > It looks like remote-mounting /var/cache/distfiles might be the > > > > > > quick-n-dirty solution like

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread Michael
On Tuesday, 5 September 2023 10:06:42 BST hitachi303 wrote: > Am 04.09.23 um 15:04 schrieb Michael: > > PS. Is http_replicator still available/maintained? I see the wiki > > mentions > > apt-cacher-ng for local distfiles cache. > > IIRC it died when python or perl 2.x was no longer available.

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread Walter Dnes
On Tue, Sep 05, 2023 at 08:04:19AM +0100, Neil Bothwick wrote > On Mon, 4 Sep 2023 22:54:38 -0400, Walter Dnes wrote: > > > It looks like remote-mounting /var/cache/distfiles might be the > > quick-n-dirty solution like Alan suggested. And I never have a need to > > have emerge run

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread hitachi303
Am 04.09.23 um 15:04 schrieb Michael: PS. Is http_replicator still available/maintained? I see the wiki mentions apt-cacher-ng for local distfiles cache. IIRC it died when python or perl 2.x was no longer available.

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-05 Thread Neil Bothwick
On Mon, 4 Sep 2023 22:54:38 -0400, Walter Dnes wrote: > On Mon, Sep 04, 2023 at 06:21:27PM +0100, Neil Bothwick wrote > > I use apt-cacher-ng for this and it does what you are looking for. > > https://wiki.gentoo.org/wiki/Local_distfiles_cache#Open_issues says... > > > Open issues > > > >

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-04 Thread Walter Dnes
On Mon, Sep 04, 2023 at 06:21:27PM +0100, Neil Bothwick wrote > On Mon, 04 Sep 2023 14:04:53 +0100, Michael wrote: > > The reference to a host makes me think Walter wants one machne to hold > the distfiles for all on the network. Correct. > I use apt-cacher-ng for this and it does what you

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-04 Thread Arve Barsnes
On Mon, 4 Sept 2023 at 22:02, Mark Knecht wrote: > I'm a GMail user also. Sadly you'll want to not only bottom post, but also > select all text you're responding to, remove formatting (Ctrl-V) and then > type your response or you'll be down voted for responding in HTML. > > I hate it also, but

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-04 Thread Mark Knecht
On Mon, Sep 4, 2023 at 12:38 PM Alan McKinnon wrote: > > > > On Mon, Sep 4, 2023 at 8:26 PM Neil Bothwick wrote: >> >> On Mon, 4 Sep 2023 19:49:56 +0200, Alan McKinnon wrote: >> >> > Quick n dirty solution: >> > >> > put all distfiles on a central server >> > FS mount that remote dir to

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-04 Thread Alan McKinnon
On Mon, Sep 4, 2023 at 8:26 PM Neil Bothwick wrote: > On Mon, 4 Sep 2023 19:49:56 +0200, Alan McKinnon wrote: > > > Quick n dirty solution: > > > > put all distfiles on a central server > > FS mount that remote dir to /var/cache/distfiles on all hosts > > That's what I used to do, but had

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-04 Thread Neil Bothwick
On Mon, 4 Sep 2023 19:49:56 +0200, Alan McKinnon wrote: > Quick n dirty solution: > > put all distfiles on a central server > FS mount that remote dir to /var/cache/distfiles on all hosts That's what I used to do, but had problems when downloading the same file from to clients at once. BTW

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-04 Thread Alan McKinnon
Quick n dirty solution: put all distfiles on a central server FS mount that remote dir to /var/cache/distfiles on all hosts Alan On Mon, Sep 4, 2023 at 7:21 PM Neil Bothwick wrote: > On Mon, 04 Sep 2023 14:04:53 +0100, Michael wrote: > > > On Monday, 4 September 2023 11:12:51 BST Walter Dnes

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-04 Thread Neil Bothwick
On Mon, 04 Sep 2023 14:04:53 +0100, Michael wrote: > On Monday, 4 September 2023 11:12:51 BST Walter Dnes wrote: > > I may be misunderstanding, but it seems to me that local mirrors are > > all-or-nothing. In the interests of saving bandwidth, I'd like to > > have a client first check the

Re: [gentoo-user] Is distfile partial mirror with failover possible?

2023-09-04 Thread Michael
On Monday, 4 September 2023 11:12:51 BST Walter Dnes wrote: > I may be misunderstanding, but it seems to me that local mirrors are > all-or-nothing. In the interests of saving bandwidth, I'd like to have > a client first check the host's /var/cache/distfiles directory for a > source tarball