Re: [DNG] ..no response on https://talk.devuan.org/t/mirroring-devuan/45/7 so I try here

2018-03-12 Thread KatolaZ
On Mon, Mar 12, 2018 at 10:22:32PM +0100, Arnt Karlsen wrote:

[cut]

> > 
> > Please notice that the original walkthrough document is always at:
> > 
> >   https://pkgmaster.devuan.org/devuan_mirror_walkthrough.txt
> > 
> > In theory, package mirrors (like ftp.fau.de, the one that you mention)
> > should mirror that file automatically, but they are not requested to
> > do so, so it's better to always refer to the version on
> > pkgmaster.devuan.org. If you have suggestions for improvements to the
> > walkthrough, you are welcome to propose them :)
> 
> 
> ..thanks.  _Should_ I really need ssh key access to rsync the 
> "devuan" part of Devuan for my lan mirror?  
> For public mirrors, I totally agree we need ssh key security, 
> but for my lan mirrors?  
>
> ..for non-public lan mirrors I feel ssh key security should be
> optional, so my lan mirrors keep working when my net link dies.
> 

You should use apt-mirror. It works seamlessly. pkgmaster does not
serve the package repo via public rsync.

We will probably put in place another machine to provide a secondary
mirror with public rsync access. 

> 
> > Anyway, you still need a Debian mirror for all the packages that are
> > not forked by Devuan (which are about 95% of all the 18+ packages
> > in Jessie, Ascii, Ceres), so in practice you can't yank the Debian
> > mirror down atm.
> 
> ..correct, unless you're serving Debian clients or keeping an eye on 
> systemd etc conspiracies, the easier approach would be starting with 
> a Debian lan mirror and then "update" that debmirror-style to create
> our own "merged" Devuan package mirror. 
> 
> ..debmirror-style, debmirror should believe any "merged" lie we feed 
> it, once we have those ssh key access issues on "devuan" sorted out.  
> 

Nope. The best approach is to use ftpmirror or apt-mirror, specifying
Devuan's repo in the configuration. This work seamlessly, and will
give you a fully-functional local Devuan mirror. 

HTH

KatolaZ

-- 
[ ~.,_  Enzo Nicosia aka KatolaZ - Devuan -- Freaknet Medialab  ]  
[ "+.  katolaz [at] freaknet.org --- katolaz [at] yahoo.it  ]
[   @)   http://kalos.mine.nu ---  Devuan GNU + Linux User  ]
[ @@)  http://maths.qmul.ac.uk/~vnicosia --  GPG: 0B5F062F  ] 
[ (@@@)  Twitter: @KatolaZ - skype: katolaz -- github: KatolaZ  ]


signature.asc
Description: Digital signature
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng


Re: [DNG] ..no response on https://talk.devuan.org/t/mirroring-devuan/45/7 so I try here

2018-03-12 Thread Arnt Karlsen
On Mon, 12 Mar 2018 19:10:30 +, KatolaZ wrote in message 
<20180312191030.ga16...@katolaz.homeunix.net>:

> On Mon, Mar 12, 2018 at 03:43:25PM +0100, Arnt Karlsen wrote:
> 
> [cut]
> 
> >   
> > > merged# This is new devuan.org code,  
> > 
> > ..this is "Debian's mirror MINUS systemd PLUS Devuan's code mirror",
> > merger job is done with amprolla's you-don't-wanna-know server side
> > magic.
> >   
> > > size?  
> > 
> > ..today: 2.6TB, according to:
> > https://www.debian.org/mirror/size
> > 
> > 
> > ...or, if you like me have a partial Debian mirror on your lan with
> > source, all, amd64, i386 and hurd-i386 and oldstable/jessie, stable,
> > testing and sid, 413GB.
> > 
> > ..minus hurd-i386, I estimate "merged" to: 365GB and a complete 
> > "devuan+merged" Devuan mirror to: qalc 413-48+13.81 = 379GB.
> >  
> 
> 
> mmmhhh, if you use an external Debian mirror, the actual size of the
> Devuan-specific stuff is only about 14GB atm. A full mirror with all,
> amd64, and i386 is about 140GB per release, atm (so about 420GB if you
> want jessie, ascii, and ceres. Will soon need to add another ~130GB
> for Beowulf ;)).

..I don't have any arm* debs in my lan mirror, Debian reports these 
to 180GB, 179GB and 190GB, how much on our side in "devuan"?

..trying to find out, I found I'm denied rsync access to "devuan" 
because I don't yet have ssh keys, so I joined devuan-mirror and 
asked for ssh key access this afternoon today.

> [cut]
> 
> >   
> > > ..I have a partial (source,amd64,i386,i386-hurd) lan Debian
> > > mirror (bad isp link) and I understand some packages are
> > > identical over here at Devuan, so I guess I can play mirror
> > > guineapig here.   
> > 
> > ..in my case, I'd add "5c) IF YOU HAVE A DEBIAN MIRROR BOX ON YOUR
> > LAN" to ftp://ftp.fau.de/devuan/devuan_mirror_walkthrough.txt ,
> > swapping out all mentions of "deb.debian.org" in section "5b) IF
> > YOU DON'T HAVE A LOCAL DEBIAN MIRROR" with a relevant lan ip (e.g.
> > "10.11.12.13") in all the relevant rewrite rules.
> > That approach leaves your Debian mirror operative until you have
> > C-level 
> > approval to yank it down, or, you can leave it up for those crazy
> > bad downtime cases all the way up to "Lennart comes back as
> > Jesus." ;oD
> > 
> >   
> 
> Please notice that the original walkthrough document is always at:
> 
>   https://pkgmaster.devuan.org/devuan_mirror_walkthrough.txt
> 
> In theory, package mirrors (like ftp.fau.de, the one that you mention)
> should mirror that file automatically, but they are not requested to
> do so, so it's better to always refer to the version on
> pkgmaster.devuan.org. If you have suggestions for improvements to the
> walkthrough, you are welcome to propose them :)


..thanks.  _Should_ I really need ssh key access to rsync the 
"devuan" part of Devuan for my lan mirror?  
For public mirrors, I totally agree we need ssh key security, 
but for my lan mirrors?  

..for non-public lan mirrors I feel ssh key security should be
optional, so my lan mirrors keep working when my net link dies.


> Anyway, you still need a Debian mirror for all the packages that are
> not forked by Devuan (which are about 95% of all the 18+ packages
> in Jessie, Ascii, Ceres), so in practice you can't yank the Debian
> mirror down atm.

..correct, unless you're serving Debian clients or keeping an eye on 
systemd etc conspiracies, the easier approach would be starting with 
a Debian lan mirror and then "update" that debmirror-style to create
our own "merged" Devuan package mirror. 

..debmirror-style, debmirror should believe any "merged" lie we feed 
it, once we have those ssh key access issues on "devuan" sorted out.  

-- 
..med vennlig hilsen = with Kind Regards from Arnt Karlsen
...with a number of polar bear hunters in his ancestry...
  Scenarios always come in sets of three: 
  best case, worst case, and just in case.
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng


Re: [DNG] ..no response on https://talk.devuan.org/t/mirroring-devuan/45/7 so I try here

2018-03-12 Thread KatolaZ
On Mon, Mar 12, 2018 at 03:43:25PM +0100, Arnt Karlsen wrote:

[cut]

> 
> > merged# This is new devuan.org code,
> 
> ..this is "Debian's mirror MINUS systemd PLUS Devuan's code mirror",
> merger job is done with amprolla's you-don't-wanna-know server side
> magic.
> 
> > size?
> 
> ..today: 2.6TB, according to:
> https://www.debian.org/mirror/size
> 
> 
> ...or, if you like me have a partial Debian mirror on your lan with
> source, all, amd64, i386 and hurd-i386 and oldstable/jessie, stable,
> testing and sid, 413GB.
> 
> ..minus hurd-i386, I estimate "merged" to: 365GB and a complete 
> "devuan+merged" Devuan mirror to: qalc 413-48+13.81 = 379GB.
>


mmmhhh, if you use an external Debian mirror, the actual size of the
Devuan-specific stuff is only about 14GB atm. A full mirror with all,
amd64, and i386 is about 140GB per release, atm (so about 420GB if you
want jessie, ascii, and ceres. Will soon need to add another ~130GB
for Beowulf ;)).

[cut]

> 
> > ..I have a partial (source,amd64,i386,i386-hurd) lan Debian mirror 
> > (bad isp link) and I understand some packages are identical over 
> > here at Devuan, so I guess I can play mirror guineapig here. 
> 
> ..in my case, I'd add "5c) IF YOU HAVE A DEBIAN MIRROR BOX ON YOUR LAN"
> to ftp://ftp.fau.de/devuan/devuan_mirror_walkthrough.txt , swapping out
> all mentions of "deb.debian.org" in section "5b) IF YOU DON'T HAVE A 
> LOCAL DEBIAN MIRROR" with a relevant lan ip (e.g. "10.11.12.13") in all
> the relevant rewrite rules.
> That approach leaves your Debian mirror operative until you have
> C-level 
> approval to yank it down, or, you can leave it up for those crazy bad
> downtime cases all the way up to "Lennart comes back as Jesus." ;oD
> 
> 

Please notice that the original walkthrough document is always at:

  https://pkgmaster.devuan.org/devuan_mirror_walkthrough.txt

In theory, package mirrors (like ftp.fau.de, the one that you mention)
should mirror that file automatically, but they are not requested to
do so, so it's better to always refer to the version on
pkgmaster.devuan.org. If you have suggestions for improvements to the
walkthrough, you are welcome to propose them :)

Anyway, you still need a Debian mirror for all the packages that are
not forked by Devuan (which are about 95% of all the 18+ packages
in Jessie, Ascii, Ceres), so in practice you can't yank the Debian
mirror down atm.

My2Cents

KatolaZ

-- 
[ ~.,_  Enzo Nicosia aka KatolaZ - Devuan -- Freaknet Medialab  ]  
[ "+.  katolaz [at] freaknet.org --- katolaz [at] yahoo.it  ]
[   @)   http://kalos.mine.nu ---  Devuan GNU + Linux User  ]
[ @@)  http://maths.qmul.ac.uk/~vnicosia --  GPG: 0B5F062F  ] 
[ (@@@)  Twitter: @KatolaZ - skype: katolaz -- github: KatolaZ  ]


signature.asc
Description: Digital signature
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng


Re: [DNG] ..no response on https://talk.devuan.org/t/mirroring-devuan/45/7 so I try here

2018-03-12 Thread Arnt Karlsen
On Mon, 12 Mar 2018 10:32:15 -0500, goli...@dyne.org wrote in message 
<37e1737b6270d5f488c88d006f55a...@dyne.org>:

> On 2018-03-12 09:43, Arnt Karlsen wrote:
> > On Thu, 17 Dec 2015 02:56:13 +0100, Arnt wrote in message
> > <20151217025613.4656e...@nb6.lan>:
> >   
> >> Hi,
> >> 
> >> ..I got no response on
> >> https://talk.devuan.org/t/mirroring-devuan/45/7 so I try here: do
> >> you guys have " du -sch "-style numbers for alpha-iso-cd  # 28MB  
> > 
> >   
> 
> Of course you didn't. The email interactiveness was disabled maybe a 
> year ago and we have no way to alter or respond to posts there.  Did
> you not see the banner at the top of the page?

..nope, much easier to search my own mail list archive ;o), 
I responded because I found a viable answer to my first 
question on this mail list, posted over 2 years ago.

> PROCEED WITH CAUTION
> This experiment is over. These pages are offered as a read only 
> historical reference that may contain outdated documentation. Do 
> continue to browse but replying, likes, and other actions are
> disabled. For current discussions, please travel to the DNG mail
> list, the Devuan irc channels freenode#devuan and the dev1galaxy.org
> forum. So long, and thanks for all the fish!
> 
> The talk.d.o archive is still a WIP.
> 
> golinux

..good to know. :o)

-- 
..med vennlig hilsen = with Kind Regards from Arnt Karlsen
...with a number of polar bear hunters in his ancestry...
  Scenarios always come in sets of three: 
  best case, worst case, and just in case.
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng


Re: [DNG] ..no response on https://talk.devuan.org/t/mirroring-devuan/45/7 so I try here

2018-03-12 Thread golinux

On 2018-03-12 09:43, Arnt Karlsen wrote:

On Thu, 17 Dec 2015 02:56:13 +0100, Arnt wrote in message
<20151217025613.4656e...@nb6.lan>:


Hi,

..I got no response on https://talk.devuan.org/t/mirroring-devuan/45/7
so I try here: do you guys have " du -sch "-style numbers for
alpha-iso-cd  # 28MB





Of course you didn't. The email interactiveness was disabled maybe a 
year ago and we have no way to alter or respond to posts there.  Did you 
not see the banner at the top of the page?


PROCEED WITH CAUTION
This experiment is over. These pages are offered as a read only 
historical reference that may contain outdated documentation. Do 
continue to browse but replying, likes, and other actions are disabled. 
For current discussions, please travel to the DNG mail list, the Devuan 
irc channels freenode#devuan and the dev1galaxy.org forum. So long, and 
thanks for all the fish!


The talk.d.o archive is still a WIP.

golinux






















..today: 39.58GB, according to:

https://ftp.fau.de/cgi-bin/show-mirror-status.cgi?mirror=devuan-cd


devuan# This is Debian minus Systemd?


..this is Devuan's code mirror.


 Size?


..today: 13.81GB, according to:
https://ftp.fau.de/cgi-bin/show-mirror-status.cgi?mirror=devuan


merged# This is new devuan.org code,


..this is "Debian's mirror MINUS systemd PLUS Devuan's code mirror",
merger job is done with amprolla's you-don't-wanna-know server side
magic.


size?


..today: 2.6TB, according to:
https://www.debian.org/mirror/size


...or, if you like me have a partial Debian mirror on your lan with
source, all, amd64, i386 and hurd-i386 and oldstable/jessie, stable,
testing and sid, 413GB.

..minus hurd-i386, I estimate "merged" to: 365GB and a complete
"devuan+merged" Devuan mirror to: qalc 413-48+13.81 = 379GB.



in http://packages.devuan.org/ ?


..https://ftp.fau.de/cgi-bin/show-mirror-status.cgi?mirror=devuan-cd
https://files.devuan.org/MIRRORS.txt misled me into mirroring
files.devuan.org/ rather than auto.mirror|packages.devuan.org/devuan,
it turned out "Devuan Mirror != Devuan Mirror." ;o)

..proper way to mirror Devuan mirrors:
ftp://ftp.fau.de/devuan/devuan_mirror_walkthrough.txt



..I have a partial (source,amd64,i386,i386-hurd) lan Debian mirror
(bad isp link) and I understand some packages are identical over
here at Devuan, so I guess I can play mirror guineapig here.


..in my case, I'd add "5c) IF YOU HAVE A DEBIAN MIRROR BOX ON YOUR LAN"
to ftp://ftp.fau.de/devuan/devuan_mirror_walkthrough.txt , swapping out
all mentions of "deb.debian.org" in section "5b) IF YOU DON'T HAVE A
LOCAL DEBIAN MIRROR" with a relevant lan ip (e.g. "10.11.12.13") in all
the relevant rewrite rules.
That approach leaves your Debian mirror operative until you have
C-level
approval to yank it down, or, you can leave it up for those crazy bad
downtime cases all the way up to "Lennart comes back as Jesus." ;oD

___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng


Re: [DNG] ..no response on https://talk.devuan.org/t/mirroring-devuan/45/7 so I try here

2018-03-12 Thread Arnt Karlsen
On Thu, 17 Dec 2015 02:56:13 +0100, Arnt wrote in message 
<20151217025613.4656e...@nb6.lan>:

> Hi,
> 
> ..I got no response on https://talk.devuan.org/t/mirroring-devuan/45/7
> so I try here: do you guys have " du -sch "-style numbers for
> alpha-iso-cd  # 28MB

..today: 39.58GB, according to: 
https://ftp.fau.de/cgi-bin/show-mirror-status.cgi?mirror=devuan-cd

> devuan# This is Debian minus Systemd?

..this is Devuan's code mirror.

>  Size? 

..today: 13.81GB, according to: 
https://ftp.fau.de/cgi-bin/show-mirror-status.cgi?mirror=devuan

> merged# This is new devuan.org code,

..this is "Debian's mirror MINUS systemd PLUS Devuan's code mirror",
merger job is done with amprolla's you-don't-wanna-know server side
magic.

> size?

..today: 2.6TB, according to:
https://www.debian.org/mirror/size


...or, if you like me have a partial Debian mirror on your lan with
source, all, amd64, i386 and hurd-i386 and oldstable/jessie, stable,
testing and sid, 413GB.

..minus hurd-i386, I estimate "merged" to: 365GB and a complete 
"devuan+merged" Devuan mirror to: qalc 413-48+13.81 = 379GB.


> in http://packages.devuan.org/ ?

..https://ftp.fau.de/cgi-bin/show-mirror-status.cgi?mirror=devuan-cd
https://files.devuan.org/MIRRORS.txt misled me into mirroring
files.devuan.org/ rather than auto.mirror|packages.devuan.org/devuan,
it turned out "Devuan Mirror != Devuan Mirror." ;o)

..proper way to mirror Devuan mirrors:
ftp://ftp.fau.de/devuan/devuan_mirror_walkthrough.txt


> ..I have a partial (source,amd64,i386,i386-hurd) lan Debian mirror 
> (bad isp link) and I understand some packages are identical over 
> here at Devuan, so I guess I can play mirror guineapig here. 

..in my case, I'd add "5c) IF YOU HAVE A DEBIAN MIRROR BOX ON YOUR LAN"
to ftp://ftp.fau.de/devuan/devuan_mirror_walkthrough.txt , swapping out
all mentions of "deb.debian.org" in section "5b) IF YOU DON'T HAVE A 
LOCAL DEBIAN MIRROR" with a relevant lan ip (e.g. "10.11.12.13") in all
the relevant rewrite rules.  
That approach leaves your Debian mirror operative until you have
C-level 
approval to yank it down, or, you can leave it up for those crazy bad
downtime cases all the way up to "Lennart comes back as Jesus." ;oD



-- 
..med vennlig hilsen = with Kind Regards from Arnt Karlsen
...with a number of polar bear hunters in his ancestry...
  Scenarios always come in sets of three: 
  best case, worst case, and just in case.
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng


[DNG] ..no response on https://talk.devuan.org/t/mirroring-devuan/45/7 so I try here

2015-12-17 Thread Arnt Karlsen
Hi,

..I got no response on https://talk.devuan.org/t/mirroring-devuan/45/7
so I try here: do you guys have " du -sch "-style numbers for
alpha-iso-cd  # 28MB
devuan# This is Debian minus Systemd?  Size? 
merged# This is new devuan.org code, size?
in http://packages.devuan.org/ ?

..I have a partial (source,amd64,i386,i386-hurd) lan Debian mirror 
(bad isp link) and I understand some packages are identical over 
here at Devuan, so I guess I can play mirror guineapig here. 

-- 
..med vennlig hilsen = with Kind Regards from Arnt Karlsen
...with a number of polar bear hunters in his ancestry...
  Scenarios always come in sets of three: 
  best case, worst case, and just in case.
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng