Re: [PLUG] What wget options to clone a repo?

2019-11-27 Thread Rich Shepard
On Wed, 27 Nov 2019, Rich Shepard wrote: If so, it's not visible. Mea culpa! A subdirectory was not changed from root.root. It now is changed. Files downloading. Will see if there are errors. Thanks, Rich ___ PLUG mailing list PLUG@pdxlinux.org

Re: [PLUG] What wget options to clone a repo?

2019-11-27 Thread Rich Shepard
On Wed, 27 Nov 2019, Ben Koenig wrote: Are all of the user:group permissions consistent in that folder? I bet one of the subfolders in there is owned by root, and causing rsync to get stuck when you run as a normal user. Ben, No. I changed all user.group to rshepard.users. and then try

Re: [PLUG] What wget options to clone a repo?

2019-11-27 Thread Ben Koenig
Are all of the user:group permissions consistent in that folder? I bet one of the subfolders in there is owned by root, and causing rsync to get stuck when you run as a normal user. you can either execute the same rsync command as root, or run $ chmod -R 777 /opt/Slackware/slackware64-14.2 and

Re: [PLUG] What wget options to clone a repo?

2019-11-27 Thread Rich Shepard
On Wed, 27 Nov 2019, Tomas Kuchta wrote: Do you really want rsync to write to /opt/?? Tomas, Yes. It's a local repository that I can check for updated packages. I keep all non-distro packages in /opt except for those that install themselves in /usr/local/. Regards, Rich

Re: [PLUG] What wget options to clone a repo?

2019-11-27 Thread Tomas Kuchta
Before fixing the directory permission - I would suggest evaluating the path. Do you really want rsync to write to /opt/?? Tomas On Wed, Nov 27, 2019, 16:20 Ben Koenig wrote: > Break down the error message: > rsync: mkstemp > >

Re: [PLUG] What wget options to clone a repo?

2019-11-27 Thread Ben Koenig
Break down the error message: rsync: mkstemp "/opt/Slackware/slackware64-14.2/patches/packages/.bind-9.11.13-x86_64-1_slack14.2.txt.UAbg1O" failed: Permission denied (13) This 1 line is telling you everything you need to know. 1) Rsync is the programming managing the file transfer 2) mkstemp is a

Re: [PLUG] What wget options to clone a repo?

2019-11-27 Thread Rich Shepard
On Mon, 25 Nov 2019, Tomas Kuchta wrote: What you might see might be file disappearing on remote side, permission or diskspace issues on local side. I'd check for something like that. Tomas, It shouldn't be disappearing from the source repo and perms on the destination repo are 755 and owned

Re: [PLUG] What wget options to clone a repo?

2019-11-25 Thread Tomas Kuchta
Rsync saves file as .fileName.randomStr while in transfer then renames it. That way the transfer is atomic. What you might see might be file disappearing on remote side, permission or diskspace issues on local side. I'd check for something like that. Tomas On Mon, Nov 25, 2019, 11:32 Rich

Re: [PLUG] What wget options to clone a repo?

2019-11-25 Thread Rich Shepard
On Wed, 6 Nov 2019, Galen Seitz wrote: rsync -havP --no-o --no-g --safe-links --timeout=60 --contimeout=30 rsync://slackware.cs.utah.edu/slackware/slackware64-14.2/ /my_mirror/slackware64-14.2/ Galen, The Utah site is not a current mirror. Using the above syntax: $ rsync -havP --no-o

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Rich Shepard
On Wed, 6 Nov 2019, Galen Seitz wrote: It looks like OSU is a primary mirror for Slackware, so rsync access to it may not be available to it for mortals. At least my attempts failed. Galen, It is a/the primary mirror for Slackware and my efforts to use rsyn with any options failed. rsync

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Galen Seitz
On 11/6/19 12:18 PM, Galen Seitz wrote: > > rsync -havP --no-o --no-g --safe-links --timeout=60 --contimeout=30 > rsync://slackware.cs.utah.edu/slackware/slackware64-14.2/ /scratch/mutt/ > Oops. As I said, I didn't want to fill my disk. That's why I originally tried to mirror mutt, not

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Rich Shepard
On Wed, 6 Nov 2019, Ben Koenig wrote: You might want to consider using Alien Bob's scripts to handle the rsync command. http://www.slackware.com/~alien/ Ben, That works after there's a copy of the current directory tree. The syntax is rsync [opts] [remote path] [local path] Yep. Except,

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Galen Seitz
On 11/6/19 11:43 AM, Ben Koenig wrote: > You might want to consider using Alien Bob's scripts to handle the rsync > command. > http://www.slackware.com/~alien/ > > But.. for a quick and dirty solution the following should work > > > The syntax is > rsync [opts] [remote path] [local path] > >

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Tomas Kuchta
Not only that, wget --mirror will follow and download all links, so you end up with ton of stuff you do not want including all web server generated html stuff. Incremental rsync updates will not work because of - date stamps and different directory hierarchy. Once you do wget mirror, you are

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Ben Koenig
You might want to consider using Alien Bob's scripts to handle the rsync command. http://www.slackware.com/~alien/ But.. for a quick and dirty solution the following should work The syntax is rsync [opts] [remote path] [local path] While people have strong opinions on this one, here's the

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Rich Shepard
On Wed, 6 Nov 2019, Galen Seitz wrote: rsync is probably a better option. https://rsync.osuosl.org/pub/slackware/ Galen, My apologies: it looks like a better option because wget is mirroring the entire slackware/ directory tree. When I used wget --mirror -e robots=off

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Galen Seitz
On 11/6/19 10:13 AM, Rich Shepard wrote: On Wed, 6 Nov 2019, Galen Seitz wrote: rsync is probably a better option. https://rsync.osuosl.org/pub/slackware/ Galen, Thanks. wget is chomping away at downloading the current contents. Once there's a seed future checks (via a cron job) will look

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Rich Shepard
On Wed, 6 Nov 2019, Galen Seitz wrote: rsync is probably a better option. https://rsync.osuosl.org/pub/slackware/ Galen, Thanks. wget is chomping away at downloading the current contents. Once there's a seed future checks (via a cron job) will look for only patches (upgraded packages) and

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Ben Koenig
rsync is probably what you want for this. wget can, but in the long run you'd be better off using rsync to mirror the slackware tree. On Wed, Nov 6, 2019 at 9:56 AM Rich Shepard wrote: > On Wed, 6 Nov 2019, a...@clueserver.org wrote: > > > You need to use --mirror as well as -e robots=off > >

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Rich Shepard
On Wed, 6 Nov 2019, a...@clueserver.org wrote: You need to use --mirror as well as -e robots=off Thank you, Alan. My knowledge of wget has doubled. Best regards, Rich ___ PLUG mailing list PLUG@pdxlinux.org

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Ali Corbin
On Wed, Nov 6, 2019 at 9:01 AM Galen Seitz wrote: > On 11/6/19 8:40 AM, Rich Shepard wrote: > > I want to clone this directory tree: > > https://slackware.osuosl.org/slackware64-14.2/ > > > > I've used wget very infrequently and reading the man page I've no idea > > which > > options I need.

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread alan
> I want to clone this directory tree: > https://slackware.osuosl.org/slackware64-14.2/ > > I've used wget very infrequently and reading the man page I've no idea > which > options I need. Passing that URL to wget produced only an index file. You need to use --mirror as well as -e robots=off

Re: [PLUG] What wget options to clone a repo?

2019-11-06 Thread Galen Seitz
On 11/6/19 8:40 AM, Rich Shepard wrote: I want to clone this directory tree: https://slackware.osuosl.org/slackware64-14.2/ I've used wget very infrequently and reading the man page I've no idea which options I need. Passing that URL to wget produced only an index file. rsync is probably a