I’m considering to run the mirror command every day, three times a day, at hours: 2, 7, 21 (UTC-3 time). The ideia is to be set and forget.
I’m building the repository right now, for the initial copy I’ve used lftp (http://lftp.yar.ru), which is painful slow and really bad with delta updates, and with my organization is bad, since my ideas is to run rsync directly on the storage (TrueNAS), with lftp I had to mount the /var/repos directory on other machine just to run lftp. Files are already available here: <http://mirror.versatushpc.com.br/xcat> Index of /xcat/<http://mirror.versatushpc.com.br/xcat> mirror.versatushpc.com.br<http://mirror.versatushpc.com.br/xcat> [X]<http://mirror.versatushpc.com.br/xcat> rsync is definitely the best option to mirror due to delta sync as you said. Something like -aSH --delete --delete-delay --delay-updates would be good with rsync, considering that any symbolic link on xCAT side is relative, so it will not be a broken symlink after the mirror. Thanks. On 23 May 2023, at 16:50, Nathan A Besaw via xCAT-user <xcat-user@lists.sourceforge.net> wrote: Hi Vinícius, Currently rsync is not available from xcat.org<http://xcat.org/>, but we can consider enabling it. How frequently do you plan to sync your local mirror from the xcat.org<http://xcat.org/> version? For the initial sync, I think you can use wget or curl to recursively download everything from https://xcat.org/files/xcat/ (or whatever directories are relevant to you). If you are going to refresh your mirror infrequently (after every release?), using wget or curl may be sufficient. If you want to resync more regularly I would prefer to use a solution that includes incremental copying so you don't have to redownload ever file every time. ________________________________ From: Vinícius Ferrão via xCAT-user <xcat-user@lists.sourceforge.net> Sent: Friday, May 19, 2023 1:02 PM To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net> Cc: Vinícius Ferrão <fer...@versatushpc.com.br> Subject: [EXTERNAL] [xcat-user] rsync on https://xcat.org/files/xcat/repos Hello, I would like to know if rsync is available on xCAT repository. I want to mirror it locally. I know that I can download the entire tarball from a given version, but I would like to use rsync to keep it updated. Thank you. _______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net<mailto:xCAT-user@lists.sourceforge.net> https://lists.sourceforge.net/lists/listinfo/xcat-user _______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net<mailto:xCAT-user@lists.sourceforge.net> https://lists.sourceforge.net/lists/listinfo/xcat-user
_______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
