Re: [R] Slow CRAN Mirror Action

2016-03-08 Thread Uwe Ligges



On 08.03.2016 11:01, Justace Clutter wrote:

I have been creating a local mirror of the CRAN for my works servers.
After a review of the CRAN mirror literature, I settled on the following
command to perform the mirror:

rsync -rtlzv --delete --exclude-from u:\CRANRSYNCFilterRules
cran.r-project.org::CRAN .

Where the CRANRSYNCFilterRules file has the following contents:

/ BEGIN SNIP
- bin/linux
- bin/macos
- bin/macosx
- bin/windows/base/old
#- bin/windows/contrib/*
- bin/windows/contrib/1*
- bin/windows/contrib/2*
- bin/windows/contrib/3.0
- bin/windows/contrib/3.1
+ bin/
+ bin/windows/
+ bin/windows/contrib/
+ bin/windows/contrib/3.2/
+ bin/windows/contrib/3.2/***
/ END SNIP

What I find is that the command tends to redownload a lot of files and I
can never seem to get past the windows/contrib/3.2 directory because I have
to leave work and go home for the day after 7 hours.  Is there something
incorrect with my rsync command which is forcing the redownload of a lot of
packages?  Is there a way to speed this process up?  Thank you for any help.



No, we rebuild really many packages on a daily basis. Once a depdendency 
changes you may need to build a new binary. So this is expected.


Best,
Uwe Ligges



Version Information: Just in case people feel they need to know
OS: Windows 7
rsync: version 3.0.9  protocol version 30
Network: hardwired to company LAN which has some form of firewall/proxy to
the real internet

Justace

[[alternative HTML version deleted]]

__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.



__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.


[R] Slow CRAN Mirror Action

2016-03-08 Thread Justace Clutter
I have been creating a local mirror of the CRAN for my works servers.
After a review of the CRAN mirror literature, I settled on the following
command to perform the mirror:

rsync -rtlzv --delete --exclude-from u:\CRANRSYNCFilterRules
cran.r-project.org::CRAN .

Where the CRANRSYNCFilterRules file has the following contents:

/ BEGIN SNIP
- bin/linux
- bin/macos
- bin/macosx
- bin/windows/base/old
#- bin/windows/contrib/*
- bin/windows/contrib/1*
- bin/windows/contrib/2*
- bin/windows/contrib/3.0
- bin/windows/contrib/3.1
+ bin/
+ bin/windows/
+ bin/windows/contrib/
+ bin/windows/contrib/3.2/
+ bin/windows/contrib/3.2/***
/ END SNIP

What I find is that the command tends to redownload a lot of files and I
can never seem to get past the windows/contrib/3.2 directory because I have
to leave work and go home for the day after 7 hours.  Is there something
incorrect with my rsync command which is forcing the redownload of a lot of
packages?  Is there a way to speed this process up?  Thank you for any help.

Version Information: Just in case people feel they need to know
OS: Windows 7
rsync: version 3.0.9  protocol version 30
Network: hardwired to company LAN which has some form of firewall/proxy to
the real internet

Justace

[[alternative HTML version deleted]]

__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.