Blacklisting a SourceForge mirror from ports?
in ports/Mk/bsd.sites.mk, the list of SourceForge mirrors is defined by:
.for mirror in heanet sunet iweb switch surfnet kent freefr \
voxel jaist osdn nchc transact softlayer \
internode biznetnetworks ufpr
# garr dfn ovh (redirect as of 2009-Sep-02)
MASTER_SITE_SOURCEFORGE+= \
http://${mirror}.dl.sourceforge.net/project/%SUBDIR%/
.endfor
.endif
The problem is that the first mirror, heanet, is glacially slow every
time I try to download from it. Transfers of 5-10KB/s aren't unheard
of. When I see that a large tarball is coming down from heanet, I'll
routinely kill the transfer and manually download it.
In my /etc/make.conf, I have:
MASTER_SITE_SOURCEFORGE=http://sunet.dl.sourceforge.net/%SUBDIR%/
That *usually* works, but will often return a redirect, in which case
the fetch goes back to using the list of mirrors, starting with heanet,
which puts me back in the same predicament.
I could obviously edit bsd.sites.mk to remove that entry, but updates
could wipe out my changes. Worse, if the SF layout changes and
bsd.sites.mk is updated to reflect the new structure, a locally edited
version wouldn't have those fixes.
All that said, is there a better way to specify SourceForge mirrors? A
blacklist would be ideal for this specific situation, but I'm open to ideas.
--
Kirk Strauser
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Blacklisting a SourceForge mirror from ports?
I don't know about blacklisting, however you may want to look at the port
called fastest_sites:
/usr/ports/ports-mgmt/fastest_sites]$ cat pkg-descr
Find the fastest mirror for every mirror list in bsd.sites.mk.
Output is suitable for inclusion into make.conf.
WWW:
http://www.semicomplete.com/blog/geekery/freebsd-ports-master-sites-sorting.html
-jgh
On Wed, Dec 23, 2009 at 11:38:01AM -0600, Kirk Strauser thus spake:
in ports/Mk/bsd.sites.mk, the list of SourceForge mirrors is defined by:
.for mirror in heanet sunet iweb switch surfnet kent freefr \
voxel jaist osdn nchc transact softlayer \
internode biznetnetworks ufpr
# garr dfn ovh (redirect as of 2009-Sep-02)
MASTER_SITE_SOURCEFORGE+= \
http://${mirror}.dl.sourceforge.net/project/%SUBDIR%/
.endfor
.endif
The problem is that the first mirror, heanet, is glacially slow every
time I try to download from it. Transfers of 5-10KB/s aren't unheard
of. When I see that a large tarball is coming down from heanet, I'll
routinely kill the transfer and manually download it.
In my /etc/make.conf, I have:
MASTER_SITE_SOURCEFORGE=http://sunet.dl.sourceforge.net/%SUBDIR%/
That *usually* works, but will often return a redirect, in which case
the fetch goes back to using the list of mirrors, starting with heanet,
which puts me back in the same predicament.
I could obviously edit bsd.sites.mk to remove that entry, but updates
could wipe out my changes. Worse, if the SF layout changes and
bsd.sites.mk is updated to reflect the new structure, a locally edited
version wouldn't have those fixes.
All that said, is there a better way to specify SourceForge mirrors? A
blacklist would be ideal for this specific situation, but I'm open to ideas.
--
Kirk Strauser
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Blacklisting a SourceForge mirror from ports?
Would route add heanet.dl.sourceforge.net 127.0.0.1 help?
On Wed, Dec 23, 2009 at 11:38:01AM -0600, Kirk Strauser typed:
in ports/Mk/bsd.sites.mk, the list of SourceForge mirrors is defined by:
.for mirror in heanet sunet iweb switch surfnet kent freefr \
voxel jaist osdn nchc transact softlayer \
internode biznetnetworks ufpr
# garr dfn ovh (redirect as of 2009-Sep-02)
MASTER_SITE_SOURCEFORGE+= \
http://${mirror}.dl.sourceforge.net/project/%SUBDIR%/
.endfor
.endif
The problem is that the first mirror, heanet, is glacially slow every
time I try to download from it. Transfers of 5-10KB/s aren't unheard
of. When I see that a large tarball is coming down from heanet, I'll
routinely kill the transfer and manually download it.
In my /etc/make.conf, I have:
MASTER_SITE_SOURCEFORGE=http://sunet.dl.sourceforge.net/%SUBDIR%/
That *usually* works, but will often return a redirect, in which case
the fetch goes back to using the list of mirrors, starting with heanet,
which puts me back in the same predicament.
I could obviously edit bsd.sites.mk to remove that entry, but updates
could wipe out my changes. Worse, if the SF layout changes and
bsd.sites.mk is updated to reflect the new structure, a locally edited
version wouldn't have those fixes.
All that said, is there a better way to specify SourceForge mirrors? A
blacklist would be ideal for this specific situation, but I'm open to ideas.
--
Kirk Strauser
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Blacklisting a SourceForge mirror from ports?
On Wed, Dec 23, 2009 at 3:33 PM, Ruben de Groot mai...@bzerk.org wrote: Would route add heanet.dl.sourceforge.net 127.0.0.1 help? Or map heanet to a non-routable addy in /etc/hosts... ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
RE: Blacklisting a SourceForge mirror from ports?
Null routes work great, until the url fronts 29 VIP's located around the world. And of course if the IP's ever change, null routes need to be updated Does pf / ipfw allow url filtering, such that you could block this url and not worry about the ip's? Duh... I think that's what previous post was getting at with the hosts file... Much easier / cleaner / better than using pf! So yea, adding heanet.dl.sourceforge.net 127.0.0.1 to your hosts file would work perfect! -Original Message- From: owner-freebsd-questi...@freebsd.org [mailto:owner-freebsd-questi...@freebsd.org] On Behalf Of J Sisson Sent: Wednesday, December 23, 2009 4:43 PM To: Ruben de Groot; Kirk Strauser; freebsd-questions@freebsd.org Subject: Re: Blacklisting a SourceForge mirror from ports? On Wed, Dec 23, 2009 at 3:33 PM, Ruben de Groot mai...@bzerk.org wrote: Would route add heanet.dl.sourceforge.net 127.0.0.1 help? Or map heanet to a non-routable addy in /etc/hosts... ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org font size=1 div style='border:none;border-bottom:double windowtext 2.25pt;padding:0in 0in 1.0pt 0in' /div This email is intended to be reviewed by only the intended recipient and may contain information that is privileged and/or confidential. If you are not the intended recipient, you are hereby notified that any review, use, dissemination, disclosure or copying of this email and its attachments, if any, is strictly prohibited. If you have received this email in error, please immediately notify the sender by return email and delete this email from your system. /font ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Blacklisting a SourceForge mirror from ports?
On Wed, 23 Dec 2009 11:38:01 -0600 Kirk Strauser k...@strauser.com wrote: In my /etc/make.conf, I have: MASTER_SITE_SOURCEFORGE=http://sunet.dl.sourceforge.net/%SUBDIR%/ I set MASTER_SORT_REGEX instead That *usually* works, but will often return a redirect, in which case the fetch goes back to using the list of mirrors, starting with heanet, which puts me back in the same predicament. Don't the default settings prevent fetch following redirects. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Blacklisting a SourceForge mirror from ports?
On Thu, 24 Dec 2009 03:32:20 + RW rwmailli...@googlemail.com wrote: On Wed, 23 Dec 2009 11:38:01 -0600 Kirk Strauser k...@strauser.com wrote: MASTER_SITE_SOURCEFORGE=http://sunet.dl.sourceforge.net/%SUBDIR%/ That *usually* works, but will often return a redirect, in which case the fetch goes back to using the list of mirrors, starting with heanet, which puts me back in the same predicament. Don't the default settings prevent fetch following redirects. If you mean that fetch refuses the redirect and the ports system moves on to the next entry then you can simply paste the entire sourceforge list with heanet removed. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
