On 8 Sep 06, at 11:29 AM 8 Sep 06, Mike Perham wrote:

We are walled off from the public repo in order to control our
dependencies very closely.  Until recently, if I found that we needed
a new package, I would just suck down the contents by using wget:

wget -nd -l 1 -r
http://repo1.maven.org/maven2/commons-attributes/commons-attributes- api/2.2/

The new repo does User-Agent sniffing so that I can't do this.  If I
add -U Mozilla, wget works fine.

Am I doing something unreasonable or is it possible to disable this sniffing?


I disabled wget because people were trying to sync the entire repository using wget. Some asshole sucked out 7GB and I'm paying for the bandwidth right now. We need to figure out how to stop crawling and then I would turn it back on. I turned it off because at the rate of yesterday's consumption I could not afford the bandwidth.

mike

---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Jason van Zyl
[EMAIL PROTECTED]




---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to