On 8 Sep 06, at 12:59 PM 8 Sep 06, Carlos Sanchez wrote:
You can rsync from ibiblio pretty easily
Yah, and we will continue to sync there but we can definitely get
some good Maven citizen guidelines. Yanking out 7gb from the repo is
a bit much.
Us cleaning up some stuff on our side would be good too as Brett
pointed out that a lot of consumption is probably happening because
people blow their repos away and download everything again when they
have problems. So there are probably lots of things we can do to cut
down the needless consumption of bandwidth.
Jason.
On 9/8/06, Mike Perham <[EMAIL PROTECTED]> wrote:
Yeah, I saw that. The IP resolved to petal.amgreetings.com. I'm not
sure why a greeting card company is using Maven but a donation would
be nice if that person is reading this.
Fair enough, it's not a big deal to spoof my user-agent.
On 9/8/06, Jason van Zyl <[EMAIL PROTECTED]> wrote:
>
> On 8 Sep 06, at 11:29 AM 8 Sep 06, Mike Perham wrote:
>
> > We are walled off from the public repo in order to control our
> > dependencies very closely. Until recently, if I found that we
needed
> > a new package, I would just suck down the contents by using wget:
> >
> > wget -nd -l 1 -r
> > http://repo1.maven.org/maven2/commons-attributes/commons-
attributes-
> > api/2.2/
> >
> > The new repo does User-Agent sniffing so that I can't do
this. If I
> > add -U Mozilla, wget works fine.
> >
> > Am I doing something unreasonable or is it possible to disable
this
> > sniffing?
> >
>
> I disabled wget because people were trying to sync the entire
> repository using wget. Some asshole sucked out 7GB and I'm
paying for
> the bandwidth right now. We need to figure out how to stop crawling
> and then I would turn it back on. I turned it off because at the
rate
> of yesterday's consumption I could not afford the bandwidth.
>
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
--
I could give you my word as a Spaniard.
No good. I've known too many Spaniards.
-- The Princess Bride
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
Jason van Zyl
[EMAIL PROTECTED]
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
