Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-21 Thread Lionel Elie Mamane
On Mon, Nov 21, 2005 at 10:35:01AM -0500, Joey Hess wrote:
> Brian M. Carlson wrote:

>> Additionally, the robots.txt is being violated by "bts cache", so
>> perhaps someone should file a bug.

> "bts cache" is not a web spider, it only downloads the bugs that you
> tell it to. It violates the robots.txt much less than eg, wget.

wget (in non-recursive behaviour, never following any link) downloads
only the URLs you tell it too, so according to the same argument,
doesn't violate robots.txt . In recursive mode (following links), wget
respects robots.txt (by default).

--
Lionel


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-21 Thread Joey Hess
Blars Blarson wrote:
> If you can't use one of the program intfaces listed above for some
> reason, put a 5 second sleep between the completion of one request and
> sending the next.  That spreads the load out and gives others a chance
> to access the BTS.

Done in devscripts 2.9.9.


PS: Will we ever stop hosting two critical and demanding services (bts,
archive) on the same overloaded machine?

-- 
see shy jo


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-21 Thread Andreas Barth
* Joey Hess ([EMAIL PROTECTED]) [051121 16:34]:
> The LDAP interface is not production quality enough to be used by
> anything IMHO. It seems to be down or moved to somewhere else half the
> time.

It should now have a permanent address at bts2ldap.debian.net, so at
least the moving around should be part of the history. However, sadly,
it's still only project and not product quality. Any help on that would
be welcome.

Cheers,
Andi
-- 
  http://home.arcor.de/andreas-barth/


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-21 Thread Joey Hess
Brian M. Carlson wrote:
> > If you need to access the BTS data from a program, there is an LDAP
> > interface available and a copy of entire BTS database on one of the
> > developer accessable machines.
> 
> Then "bts cache" should use that, and not HTTP, or perhaps only fall back to 
> HTTP.

The LDAP interface is not production quality enough to be used by
anything IMHO. It seems to be down or moved to somewhere else half the
time. We (devscripts maints) have had to switch other programs
(tagpending) away from using it due to these problems.

Using the cache would be good, except it's only available to debian
developers via ssh.

> Additionally, the robots.txt is being violated by "bts cache", so 
> perhaps someone should file a bug.

"bts cache" is not a web spider, it only downloads the bugs that you
tell it to. It violates the robots.txt much less than eg, wget.

-- 
see shy jo



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-20 Thread David Moreno Garza
On 16:14 Sun 20 Nov 2005, Graham Wilson wrote:
> Wouldn't it also be possible to subscribe to debian-bugs-dist to get
> updates about the relevant bugs that way? Though, that might take quite
> a bit more processing on the receiving end than using the LDAP
> interface.

But the first is a preferred way, since that would bring you the conversation
within the bug report right to you, and the LDAP gateway won't.

-- 
David Moreno Garza <[EMAIL PROTECTED]>   |  http://www.damog.net/
   <[EMAIL PROTECTED]>  |  GPG: C671257D
 En marciano me fui a convertir.


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-20 Thread Graham Wilson
On Sun, Nov 20, 2005 at 10:44:15AM -0800, Blars Blarson wrote:
> If you need to access the BTS data from a program, there is an LDAP
> interface available and a copy of entire BTS database on one of the
> developer accessable machines.

Wouldn't it also be possible to subscribe to debian-bugs-dist to get
updates about the relevant bugs that way? Though, that might take quite
a bit more processing on the receiving end than using the LDAP
interface.

-- 
gram


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-20 Thread David Moreno Garza
On 08:33 Sun 20 Nov 2005, Christian Perrier wrote:
> It seems that this became enough for my address being listed...and now
> I can't work anymore on any bug from my home system. 
> 
> I will probably use a workaround by using my ISP proxy server but this
> just moves the problem elsewhere...

What about...

% ldapsearch -h bts2ldap.debian.net -p 10101 -LLL -x -b 
dc=current,dc=bugs,dc=debian,dc=org 'debbugsID=33' -s sub

...when you only want some information keys regarding the bug, as a
suboptimal workaround?

-- 
David Moreno Garza <[EMAIL PROTECTED]>   |  http://www.damog.net/
   <[EMAIL PROTECTED]>  |  GPG: C671257D
 Save the planet, it is the only one with chocolate.


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-20 Thread Brian M. Carlson
On Sunday 20 November 2005 18:44, Blars Blarson wrote:
> If you need to access the BTS data from a program, there is an LDAP
> interface available and a copy of entire BTS database on one of the
> developer accessable machines.

Then "bts cache" should use that, and not HTTP, or perhaps only fall back to 
HTTP.  Additionally, the robots.txt is being violated by "bts cache", so 
perhaps someone should file a bug.

-- 
Brian M. Carlson <[EMAIL PROTECTED]>
Running on GNU/kFreeBSD
Support alternative kernels in Debian!


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-20 Thread Blars Blarson
In article <[EMAIL PROTECTED]> you write:
>(this mail was CC'ed to debian-admin but I messed up in the To field)

[EMAIL PROTECTED] would be the correct place to send this.

>Since yesterday, I'm afraid that my IP address 81.56.227.253 is listed
>on bugs.debian.org among addresses which get a "Go away" answer when
>requesting a specific bug report (http://bugs.debian.org/xx)

And as of about 9 hours ago the listing was removed.

>>From discussions I had on IRC with Anthony Towns, this seems to be
>caused by numerous requests made by my system to the BTS at regular
>intervals.

The BTS web pages are NOT designed to be abused like that.  We've had
cases where a single IP drove the load average of spohr over 80 and
basicly shut down all bug processing for hours.

As most of the obvious cases where many requests are being made to the
BTS web look like spammers harvesting email addresses, I've been
blocking systems from accessing the BTS more lately.

If you need to access the BTS data from a program, there is an LDAP
interface available and a copy of entire BTS database on one of the
developer accessable machines.

>Is there something I can do for getting my address unlisted (apart
>from again reducing the load I put on b.d.o...which I did again down
>to the lowest acceptable refresh rate on my side)?

[EMAIL PROTECTED] is the proper place to send your request.

If you can't use one of the program intfaces listed above for some
reason, put a 5 second sleep between the completion of one request and
sending the next.  That spreads the load out and gives others a chance
to access the BTS.


-- 
Blars Blarson   [EMAIL PROTECTED]
http://www.blars.org/blars.html
With Microsoft, failure is not an option.  It is a standard feature.


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: My IP address seems listed as a spammer address by bugs.debian.org

2005-11-20 Thread Florian Weimer
* Christian Perrier:

> Is there something I can do for getting my address unlisted (apart
> from again reducing the load I put on b.d.o...which I did again down
> to the lowest acceptable refresh rate on my side)?

There is a BTS mirror on merkel.  Maybe you could mirror the bug
reports you are interested in from there?


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]