Re: My IP address seems listed as a spammer address by bugs.debian.org
On Mon, Nov 21, 2005 at 10:35:01AM -0500, Joey Hess wrote: > Brian M. Carlson wrote: >> Additionally, the robots.txt is being violated by "bts cache", so >> perhaps someone should file a bug. > "bts cache" is not a web spider, it only downloads the bugs that you > tell it to. It violates the robots.txt much less than eg, wget. wget (in non-recursive behaviour, never following any link) downloads only the URLs you tell it too, so according to the same argument, doesn't violate robots.txt . In recursive mode (following links), wget respects robots.txt (by default). -- Lionel -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: My IP address seems listed as a spammer address by bugs.debian.org
Blars Blarson wrote: > If you can't use one of the program intfaces listed above for some > reason, put a 5 second sleep between the completion of one request and > sending the next. That spreads the load out and gives others a chance > to access the BTS. Done in devscripts 2.9.9. PS: Will we ever stop hosting two critical and demanding services (bts, archive) on the same overloaded machine? -- see shy jo -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: My IP address seems listed as a spammer address by bugs.debian.org
* Joey Hess ([EMAIL PROTECTED]) [051121 16:34]: > The LDAP interface is not production quality enough to be used by > anything IMHO. It seems to be down or moved to somewhere else half the > time. It should now have a permanent address at bts2ldap.debian.net, so at least the moving around should be part of the history. However, sadly, it's still only project and not product quality. Any help on that would be welcome. Cheers, Andi -- http://home.arcor.de/andreas-barth/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: My IP address seems listed as a spammer address by bugs.debian.org
Brian M. Carlson wrote: > > If you need to access the BTS data from a program, there is an LDAP > > interface available and a copy of entire BTS database on one of the > > developer accessable machines. > > Then "bts cache" should use that, and not HTTP, or perhaps only fall back to > HTTP. The LDAP interface is not production quality enough to be used by anything IMHO. It seems to be down or moved to somewhere else half the time. We (devscripts maints) have had to switch other programs (tagpending) away from using it due to these problems. Using the cache would be good, except it's only available to debian developers via ssh. > Additionally, the robots.txt is being violated by "bts cache", so > perhaps someone should file a bug. "bts cache" is not a web spider, it only downloads the bugs that you tell it to. It violates the robots.txt much less than eg, wget. -- see shy jo
Re: My IP address seems listed as a spammer address by bugs.debian.org
On 16:14 Sun 20 Nov 2005, Graham Wilson wrote: > Wouldn't it also be possible to subscribe to debian-bugs-dist to get > updates about the relevant bugs that way? Though, that might take quite > a bit more processing on the receiving end than using the LDAP > interface. But the first is a preferred way, since that would bring you the conversation within the bug report right to you, and the LDAP gateway won't. -- David Moreno Garza <[EMAIL PROTECTED]> | http://www.damog.net/ <[EMAIL PROTECTED]> | GPG: C671257D En marciano me fui a convertir. -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: My IP address seems listed as a spammer address by bugs.debian.org
On Sun, Nov 20, 2005 at 10:44:15AM -0800, Blars Blarson wrote: > If you need to access the BTS data from a program, there is an LDAP > interface available and a copy of entire BTS database on one of the > developer accessable machines. Wouldn't it also be possible to subscribe to debian-bugs-dist to get updates about the relevant bugs that way? Though, that might take quite a bit more processing on the receiving end than using the LDAP interface. -- gram -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: My IP address seems listed as a spammer address by bugs.debian.org
On 08:33 Sun 20 Nov 2005, Christian Perrier wrote: > It seems that this became enough for my address being listed...and now > I can't work anymore on any bug from my home system. > > I will probably use a workaround by using my ISP proxy server but this > just moves the problem elsewhere... What about... % ldapsearch -h bts2ldap.debian.net -p 10101 -LLL -x -b dc=current,dc=bugs,dc=debian,dc=org 'debbugsID=33' -s sub ...when you only want some information keys regarding the bug, as a suboptimal workaround? -- David Moreno Garza <[EMAIL PROTECTED]> | http://www.damog.net/ <[EMAIL PROTECTED]> | GPG: C671257D Save the planet, it is the only one with chocolate. -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: My IP address seems listed as a spammer address by bugs.debian.org
On Sunday 20 November 2005 18:44, Blars Blarson wrote: > If you need to access the BTS data from a program, there is an LDAP > interface available and a copy of entire BTS database on one of the > developer accessable machines. Then "bts cache" should use that, and not HTTP, or perhaps only fall back to HTTP. Additionally, the robots.txt is being violated by "bts cache", so perhaps someone should file a bug. -- Brian M. Carlson <[EMAIL PROTECTED]> Running on GNU/kFreeBSD Support alternative kernels in Debian! -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: My IP address seems listed as a spammer address by bugs.debian.org
In article <[EMAIL PROTECTED]> you write: >(this mail was CC'ed to debian-admin but I messed up in the To field) [EMAIL PROTECTED] would be the correct place to send this. >Since yesterday, I'm afraid that my IP address 81.56.227.253 is listed >on bugs.debian.org among addresses which get a "Go away" answer when >requesting a specific bug report (http://bugs.debian.org/xx) And as of about 9 hours ago the listing was removed. >>From discussions I had on IRC with Anthony Towns, this seems to be >caused by numerous requests made by my system to the BTS at regular >intervals. The BTS web pages are NOT designed to be abused like that. We've had cases where a single IP drove the load average of spohr over 80 and basicly shut down all bug processing for hours. As most of the obvious cases where many requests are being made to the BTS web look like spammers harvesting email addresses, I've been blocking systems from accessing the BTS more lately. If you need to access the BTS data from a program, there is an LDAP interface available and a copy of entire BTS database on one of the developer accessable machines. >Is there something I can do for getting my address unlisted (apart >from again reducing the load I put on b.d.o...which I did again down >to the lowest acceptable refresh rate on my side)? [EMAIL PROTECTED] is the proper place to send your request. If you can't use one of the program intfaces listed above for some reason, put a 5 second sleep between the completion of one request and sending the next. That spreads the load out and gives others a chance to access the BTS. -- Blars Blarson [EMAIL PROTECTED] http://www.blars.org/blars.html With Microsoft, failure is not an option. It is a standard feature. -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: My IP address seems listed as a spammer address by bugs.debian.org
* Christian Perrier: > Is there something I can do for getting my address unlisted (apart > from again reducing the load I put on b.d.o...which I did again down > to the lowest acceptable refresh rate on my side)? There is a BTS mirror on merkel. Maybe you could mirror the bug reports you are interested in from there? -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]