Bug#335893: Using the geoip or geoipfree plugin makes awstats.pl too slow (network access?)
tag 335893 -fixed-upstream severity 335893 wishlist thanks I have forwarded your bugreport to upstream (previous one was closed due to timeout): https://sourceforge.net/tracker/?func=detailaid=3015831group_id=13764atid=113764 Please, beware. I will downgrade the severity to wishlist. There is nothing to do for documentation, but parallel dns queries seems to be a good suggestion anyway. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#335893: Using the geoip or geoipfree plugin makes awstats.pl too slow (network access?)
Package: awstats
Version: 6.4-2
Severity: normal
If I use the geoip or geoipfree plugin, awstats.pl is much slower
during an update: one loses at least a factor 100, not 8 or 10% as
advertised! But this takes no CPU time; I assume this is because
the hosts need to be resolved. Here's a part of a strace -r:
[...]
0.000147 open(/etc/hosts, O_RDONLY) = -1 ENOENT (No such file or
directory)
0.47 gettimeofday({1130338331, 48191}, NULL) = 0
0.38 socket(PF_INET, SOCK_DGRAM, IPPROTO_IP) = 7
0.36 connect(7, {sa_family=AF_INET, sin_port=htons(53),
sin_addr=inet_addr(152.81.1.25)}, 28) = 0
0.43 fcntl64(7, F_GETFL) = 0x2 (flags O_RDWR)
0.29 fcntl64(7, F_SETFL, O_RDWR|O_NONBLOCK) = 0
0.26 gettimeofday({1130338331, 48362}, NULL) = 0
0.30 poll([{fd=7, events=POLLOUT, revents=POLLOUT}], 1, 0) = 1
0.36 send(7, f]\1\0\0\1\0\0\0\0\0\0\rh00095b3f4ae0\2ne\7cl..., 52,
0) = 52
0.47 poll([{fd=7, events=POLLIN}], 1, 5000) = 0
5.001788 socket(PF_INET, SOCK_DGRAM, IPPROTO_IP) = 8
0.45 connect(8, {sa_family=AF_INET, sin_port=htons(53),
sin_addr=inet_addr(152.81.1.128)}, 28) = 0
0.48 fcntl64(8, F_GETFL) = 0x2 (flags O_RDWR)
0.31 fcntl64(8, F_SETFL, O_RDWR|O_NONBLOCK) = 0
0.28 gettimeofday({1130338336, 50415}, NULL) = 0
0.31 poll([{fd=8, events=POLLOUT, revents=POLLOUT}], 1, 0) = 1
0.37 send(8, f]\1\0\0\1\0\0\0\0\0\0\rh00095b3f4ae0\2ne\7cl..., 52,
0) = 52
0.50 poll([{fd=8, events=POLLIN}], 1, 5000) = 0
5.003865 gettimeofday({1130338341, 54401}, NULL) = 0
0.34 poll([{fd=7, events=POLLOUT, revents=POLLOUT}], 1, 0) = 1
0.38 send(7, f]\1\0\0\1\0\0\0\0\0\0\rh00095b3f4ae0\2ne\7cl..., 52,
0) = 52
0.53 poll([{fd=7, events=POLLIN}], 1, 5000) = 0
5.004018 gettimeofday({1130338346, 58545}, NULL) = 0
0.35 poll([{fd=8, events=POLLOUT, revents=POLLOUT}], 1, 0) = 1
0.37 send(8, f]\1\0\0\1\0\0\0\0\0\0\rh00095b3f4ae0\2ne\7cl..., 52,
0) = 52
0.51 poll([{fd=8, events=POLLIN}], 1, 5000) = 0
5.004004 close(7) = 0
0.38 close(8) = 0
[...]
I don't know if there is a bug in the script or if the documentation
is wrong. In the latter case, this could probably be optimized (e.g.
with parallel queries).
-- System Information:
Debian Release: testing/unstable
APT prefers unstable
APT policy: (500, 'unstable'), (500, 'testing'), (500, 'stable')
Architecture: i386 (i686)
Shell: /bin/sh linked to /bin/bash
Kernel: Linux 2.6.13.4-20051012
Locale: LANG=POSIX, LC_CTYPE=en_US.ISO8859-1 (charmap=ISO-8859-1)
Versions of packages awstats depends on:
ii perl [libstorable-perl] 5.8.7-7Larry Wall's Practical Extraction
Versions of packages awstats recommends:
ii libnet-xwhois-perl0.90-1 Whois Client Interface for Perl5
-- no debconf information
--
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Bug#335893: Using the geoip or geoipfree plugin makes awstats.pl too slow (network access?)
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Wed, 26 Oct 2005 17:30:41 +0200 Vincent Lefevre [EMAIL PROTECTED] wrote: If I use the geoip or geoipfree plugin, awstats.pl is much slower during an update: one loses at least a factor 100, not 8 or 10% as advertised! But this takes no CPU time; I assume this is because the hosts need to be resolved. Here's a part of a strace -r: I don't know if there is a bug in the script or if the documentation is wrong. In the latter case, this could probably be optimized (e.g. with parallel queries). Hmm - speed of dns lookups is wildly dependent on your system setup and the Internet weather in general. So even if documented is will be only speculation. I suggest closing this as a non-bug, but leave open for now to allow other opinions. - Jonas - -- * Jonas Smedegaard - idealist og Internet-arkitekt * Tlf.: +45 40843136 Website: http://dr.jones.dk/ - Enden er nær: http://www.shibumi.org/eoti.htm -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.2 (GNU/Linux) iD8DBQFDX8a/n7DbMsAkQLgRAuDPAJ9DXxB2VgaDR98iCRWO6IVTwiBXGwCdGLMP EXk3t94idBu47hv0dHaJxU0= =cOoQ -END PGP SIGNATURE-
Bug#335893: Using the geoip or geoipfree plugin makes awstats.pl too slow (network access?)
On 2005-10-26 20:11:11 +0200, Jonas Smedegaard wrote: Hmm - speed of dns lookups is wildly dependent on your system setup and the Internet weather in general. So even if documented is will be only speculation. There's still a big difference between a 10% reduction of the speed (build time multiplied by about 1.1) and a build time multiplied by 100. The current value given by the documentation seems to be very wrong. Also, the problem seems to be due to a 5-second timeout (or is there another explanation?). In this case, parallel queries could greatly improve the build time. -- Vincent Lefèvre [EMAIL PROTECTED] - Web: http://www.vinc17.org/ 100% accessible validated (X)HTML - Blog: http://www.vinc17.org/blog/ Work: CR INRIA - computer arithmetic / SPACES project at LORIA -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
