[Pdns-users] PowerDNS Recursor 3.3-RC3 released
Dear PowerDNS community, PowerDNS Recursor 3.3 Release Candidate 3 is now available! It is in wide production use already, but we'd like everyone to take a good look at it before we release it as 3.3-final. If nothing crops up, RC3 will be the exact same as the 3.3 release. RC1 had some compilation problems on popular platforms like CentOS5/RHEL5, which forced a quick RC2. RC2 emitted harmless warnings about the root expiring, but such warnings don't look too harmless, so they had to be fixed. Tar, RPM & Deb for 32 bit and 64 bit platforms can be found on http://svn.powerdns.com/release-candidates/ The release notes are also available as HTML with clickable links on http://doc.powerdns.com/changelog.html#CHANGELOG-RECURSOR-3-3 Version 3.3 fixes a number of small but persistent issues, rounds off our IPv6 support and adds an important feature for many users of the Lua scripts. In addition, scalability on Solaris 10 is improved. Changes between RC1, RC2 and RC3. * RC2: Fixed linking on RHEL5/CENTOS5, which both ship with a gcc compiler that claims to support atomic operations, but doesn't. Code in commit 1714. Spotted by 'Bas' and Imre Gergely. * RC2: Negative query cache was configured to grow too large, and was not cleaned efficiently. Code in commit 1712, spotted by Imre Gergely. * RC3: Root failed to be renewed automatically, relied on fallback to make this happen. Code in commit 1716, spotted by Detlef Peeters. 3.3 release notes follow. Bug fixes: * 'dist-recursor' script was not compatible with pure POSIX /bin/sh, discovered by Simon Kirby. Fix in commit 1545. * Simon Bedford, Brad Dameron and Laurient Papier discovered relatively high TCP/IP loads could cause TCP/IP service to shut down over time. Addressed in commits 1546, 1640, 1652, 1685, 1698. Additional information provided by Zwane Mwaikambo, Nicholas Miell and Jeff Roberson. Testing by Christian Hofstaedtler and Michael Renner. * The PowerDNS Recursor could not read the 'root zone' (this is something else than the root hints) because of an unquoted TXT record. This has now been addressed, allowing operators to hardcode the root zone. This can improve security if the root zone used is kept up to date. Change in commit 1547. * A return of an old bug, when a domain gets new nameservers, but the old nameservers continue to contain a copy of the domain, PowerDNS could get 'stuck' with the old servers. Fixed in commit 1548. * Discovered & reported by Alexander Gall of SWITCH, the Recursor used to try to resolve 'AXFR' records over UDP. Fix in commit 1619. * The Recursor embedded authoritative server messed up parsing a record like '@ IN MX 15 @'. Spotted by Aki Tuomi, fix in commit 1621. * The Recursor embedded authoritative server messed up parsing really really long lines. Spotted by Marco Davids, fix in commit 1624, commit 1625. * Packet cache was not DNS class correct. Spotted by "Robin", fix in commit 1688. * The packet cache would cache some NXDOMAINS for too long. Solving this bug exposed an underlying oddity where the initial NXDOMAIN response had an overly long (untruncated) TTL, whereas all the next ones would be ok. Solved in commit 1679, closing ticket 281. Especially important for RBL operators. Fixed after some nagging by Alex Broens (thanks). Improvements: * The priming of the root now uses more IPv6 addresses. Change in commit 1550, closes ticket 287. Also, the IPv6 address of I.ROOT-SERVERS.NET was added in commit 1650. * The rec_control dump-cache command now also dumps the 'negative query' cache. Code in commit 1713. * PowerDNS Recursor can now bind to fe80 IPv6 space with '%eth0' link selection. Suggested by Darren Gamble, implemented with help from Niels Bakker. Change in commit 1620. * Solaris on x86 has a long standing bug in port_getn(), which we now work around. Spotted by 'Dirk' and 'AS'. Solution suggested by the Apache runtime library, update in commit 1622. * New runtime statistic: 'tcp-clients' which lists the number of currently active TCP/IP clients. Code in commit 1623. * Deal better with UltraDNS style CNAME redirects containing SOA records. Spotted by Andy Fletcher from UKDedicated in ticket 303, fix in commit 1628. * The packet cache, which has 'ready to use' packets containing answers, now artificially ages the ready to use packets. Code in commit 1630. * Lua scripts can now indicate that certain queries will have 'variable' answers, which means that the packet cache will not touch these answers. This is great for overriding some domains for some users, but not all of them. Use setvariable() in Lua to indicate such domains. Code in commit 1636. * Add query statistic called 'dont-outqueries', plus add IPv6 address :: and IPv4 address 0.0.0.0 to the
Re: [Pdns-users] pdns-recursor-3.3rc2 cache is growing slow
On Mon, 20 Sep 2010 13:17:06 +0300, Imre Gergely wrote: > On 09/20/2010 12:46 PM, Detlef Peeters wrote: >> On Mon, 20 Sep 2010 11:39:36 +0200, bert hubert >> wrote: >>> Odd - can you paste some 'stats:' lines from the log files? >>> >>> stats: 4331362754 questions, 1003788 cache entries, 100987 negative entries, >>> 27% cache hits >>> stats: throttle map: 2752, ns speeds: 76672 >>> stats: outpacket/query ratio 3205%, 2% throttled, 0 no-delegation drops >>> stats: 263614 outgoing tcp connections, 146 queries running, 45761180 >>> outgoing timeouts >>> stats: 504910 packet cache entries, 8798% packet cache hits >>> stats: 6286 qps (average over 1801 seconds) >>> >>> This is from our testing of rc1. >> >> Yes, >> >> here are some stats: >> >> stats: 155898 questions, 83540 cache entries, 1237 negative entries, >> 21% cache hits >> stats: throttle map: 2, ns speeds: 2371 >> stats: outpacket/query ratio 138%, 0% throttled, 0 no-delegation drops >> stats: 108 outgoing tcp connections, 1 queries running, 2483 outgoing >> timeouts >> stats: 24177 packet cache entries, 8% packet cache hits >> stats: 1 qps (average over 1916 seconds) > > Is this pdns 3.3-rc2 actually being used? Seems to me it's getting > really low traffic. Are these stats from the 3.3rc2 running for six days > straight? 155k questions would hardly fill up a cache of 1mil. Yes, these stats are from the 3.3rc2. Here are some old stats from the same server running with 3.2 installed: stats: 11844008 questions, 1000141 cache entries, 4347 negative entries, 10% cache hits stats: throttle map: 67, ns speeds: 3561 stats: outpacket/query ratio 102%, 0% throttled, 0 no-delegation drops stats: 1347 outgoing tcp connections, 7 queries running, 138758 outgoing timeouts stats: 500145 packet cache entries, 4% packet cache hits stats: 11 qps (average over 2015 seconds) regards, Detlef ___ Pdns-users mailing list Pdns-users@mailman.powerdns.com http://mailman.powerdns.com/mailman/listinfo/pdns-users
Re: [Pdns-users] pdns-recursor-3.3rc2 cache is growing slow
Brad, I had not gotten back to you on that one, I think in your test you flooded the server with many many 'dig +tcp' sessions, far more than were configured to be allowed at any one time. This may explain your results - powerdns probably did not 'see' a lot of your queries. Regarding Detlefs numbers, at very low query rates (I see 1qps), it may indeed be possible that parts of the cache are now being cleaned more efficiently. I don't exactly know which parts of the cache Detlef saw as bigger before. The numbers look pretty normal though, > > stats: 155898 questions, 83540 cache entries, 1237 negative entries, It would be very hard to have a lot more cache entries than questions. Bert On Mon, Sep 20, 2010 at 10:13:37AM +, Brad Dameron wrote: > I have been wondering about the stats reporting as well. When I do my 3 > million test the tcp connections was only showing about 1.2 million requests > when I know I did 3 million of them. I tested this many times with varying > results. Almost like all the threads are not reporting the total correctly. > > Brad > > > -Original Message- > > From: pdns-users-boun...@mailman.powerdns.com [mailto:pdns-users- > > boun...@mailman.powerdns.com] On Behalf Of Detlef Peeters > > Sent: Monday, September 20, 2010 2:46 AM > > To: bert hubert > > Cc: Pdns-users@mailman.powerdns.com > > Subject: Re: [Pdns-users] pdns-recursor-3.3rc2 cache is growing slow > > > > On Mon, 20 Sep 2010 11:39:36 +0200, bert hubert > > wrote: > > > Odd - can you paste some 'stats:' lines from the log files? > > > > > > stats: 4331362754 questions, 1003788 cache entries, 100987 negative > > entries, > > > 27% cache hits > > > stats: throttle map: 2752, ns speeds: 76672 > > > stats: outpacket/query ratio 3205%, 2% throttled, 0 no-delegation > > drops > > > stats: 263614 outgoing tcp connections, 146 queries running, 45761180 > > > outgoing timeouts > > > stats: 504910 packet cache entries, 8798% packet cache hits > > > stats: 6286 qps (average over 1801 seconds) > > > > > > This is from our testing of rc1. > > > > Yes, > > > > here are some stats: > > > > stats: 155898 questions, 83540 cache entries, 1237 negative entries, > > 21% cache hits > > stats: throttle map: 2, ns speeds: 2371 > > stats: outpacket/query ratio 138%, 0% throttled, 0 no-delegation drops > > stats: 108 outgoing tcp connections, 1 queries running, 2483 outgoing > > timeouts > > stats: 24177 packet cache entries, 8% packet cache hits > > stats: 1 qps (average over 1916 seconds) > > > > regards, > > > > Detlef > > ___ > > Pdns-users mailing list > > Pdns-users@mailman.powerdns.com > > http://mailman.powerdns.com/mailman/listinfo/pdns-users > > > This email may contain confidential and privileged material for the sole use > of the intended recipient. Any review, use, distribution or disclosure by > others is strictly prohibited. If you are not the intended recipient (or > authorized to receive for the recipient), please contact the sender by reply > email and delete all copies of this message. > > > ___ > Pdns-users mailing list > Pdns-users@mailman.powerdns.com > http://mailman.powerdns.com/mailman/listinfo/pdns-users > ___ Pdns-users mailing list Pdns-users@mailman.powerdns.com http://mailman.powerdns.com/mailman/listinfo/pdns-users
Re: [Pdns-users] pdns-recursor-3.3rc2 cache is growing slow
On 09/20/2010 12:46 PM, Detlef Peeters wrote: > On Mon, 20 Sep 2010 11:39:36 +0200, bert hubert > wrote: >> Odd - can you paste some 'stats:' lines from the log files? >> >> stats: 4331362754 questions, 1003788 cache entries, 100987 negative entries, >> 27% cache hits >> stats: throttle map: 2752, ns speeds: 76672 >> stats: outpacket/query ratio 3205%, 2% throttled, 0 no-delegation drops >> stats: 263614 outgoing tcp connections, 146 queries running, 45761180 >> outgoing timeouts >> stats: 504910 packet cache entries, 8798% packet cache hits >> stats: 6286 qps (average over 1801 seconds) >> >> This is from our testing of rc1. > > Yes, > > here are some stats: > > stats: 155898 questions, 83540 cache entries, 1237 negative entries, > 21% cache hits > stats: throttle map: 2, ns speeds: 2371 > stats: outpacket/query ratio 138%, 0% throttled, 0 no-delegation drops > stats: 108 outgoing tcp connections, 1 queries running, 2483 outgoing > timeouts > stats: 24177 packet cache entries, 8% packet cache hits > stats: 1 qps (average over 1916 seconds) Is this pdns 3.3-rc2 actually being used? Seems to me it's getting really low traffic. Are these stats from the 3.3rc2 running for six days straight? 155k questions would hardly fill up a cache of 1mil. -- Imre Gergely Yahoo!: gergelyimre | ICQ#: 101510959 MSN: gergely_imre | GoogleTalk: gergelyimre gpg --keyserver subkeys.pgp.net --recv-keys 0x34525305 ___ Pdns-users mailing list Pdns-users@mailman.powerdns.com http://mailman.powerdns.com/mailman/listinfo/pdns-users
Re: [Pdns-users] pdns-recursor-3.3rc2 cache is growing slow
I have been wondering about the stats reporting as well. When I do my 3 million test the tcp connections was only showing about 1.2 million requests when I know I did 3 million of them. I tested this many times with varying results. Almost like all the threads are not reporting the total correctly. Brad > -Original Message- > From: pdns-users-boun...@mailman.powerdns.com [mailto:pdns-users- > boun...@mailman.powerdns.com] On Behalf Of Detlef Peeters > Sent: Monday, September 20, 2010 2:46 AM > To: bert hubert > Cc: Pdns-users@mailman.powerdns.com > Subject: Re: [Pdns-users] pdns-recursor-3.3rc2 cache is growing slow > > On Mon, 20 Sep 2010 11:39:36 +0200, bert hubert > wrote: > > Odd - can you paste some 'stats:' lines from the log files? > > > > stats: 4331362754 questions, 1003788 cache entries, 100987 negative > entries, > > 27% cache hits > > stats: throttle map: 2752, ns speeds: 76672 > > stats: outpacket/query ratio 3205%, 2% throttled, 0 no-delegation > drops > > stats: 263614 outgoing tcp connections, 146 queries running, 45761180 > > outgoing timeouts > > stats: 504910 packet cache entries, 8798% packet cache hits > > stats: 6286 qps (average over 1801 seconds) > > > > This is from our testing of rc1. > > Yes, > > here are some stats: > > stats: 155898 questions, 83540 cache entries, 1237 negative entries, > 21% cache hits > stats: throttle map: 2, ns speeds: 2371 > stats: outpacket/query ratio 138%, 0% throttled, 0 no-delegation drops > stats: 108 outgoing tcp connections, 1 queries running, 2483 outgoing > timeouts > stats: 24177 packet cache entries, 8% packet cache hits > stats: 1 qps (average over 1916 seconds) > > regards, > > Detlef > ___ > Pdns-users mailing list > Pdns-users@mailman.powerdns.com > http://mailman.powerdns.com/mailman/listinfo/pdns-users This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message. ___ Pdns-users mailing list Pdns-users@mailman.powerdns.com http://mailman.powerdns.com/mailman/listinfo/pdns-users
Re: [Pdns-users] pdns-recursor-3.3rc2 cache is growing slow
On Mon, 20 Sep 2010 11:39:36 +0200, bert hubert wrote: > Odd - can you paste some 'stats:' lines from the log files? > > stats: 4331362754 questions, 1003788 cache entries, 100987 negative entries, > 27% cache hits > stats: throttle map: 2752, ns speeds: 76672 > stats: outpacket/query ratio 3205%, 2% throttled, 0 no-delegation drops > stats: 263614 outgoing tcp connections, 146 queries running, 45761180 > outgoing timeouts > stats: 504910 packet cache entries, 8798% packet cache hits > stats: 6286 qps (average over 1801 seconds) > > This is from our testing of rc1. Yes, here are some stats: stats: 155898 questions, 83540 cache entries, 1237 negative entries, 21% cache hits stats: throttle map: 2, ns speeds: 2371 stats: outpacket/query ratio 138%, 0% throttled, 0 no-delegation drops stats: 108 outgoing tcp connections, 1 queries running, 2483 outgoing timeouts stats: 24177 packet cache entries, 8% packet cache hits stats: 1 qps (average over 1916 seconds) regards, Detlef ___ Pdns-users mailing list Pdns-users@mailman.powerdns.com http://mailman.powerdns.com/mailman/listinfo/pdns-users
Re: [Pdns-users] pdns-recursor-3.3rc2 cache is growing slow
Odd - can you paste some 'stats:' lines from the log files? stats: 4331362754 questions, 1003788 cache entries, 100987 negative entries, 27% cache hits stats: throttle map: 2752, ns speeds: 76672 stats: outpacket/query ratio 3205%, 2% throttled, 0 no-delegation drops stats: 263614 outgoing tcp connections, 146 queries running, 45761180 outgoing timeouts stats: 504910 packet cache entries, 8798% packet cache hits stats: 6286 qps (average over 1801 seconds) This is from our testing of rc1. Bert On Mon, Sep 20, 2010 at 11:00:58AM +0200, Detlef Peeters wrote: > Hello, > > I've noticed on the machine I am testing pdns-recursor-3.3rc2 the > cache is growing really slow. After 6 days there are only 80.000 > entries. With pdns-recursor-3.2 the cache is filled up to 1.000.000 > entries after 5 days. > > Has there something changed with the cache handling in > pdns-recursor-3.3rc2? > > regards, > > Detlef > > ___ > Pdns-users mailing list > Pdns-users@mailman.powerdns.com > http://mailman.powerdns.com/mailman/listinfo/pdns-users > ___ Pdns-users mailing list Pdns-users@mailman.powerdns.com http://mailman.powerdns.com/mailman/listinfo/pdns-users
[Pdns-users] pdns-recursor-3.3rc2 cache is growing slow
Hello, I've noticed on the machine I am testing pdns-recursor-3.3rc2 the cache is growing really slow. After 6 days there are only 80.000 entries. With pdns-recursor-3.2 the cache is filled up to 1.000.000 entries after 5 days. Has there something changed with the cache handling in pdns-recursor-3.3rc2? regards, Detlef ___ Pdns-users mailing list Pdns-users@mailman.powerdns.com http://mailman.powerdns.com/mailman/listinfo/pdns-users
