Re: [Dnsmasq-discuss] Stats improvement
On Thu, 2014-03-27 at 20:57 +, Simon Kelley wrote: On 26/03/14 05:12, Olivier Mauras wrote: Yes it should definitely be TXT records. Sounds really good to me. for upstream servers, why not having upstream.bind return total queries forwarded + list of upstream servers that can then be check individually with: dig TXT server1.upstream.bind OK. Code in git now. Try eg dig +short chaos txt misses.bind and dig +short chaos txt servers.bind Cheers, Simon. Olivier On Tue, 2014-03-25 at 21:37 +, Simon Kelley wrote: My feeling it that this should use TXT records, then they can be extracted into any application using eg dig +short chaos txt stats.bind or the equivalent, which outputs the string to stdout. The current code has, cache-size, insertions which evicted unexpired cache entries, queries forwarded, queries answered locally, queries for auth zones. then for each upstream server, queries sent, and queries retried or failed. We could have size.bind and evictions.bind for cache size and evictions local.bind, upstream.bind and auth.bind for queries. But how to handle the variable number of upstream servers. Just free text? Simon. Enigmail On 24/03/14 22:53, Olivier Mauras wrote: On Mon, 2014-03-24 at 21:55 +, Simon Kelley wrote: On 24/03/14 11:25, Olivier Mauras wrote: Hello, I was wondering what would be the effort, and if there'd actually be any interest for some dnsmasq statistics improvements. (Yes i'm splitting dicussions ^^) For monitoring/graph purposes, actual dnsmasq stats are a bit difficult to use and completely unusable if using log_queries as it takes too long to retrieve them inside logs. I'd love to see a stats interface that would output total_queries, cache_hits, cache_misses, memory used by cache, etc Thanks, Olivier There's an idea to make this available as a DNS query, in the same way that dig chaos txt version.bind returns the version number. Comments? Cheers, Simon. That would be a really good way of doing it! Just gave it a quick check, this is brilliant :) Thanks a lot for this! Olivier signature.asc Description: This is a digitally signed message part ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss
Re: [Dnsmasq-discuss] Stats improvement
On Fri, Mar 28, 2014 at 9:35 AM, Dave Taht dave.t...@gmail.com wrote: On Thu, Mar 27, 2014 at 1:57 PM, Simon Kelley si...@thekelleys.org.uk wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 26/03/14 05:12, Olivier Mauras wrote: Yes it should definitely be TXT records. Sounds really good to me. for upstream servers, why not having upstream.bind return total queries forwarded + list of upstream servers that can then be check individually with: dig TXT server1.upstream.bind OK. Code in git now. Try eg dig +short chaos txt misses.bind and dig +short chaos txt servers.bind I haven't looked at the code yet, but my take on this was originally that I'd wanted a single dns reply for all the statistics (can live without), 64 bit counters, and not only tracking misses but the latency cost of a miss. Then there are misses that are never latency cost of a fill, I meant. This would end up giving stats that are comparable to namebench. resolved... and (even harder), things like a 5 minute rolling average... and a breakdown by query type (, A, DS, etc) gettimeofday() is very efficient on modern linuxes (it gets the time from a shared page cache without even making a syscall), but I can see that you might want to be able to compile that out. And I wasn't expecting you to get to it in this release! Just basic stats is great Cheers, Simon. Olivier On Tue, 2014-03-25 at 21:37 +, Simon Kelley wrote: My feeling it that this should use TXT records, then they can be extracted into any application using eg dig +short chaos txt stats.bind or the equivalent, which outputs the string to stdout. The current code has, cache-size, insertions which evicted unexpired cache entries, queries forwarded, queries answered locally, queries for auth zones. then for each upstream server, queries sent, and queries retried or failed. We could have size.bind and evictions.bind for cache size and evictions local.bind, upstream.bind and auth.bind for queries. But how to handle the variable number of upstream servers. Just free text? Simon. Enigmail On 24/03/14 22:53, Olivier Mauras wrote: On Mon, 2014-03-24 at 21:55 +, Simon Kelley wrote: On 24/03/14 11:25, Olivier Mauras wrote: Hello, I was wondering what would be the effort, and if there'd actually be any interest for some dnsmasq statistics improvements. (Yes i'm splitting dicussions ^^) For monitoring/graph purposes, actual dnsmasq stats are a bit difficult to use and completely unusable if using log_queries as it takes too long to retrieve them inside logs. I'd love to see a stats interface that would output total_queries, cache_hits, cache_misses, memory used by cache, etc Thanks, Olivier There's an idea to make this available as a DNS query, in the same way that dig chaos txt version.bind returns the version number. Comments? Cheers, Simon. That would be a really good way of doing it! -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlM0kMsACgkQKPyGmiibgrcBGQCgh70G5hX6LqTdO+2z0ZEg0PYe 25EAnRvZ79kpqBVa4g9dGz7XXlKCOTR5 =85b/ -END PGP SIGNATURE- -- Dave Täht Fixing bufferbloat with cerowrt: http://www.teklibre.com/cerowrt/subscribe.html -- Dave Täht Fixing bufferbloat with cerowrt: http://www.teklibre.com/cerowrt/subscribe.html ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss
[Dnsmasq-discuss] Stats improvement
Hello, I was wondering what would be the effort, and if there'd actually be any interest for some dnsmasq statistics improvements. (Yes i'm splitting dicussions ^^) For monitoring/graph purposes, actual dnsmasq stats are a bit difficult to use and completely unusable if using log_queries as it takes too long to retrieve them inside logs. I'd love to see a stats interface that would output total_queries, cache_hits, cache_misses, memory used by cache, etc Thanks, Olivier ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss
Re: [Dnsmasq-discuss] Stats improvement
On 2014-03-24 12:25, Olivier Mauras wrote: I'd love to see a stats interface that would output total_queries, cache_hits, cache_misses, memory used by cache, etc What's wrong with: kill -SIGUSR1 `pidof dnsmasq` Olaf ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss
Re: [Dnsmasq-discuss] Stats improvement
Mainly that it's barely usable with log_queries as greping log files of 4 to 6GB tends to not be that responsive... On 2014-03-24 13:33, Olaf Westrik wrote: On 2014-03-24 12:25, Olivier Mauras wrote: I'd love to see a stats interface that would output total_queries, cache_hits, cache_misses, memory used by cache, etc What's wrong with: kill -SIGUSR1 `pidof dnsmasq` Olaf ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss
Re: [Dnsmasq-discuss] Stats improvement
I would certainly like to have a standard way of getting these statistics, through the dns, perhaps one unified with whatever bind and unbound use (or don't use.) Not a lot of people seem to be aware of why dns caching forwarders are so great, although benchmarks like namebench against your chrome or firefox cache are quite revealing, parsing huge network captures as I am presently to try to get a grip on timings for dns/response pairing is a pita and not router centric. However: Do check out namebench, it's pretty cool. It does bug me that in tests against the alexa top 2000 that it invariably selects some other dns server besides your local one as being the best, because it has the best average - as if you regularly go to websites in timbuktu and care about the response time more than, say, google. Example against alexa top 2000 with a fresh cache: http://snapon.lab.bufferbloat.net/~d/namebench/namebench_2014-03-20_1255.html It is much better to test against your more common query set, which I don't have a snapshot of on that site presently - usually 40% or more of queries are resolved in a ms, 30% or so via your ISP in under 20ms. I'd love to see people posting namebench results from against their firefox/chrome caches... it's in apt on ubuntu at least the version I have is buggy, you have to hit control-C at least once for the gui to come up. On Mon, Mar 24, 2014 at 2:55 PM, Simon Kelley si...@thekelleys.org.uk wrote: On 24/03/14 11:25, Olivier Mauras wrote: Hello, I was wondering what would be the effort, and if there'd actually be any interest for some dnsmasq statistics improvements. (Yes i'm splitting dicussions ^^) For monitoring/graph purposes, actual dnsmasq stats are a bit difficult to use and completely unusable if using log_queries as it takes too long to retrieve them inside logs. I'd love to see a stats interface that would output total_queries, cache_hits, cache_misses, memory used by cache, etc Thanks, Olivier There's an idea to make this available as a DNS query, in the same way that dig chaos txt version.bind returns the version number. Comments? Cheers, Simon. ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss -- Dave Täht Fixing bufferbloat with cerowrt: http://www.teklibre.com/cerowrt/subscribe.html ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss
Re: [Dnsmasq-discuss] Stats improvement
On Mon, 2014-03-24 at 21:55 +, Simon Kelley wrote: On 24/03/14 11:25, Olivier Mauras wrote: Hello, I was wondering what would be the effort, and if there'd actually be any interest for some dnsmasq statistics improvements. (Yes i'm splitting dicussions ^^) For monitoring/graph purposes, actual dnsmasq stats are a bit difficult to use and completely unusable if using log_queries as it takes too long to retrieve them inside logs. I'd love to see a stats interface that would output total_queries, cache_hits, cache_misses, memory used by cache, etc Thanks, Olivier There's an idea to make this available as a DNS query, in the same way that dig chaos txt version.bind returns the version number. Comments? Cheers, Simon. That would be a really good way of doing it! signature.asc Description: This is a digitally signed message part ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss
Re: [Dnsmasq-discuss] Stats improvement
It would be very interesting to see the differences between dnsmasq without DNSSEC, with DNSSEC and with DNSSEC and --dnssec-check-unsigned Cheers, Simon. On 24/03/14 22:50, Dave Taht wrote: On Mon, Mar 24, 2014 at 3:21 PM, Dave Taht dave.t...@gmail.com wrote: I would certainly like to have a standard way of getting these statistics, through the dns, perhaps one unified with whatever bind and unbound use (or don't use.) Not a lot of people seem to be aware of why dns caching forwarders are so great, although benchmarks like namebench against your chrome or firefox cache are quite revealing, parsing huge network captures as I am presently to try to get a grip on timings for dns/response pairing is a pita and not router centric. However: Do check out namebench, it's pretty cool. It does bug me that in tests against the alexa top 2000 that it invariably selects some other dns server besides your local one as being the best, because it has the best average - as if you regularly go to websites in timbuktu and care about the response time more than, say, google. Example against alexa top 2000 with a fresh cache: http://snapon.lab.bufferbloat.net/~d/namebench/namebench_2014-03-20_1255.html It is much better to test against your more common query set, which I don't have a snapshot of on that site presently - usually 40% or more of queries are resolved in a ms, 30% or so via your ISP in under 20ms. I'd love to see people posting namebench results from against their firefox/chrome caches... it's in apt on ubuntu at least the version I have is buggy, you have to hit control-C at least once for the gui to come up. I just did a namebench test against my local firefox cache (without clearing dnsmasq's caches) http://snapon.lab.bufferbloat.net/~d/namebench/namebench_2014-03-24_1541.html note that I have three dns servers in place - one on my local machine, a dnsmasq locally that is sending stuff over ipv6 to another dnsmasq which is then connected over ipv4 and ipv6 to comcasts forwarders. On Mon, Mar 24, 2014 at 2:55 PM, Simon Kelley si...@thekelleys.org.uk wrote: On 24/03/14 11:25, Olivier Mauras wrote: Hello, I was wondering what would be the effort, and if there'd actually be any interest for some dnsmasq statistics improvements. (Yes i'm splitting dicussions ^^) For monitoring/graph purposes, actual dnsmasq stats are a bit difficult to use and completely unusable if using log_queries as it takes too long to retrieve them inside logs. I'd love to see a stats interface that would output total_queries, cache_hits, cache_misses, memory used by cache, etc Thanks, Olivier There's an idea to make this available as a DNS query, in the same way that dig chaos txt version.bind returns the version number. Comments? Cheers, Simon. ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss -- Dave Täht Fixing bufferbloat with cerowrt: http://www.teklibre.com/cerowrt/subscribe.html ___ Dnsmasq-discuss mailing list Dnsmasq-discuss@lists.thekelleys.org.uk http://lists.thekelleys.org.uk/mailman/listinfo/dnsmasq-discuss
