Re: High memory consumption in bind 9.18.2

2022-08-17 Thread Emmanuel Fusté
on. Thank you very much in advice, Dmitri. -Original Message- From: bind-users On Behalf Of Ondrej Surý Sent: Thursday, August 4, 2022 7:48 PM To: Emmanuel Fusté Cc: bind-users@lists.isc.org Subject: Re: High memory consumption in bind 9.18.2 What Emmanuel said… -- Ondřej Surý

Re: High memory consumption in bind 9.18.2

2022-08-08 Thread Anand Buddhdev
On 08/08/2022 12:29, Dmitri Pavlov wrote: Hi Dmitri, Your response about the KB correctness will help to deliver a better optimized business decision. If you're using BIND in your commercial products and making money from it, you should consider taking out an ISC support contract, so that

RE: High memory consumption in bind 9.18.2

2022-08-05 Thread Dmitri Pavlov
Thank you very much, Team. Your feedback is very much appreciated. Dmitri. -Original Message- From: bind-users On Behalf Of Ondrej Surý Sent: Thursday, August 4, 2022 7:48 PM To: Emmanuel Fusté Cc: bind-users@lists.isc.org Subject: Re: High memory consumption in bind 9.18.2 What

Re: High memory consumption in bind 9.18.2

2022-08-04 Thread Ondřej Surý
What Emmanuel said… -- Ondřej Surý — ISC (He/Him) My working hours and your working hours may be different. Please do not feel obligated to reply outside your normal working hours. > On 4. 8. 2022, at 19:15, Emmanuel Fusté wrote: > > Le 04/08/2022 à 17:48, Dmitri Pavlov a écrit >>

Re: High memory consumption in bind 9.18.2

2022-08-04 Thread Emmanuel Fusté
Le 04/08/2022 à 17:48, Dmitri Pavlov a écrit Therefore, a very small request. Would it be possible on your side to run the same experiment as with (BIND 9.16.32 / BIND 9.18.6 / BIND 9.19.4) one more time but with BIND 9.16.21 (or any other version in 9.16.x <25 range )? Why not the opposite

RE: High memory consumption in bind 9.18.2

2022-08-04 Thread Dmitri Pavlov
rs@lists.isc.org Subject: Re: High memory consumption in bind 9.18.2 Well, then I don’t know the reason for the difference in your case. And I don’t personally see a compelling reason to investigate a 10% increase in artificial scenario like this since it apparently doesn’t apply to all scenario

RE: High memory consumption in bind 9.18.2

2022-08-02 Thread Dmitri Pavlov
gust 2, 2022 6:30 PM To: Dmitri Pavlov Cc: bind-users@lists.isc.org Subject: Re: High memory consumption in bind 9.18.2 Well, then I don’t know the reason for the difference in your case. And I don’t personally see a compelling reason to investigate a 10% increase in artificial scenario like this

RE: High memory consumption in bind 9.18.2

2022-08-02 Thread Dmitri Pavlov
0c" Dmitri. -Original Message- From: Anand Buddhdev Sent: Tuesday, August 2, 2022 6:42 PM To: Dmitri Pavlov Cc: bind-users@lists.isc.org Subject: Re: High memory consumption in bind 9.18.2 Dmitri, Just downloading, building and installing the latest version of jemalloc like this doe

Re: High memory consumption in bind 9.18.2

2022-08-02 Thread Anand Buddhdev
Dmitri, Just downloading, building and installing the latest version of jemalloc like this doesn't mean that BIND will find and use it. BIND has to be compiled with the correct compiler and linker flags to use this version. Are you certain BIND is using your installed version? -- Anand On

Re: High memory consumption in bind 9.18.2

2022-08-02 Thread Ondřej Surý
rom: Dmitri Pavlov > Sent: Tuesday, August 2, 2022 6:14 PM > To: Ondřej Surý > Cc: bind-users@lists.isc.org > Subject: RE: High memory consumption in bind 9.18.2 > > Hi, > > Thank you very much for your feedback, Ondrej. > > Sharing the steps. Very simple: configure -&g

RE: High memory consumption in bind 9.18.2

2022-08-02 Thread Dmitri Pavlov
eboot -f Dmitri. -Original Message- From: Dmitri Pavlov Sent: Tuesday, August 2, 2022 6:14 PM To: Ondřej Surý Cc: bind-users@lists.isc.org Subject: RE: High memory consumption in bind 9.18.2 Hi, Thank you very much for your feedback, Ondrej. Sharing the steps. Very simple: configure -> m

RE: High memory consumption in bind 9.18.2

2022-08-02 Thread Dmitri Pavlov
rom: Ondřej Surý Sent: Tuesday, August 2, 2022 6:20 PM To: Dmitri Pavlov Cc: bind-users@lists.isc.org Subject: Re: High memory consumption in bind 9.18.2 I don’t see jemalloc anywhere in your setup scripts. Preferably use the latest upstream jemalloc version available. Ondřej -- Ondřej Surý —

Re: High memory consumption in bind 9.18.2

2022-08-02 Thread Ondřej Surý
steps be to get the expected smaller memory > footprint. Or maybe there are obvious flaws in the experiment? > > Thanking you very much for patience and cooperation, > Dmitri. > > > > > -Original Message- > From: Ondřej Surý > Sent: Monday, August 1, 20

RE: High memory consumption in bind 9.18.2

2022-08-02 Thread Dmitri Pavlov
Re: High memory consumption in bind 9.18.2 $ wc -l gen.db 1 gen.db generated with: #!/bin/env python3 for x in range(0, 1): for y in range(0, 2500): print(f"az{x}-{y} IN A 10.53.0.1") print(f"bz{x}-{y} IN A 10.53.0.2") print(f"ca{x

Re: High memory consumption in bind 9.18.2

2022-08-01 Thread Ondřej Surý
. That is it. > > We will test with a higher kernel. > > Kind regards, > Dmitri. > > > > > > > > > > -Original Message- > From: Ondřej Surý > Sent: Monday, August 1, 2022 6:46 PM > To: Dmitri Pavlov > Cc: bind-users@lists.isc.

Re: High memory consumption in bind 9.18.2

2022-08-01 Thread Ondřej Surý
> On 1. 8. 2022, at 20:05, Dmitri Pavlov wrote: > The records generation part is different though , using shell script > basically. Unique IPs were linked with unique CNAMEs. I would need the exact algorithm how did you generate the zones. BTW using shell for this takes ages. Generating zone

RE: High memory consumption in bind 9.18.2

2022-08-01 Thread Dmitri Pavlov
s files. That is it. We will test with a higher kernel. Kind regards, Dmitri. -Original Message- From: Ondřej Surý Sent: Monday, August 1, 2022 6:46 PM To: Dmitri Pavlov Cc: bind-users@lists.isc.org Subject: Re: High memory consumption in bind 9.18.2 > On 1. 8. 2022, at 17:19, D

Re: High memory consumption in bind 9.18.2

2022-08-01 Thread Ondřej Surý
$ wc -l gen.db 1 gen.db generated with: #!/bin/env python3 for x in range(0, 1): for y in range(0, 2500): print(f"az{x}-{y} IN A 10.53.0.1") print(f"bz{x}-{y} IN A 10.53.0.2") print(f"ca{x}-{y} IN A 10.53.0.3") print(f"xh{x}-{y} IN CNAME

Re: High memory consumption in bind 9.18.2

2022-08-01 Thread Ondřej Surý
> On 1. 8. 2022, at 17:19, Dmitri Pavlov wrote: > > I’m pretty much sure you will get the same results in your lab. I don’t want to delve into vague description of your experiment. You’ll have to share the exact scripts. Even this: > just the time-consuming task is to generate 100 MIL A +

RE: High memory consumption in bind 9.18.2

2022-08-01 Thread Dmitri Pavlov
ble as the experiment is only to measure a memory footprint of “many” records. Regards, Dmitri. From: bind-users On Behalf Of Dmitri Pavlov Sent: Monday, August 1, 2022 6:19 PM To: Victoria Risk Cc: bind-users@lists.isc.org; Ond≈ôej Sur√Ω Subject: RE: High memory consumption in bind 9.18.2 Thank you

Re: High memory consumption in bind 9.18.2

2022-08-01 Thread Sten Carlsen
-- Best regards Sten Carlsen -- Aoccdrnig to rseerach at Cmabrigde Uinervtisy, it deosn't mttaer in waht oredr the ltteers in a wrod are, the olny iprmoatnt tihng is taht the frist and lsat lteter be at the rghit pclae. The rset can be a ttoal

RE: High memory consumption in bind 9.18.2

2022-08-01 Thread Dmitri Pavlov
out our experiment are required. Regards, Dmitri. From: bind-users On Behalf Of Victoria Risk Sent: Monday, August 1, 2022 6:08 PM To: Doug Whitfield Cc: bind-users@lists.isc.org; Ond≈ôej Sur√Ω Subject: Re: High memory consumption in bind 9.18.2 Hi Doug, I think Ondrej is referring to this p

Re: High memory consumption in bind 9.18.2

2022-08-01 Thread Victoria Risk
Hi Doug, I think Ondrej is referring to this post from a prior month: https://lists.isc.org/pipermail/bind-users/2022-June/106350.html …. For tips on how to measure memory usage you might want to look at

Re: High memory consumption in bind 9.18.2

2022-08-01 Thread Ondřej Surý
> On 1. 8. 2022, at 16:14, Doug Whitfield wrote: > > as monitored from "top" RES value Please read the whole thread on measuring the real consumed memory. The '“top” RES value' has little or no value at all. Ondrej -- Ondřej Surý (He/Him) ond...@isc.org My working hours and your working

Re: High memory consumption in bind 9.18.2

2022-08-01 Thread Doug Whitfield
scenarios it applies to? Best regards, Doug Whitfield From: bind-users on behalf of Petr Špaček Date: Tuesday, July 26, 2022 at 03:16 To: bind-users@lists.isc.org Subject: Re: High memory consumption in bind 9.18.2 On 26. 07. 22 0:14, Doug Whitfield wrote: > I wonder if simply adding the w

Re: High memory consumption in bind 9.18.2

2022-07-26 Thread Petr Špaček
On 26. 07. 22 0:14, Doug Whitfield wrote: I wonder if simply adding the words “in most cases” to the end of the sentence might make it more clear that the 10% increase in memory is not so much a bug as a different use case. I'm eager to see reproducer for this +10 % increase but so far it was

Re: High memory consumption in bind 9.18.2

2022-07-25 Thread Ondřej Surý
There’s no generic tool. The one that was mentioned in the article was tailored for that specific bug in jemalloc. In any case, the article is only tangential to the topic here. It talks about a issue in the jemalloc that was triggered by a specific code in named. Ondřej -- Ondřej Surý — ISC

Re: High memory consumption in bind 9.18.2

2022-07-25 Thread Doug Whitfield
Subject: Re: High memory consumption in bind 9.18.2 I can’t really parse your message. I’ve repeatedly asked you to provide a reproducer. And yet again you come and ask that we do the debugging for you. The currency here that you need to pay to get help is sharing - sharing the information

Re: High memory consumption in bind 9.18.2

2022-07-25 Thread Ondřej Surý
not really help you if you ignore everything that was said to >> >>>>> you regarding the memory measurements. >> >>>>> >> >>>>> Ondrej. >> >>>>> -- >> >>>>> Ondřej Surý (He/Him) >> >>>>

Re: High memory consumption in bind 9.18.2

2022-07-25 Thread Gregory Sloop
that was said to you >>>>>>> regarding the memory measurements. >>>>>>> >>>>>>> Ondrej. >>>>>>> -- >>>>>>> Ondřej Surý (He/Him) >>>>>>> ond...@isc.org >>>>>>&g

Re: High memory consumption in bind 9.18.2

2022-07-25 Thread Raman kumar
expected behaviour or any more tuning is needed? > >>>>> > > >>>>> > One more thing: does CNAME record length also impact the memory > used? > >>>>> > > >>>>> > Regards, > >>>>> > Raman &

Re: High memory consumption in bind 9.18.2

2022-07-21 Thread Ondřej Surý
so impact the memory used? >>>>> > >>>>> > Regards, >>>>> > Raman >>>>> > >>>>> > >>>>> > On Thu, May 19, 2022 at 3:52 PM Petr Špaček wrote: >>>>> > On 18. 05. 22 22:3

Re: High memory consumption in bind 9.18.2

2022-06-21 Thread Ondřej Surý
, at 22:32, Klaus Darilion via bind-users <bind-users@lists.isc.org> wrote: > >> > >> Can you please provide some commands whose output you are interested? I want to collect the statistics for 9.16 before updating to 9.18. > >> Thanks > >> Klaus > >> &g

Re: High memory consumption in bind 9.18.2

2022-06-21 Thread Raman kumar
gt; Ondřej Surý — ISC (He/Him) > > > > > > My working hours and your working hours may be different. Please do > not feel obligated to reply outside your normal working hours. > > > > > >> On 18. 5. 2022, at 22:32, Klaus Darilion via bind-users < >

Re: High memory consumption in bind 9.18.2

2022-06-16 Thread Ondřej Surý
>> > >> Can you please provide some commands whose output you are interested? I > >> want to collect the statistics for 9.16 before updating to 9.18. > >> Thanks > >> Klaus > >> > >>> -Ursprüngliche Nachricht- > >>&g

Re: High memory consumption in bind 9.18.2

2022-06-16 Thread Raman kumar
or 9.16 before updating to 9.18. > >> Thanks > >> Klaus > >> > >>> -Ursprüngliche Nachricht- > >>> Von: bind-users Im Auftrag von Petr > >>> Špacek > >>> Gesendet: Mittwoch, 18. Mai 2022 18:20 > >&g

AW: High memory consumption in bind 9.18.2

2022-05-19 Thread Klaus Darilion via bind-users
Von: Petr Špaček > Gesendet: Donnerstag, 19. Mai 2022 12:22 > An: Klaus Darilion > Cc: bind-users@lists.isc.org > Betreff: Re: High memory consumption in bind 9.18.2 > > On 18. 05. 22 22:39, Ondřej Surý wrote: > > Hi Klarstein, > > > > Gathering the output of na

Re: High memory consumption in bind 9.18.2

2022-05-19 Thread Petr Špaček
the details. regards Klaus -Ursprüngliche Nachricht- Von: bind-users Im Auftrag von Ondrej Surý101 71 l t1h, 18. Mai 2022 08:37 An: Raman kumar Cc: bind-users@lists.isc.org Betreff: Re: High memory consumption in bind 9.18.2 You did not provided any details, so we can’t really help

Re: High memory consumption in bind 9.18.2

2022-05-18 Thread Ondřej Surý
gt; Thanks > Klaus > >> -Ursprüngliche Nachricht- >> Von: bind-users Im Auftrag von Petr >> Špacek >> Gesendet: Mittwoch, 18. Mai 2022 18:20 >> An: bind-users@lists.isc.org >> Betreff: Re: AW: High memory consumption in bind 9.18.2 >> >> I woul

AW: AW: High memory consumption in bind 9.18.2

2022-05-18 Thread Klaus Darilion via bind-users
An: bind-users@lists.isc.org > Betreff: Re: AW: High memory consumption in bind 9.18.2 > > I would be very interested in hearing more! > > In majority of our internal testing 9.16 has higher memory consumption > than 9.18, especially when 9.18 is compiled with libjemalloc. An

Re: High memory consumption in bind 9.18.2

2022-05-18 Thread Ondřej Surý
s >>> -Ursprüngliche Nachricht- >>> Von: bind-users Im Auftrag von Ondrej >>> Surý101 71 l t1h, 18. Mai 2022 08:37 >>> An: Raman kumar >>> Cc: bind-users@lists.isc.org >>> Betreff: Re: High memory consumption in bind 9.18.2 >>> &

Re: AW: High memory consumption in bind 9.18.2

2022-05-18 Thread Petr Špaček
-Ursprüngliche Nachricht- Von: bind-users Im Auftrag von Ondrej Surý101 71 l t1h, 18. Mai 2022 08:37 An: Raman kumar Cc: bind-users@lists.isc.org Betreff: Re: High memory consumption in bind 9.18.2 You did not provided any details, so we can’t really help you. What is “RAM consumption

Re: High memory consumption in bind 9.18.2

2022-05-18 Thread Raman kumar
Hello, Please find the details below. Free command is used to check RAM available/used. space used is 50GB on RHEL 7.9 in bind version 9.18.2 whereas in bind version 9.16.10 RAM space used is 44 GB with the same amount of data and configuration. free -g totalused

AW: High memory consumption in bind 9.18.2

2022-05-18 Thread Klaus Darilion via bind-users
man kumar > Cc: bind-users@lists.isc.org > Betreff: Re: High memory consumption in bind 9.18.2 > > You did not provided any details, so we can’t really help you. > > What is “RAM consumption” anyway? VSZ, RSS, numbers pulled from stats > channel from named? > > What’s th

Re: High memory consumption in bind 9.18.2

2022-05-18 Thread Ondřej Surý
You did not provided any details, so we can’t really help you. What is “RAM consumption” anyway? VSZ, RSS, numbers pulled from stats channel from named? What’s the hardware, what is the configuration, how was BIND 9 compiled (or packaged)? The more details, the better Ondrej -- Ondřej Surý

High memory consumption in bind 9.18.2

2022-05-18 Thread Raman kumar
Hello Team, While upgrading from BIND 9.16.10 to 9.18.2, we have observed high memory consumption. On version 9.16.2, RAM consumption was 3.8 GB. And on 9.18.2, RAM consumption is 4.5 GB. Due to this an increase of approximately 20 % memory is observed. Is this the expected behaviour or any