Re: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Hello Vlad, is there a location where I can download a win64 installer package of a nightly build including the fix, or when will 2.5.5 be released officially? Would need this for automatic installation. -- Joja Von: firebird-support@yahoogroups.com [mailto:firebird-support@yahoogroups.com] Gesendet: Dienstag, 9. Juni 2015 10:01 An: firebird-support@yahoogroups.com Betreff: Re: AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4 ---In firebird-support@yahoogroups.com, joja.lists@... wrote : The production system is running till yesterday 14h00 (UTC+2) with no increase in memory consumption. Problem solved. Well done. Thanks a lot. Thank you ! Vlad hi, http://www.firebirdsql.org/en/snapshot-builds/ regards, Karol Bieniaszewski
AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
is there a location where I can download a win64 installer package of a nightly build including the fix, or when will 2.5.5 be released officially? http://www.firebirdsql.org/en/snapshot-builds/ There are only zip packages, no installer packages. -- Joja
Re: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
W dniu 2015-06-10 14:30:52 użytkownik 'Jojakim Stahl' joja.li...@jojakim.de [firebird-support] firebird-support@yahoogroups.com napisał: is there a location where I can download a win64 installer package of a nightly build including the fix, or when will 2.5.5 be released officially? http://www.firebirdsql.org/en/snapshot-builds/ There are only zip packages, no installer packages. -- Joja Hi, you mean - exe file installer? For snapshot it not exists But if this is single installation then you can replace folder already contained files For new installation- unzip file and there is install bat files regards, Karol Bieniaszewski
[firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Hello Vlad, is there a location where I can download a win64 installer package of a nightly build including the fix, or when will 2.5.5 be released officially? Would need this for automatic installation. -- Joja Von: firebird-support@yahoogroups.com [mailto:firebird-support@yahoogroups.com] Gesendet: Dienstag, 9. Juni 2015 10:01 An: firebird-support@yahoogroups.com Betreff: Re: AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4 ---In firebird-support@yahoogroups.com, joja.lists@... wrote : The production system is running till yesterday 14h00 (UTC+2) with no increase in memory consumption. Problem solved. Well done. Thanks a lot. Thank you ! Vlad
Re: AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Thank you ! Vlad Vlad, does this issue affect classic and superclassic? According to one of Vlad's previous message, only SuperServer. -- With regards, Thomas Steinmaurer http://www.upscene.com Professional Tools and Services for Firebird FB TraceManager, IB LogManager, Database Health Check, Tuning etc.
Re: AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Thank you ! Vlad Vlad, does this issue affect classic and superclassic?
Re: AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
See above Em 09/06/2015 06:41, Jesus Garcia jeg...@gmail.com [firebird-support] firebird-support@yahoogroups.com escreveu: Thank you ! Vlad Vlad, does this issue affect classic and superclassic?
AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Please, verify it using recent snapshot build I installed on my dev machine and running for little more than 1 hour now. The fix seems to be work. I will install today afternoon/evening, or tomorrow morning on the production system. The production system is running till yesterday 14h00 (UTC+2) with no increase in memory consumption. Problem solved. Well done. Thanks a lot. -- Joja
[firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
I must give a big thanks to Vlad. I think all firebird users must too. Regards, Tjioe Hian Pin
AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Please, verify it using recent snapshot build I installed on my dev machine and running for little more than 1 hour now. The fix seems to be work. I will install today afternoon/evening, or tomorrow morning on the production system. Thank you. -- Joja
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, ts@... wrote : Is this SuperServer only or also SuperClassic? SuperServer only. Thank you! Thomas
Re: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote : Sorry, I didn’t check my mail till now. Thank you for creating the ticket. And of course for fixing the bug. Please, verify it using recent snapshot build Regards, Vlad
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, ts@... wrote : Is this SuperServer only or also SuperClassic? SuperServer only. Regards, Vlad
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Vlad, ---In firebird-support@yahoogroups.com, hvlad@... wrote : Could you register it a tracker, please ? Done: http://tracker.firebirdsql.org/browse/CORE-4830 Is this SuperServer only or also SuperClassic? Thanks! -- With regards, Thomas Steinmaurer http://www.upscene.com/ Professional Tools and Services for Firebird FB TraceManager, IB LogManager, Database Health Check, Tuning etc.
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote : Reproducible test case would be ideal Hello Vlad, hello Alexey, and other interested people! I have prepared a test case now showing the memory leak with a simple fresh database and many many connect / select / disconnect sequences. Take the below script (also attached, but don’t know if group allows this), place it in a file named connleak.cmd in a new empty directory and call it: 1st: connleak init 2nd: connleak run You can open the task manager and see fbserver.exe memory consumption growing. Hope this helps to investigate the problem. Thanks, it helps. I've reproduced and fixed it (not committed yet). Could you register it a tracker, please ? Regards, Vlad
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, hvlad@... wrote : Could you register it a tracker, please ? Done: http://tracker.firebirdsql.org/browse/CORE-4830 http://tracker.firebirdsql.org/browse/CORE-4830 Regards, Vlad
AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Sorry, I didn’t check my mail till now. Thank you for creating the ticket. And of course for fixing the bug. Also to Alexey many thanks for his support. He brought me on the right path with the VMMap analysis tool. -- Joja Von: firebird-support@yahoogroups.com [mailto:firebird-support@yahoogroups.com] Gesendet: Samstag, 6. Juni 2015 19:18 An: firebird-support@yahoogroups.com Betreff: Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4 ---In firebird-support@yahoogroups.com, hvlad@... wrote : Could you register it a tracker, please ? Done: http://tracker.firebirdsql.org/browse/CORE-4830 Regards, Vlad
AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Hello Vlad, hello Alexey, ---In firebird-support@yahoogroups.com, joja.lists@... wrote : Any hints how to investigate this problem? Reproducible test case would be ideal I spent three days now to reproduce this with non-production system - no success so far. I am in contact with Alexey Kovyazin who got a minidump from production system, but I don’t know if he found a hot path till now. I did a VMMap dump for him too, which shows a memory usage where at the beginning there some blocks with different sizes, i.e. one block which could be approx. page_buffers*page_size, so the db cache. Then there are many many small blocks of 64K this is which causes the mem consumption in my opinion. However, don’t understand very much how FB allocates mem internally. When I open the string view in VMMap, I see that these 64K blocks contain many times the same set of table names: LAST_MODIFICATION, WB_PRG, EVENT_DATA, EVENT_HEADER and NONE – which is not a table name, perhaps the character set name, because I use NONE as charset. I checked some 64K blocks, and they contain all the same pool of strings. The application accessing the db holds some permanently open connections with prepared statements performing actions regularly. But there are some actions which are triggered by clients of my application in regular intervals, which open and close the db connection each time. These regular things access the tables whose names I found in the 64K blocks. Together with NONE (perhaps send to the db when performing a new connect), maybe FB is leaking here on each connect / disconnect, not cleaning up correctly when a connection is closed? Interestingly, the string view never shows strings of the data which is contained in the tables. These are some observations – I do not know if they are helpful at all. --- Joja
Re: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Attention, A partir du 5 juin 2015 je ne serai plus présent à Antenna A partir du premier juillet 2015, mon adresse ne sera plus active. Pour contacter la directrice d'Antenna utilisez l'adresse suivante: virginie.ca...@antenna.fr Pour me contacter utlisez:yves.cra...@orange.fr
AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Hello,
still no solution. Running since last Friday, fbserver.exe grew up to +3GB
memory so far. Few minutes ago, I stopped all our services, it remained only
one attachment from isql to select mon$memory_usage: memory did not went down.
IMHO, this memory leak is not caused by a client leaving open something,
otherwise the memory should go down when the connection is closed, shouldn't it?
SQL select cast('NOW' as timestamp) TS, m.*, (select count(*) from mon$attachme
nts) ATTACHMENTS, (select count(*) from mon$statements) STATEMENTS from mon$memo
ry_usage m where m.mon$stat_group=0;
TS 2015-06-03 14:04:02.3910
MON$STAT_ID 1
MON$STAT_GROUP 0
MON$MEMORY_USED 3329950624
MON$MEMORY_ALLOCATED3870920704
MON$MAX_MEMORY_USED 3331189248
MON$MAX_MEMORY_ALLOCATED3870990336
ATTACHMENTS 1
STATEMENTS 1
Any hints how to investigate this problem?
Thank you.
--
joja
Von: firebird-support@yahoogroups.com [mailto:firebird-support@yahoogroups.com]
Gesendet: Freitag, 29. Mai 2015 12:03
An: firebird-support@yahoogroups.com
Betreff: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote :
I'm facing a problem where the firebird server v2.5.4 on win 2012 server in
superserver mode is leaking memory. Currently I'm at ~5GB usage.
I just restarted our services: FB memory usage went down to normal values:
MON$STAT_ID 1
MON$STAT_GROUP 0
MON$MEMORY_USED 145842736
MON$MEMORY_ALLOCATED 152465408
MON$MAX_MEMORY_USED 147606936
MON$MAX_MEMORY_ALLOCATED 154570752
1. Show us results of
select count(*) form mon$attachments
Before restart: 11
After restart: 11
select count(*) form mon$transactions
Before restart: 0
After restart: 3
select count(*) form mon$statements
Before restart: 84
After restart: 122
2. Do you use any custom UDF's ?
No
--
Joja
AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Do you HAVE a memory problem? Or are you upset about Firebird using this
amount of RAM?
In my opinion FB is leaking memory. Initially the fbserver.exe has about 150MB
and it it's all my memory over time. First time till ~20GB and finally the
server went out of service. Now I try to restart every couple of days to avoid
driving into the wall.
--
Joja
On 03/06/2015 09:48, 'Jojakim Stahl' joja.li...@jojakim.de [firebird-support]
wrote:
Hello,
still no solution. Running since last Friday, fbserver.exe grew up to +3GB
memory so far. Few minutes ago, I stopped all our services, it remained only
one attachment from isql to select mon$memory_usage: memory did not went down.
IMHO, this memory leak is not caused by a client leaving open something,
otherwise the memory should go down when the connection is closed, shouldn't it?
SQL select cast('NOW' as timestamp) TS, m.*, (select count(*) from mon$attachme
nts) ATTACHMENTS, (select count(*) from mon$statements) STATEMENTS from mon$memo
ry_usage m where m.mon$stat_group=0;
TS 2015-06-03 14:04:02.3910
MON$STAT_ID 1
MON$STAT_GROUP 0
MON$MEMORY_USED 3329950624
MON$MEMORY_ALLOCATED 3870920704
MON$MAX_MEMORY_USED 3331189248
MON$MAX_MEMORY_ALLOCATED 3870990336
ATTACHMENTS 1
STATEMENTS 1
Any hints how to investigate this problem?
Thank you.
--
joja
Von: firebird-support@yahoogroups.com [mailto:firebird-support@yahoogroups.com]
Gesendet: Freitag, 29. Mai 2015 12:03
An: firebird-support@yahoogroups.com
Betreff: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote :
I'm facing a problem where the firebird server v2.5.4 on win 2012 server in
superserver mode is leaking memory. Currently I'm at ~5GB usage.
I just restarted our services: FB memory usage went down to normal values:
MON$STAT_ID 1
MON$STAT_GROUP 0
MON$MEMORY_USED 145842736
MON$MEMORY_ALLOCATED 152465408
MON$MAX_MEMORY_USED 147606936
MON$MAX_MEMORY_ALLOCATED 154570752
1. Show us results of
select count(*) form mon$attachments
Before restart: 11
After restart: 11
select count(*) form mon$transactions
Before restart: 0
After restart: 3
select count(*) form mon$statements
Before restart: 84
After restart: 122
2. Do you use any custom UDF's ?
No
--
Joja
Re: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Do you HAVE a memory problem? Or are you upset about Firebird using this
amount of RAM?
On 03/06/2015 09:48, 'Jojakim Stahl' joja.li...@jojakim.de
[firebird-support] wrote:
Hello,
still no solution. Running since last Friday, fbserver.exe grew up to
+3GB memory so far. Few minutes ago, I stopped all our services, it
remained only one attachment from isql to select mon$memory_usage:
memory did not went down. IMHO, this memory leak is not caused by a
client leaving open something, otherwise the memory should go down
when the connection is closed, shouldn't it?
SQL select cast('NOW' as timestamp) TS, m.*, (select count(*) from
mon$attachme
nts) ATTACHMENTS, (select count(*) from mon$statements) STATEMENTS
from mon$memo
ry_usage m where m.mon$stat_group=0;
TS 2015-06-03 14:04:02.3910
MON$STAT_ID 1
MON$STAT_GROUP 0
MON$MEMORY_USED 3329950624
MON$MEMORY_ALLOCATED 3870920704
MON$MAX_MEMORY_USED 3331189248
MON$MAX_MEMORY_ALLOCATED 3870990336
ATTACHMENTS 1
STATEMENTS 1
Any hints how to investigate this problem?
Thank you.
--
joja
Von: firebird-support@yahoogroups.com
[mailto:firebird-support@yahoogroups.com]
Gesendet: Freitag, 29. Mai 2015 12:03
An: firebird-support@yahoogroups.com
Betreff: AW: [firebird-support] Re: Memory usage excess / leak in
FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote :
I'm facing a problem where the firebird server v2.5.4 on win 2012
server in superserver mode is leaking memory. Currently I'm at ~5GB
usage.
I just restarted our services: FB memory usage went down to normal values:
MON$STAT_ID 1
MON$STAT_GROUP 0
MON$MEMORY_USED 145842736
MON$MEMORY_ALLOCATED 152465408
MON$MAX_MEMORY_USED 147606936
MON$MAX_MEMORY_ALLOCATED 154570752
1. Show us results of
select count(*) form mon$attachments
Before restart: 11
After restart: 11
select count(*) form mon$transactions
Before restart: 0
After restart: 3
select count(*) form mon$statements
Before restart: 84
After restart: 122
2. Do you use any custom UDF's ?
No
--
Joja
Re: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote : Any hints how to investigate this problem? Reproducible test case would be ideal Regards, Vlad
[firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote : I'm facing a problem where the firebird server v2.5.4 on win 2012 server in superserver mode is leaking memory. Currently I'm at ~5GB usage. 1. Show us results of select count(*) form mon$attachments select count(*) form mon$transactions select count(*) form mon$statements 2. Do you use any custom UDF's ? Regards, Vlad
AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote : I'm facing a problem where the firebird server v2.5.4 on win 2012 server in superserver mode is leaking memory. Currently I'm at ~5GB usage. I just restarted our services: FB memory usage went down to normal values: MON$STAT_ID 1 MON$STAT_GROUP 0 MON$MEMORY_USED 145842736 MON$MEMORY_ALLOCATED152465408 MON$MAX_MEMORY_USED 147606936 MON$MAX_MEMORY_ALLOCATED154570752 1. Show us results of select count(*) form mon$attachments Before restart: 11 After restart: 11 select count(*) form mon$transactions Before restart: 0 After restart: 3 select count(*) form mon$statements Before restart: 84 After restart: 122 2. Do you use any custom UDF's ? No -- joja
