Re: AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Thank you ! Vlad Vlad, does this issue affect classic and superclassic? According to one of Vlad's previous message, only SuperServer. -- With regards, Thomas Steinmaurer http://www.upscene.com Professional Tools and Services for Firebird FB TraceManager, IB LogManager, Database Health Check, Tuning etc.
Re: AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Thank you ! Vlad Vlad, does this issue affect classic and superclassic?
Re: AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
See above Em 09/06/2015 06:41, Jesus Garcia jeg...@gmail.com [firebird-support] firebird-support@yahoogroups.com escreveu: Thank you ! Vlad Vlad, does this issue affect classic and superclassic?
AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Please, verify it using recent snapshot build I installed on my dev machine and running for little more than 1 hour now. The fix seems to be work. I will install today afternoon/evening, or tomorrow morning on the production system. The production system is running till yesterday 14h00 (UTC+2) with no increase in memory consumption. Problem solved. Well done. Thanks a lot. -- Joja
AW: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Please, verify it using recent snapshot build I installed on my dev machine and running for little more than 1 hour now. The fix seems to be work. I will install today afternoon/evening, or tomorrow morning on the production system. Thank you. -- Joja
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, ts@... wrote : Is this SuperServer only or also SuperClassic? SuperServer only. Thank you! Thomas
Re: AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote : Sorry, I didn’t check my mail till now. Thank you for creating the ticket. And of course for fixing the bug. Please, verify it using recent snapshot build Regards, Vlad
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, ts@... wrote : Is this SuperServer only or also SuperClassic? SuperServer only. Regards, Vlad
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Vlad, ---In firebird-support@yahoogroups.com, hvlad@... wrote : Could you register it a tracker, please ? Done: http://tracker.firebirdsql.org/browse/CORE-4830 Is this SuperServer only or also SuperClassic? Thanks! -- With regards, Thomas Steinmaurer http://www.upscene.com/ Professional Tools and Services for Firebird FB TraceManager, IB LogManager, Database Health Check, Tuning etc.
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, joja.lists@... wrote : Reproducible test case would be ideal Hello Vlad, hello Alexey, and other interested people! I have prepared a test case now showing the memory leak with a simple fresh database and many many connect / select / disconnect sequences. Take the below script (also attached, but don’t know if group allows this), place it in a file named connleak.cmd in a new empty directory and call it: 1st: connleak init 2nd: connleak run You can open the task manager and see fbserver.exe memory consumption growing. Hope this helps to investigate the problem. Thanks, it helps. I've reproduced and fixed it (not committed yet). Could you register it a tracker, please ? Regards, Vlad
Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
---In firebird-support@yahoogroups.com, hvlad@... wrote : Could you register it a tracker, please ? Done: http://tracker.firebirdsql.org/browse/CORE-4830 http://tracker.firebirdsql.org/browse/CORE-4830 Regards, Vlad
AW: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Sorry, I didn’t check my mail till now. Thank you for creating the ticket. And of course for fixing the bug. Also to Alexey many thanks for his support. He brought me on the right path with the VMMap analysis tool. -- Joja Von: firebird-support@yahoogroups.com [mailto:firebird-support@yahoogroups.com] Gesendet: Samstag, 6. Juni 2015 19:18 An: firebird-support@yahoogroups.com Betreff: Re: AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4 ---In firebird-support@yahoogroups.com, hvlad@... wrote : Could you register it a tracker, please ? Done: http://tracker.firebirdsql.org/browse/CORE-4830 Regards, Vlad
AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Hello Vlad, hello Alexey, ---In firebird-support@yahoogroups.com, joja.lists@... wrote : Any hints how to investigate this problem? Reproducible test case would be ideal I spent three days now to reproduce this with non-production system - no success so far. I am in contact with Alexey Kovyazin who got a minidump from production system, but I don’t know if he found a hot path till now. I did a VMMap dump for him too, which shows a memory usage where at the beginning there some blocks with different sizes, i.e. one block which could be approx. page_buffers*page_size, so the db cache. Then there are many many small blocks of 64K this is which causes the mem consumption in my opinion. However, don’t understand very much how FB allocates mem internally. When I open the string view in VMMap, I see that these 64K blocks contain many times the same set of table names: LAST_MODIFICATION, WB_PRG, EVENT_DATA, EVENT_HEADER and NONE – which is not a table name, perhaps the character set name, because I use NONE as charset. I checked some 64K blocks, and they contain all the same pool of strings. The application accessing the db holds some permanently open connections with prepared statements performing actions regularly. But there are some actions which are triggered by clients of my application in regular intervals, which open and close the db connection each time. These regular things access the tables whose names I found in the 64K blocks. Together with NONE (perhaps send to the db when performing a new connect), maybe FB is leaking here on each connect / disconnect, not cleaning up correctly when a connection is closed? Interestingly, the string view never shows strings of the data which is contained in the tables. These are some observations – I do not know if they are helpful at all. --- Joja
AW: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4
Do you HAVE a memory problem? Or are you upset about Firebird using this amount of RAM? In my opinion FB is leaking memory. Initially the fbserver.exe has about 150MB and it it's all my memory over time. First time till ~20GB and finally the server went out of service. Now I try to restart every couple of days to avoid driving into the wall. -- Joja On 03/06/2015 09:48, 'Jojakim Stahl' joja.li...@jojakim.de [firebird-support] wrote: Hello, still no solution. Running since last Friday, fbserver.exe grew up to +3GB memory so far. Few minutes ago, I stopped all our services, it remained only one attachment from isql to select mon$memory_usage: memory did not went down. IMHO, this memory leak is not caused by a client leaving open something, otherwise the memory should go down when the connection is closed, shouldn't it? SQL select cast('NOW' as timestamp) TS, m.*, (select count(*) from mon$attachme nts) ATTACHMENTS, (select count(*) from mon$statements) STATEMENTS from mon$memo ry_usage m where m.mon$stat_group=0; TS 2015-06-03 14:04:02.3910 MON$STAT_ID 1 MON$STAT_GROUP 0 MON$MEMORY_USED 3329950624 MON$MEMORY_ALLOCATED 3870920704 MON$MAX_MEMORY_USED 3331189248 MON$MAX_MEMORY_ALLOCATED 3870990336 ATTACHMENTS 1 STATEMENTS 1 Any hints how to investigate this problem? Thank you. -- joja Von: firebird-support@yahoogroups.com [mailto:firebird-support@yahoogroups.com] Gesendet: Freitag, 29. Mai 2015 12:03 An: firebird-support@yahoogroups.com Betreff: AW: [firebird-support] Re: Memory usage excess / leak in FBServer 2.5.4 ---In firebird-support@yahoogroups.com, joja.lists@... wrote : I'm facing a problem where the firebird server v2.5.4 on win 2012 server in superserver mode is leaking memory. Currently I'm at ~5GB usage. I just restarted our services: FB memory usage went down to normal values: MON$STAT_ID 1 MON$STAT_GROUP 0 MON$MEMORY_USED 145842736 MON$MEMORY_ALLOCATED 152465408 MON$MAX_MEMORY_USED 147606936 MON$MAX_MEMORY_ALLOCATED 154570752 1. Show us results of select count(*) form mon$attachments Before restart: 11 After restart: 11 select count(*) form mon$transactions Before restart: 0 After restart: 3 select count(*) form mon$statements Before restart: 84 After restart: 122 2. Do you use any custom UDF's ? No -- Joja