Firebird 2.1.5 - i686 100% CPU usage problem --------------------------------------------
Key: CORE-4264 URL: http://tracker.firebirdsql.org/browse/CORE-4264 Project: Firebird Core Issue Type: Bug Affects Versions: 2.1.5 Environment: RHEL 6.4 x86_64, xinetd 2.6.38 Reporter: Konrad Wawryn Priority: Critical Hello Colleagues, since few months we are trying to solve Firebird problem which generating 100% CPU usage and making system not stable. Every evening for 2-3 hours we have high load on the server. Also very often at this time appear our problem. It seems that this error is proceeded by following log entries: Firebird logs (/opt/firebird/firebird.log) include following entries: ----------------------------------------------------- deheremap6343.biz Tue Nov 5 19:50:03 2013 ISC_kill: process 14644 couldn't deliver signal 16 to process 15065: permission denied deheremap6343.biz Tue Nov 5 19:50:03 2013 Fatal lock manager error: invalid lock id (36016), errno: 1 deheremap6343.biz Fri Nov 8 19:35:01 2013 ISC_kill: process 28337 couldn't deliver signal 16 to process 28386: permission denied deheremap6343.biz Fri Nov 8 19:35:01 2013 Fatal lock manager error: invalid lock id (23616), errno: 1 deheremap6343.biz Mon Nov 11 18:56:05 2013 ISC_kill: process 30120 couldn't deliver signal 16 to process 30582: permission denied deheremap6343.biz Mon Nov 11 18:56:05 2013 Fatal lock manager error: invalid lock id (27592), errno: 1 ------------------------------------------------------------------------------------- Then after this error appear system starting to be not stable. Firebird process running with 100% CPU usage. We are not able to kill that process. Only server restart help us to solve that issue. I dont know if its firebird bug or maybe wrong configuration ("permission denied"). Its production system spreaded thru 15 servers and we need to find a reason of that bug how fast is possible. This is our configuration with all system components and versions: System details: 32GB Ram 4CPU cores RedHat 6.3 x86_64 Firebird database 2.1.5 i686 (firebird.tgz package) Xinetd 2.3.14-38 20 x Application servers connected to Firebird /etc/xinetd.d/firebird ---------------------------------------------------------- service gds_db2 { disable = no flags = REUSE socket_type = stream wait = no user = firebird group = gkadmin per_source = 50 port = 3052 # These lines cause problems with Windows XP SP2 clients # using default firewall configuration (SF#1065511) # log_on_success += USERID # log_on_failure += USERID server = /opt/firebird/bin/fb_inet_server } ------------------------------------------------------- Firebird database filesystem permissions (please not that user belong to differen group - to gkadmin not to firebird): Could it be a reason of "permission danied" access ? [root@deheremap6343 opt]# ll total 49796 drwxr-xr-x 11 firebird gkadmin 4096 Oct 23 20:11 firebird -rw-r--r--. 1 root root 438 May 31 13:13 firebird_20130531_1313.tar.gz [root@deheremap6343 opt]# cat /etc/passwd | grep gkadmin gkadmin:x:500:500:GK-retail admin user:/home/gkadmin:/bin/bash [root@deheremap6343 opt]# cat /etc/passwd | grep firebird firebird:x:503:500:Firebird user:/opt/firebird:/bin/bash [root@deheremap6343 opt]# [root@deheremap6343 opt]# groups firebird firebird : gkadmin [root@deheremap6343 opt]# [root@deheremap6343 opt]# groups gkadmin gkadmin : gkadmin samba firebird [root@deheremap6343 opt]# Firebird.conf we didnt changed. Could You please advise how to solve that issue ? Why during high traffic we see this error ? What could be a reason ? Version 2.1.3 include similar bug - 100% CPU usage. Do You think that this error has been solved completly in the new release ? Waiting for Your feedback Cheers Konrad -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://tracker.firebirdsql.org/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira ------------------------------------------------------------------------------ November Webinars for C, C++, Fortran Developers Accelerate application performance with scalable programming models. Explore techniques for threading, error checking, porting, and tuning. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel