Just trying to debug this problem. What if you increase max-connections in group = mysql-connection?
I cannot see the mysql initialization in your logs. It should say: MYSQL: Connected to server at … MYSQL: server version …, client version ... But appearantly it does connect. So that shouldn’t be the problem. == Rene From: Minh Tuan [mailto:[email protected]] Sent: zaterdag 16 november 2013 10:53 To: Rene Kluwen Cc: [email protected] Subject: Re: opensmppbox consume a lot of MEM Yes, other boxs and processes stood still for weeks. Only opensmppbox increase mem usage by time, even can monitor by eyes. Now it's reaching to 41.2% of server memory from 0.2% as previous mail. The increasing speed along with traffic volume as my observation. I used some commands to check actual mem usage such as top, htop,... also few scripts found on google :) minhtuan@han-vasplatform-02:~$ ps aux | awk '{print $2, $4, $11}' | sort -k2r | head -n 10 PID %MEM COMMAND 13733 41.2 /usr/local/sbin/opensmppbox 31511 18.0 /usr/sbin/mysqld 16573 0.1 /usr/sbin/apache2 16580 0.1 /usr/sbin/apache2 16583 0.1 /usr/sbin/apache2 16614 0.1 /usr/sbin/apache2 16629 0.1 /usr/sbin/apache2 16650 0.1 /usr/sbin/apache2 16651 0.1 /usr/sbin/apache2 Thank you. Tuan. On Sat, Nov 16, 2013 at 4:06 AM, Rene Kluwen <[email protected]> wrote: And you verified that it is opensmppbox that is eating memory? And not sqlbox? Just checking. == Rene From: Minh Tuan [mailto:[email protected]] Sent: vrijdag 15 november 2013 20:24 To: Rene Kluwen Cc: [email protected] Subject: Re: opensmppbox consume a lot of MEM I don't know where to find the opensmppbox version but i downloaded the lastest SVN with changelog: 2013-09-01 Rene Kluwen <rene.kluwen at chimit.nl> Fixed a small bug in the routing-upon-receiver number where opensmppbox would crash at boot-time if the particular config section is not defined. I attached log and config files. Just post here some things to high light: Here is the 'top' when Kannel starting, opensmppbox only occupied 0.2% mem, it'll reach to 80% in 1 day: Image removed by sender. opensmppbox log: 2013-11-16 00:59:23 [13219] [2] DEBUG: SMPP PDU 0x83c9288 dump: 2013-11-16 00:59:23 [13219] [2] DEBUG: type_name: submit_sm 2013-11-16 00:59:23 [13219] [2] DEBUG: command_id: 4 = 0x00000004 2013-11-16 00:59:23 [13219] [2] DEBUG: command_status: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [2] DEBUG: sequence_number: 7 = 0x00000007 2013-11-16 00:59:23 [13219] [2] DEBUG: service_type: NULL 2013-11-16 00:59:23 [13219] [2] DEBUG: source_addr_ton: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [2] DEBUG: source_addr_npi: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [2] DEBUG: source_addr: "32665" 2013-11-16 00:59:23 [13219] [2] DEBUG: dest_addr_ton: 1 = 0x00000001 2013-11-16 00:59:23 [13219] [2] DEBUG: dest_addr_npi: 1 = 0x00000001 2013-11-16 00:59:23 [13219] [2] DEBUG: destination_addr: "841869066432" 2013-11-16 00:59:23 [13219] [2] DEBUG: esm_class: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [2] DEBUG: protocol_id: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [2] DEBUG: priority_flag: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [2] DEBUG: schedule_delivery_time: NULL 2013-11-16 00:59:23 [13219] [2] DEBUG: validity_period: NULL 2013-11-16 00:59:23 [13219] [2] DEBUG: registered_delivery: 1 = 0x00000001 2013-11-16 00:59:23 [13219] [2] DEBUG: replace_if_present_flag: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [2] DEBUG: data_coding: 8 = 0x00000008 2013-11-16 00:59:23 [13219] [2] DEBUG: sm_default_msg_id: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [2] DEBUG: sm_length: 72 = 0x00000048 2013-11-16 00:59:23 [13219] [2] DEBUG: short_message: 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc098: 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 72 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 73 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 34 00 31 00 36 00 36 00 20 00 6c 00 e0 00 20 .4.1.6.6. .l... 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 6d 00 e3 00 20 00 78 00 e1 00 63 00 20 00 6e .m... .x...c. .n 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 68 1e ad 00 6e 00 20 00 46 00 61 00 63 00 65 .h...n. .F.a.c.e 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 62 00 6f 00 6f 00 6b 00 20 00 63 1e e7 00 61 .b.o.o.k. .c...a 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 20 00 62 1e a1 00 6e . .b...n 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: SMPP PDU dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: routed msg '32665:abcdefgh' to smsc 'hnlive' 2013-11-16 00:59:23 [13219] [2] DEBUG: Msg object at 0x83c90d8: 2013-11-16 00:59:23 [13219] [2] DEBUG: type: sms 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.sender: 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc398: 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 5 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 6 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 33 32 36 36 35 32665 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.receiver: 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc228: 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 13 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 1024 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 2b 38 34 31 38 36 39 30 36 36 34 33 32 +841869066432 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.udhdata: 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.msgdata: 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc098: 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 72 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 73 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 34 00 31 00 36 00 36 00 20 00 6c 00 e0 00 20 .4.1.6.6. .l... 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 6d 00 e3 00 20 00 78 00 e1 00 63 00 20 00 6e .m... .x...c. .n 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 68 1e ad 00 6e 00 20 00 46 00 61 00 63 00 65 .h...n. .F.a.c.e 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 62 00 6f 00 6f 00 6b 00 20 00 63 1e e7 00 61 .b.o.o.k. .c...a 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 20 00 62 1e a1 00 6e . .b...n 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.time: 1384538363 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.smsc_id: 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83f4808: 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 6 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 7 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 68 6e 6c 69 76 65 hnlive 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.smsc_number: 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.foreign_id: 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.service: 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc0b8: 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 8 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 9 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 46 61 63 65 42 6f 6f 6b abcdefgh 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.account: 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.id: 5d667a33-c510-4e87-a7db-f2cec6fb6737 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.sms_type: 2 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.mclass: -1 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.mwi: -1 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.coding: 2 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.compress: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.validity: -1 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.deferred: -1 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.dlr_mask: 19 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.dlr_url: 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.pid: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.alt_dcs: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.rpi: -1 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.charset: 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.boxc_id: 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83c6a00: 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 8 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 9 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 46 61 63 65 42 6f 6f 6b abcdefgh 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.binfo: 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.msg_left: -1 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.split_parts: (nil) 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.priority: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.resend_try: -1 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.resend_time: -1 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.meta_data: 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc1c8: 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 6 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 1024 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 3f 73 6d 70 70 3f ?smpp? 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: Msg object ends. 2013-11-16 00:59:23 [13219] [2] DEBUG: DLR[mysql]: Adding DLR smsc=abcdefgh, ts=5d667a33-c510-4e87-a7db-f2cec6fb6737, src=32665, dst=+841869066432, mask=19, boxc=abcdefgh 2013-11-16 00:59:23 [13219] [2] DEBUG: adding DLR entry into database 2013-11-16 00:59:23 [13219] [2] DEBUG: sql: INSERT INTO `smppbox_dlr` (`smsc`, `ts`, `source`, `destination`, `service`, `url`, `mask`, `boxc`, `status`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, 0) 2013-11-16 00:59:23 [13219] [1] DEBUG: new group created `smpp' 2013-11-16 00:59:23 [13219] [1] DEBUG: group=`smpp' key=`dlr_err' value=` _____ ' 2013-11-16 00:59:23 [13219] [1] DEBUG: SMPP[abcdefgh]: Sending PDU: 2013-11-16 00:59:23 [13219] [1] DEBUG: SMPP PDU 0x83eac38 dump: 2013-11-16 00:59:23 [13219] [1] DEBUG: type_name: deliver_sm 2013-11-16 00:59:23 [13219] [1] DEBUG: command_id: 5 = 0x00000005 2013-11-16 00:59:23 [13219] [1] DEBUG: command_status: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [1] DEBUG: sequence_number: 1 = 0x00000001 2013-11-16 00:59:23 [13219] [1] DEBUG: service_type: NULL 2013-11-16 00:59:23 [13219] [1] DEBUG: source_addr_ton: 2 = 0x00000002 2013-11-16 00:59:23 [13219] [1] DEBUG: source_addr_npi: 1 = 0x00000001 2013-11-16 00:59:23 [13219] [1] DEBUG: source_addr: "+841869066432" 2013-11-16 00:59:23 [13219] [1] DEBUG: dest_addr_ton: 2 = 0x00000002 2013-11-16 00:59:23 [13219] [1] DEBUG: dest_addr_npi: 1 = 0x00000001 2013-11-16 00:59:23 [13219] [1] DEBUG: destination_addr: "32665" 2013-11-16 00:59:23 [13219] [1] DEBUG: esm_class: 4 = 0x00000004 2013-11-16 00:59:23 [13219] [1] DEBUG: protocol_id: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [1] DEBUG: priority_flag: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [1] DEBUG: schedule_delivery_time: NULL 2013-11-16 00:59:23 [13219] [1] DEBUG: validity_period: NULL 2013-11-16 00:59:23 [13219] [1] DEBUG: registered_delivery: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [1] DEBUG: replace_if_present_flag: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [1] DEBUG: data_coding: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [1] DEBUG: sm_default_msg_id: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [1] DEBUG: sm_length: 0 = 0x00000000 2013-11-16 00:59:23 [13219] [1] DEBUG: short_message: 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string at 0x83c9408: 2013-11-16 00:59:23 [13219] [1] DEBUG: len: 140 2013-11-16 00:59:23 [13219] [1] DEBUG: size: 1024 2013-11-16 00:59:23 [13219] [1] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 69 64 3a 35 64 36 36 37 61 33 33 2d 63 35 31 30 id:5d667a33-c510 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 2d 34 65 38 37 2d 61 37 64 62 2d 66 32 63 65 63 -4e87-a7db-f2cec 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 36 66 62 36 37 33 37 20 73 75 62 3a 30 30 31 20 6fb6737 sub:001 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 64 6c 76 72 64 3a 30 30 30 20 73 75 62 6d 69 74 dlvrd:000 submit 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 20 64 61 74 65 3a 31 33 31 31 31 36 30 30 35 39 date:1311160059 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 20 64 6f 6e 65 20 64 61 74 65 3a 31 33 31 31 31 done date:13111 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 36 30 30 35 39 20 73 74 61 74 3a 55 4e 44 45 4c 60059 stat:UNDEL 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 49 56 20 65 72 72 3a 30 30 30 20 74 65 78 74 3a IV err:000 text: 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 20 20 20 20 20 20 20 54 65 78 74 3a Text: 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [1] DEBUG: message_state: 5 = 0x00000005 2013-11-16 00:59:23 [13219] [1] DEBUG: receipted_message_id: 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string at 0x83eaf80: 2013-11-16 00:59:23 [13219] [1] DEBUG: len: 36 2013-11-16 00:59:23 [13219] [1] DEBUG: size: 37 2013-11-16 00:59:23 [13219] [1] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 35 64 36 36 37 61 33 33 2d 63 35 31 30 2d 34 65 5d667a33-c510-4e 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 38 37 2d 61 37 64 62 2d 66 32 63 65 63 36 66 62 87-a7db-f2cec6fb 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 36 37 33 37 6737 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [1] DEBUG: dlr_err: 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string at 0x83ecbd8: 2013-11-16 00:59:23 [13219] [1] DEBUG: len: 3 2013-11-16 00:59:23 [13219] [1] DEBUG: size: 10 2013-11-16 00:59:23 [13219] [1] DEBUG: immutable: 0 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 03 00 00 ... 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string dump ends. 2013-11-16 00:59:23 [13219] [1] DEBUG: SMPP PDU dump ends. 2013-11-16 00:59:23 [13219] [1] ERROR: SMPP: Unknown TLV `dlr_err', don't send. On Fri, Nov 15, 2013 at 2:52 PM, Rene Kluwen <[email protected]> wrote: Also: Which version of opensmppbox are you using? From: Rene Kluwen [mailto:[email protected]] Sent: vrijdag 15 november 2013 8:49 To: 'Minh Tuan'; '[email protected]' Subject: RE: opensmppbox consume a lot of MEM Could you please share your config + relevant log parts if applicable? == Rene From: users [mailto:[email protected]] On Behalf Of Minh Tuan Sent: zaterdag 28 september 2013 5:22 To: [email protected] Subject: opensmppbox consume a lot of MEM Dear all, I need help as opensmppbox is consuming a lot of my server's memory. After occupied 80% of RAM (total RAM is 2G), it's also eating 50% of swap memory (total 3G) and increasing. My configuration is: Client -> opensmppbox(mysql dlr) -> sqlbox -> bearerbox(mysql dlr) -> operator SMSC Opensmppbox has 1 Client only, but he is binding 6 connections (via Internet), with 50 short codes and ~30 TPS of throughput, connections are lost few times per day (automatic re-connect). Of course, i'm going to plug more RAM sticks in to server but i'm afraid of it will not help in this situation. Appreciate you guy can give me some advise and experience. Many thanks. Nguyen Minh Tuan from Vietnamobile. -- <====((=o-( ',_,' )-o=))=====> Bản chất tốt nhưng cuộc đời xô đẩy! -- <====((=o-( ',_,' )-o=))=====> Bản chất tốt nhưng cuộc đời xô đẩy!
<<image001.jpg>>
