Yes, other boxs and processes stood still for weeks. Only opensmppbox increase mem usage by time, even can monitor by eyes. Now it's reaching to 41.2% of server memory from 0.2% as previous mail. The increasing speed along with traffic volume as my observation.
I used some commands to check actual mem usage such as top, htop,... also
few scripts found on google :)
minhtuan@han-vasplatform-02:~$ ps aux | awk '{print $2, $4, $11}' | sort
-k2r | head -n 10
PID %MEM COMMAND
13733 41.2 /usr/local/sbin/opensmppbox
31511 18.0 /usr/sbin/mysqld
16573 0.1 /usr/sbin/apache2
16580 0.1 /usr/sbin/apache2
16583 0.1 /usr/sbin/apache2
16614 0.1 /usr/sbin/apache2
16629 0.1 /usr/sbin/apache2
16650 0.1 /usr/sbin/apache2
16651 0.1 /usr/sbin/apache2
Thank you.
Tuan.
On Sat, Nov 16, 2013 at 4:06 AM, Rene Kluwen <[email protected]> wrote:
> And you verified that it is opensmppbox that is eating memory?
>
> And not sqlbox?
>
>
>
> Just checking.
>
>
>
> == Rene
>
>
>
> *From:* Minh Tuan [mailto:[email protected]]
> *Sent:* vrijdag 15 november 2013 20:24
>
> *To:* Rene Kluwen
> *Cc:* [email protected]
> *Subject:* Re: opensmppbox consume a lot of MEM
>
>
>
> I don't know where to find the opensmppbox version but i downloaded the
> lastest SVN with changelog:
>
>
>
> *2013-09-01 Rene Kluwen <rene.kluwen at chimit.nl <http://chimit.nl>>
> Fixed a small bug in the routing-upon-receiver number where opensmppbox
> would crash at boot-time if the particular config section is not
> defined.*
>
> I attached log and config files. Just post here some things to high light:
>
> Here is the 'top' when Kannel starting, opensmppbox only occupied 0.2%
> mem, it'll reach to 80% in 1 day:
>
>
> [image: Image removed by sender.]
>
>
>
> *opensmppbox log:*
> 2013-11-16 00:59:23 [13219] [2] DEBUG: SMPP PDU 0x83c9288 dump:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: type_name: submit_sm
> 2013-11-16 00:59:23 [13219] [2] DEBUG: command_id: 4 = 0x00000004
> 2013-11-16 00:59:23 [13219] [2] DEBUG: command_status: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sequence_number: 7 = 0x00000007
> 2013-11-16 00:59:23 [13219] [2] DEBUG: service_type: NULL
> 2013-11-16 00:59:23 [13219] [2] DEBUG: source_addr_ton: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [2] DEBUG: source_addr_npi: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [2] DEBUG: source_addr: "32665"
> 2013-11-16 00:59:23 [13219] [2] DEBUG: dest_addr_ton: 1 = 0x00000001
> 2013-11-16 00:59:23 [13219] [2] DEBUG: dest_addr_npi: 1 = 0x00000001
> 2013-11-16 00:59:23 [13219] [2] DEBUG: destination_addr: "841869066432"
> 2013-11-16 00:59:23 [13219] [2] DEBUG: esm_class: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [2] DEBUG: protocol_id: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [2] DEBUG: priority_flag: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [2] DEBUG: schedule_delivery_time: NULL
> 2013-11-16 00:59:23 [13219] [2] DEBUG: validity_period: NULL
> 2013-11-16 00:59:23 [13219] [2] DEBUG: registered_delivery: 1 =
> 0x00000001
> 2013-11-16 00:59:23 [13219] [2] DEBUG: replace_if_present_flag: 0 =
> 0x00000000
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data_coding: 8 = 0x00000008
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sm_default_msg_id: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sm_length: 72 = 0x00000048
> 2013-11-16 00:59:23 [13219] [2] DEBUG: short_message:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc098:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 72
> 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 73
> 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 34 00 31 00 36 00 36
> 00 20 00 6c 00 e0 00 20 .4.1.6.6. .l...
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 6d 00 e3 00 20 00 78
> 00 e1 00 63 00 20 00 6e .m... .x...c. .n
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 68 1e ad 00 6e 00 20
> 00 46 00 61 00 63 00 65 .h...n. .F.a.c.e
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 62 00 6f 00 6f 00 6b
> 00 20 00 63 1e e7 00 61 .b.o.o.k. .c...a
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 20 00 62 1e a1 00
> 6e . .b...n
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: SMPP PDU dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: routed msg '32665:abcdefgh' to smsc
> 'hnlive'
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Msg object at 0x83c90d8:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: type: sms
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.sender:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc398:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 5
> 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 6
> 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 33 32 36 36
> 35 32665
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.receiver:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc228:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 13
> 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 1024
> 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 2b 38 34 31 38 36 39 30 36
> 36 34 33 32 +841869066432
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.udhdata:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.msgdata:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc098:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 72
> 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 73
> 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 34 00 31 00 36 00 36 00
> 20 00 6c 00 e0 00 20 .4.1.6.6. .l...
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 6d 00 e3 00 20 00 78 00
> e1 00 63 00 20 00 6e .m... .x...c. .n
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 68 1e ad 00 6e 00 20 00
> 46 00 61 00 63 00 65 .h...n. .F.a.c.e
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 62 00 6f 00 6f 00 6b 00
> 20 00 63 1e e7 00 61 .b.o.o.k. .c...a
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 00 20 00 62 1e a1 00
> 6e . .b...n
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.time: 1384538363
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.smsc_id:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83f4808:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 6
> 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 7
> 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 68 6e 6c 69 76
> 65 hnlive
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.smsc_number:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.foreign_id:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.service:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc0b8:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 8
> 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 9
> 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 46 61 63 65 42 6f 6f
> 6b abcdefgh
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.account:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.id:
> 5d667a33-c510-4e87-a7db-f2cec6fb6737
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.sms_type: 2
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.mclass: -1
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.mwi: -1
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.coding: 2
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.compress: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.validity: -1
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.deferred: -1
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.dlr_mask: 19
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.dlr_url:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.pid: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.alt_dcs: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.rpi: -1
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.charset:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.boxc_id:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83c6a00:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 8
> 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 9
> 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 46 61 63 65 42 6f 6f
> 6b abcdefgh
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.binfo:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.msg_left: -1
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.split_parts: (nil)
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.priority: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.resend_try: -1
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.resend_time: -1
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sms.meta_data:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string at 0x83cc1c8:
> 2013-11-16 00:59:23 [13219] [2] DEBUG: len: 6
> 2013-11-16 00:59:23 [13219] [2] DEBUG: size: 1024
> 2013-11-16 00:59:23 [13219] [2] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [2] DEBUG: data: 3f 73 6d 70 70
> 3f ?smpp?
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: Msg object ends.
> 2013-11-16 00:59:23 [13219] [2] DEBUG: DLR[mysql]: Adding DLR
> smsc=abcdefgh, ts=5d667a33-c510-4e87-a7db-f2cec6fb6737, src=32665,
> dst=+841869066432, mask=19, boxc=abcdefgh
> 2013-11-16 00:59:23 [13219] [2] DEBUG: adding DLR entry into database
> 2013-11-16 00:59:23 [13219] [2] DEBUG: sql: INSERT INTO `smppbox_dlr`
> (`smsc`, `ts`, `source`, `destination`, `service`, `url`, `mask`, `boxc`,
> `status`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, 0)
>
>
> 2013-11-16 00:59:23 [13219] [1] DEBUG: new group created `smpp'
> 2013-11-16 00:59:23 [13219] [1] DEBUG: group=`smpp' key=`dlr_err' value=`
> ------------------------------
> '
> 2013-11-16 00:59:23 [13219] [1] DEBUG: SMPP[abcdefgh]: Sending PDU:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: SMPP PDU 0x83eac38 dump:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: type_name: deliver_sm
> 2013-11-16 00:59:23 [13219] [1] DEBUG: command_id: 5 = 0x00000005
> 2013-11-16 00:59:23 [13219] [1] DEBUG: command_status: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [1] DEBUG: sequence_number: 1 = 0x00000001
> 2013-11-16 00:59:23 [13219] [1] DEBUG: service_type: NULL
> 2013-11-16 00:59:23 [13219] [1] DEBUG: source_addr_ton: 2 = 0x00000002
> 2013-11-16 00:59:23 [13219] [1] DEBUG: source_addr_npi: 1 = 0x00000001
> 2013-11-16 00:59:23 [13219] [1] DEBUG: source_addr: "+841869066432"
> 2013-11-16 00:59:23 [13219] [1] DEBUG: dest_addr_ton: 2 = 0x00000002
> 2013-11-16 00:59:23 [13219] [1] DEBUG: dest_addr_npi: 1 = 0x00000001
> 2013-11-16 00:59:23 [13219] [1] DEBUG: destination_addr: "32665"
> 2013-11-16 00:59:23 [13219] [1] DEBUG: esm_class: 4 = 0x00000004
> 2013-11-16 00:59:23 [13219] [1] DEBUG: protocol_id: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [1] DEBUG: priority_flag: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [1] DEBUG: schedule_delivery_time: NULL
> 2013-11-16 00:59:23 [13219] [1] DEBUG: validity_period: NULL
> 2013-11-16 00:59:23 [13219] [1] DEBUG: registered_delivery: 0 =
> 0x00000000
> 2013-11-16 00:59:23 [13219] [1] DEBUG: replace_if_present_flag: 0 =
> 0x00000000
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data_coding: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [1] DEBUG: sm_default_msg_id: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [1] DEBUG: sm_length: 0 = 0x00000000
> 2013-11-16 00:59:23 [13219] [1] DEBUG: short_message:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string at 0x83c9408:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: len: 140
> 2013-11-16 00:59:23 [13219] [1] DEBUG: size: 1024
> 2013-11-16 00:59:23 [13219] [1] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 69 64 3a 35 64 36 36 37
> 61 33 33 2d 63 35 31 30 id:5d667a33-c510
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 2d 34 65 38 37 2d 61 37
> 64 62 2d 66 32 63 65 63 -4e87-a7db-f2cec
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 36 66 62 36 37 33 37 20
> 73 75 62 3a 30 30 31 20 6fb6737 sub:001
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 64 6c 76 72 64 3a 30 30
> 30 20 73 75 62 6d 69 74 dlvrd:000 submit
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 20 64 61 74 65 3a 31 33
> 31 31 31 36 30 30 35 39 date:1311160059
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 20 64 6f 6e 65 20 64 61
> 74 65 3a 31 33 31 31 31 done date:13111
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 36 30 30 35 39 20 73 74
> 61 74 3a 55 4e 44 45 4c 60059 stat:UNDEL
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 49 56 20 65 72 72 3a 30
> 30 30 20 74 65 78 74 3a IV err:000 text:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 20 20 20 20 20 20 20 54
> 65 78 74 3a Text:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [1] DEBUG: message_state: 5 = 0x00000005
> 2013-11-16 00:59:23 [13219] [1] DEBUG: receipted_message_id:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string at 0x83eaf80:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: len: 36
> 2013-11-16 00:59:23 [13219] [1] DEBUG: size: 37
> 2013-11-16 00:59:23 [13219] [1] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 35 64 36 36 37 61 33 33
> 2d 63 35 31 30 2d 34 65 5d667a33-c510-4e
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 38 37 2d 61 37 64 62 2d
> 66 32 63 65 63 36 66 62 87-a7db-f2cec6fb
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 36 37 33
> 37 6737
> 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [1] DEBUG: dlr_err:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string at 0x83ecbd8:
> 2013-11-16 00:59:23 [13219] [1] DEBUG: len: 3
> 2013-11-16 00:59:23 [13219] [1] DEBUG: size: 10
> 2013-11-16 00:59:23 [13219] [1] DEBUG: immutable: 0
> 2013-11-16 00:59:23 [13219] [1] DEBUG: data: 03 00
> 00 ...
> 2013-11-16 00:59:23 [13219] [1] DEBUG: Octet string dump ends.
> 2013-11-16 00:59:23 [13219] [1] DEBUG: SMPP PDU dump ends.
> 2013-11-16 00:59:23 [13219] [1] ERROR: SMPP: Unknown TLV `dlr_err', don't
> send.
>
>
>
> On Fri, Nov 15, 2013 at 2:52 PM, Rene Kluwen <[email protected]>
> wrote:
>
> Also: Which version of opensmppbox are you using?
>
>
>
> *From:* Rene Kluwen [mailto:[email protected]]
> *Sent:* vrijdag 15 november 2013 8:49
> *To:* 'Minh Tuan'; '[email protected]'
> *Subject:* RE: opensmppbox consume a lot of MEM
>
>
>
> Could you please share your config + relevant log parts if applicable?
>
>
>
> == Rene
>
>
>
> *From:* users [mailto:[email protected] <[email protected]>]
> *On Behalf Of *Minh Tuan
> *Sent:* zaterdag 28 september 2013 5:22
> *To:* [email protected]
> *Subject:* opensmppbox consume a lot of MEM
>
>
>
> Dear all,
>
> I need help as opensmppbox is consuming a lot of my server's memory. After
> occupied 80% of RAM (total RAM is 2G), it's also eating 50% of swap memory
> (total 3G) and increasing.
>
> My configuration is:
>
> Client -> opensmppbox(mysql dlr) -> sqlbox -> bearerbox(mysql dlr) ->
> operator SMSC
>
> Opensmppbox has 1 Client only, but he is binding 6 connections (via
> Internet), with 50 short codes and ~30 TPS of throughput, connections are
> lost few times per day (automatic re-connect).
>
>
>
> Of course, i'm going to plug more RAM sticks in to server but i'm afraid
> of it will not help in this situation.
>
> Appreciate you guy can give me some advise and experience. Many thanks.
>
> Nguyen Minh Tuan from Vietnamobile.
>
>
>
>
> --
> <====((=o-( ',_,' )-o=))=====>
>
> Bản chất tốt nhưng cuộc đời xô đẩy!
>
--
<====((=o-( ',_,' )-o=))=====>
Bản chất tốt nhưng cuộc đời xô đẩy!
<<~WRD000.jpg>>
