This is going to be a bit long mail.
Background: As I have now and then announced, I (long time ago) merged
smsbox and bearerbox together, to make Kannel faster, easier to program
(DLR's, store-files, dynamic configurations etc.). As a part of this
project, we made list of reliability improvements. The main aims of this
project were:
- to make Kannel as fast as possible, so that the speed _always_ depends
on external things (SMSC, HTT server) speed
- to make system as reliable as possible (reliable store-file, steady
memory use etc.)
As a result, there is extend modifications to some parts (sms services)
while some are as they were (newer smsc connections, wap parts). Now
the politics here at NETikos have changed (well, not the only thing that
have changed) so we look forward to integrate various features to
Kannel CVS tree and partake more in the project.
Of course there is that problem that most of these 'improvements' are tied
to that new architecture (merged smsbox) and doing them otherwise might
not be possible or not worth it. So, is the merging worth it? Well I
finally found time to run some benchmarks, here is results briefly
(see the attachment for more results):
The benchmarking was not easy thing, and it is NOT a very good one either,
as the problem is how to benchmark just one thing. As the merged Kannel
(our version) has in addition to that merge, a better store-file and
throttle system for fakesmsc, it resulted in level results regardless what
I threw to it - it did not eat the resources of the system nor slowed
down. With Vanilla Kannel (fresh CVS) I have to put store-file away etc.
So this benchmark not only tested the speed difference of merged smsbox
and bearerbox versus separate boxes, but other parts, too. I tried to
minimize the effect of other parts and thus ran several tests with various
settings.
Well, the full results are in the attachment. Short conclusion:
It is clearly faster to use merged system. However, as a sidenote, the
inter-box speed etc. are not the main issue here, unless building up a
very, very special system (where there is more than 1000-2000 msg/s of
incoming traffic). However, the merged system made it far more easier to
implement throttle system (for incoming messages and HTTP) and improved
store-file, which resulted that this merged version could handle any loads
without slowing down or eating all the resources. Vanilla Kannel was
killed by OS after swap ran out or it got bogged down by the store-file.
But that is another store does that happen in real world or just in
benchmarks :]
As last words, yes we have various little bits and in upcoming weeks, we
investigate how we can merge them into CVS tree and then provide patches.
Hopefully as many as possible, but some might become difficult because
of the above differences and limited time to do bigger modifications to
make them work..
--
&kalle marjola
product concept manager
NETikos finland (http://www.netikos.fi)
Setup:
Vanilla Kannel (fresh CVS) vs. modified Kannel (merged bearer- and
smsbox, throttle system to fakesmsc driver, improved HTTP)
System: Linux on tabletop Linux.
No store-file. Merged Kannel has better store-system. Vanilla
Kannel got completely frozen if store-file was used with high
incoming message traffic.
-----------------------------------------------
1. fakesmsc and bearerbox/smsbox all in same machine, sending 'nop'
messages at interval of 0.0001 (10000/s)
(note: fakesmsc binary of own distribution. But I guess they are
the same)
Vanilla Kannel:
(10000)
2002-09-17 09:17:42 [0] INFO: fakesmsc: from first to last sent message 1.4 s, 7308.5
msgs/s
2002-09-17 09:17:42 [0] INFO: fakesmsc: from first to last received message 4.7 s,
2120.6 msgs/s
(100000)
2002-09-17 09:04:29 [0] INFO: fakesmsc: from first to last sent message 13.4 s,
7441.1 msgs/s
2002-09-17 09:04:29 [0] INFO: fakesmsc: from first to last received message 50.0 s,
1999.2 msgs/s
NOTE: memory growth (to 25 megabytes)
(1000000)
Couldn't handle, too much memory growth. Killed by operating system.
Same happened even with interval = 0.0004 (2500 msg/s)
Merged Kannel:
(10000)
2002-09-17 07:02:09 [0] INFO: fakesmsc: from first to last sent message 1.0 s, 9864.4
msgs/s
2002-09-17 07:02:09 [0] INFO: fakesmsc: from first to last received message 2.7 s,
3711.5 msgs/s
NOTE: with store-file, ~2800 msg/s
(100000)
2002-09-17 07:03:12 [0] INFO: fakesmsc: from first to last sent message 17.7 s,
5650.2 msgs/s
2002-09-17 07:03:12 [0] INFO: fakesmsc: from first to last received message 27.6 s,
3623.6 msgs/s
NOTE: with store-file, ~2830 msg/s
(1000000)
2002-09-17 07:08:24 [0] INFO: fakesmsc: from first to last sent message 252.8 s,
3955.7 msgs/s
2002-09-17 07:08:24 [0] INFO: fakesmsc: from first to last received message 262.7 s,
3807.2 msgs/s
NOTE: with store-file, ~2870 msg/s
-------------------------------------------------
2. As above, but fakesmsc in other machine (note: same fakesmsc binary)
Vanilla Kannel:
(10000)
2002-09-17 06:37:52 [0] INFO: fakesmsc: from first to last sent message 1.0 s, 9998.4
msgs/s
2002-09-17 06:37:52 [0] INFO: fakesmsc: from first to last received message 2.7 s,
3671.5 msgs/s
(100000)
2002-09-17 06:36:12 [0] INFO: fakesmsc: from first to last sent message 10.0 s,
9999.8 msgs/s
2002-09-17 06:36:12 [0] INFO: fakesmsc: from first to last received message 45.7 s,
2189.9 msgs/s
Merged Kannel:
(10000)
2002-09-17 07:08:20 [0] INFO: fakesmsc: from first to last sent message 1.0 s, 9998.4
msgs/s
2002-09-17 07:08:20 [0] INFO: fakesmsc: from first to last received message 1.8 s,
5469.9 msgs/s
(100000)
2002-09-17 07:10:14 [0] INFO: fakesmsc: from first to last sent message 11.6 s,
8586.6 msgs/s
2002-09-17 07:10:14 [0] INFO: fakesmsc: from first to last received message 18.6 s,
5366.4 msgs/s
NOTE: with store-file, all tests at about ~3540 msg/s
--------------------------------------------------
3. As above (2 machines), but with simple HTTP service: send status inquiry
to Kannel itself. The problem here is that they answer with
different number of SMS'es, Vanilla Kannel returns 5 while Merged
Kannel returns 8. So you have to divide the result number.
Vanilla Kannel:
(1000/5000)
2002-09-17 06:48:27 [0] INFO: fakesmsc: from first to last sent message 0.1 s, 9978.9
msgs/s
2002-09-17 06:48:27 [0] INFO: fakesmsc: from first to last received message 5.4 s,
926.8 msgs/s
(10000/50000)
2002-09-17 06:50:13 [0] INFO: fakesmsc: from first to last sent message 1.0 s, 9998.3
msgs/s
2002-09-17 06:50:13 [0] INFO: fakesmsc: from first to last received message 29.6 s,
1691.1 msgs/s
(100000) smsbox: too many open files.
Merged Kannel:
(1000/8000)
2002-09-17 07:14:25 [0] INFO: fakesmsc: from first to last sent message 0.1 s, 9985.1
msgs/s
2002-09-17 07:14:25 [0] INFO: fakesmsc: from first to last received message 1.8 s,
4451.0 msgs/s
(10000/80000)
2002-09-17 07:13:18 [0] INFO: fakesmsc: from first to last sent message 1.0 s, 9998.1
msgs/s
2002-09-17 07:13:18 [0] INFO: fakesmsc: from first to last received message 18.7 s,
4270.9 msgs/s
(100000/800000)
2002-09-17 07:18:58 [0] INFO: fakesmsc: from first to last sent message 126.2 s,
792.6 msgs/s
2002-09-17 07:18:58 [0] INFO: fakesmsc: from first to last received message 176.3 s,
4538.9 msgs/s
