BTW, I've measured throughput of Redis on my machine, and it resulted in
only 30K/sec, which is 10 times slower than ZMQ. Possibly, some hybrid
solution of several alternative backends will work.
On Saturday, May 23, 2015 at 2:04:02 AM UTC+3, Andrei Zh wrote:
It still helps a lot, because
It still helps a lot, because you can have many reporting programs, each
talking to different processes on the server, and those processes are able
to get the transactions done very quickly, with multiple write daemons and
journaling daemons doing the actual I/O from the shared buffer
But it also means that this trick won't work with separate machines for
database (metric server) and reporting program, which is one of the goals.
On Thu, May 21, 2015 at 12:19 AM, Scott Jones scott.paul.jo...@gmail.com
wrote:
On Wednesday, May 20, 2015 at 4:26:40 PM UTC-4, Andrei Zh wrote:
It still helps a lot, because you can have many reporting programs, each
talking to different processes on the server, and those processes are able
to get the transactions done very quickly, with multiple write daemons and
journaling daemons doing the actual I/O from the shared buffer pool.
I was able to get 2M/sec without transactions, and 909K/sec with
transactions (so it's durable), on my laptop, using Caché... (from
InterSystems... I used to consult for them)
They do have a free single user database engine, Globals, that you might
be able to use... I don't recall
On Wednesday, May 20, 2015 at 4:26:40 PM UTC-4, Andrei Zh wrote:
Well, if they don't use any tricks like passing data through shared memory
or heavy batching, then it's pretty impressive. But, as you mentioned, in
this particular case Caché is not an option.
I would say that *any*
On Tuesday, May 19, 2015 at 7:23:13 PM UTC-4, Andrei Zh wrote:
But, ZMQ isn't storing it anywhere... that's just a messaging protocol,
isn't it?
Yes, and in fact, it may be even enough if you have sufficiently smart
consumer on other end. For example, if the goal is to keep only
But, ZMQ isn't storing it anywhere... that's just a messaging protocol,
isn't it?
Yes, and in fact, it may be even enough if you have sufficiently smart
consumer on other end. For example, if the goal is to keep only statistics,
you can use running max, average, histogram, etc. In this case
