Re: Aeron, a high throughput, low latency messaging system

2014-11-19 Thread Roger Hoover
Hi Daniel, Thanks for sharing this. Looks like a great project. I probably don't know enough to give a great answer but will throw in my 2c anyway. I think Kafka prioritizes throughput and aeron prioritizes latency. As you mentioned, maybe Aeron could replace the current Kafka TCP protocol.

Re: Aeron, a high throughput, low latency messaging system

2014-11-19 Thread Daniel Compton
Hi Roger While Aeron does indeed prioritise latency, it also has exceptional throughput performance as well. The early benchmark one user did put it at 2x Kafka: https://groups.google.com/d/msg/mechanical-sympathy/GrEce0gP7RU/gDzl5JG2dfwJ. While benchmarking is fraught with perils and should be

Re: Aeron, a high throughput, low latency messaging system

2014-11-19 Thread Otis Gospodnetic
Here's a good writeup that also mentions Kafka: http://highscalability.com/blog/2014/11/17/aeron-do-we-really-need-another-messaging-system.html Comparing it to Kafka is an apples to oranges comparison from what I can tell. Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log

Aeron, a high throughput, low latency messaging system

2014-11-17 Thread Daniel Compton
Recently there has been some interesting discussion on the Mechanical Sympathy mailing list about Martin Thompson’s new extremely high performance, extremely low latency, open source messaging system called Aeron. For those of you that don’t know, Martin Thompson is an expert on wringing as