Re: [Architecture] Connection Pool Implementation for ESB Kafka and JMS Connectors

2016-12-01 Thread Kathees Rajendram
Hi Dushan, I am working on connection pool implementation for Kafka Connector. By next week, I am going to start implementing the JMS connector. I will let you know while designing the connector. Thanks, Kathees On Thu, Dec 1, 2016 at 12:34 PM, Dushan Abeyruwan wrote: > Hi Kathees, > Yes, t

Re: [Architecture] Connection Pool Implementation for ESB Kafka and JMS Connectors

2016-12-01 Thread Malith Jayasinghe
Hi Kathees, The underlying implementation of pool can have a significant impact on the performance. See the architecture tread "bench marks for object pool implementations" What is reason for going for a custom implementation here? Since this is a custom implementation it might be a good idea to

Re: [Architecture] Connection Pool Implementation for ESB Kafka and JMS Connectors

2016-11-30 Thread Kathees Rajendram
Hi Malaka, Yes. Once I compare this performance with other implementations and will arrange a code review. @Malith I will compare the performance of this custom connection pool implementation with other implementations as it is mentioned in the mail thread [1] that Stormpot throughput is highest,

Re: [Architecture] Connection Pool Implementation for ESB Kafka and JMS Connectors

2016-11-30 Thread Dushan Abeyruwan
Hi Kathees, Yes, there seems to be an obvious improvement. However, when comes to JMS connector,try to design that more generic, I guess that can be done with some customizations of what Hasitha has done. Anyway, please do let me know when JMS genetic connector design planned, we can run through

Re: [Architecture] Connection Pool Implementation for ESB Kafka and JMS Connectors

2016-11-30 Thread Malaka Silva
Seems like a significant improvement. I guess pool exists per node in cluster? Once completed please arrange a code review. On Wed, Nov 30, 2016 at 12:27 PM, Kathees Rajendram wrote: > Hi, > > I am working on connection pool implementation for Kafka [1] and JMS [2] > connectors. In the existin

[Architecture] Connection Pool Implementation for ESB Kafka and JMS Connectors

2016-11-29 Thread Kathees Rajendram
Hi, I am working on connection pool implementation for Kafka [1] and JMS [2] connectors. In the existing connectors, connections are created and closed per message which gives the performance issue. I have improved the Kafka connector with configurable connection pool parameter. When publishing th