Hi All,
I found many connections created by Bolts may cause a lot of pressure.
Especially, the short connections cause the ‘logon storm’ for oracle.
So, I want to know if anyway to pooling connections in Bolts, such as for
oracle, Hbase, Redis ......
I really know how to create a connection pool in a Monolithic system, such as
C3P0 for oracle, Jedis pool for Redis. But it seems not appropriate for Bolts.
In my mind, there may be two ways to fix it:
1． Create a connection pool per worker. Means using a static field per jvm
process.
But if the worker crash down, “connection leak” pops.
However, we can set the “connection timeout” on server side to reduce the harm.
But it still is not an elegant implementation.
2． Find a proxy to be the pool. Every bolt borrows a connection from it when
needs. But by now, I don’t find an appropriate component. And IPC may cause
performance problems.
So, any suggestion?
________________________________
Thanks and Regards,
林钰鑫 / Derek
