Re: [Architecture] Stream Processor HA improved archectecture

2018-07-13 Thread Gihan Anuruddha
When you say periodically, how often? In the initial description, it says newly active node's port gets open once it finish processing the queue. So events that send to the SP during that period going to lost?? On Fri, Jul 13, 2018 at 3:49 PM Damith Wickramasinghe wrote: > Hi all, > > Please

Re: [Architecture] Stream Processor HA improved archectecture

2018-07-13 Thread Damith Wickramasinghe
Hi all, Please find my comments inline. These are from highlevel perspective. @Anoukh I'm assuming that "queue1" and "queue2" are actually per Source? > Actually both would be just one. Reason being since we need to maintain the order of the events. So at the moment the active node goes down,

Re: [Architecture] Stream Processor HA improved archectecture

2018-07-12 Thread Harshan Liyanage
Hi Damith, According to this architecture, the passive node will only fetch event states and filter events only once it is active. This model might exhaust the queue 2 very soon depending on the rate of events. What if we could add another async task to check the state and filter events even if

Re: [Architecture] Stream Processor HA improved archectecture

2018-07-12 Thread Tishan Dahanayakage
@Anoukh, We can configure a LB in front to handle failover. Actually that is the correct solution rather than publishing to both. But I think we need to figure out how to handle incoming databridge traffic as it cannot be load balanced. Yes we can utilize client side load balancing and directly

Re: [Architecture] Stream Processor HA improved archectecture

2018-07-12 Thread Anoukh Jayawardena
Hi Damith, Just a few clarifications on the new architecture. I'm assuming that "queue1" and "queue2" are actually per Source? Which means if we have 3 sources, we'll have 3 queues in active node and 3 queues in passive node? Does that mean there will be 3 threads working in async? Also, the main

[Architecture] Stream Processor HA improved archectecture

2018-07-12 Thread Damith Wickramasinghe
Hi all, We are in the process of refactor/improve the existing HA architecture due to various concerns found. Below is the high level design came up with. We will provide more in-depth details as the implementation carries on. ​ ​ As per above at a given point of time there will only be a one