I have just caught up with this discussion and wanted to outline a set of use cases we have that rely on server nodes communicating with client nodes.
Firstly, I'd like to confirm my mental model of server & client nodes within a grid (ignoring thin clients for now): A grid contains a set of nodes somewhat arbitrarily labelled 'server' and 'client' where the distinction of a 'server' node is that it is responsible for containing data (in-memory only, or also with persistence). Apart from that distinction, all nodes are essentially peers in the grid and may use the messaging fabric, compute layer and other grid features on an equal footing. In our solution we leverage these capabilities to build and orchestrate complex analytics queries that utilise compute functions that are initiated in three distinct ways: client -> client, client -> server and server -> client, and where all three styles of initiation are using within a single analytics request made to the grid it self. I can go into more detail about the exact sequencing of these activities if you like, but it may be sufficient to know they are used to reason about the problem statement and proposals outlined here. Our infrastructure is deployed to Kubernetes using EKS on AWS, and all three relationships between client and server nodes noted above function well (caveat: we do see odd things though such as long pauses on critical worker threads, and occasional empty topology warnings when locating client nodes to send requests to). We also use continuous queries in three contexts (all within server nodes). If this thread is suggesting changing the functional relationship between server and client nodes then this may have impacts on our architecture and implementation that we will need to consider. This thread has highlighted issues with K8s deployments and also CQ issues. The suggestion is that Server to Client just doesn't work on K8s, which does not agree with our experience of it working. I'd also like to understand better the bounds of the issue with CQ: When does it not work and what are the symptoms we would see if there was an issue with the way we are using it, or the K8s infrastructure we deploy to? Thanks, Raymond. -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/