[grpc-io] Stream message delivery guarantees

2023-10-20 Thread Edvard Fagerholm
Hi, I'm wondering if the following is possible the way gRPC streams are implemented. Assume that we have a server-side stream and the server keeps writing data into the stream, so payloads: A, B, C, D, E, ... Is it possible for the client to receive a sequence like: A, B, D, E, ... i.e.

[grpc-io] Re: gRPC AysncIO client connections limit

2023-10-20 Thread Edvard Fagerholm
When testing how many TCP sockets are you creating? Have you checked? If you're using a single shared client stub on a load tester app, then you're probably just creating many HTTP/2 streams over a single HTTP/2 connection. If you're having a load balancer in between like AWS ALB, then it also

[grpc-io] Managing very high numbers of concurrent gRPC streams in Java

2023-10-06 Thread Edvard Fagerholm
Hi, I need to be able to create tens of thousands of simultaneous requests between a server and a load balancer to load balance millions of concurrent mobile connections that listen to events using a gRPC stream. gRPC docs advocate for sharing stubs (first bullet point here):

[grpc-io] Re: Simplest Java code for custom dynamic headers?

2023-06-21 Thread Edvard Fagerholm
t stub in place of your > clientStub after you calculate the shard. > > > > On Wednesday, June 21, 2023 at 10:05:46 AM UTC-7 Edvard Fagerholm wrote: > > Hi there, > > I have a load balancer that routes based on a shard ID to the correct gRPC > server. The code is

[grpc-io] Simplest Java code for custom dynamic headers?

2023-06-21 Thread Edvard Fagerholm
Hi there, I have a load balancer that routes based on a shard ID to the correct gRPC server. The code is essentially the following: public void stateUpdate(StateUpdateRequest req, StreamObserver responseObserver) { // Run on Virtual Thread executor.submit(() -> {

[grpc-io] gRPC Java server fails under load tester after a few days

2024-03-08 Thread Edvard Fagerholm
Hi there, I'm working on a proxy server for a set of services that use gRPC. I've been running a load tester with 1 million concurrent clients against 70 server tasks, so the number of sockets per server is not anything crazy. In terms of CPU capacity the servers are over-provisioned and