[grpc-io] Why increasing max_workers from 1 to any number reduce concurrency in Python gRPC

2019-07-20 Thread alireza hoseini
I have used the below sample code to run the server: self.server = grpc.server(futures.ThreadPoolExecutor(max_workers=1)), maximum_concurrent_rpcs=3000) Some unnecessary codes are removed for better readability. I have used ghz to load test my gRPC server: ghz --ins

[grpc-io] gRPC server concurrency issue in python

2019-08-14 Thread alireza hoseini
Correct me if I'm wrong: Basically if the ThreadPoolExecutor's max_workers is less than maximum_concurrent_rpcs then after all the threads get busy processing requests, the next request will be queued and will be processed when a thread finishes its processing. If my server already processing m