Hi! The benchmark page shows that grpc-java has a unary call latency of ~300us and a qps of ~150k between 2 8-cores VMs.
https://performance-dot-grpc-testing.appspot.com/explore?dashboard=5712453606309888 How do I reproduce these numbers with AsyncClient and AsyncServer? What are the command line parameters used for producing these numbers? I ranthe benchmark on a pair of 16-cores VMs with 40 Gbps network in the same datacenter. I ran server with: java io.grpc.benchmarks.qps.AsyncServer --address=0.0.0.0:9000 --transport=netty_nio and client with: java io.grpc.benchmarks.qps.AsyncClient --address=server:9000 --transport=netty_nio and results: Channels: 4 Outstanding RPCs per Channel: 10 Server Payload Size: 0 Client Payload Size: 0 50%ile Latency (in micros): *2151* 90%ile Latency (in micros): 8087 95%ile Latency (in micros): 10607 99%ile Latency (in micros): 17711 99.9%ile Latency (in micros): 39359 Maximum Latency (in micros): 413951 QPS: *10917* For optimizing latency I ran server with --directexecutor and client with --channels=1 --outstanding_rpcs=1 Channels: 1 Outstanding RPCs per Channel: 1 Server Payload Size: 0 Client Payload Size: 0 50%ile Latency (in micros): *617* 90%ile Latency (in micros): 1011 95%ile Latency (in micros): 2025 99%ile Latency (in micros): 7659 99.9%ile Latency (in micros): 18255 Maximum Latency (in micros): 125567 QPS: 1094 For optimizing throughput I ran client with --directexecutor and --channels=32 and --outstanding_rpcs=1000 Channels: 32 Outstanding RPCs per Channel: 1000 Server Payload Size: 0 Client Payload Size: 0 50%ile Latency (in micros): 167935 90%ile Latency (in micros): 520447 95%ile Latency (in micros): 652799 99%ile Latency (in micros): 1368063 99.9%ile Latency (in micros): 2390015 Maximum Latency (in micros): 3741695 QPS: 120428 Without --directexecutor in the server and client with --channels=32 and --outstanding_rpcs=1000 Channels: 32 Outstanding RPCs per Channel: 1000 Server Payload Size: 0 Client Payload Size: 0 50%ile Latency (in micros): 347135 90%ile Latency (in micros): 1097727 95%ile Latency (in micros): 1499135 99%ile Latency (in micros): 2330623 99.9%ile Latency (in micros): 3735551 Maximum Latency (in micros): 6463487 QPS: 55969 What is the recommended configuration to achieve the claimed throughput of 150k qps? What are the parameters used for generating the numbers? I'm not able to find that anywhere. Thanks! Alpha -- You received this message because you are subscribed to the Google Groups "grpc.io" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/grpc-io. To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/a3f2110e-e36a-4950-bf94-30a8f4d059e9%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
