Thanks Carl.
And what throughput can you achieve with these latencies?
I mean sending one Req and receiving one Response is fine but what happens
to latencies when REQ rate reaches 50K Reqs per second, especially what is
avg latency and throughput at point when CPU cores are saturated at either
Client or Server.
I agree that latency and throughput do not go hand in hand but would love
to know your numbers before it starts crossing millisecond latency
boundaries?
--Pradeep
On Tue, Aug 9, 2016 at 5:00 PM, Carl Mastrangelo <[email protected]> wrote:
> On machines that are within the same network, you can expect latencies in
> the low hundreds of microseconds. I have personally measured numbers
> within 100 - 200 microseconds on nearby machines. I had to tune the server
> somewhat to achieve this, but it is possible.
>
> On Tuesday, August 9, 2016 at 10:33:31 AM UTC-7, Pradeep Singh wrote:
>>
>> Oh I was running the included benchmark in gRPC src code.
>> I think it reuses the same connection.
>>
>> 300us sounds really good.
>>
>> What latency do you guys notice when client and server are running on
>> different hosts?
>>
>> Thanks,
>>
>> On Tue, Aug 9, 2016 at 8:58 AM, Eric Anderson <[email protected]> wrote:
>>
>>> On Mon, Aug 8, 2016 at 12:35 AM, <[email protected]> wrote:
>>>
>>>> With custom zmq messaging bus we get latency in order of microseconds
>>>> between 2 services on same host (21 us avg) vs 2 ms avg for gRPC.
>>>>
>>>
>>> Did you reuse the ClientConn between RPCs?
>>>
>>> In our performance tests on GCE (using not very special machines, where
>>> netperf takes ~100µs) we see ~300µs latency for unary and ~225µs latency
>>> for streaming in Go.
>>>
>>
>>
>>
>> --
>> Pradeep Singh
>>
>
--
Pradeep Singh
--
You received this message because you are subscribed to the Google Groups
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/grpc-io/CAPpR%3DvVCCx5LfLweyWxNPPaGapyM-R2sydyfQ02__MJ7C%3DMp-w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
