Hi all,

I have some doubts about arrow flight throughput. In this 
article(https://www.dremio.com/understanding-apache-arrow-flight/),  it said 
"High efficiency. Flight is designed to work without any serialization or 
deserialization of records, and with zero memory copies, achieving over 20 Gbps 
per core."  And in the other article 
(https://arrow.apache.org/blog/2019/10/13/introducing-arrow-flight/), it said 
"As far as absolute speed, in our C++ data throughput benchmarks, we are seeing 
end-to-end TCP throughput in excess of 2-3GB/s on localhost without TLS 
enabled. This benchmark shows a transfer of ~12 gigabytes of data in about 4 
seconds:"

Here 20 Gbps /8 = 2.5GB/s, does it mean if we test benchmark in a server with 
two cores, the throughput will be 5 GB/s?  But I have run the 
arrow-flight-benchmark, my server with 40 cores, but the result is " Speed: 
2420.82 MB/s" .

So what should I do to increase the throughput? Please correct me if I am 
wrong. Thank you in advance!

Thanks,
Jiajia



Reply via email to