Josh, I don't think I'm able to reproduce with your repo. I'm getting something like 0.2s on my desktop:
(venv) rbellevi@rbell:~/Dev/tmp/grpc_min$ python3 grpc_client.py 0.28313207626342773s 18506294 photons in 1008640 bins 0.14323067665100098s 18506294 photons in 1008640 bins (venv) rbellevi@rbell:~/Dev/tmp/grpc_min$ python3 grpc_client.py 0.23985695838928223s 18506294 photons in 1008640 bins 0.13980460166931152s 18506294 photons in 1008640 bins Also, your requirements.txt includes "grpc=1.0.0". I'm assuming this is just an typo. I used "grpcio". Maybe try running cProfile to generate a profile of the repro on your machine and sharing that here? On Tue, Feb 8, 2022 at 10:34 AM Josh Parks <[email protected]> wrote: > I'm trying to do a large array transfer (10-50MB) over gRPC in python and > it's quite slow (5-10 seconds, both client and server on localhost). I've > tried both streaming and unary requests, and they both seem to run slowly. > > For more details/conversation, here's the stackoveflow question: > https://stackoverflow.com/questions/70993553/grpc-slow-serialization-on-large-dataset > > And for the minimum reproducible example: > https://github.com/parksj10/grpc_min > > Any help/guidance much appreciated!!! > > > -- > You received this message because you are subscribed to the Google Groups " > grpc.io" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/grpc-io/b713e084-a3d9-46e3-aae2-8501164ca449n%40googlegroups.com > <https://groups.google.com/d/msgid/grpc-io/b713e084-a3d9-46e3-aae2-8501164ca449n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "grpc.io" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/CAOew_sFSgyu9AohYy%2BzbH9N%3DhmXXW_u0MP%3DNXW1wyhZL9UM7UQ%40mail.gmail.com.
