On Wed, Aug 28, 2024 at 7:05 AM Samuel Joshua <[email protected]> wrote:
> Hi, > > I have a python object which when serielized using jsonpickle or the > python pickle library to json gives me 6 GB size. I would like to try > protobuf instead, would it be supported? I read in the overview ( > https://protobuf.dev/overview/#solve) that it only supports only a few MB > in size data for serializations. Please do let me know. > Protocol Buffer serialization is limited to 2GiB payloads. This is due to how sizes are encoded in the format and the runtime APIs. See https://protobuf.dev/programming-guides/encoding/#size-limit There are ways to encode longer payloads, but it requires extensive care. If your payload is large because you have a list of smaller objects, then you can serialize the individual objects on their own and use some other way to pack them together. > -- > You received this message because you are subscribed to the Google Groups > "Protocol Buffers" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/protobuf/3811cc17-c999-4b5a-91b9-65f4aa4118ccn%40googlegroups.com > <https://groups.google.com/d/msgid/protobuf/3811cc17-c999-4b5a-91b9-65f4aa4118ccn%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Protocol Buffers" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/protobuf/CAM9aRsK4CA6aaXSE6rS0g%2BUwJC%2B%2BQCJf_3CgqfHWJGaoqYYgfw%40mail.gmail.com.
