Hi Brian, This seems like something we should allow. What imposes the current limit? Is it in the thrift format, or just the implementations?
On Fri, Apr 5, 2019 at 10:23 AM Brian Bowman <brian.bow...@sas.com> wrote: > All, > > SAS requires support for storing varying-length character and binary blobs > with a 2^64 max length in Parquet. Currently, the ByteArray len field is > a unint32_t. Looks this the will require incrementing the Parquet file > format version and changing ByteArray len to uint64_t. > > Have there been any requests for this or other Parquet developments that > require file format versioning changes? > > I realize this a non-trivial ask. Thanks for considering it. > > -Brian > -- Ryan Blue Software Engineer Netflix
