Antoine Pitrou commented on ARROW-750:

Two questions :
1) what is the process for evolving the memory layout specification?
2) string and binary types are currently not part of the memory layout 
specification (instead they are assumed to be backed by physical list arrays). 
Should we do the same for large string / binary types, i.e. add a large list 
physical type?

> [Format] Add LargeBinary and LargeString types
> ----------------------------------------------
>                 Key: ARROW-750
>                 URL: https://issues.apache.org/jira/browse/ARROW-750
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Format
>            Reporter: Wes McKinney
>            Priority: Major
> These are string and binary types that use 64-bit offsets. Java will not need 
> to implement these types for the time being, but they are needed when 
> representing very large datasets in C++

This message was sent by Atlassian JIRA

Reply via email to