westonpace commented on issue #10776: URL: https://github.com/apache/arrow/issues/10776#issuecomment-885372377
Correct. A single array (regardless of type) may not contain more than 2^31 - 1 elements. String & List arrays cannot contain more than 2^31 - 1 bytes (these types are more restrictive). In Arrow, this limitation is usually fixed by using multiple arrays in a single chunked array or multiple record batches in a single table. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
