mapleFU commented on PR #35825: URL: https://github.com/apache/arrow/pull/35825#issuecomment-2044661831
Recently I've revisit this part of code. Maybe we can have a thought on this since single string wouldn't greater than 2GB, maybe the accumulator could still be StringBuilder/BinaryBuilder, limit by 2GB. And if user uses LargeBinary, `::parquet::arrow::` would merging them to LargeBinary/LargeString/Dictionary. Would that API ok? @felipecrv @pitrou -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
