amoeba commented on issue #43742: URL: https://github.com/apache/arrow/issues/43742#issuecomment-2297938559
This has come up at least once before, see https://github.com/apache/arrow/issues/40050. In addition to options (1) and (2), there's also an option in the ParquetReader, `thrift_string_size_limit`, that the user can increase to make the read succeed. I like the idea of warning when writing out a file that will encounter the limit and also improving the error message when reading in a file that would surpass the limit. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
