tustvold commented on PR #3292: URL: https://github.com/apache/arrow-rs/pull/3292#issuecomment-1345566492
> then the reader should produce the original arrow table when given the original schema Yup, in a lot of data systems the schema will be stored separately in some sort of catalog, and so this is a fairly important invariant > that this escaping was happening later in the writer code. Not sure either, certainly worth a test or two > I’m sure there are better ways to do it… You could use the pretty print module, I think it supports binary arrays (although I could be mistaken). > contents of the files A cursory google would suggest that CSV files need not be entirely UTF-8. As such perhaps we could avoid escaping at all? Provided we can both read and write it, I don't see any issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
