sunchao commented on pull request #35229: URL: https://github.com/apache/spark/pull/35229#issuecomment-1015876775
> We should add a test for this. AFAIK Parquet field names can contain special chars (one of our customers hit this issue), regardless of what Parquet spec says. Can we use some third-party library to generate such Parquet files? Also cc @sunchao Sorry for chiming in late. Yes I believe other implementations such as C++/Rust don't put this restriction so we can use them to generate test files. Nice to see @AngersZhuuuu already found a solution. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
