wanx4910 opened a new issue #11027: URL: https://github.com/apache/arrow/issues/11027
I am writing some data to parquet format that requires partitioning the dataset by the column value and the column value contains non-alphanumeric characters. For example, our date format is '2021/08/30' and when the data gets written into the filesystem, the folder structure splits on the '/' character and it looks somehing like 'date=2021'/08/30/somedata.parquet. I was wonder how to get around the folder splitting behaviour, so that the folder would be something like this /'date=2021/08/30'/somedata.parquet This is the most similar issue report that I can find on the java arrow/parquet repo. https://github.com/apache/parquet-mr/pull/361 Thanks for all the help! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
