jorisvandenbossche commented on PR #33674: URL: https://github.com/apache/arrow/pull/33674#issuecomment-1399266477
No, I was thinking about the latter. How I interpret it, with the datasets API, we _always_ create a partitioned dataset, since we always create a (possibly nested) directory of files (in contrast to the Parquet ``write_table`` API which writes single files). Even if the different files / parts have no meaningful additional information embedded in the name or path, I personally still consider that as partitioned (but again, that's my interpretation, I don't know if that's the common interpretation of "partitioned") -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
