Joris Van den Bossche created ARROW-13791:
---------------------------------------------
Summary: [Python][Docs] Update datasets user guide with more
details on Partitioning(Factory)
Key: ARROW-13791
URL: https://issues.apache.org/jira/browse/ARROW-13791
Project: Apache Arrow
Issue Type: Improvement
Components: Documentation, Python
Reporter: Joris Van den Bossche
Currently, the datasets user guide has a section about the different
partitioning flavors:
https://arrow.apache.org/docs/python/dataset.html#different-partitioning-schemes.
However, for the case where the partitioning schema is inferred from the file
paths, this only shows the "short-cut" way to do this, and not the equivalent
explicit method to create a factory object with
{{ds.Hive/DirectoryPartitioning.discover(..)}} call, which allows to specify
more options (eg using dictionary types or not, etc).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)