This is an automated email from the ASF dual-hosted git repository. kszucs pushed a commit to branch maint-6.0.x in repository https://gitbox.apache.org/repos/asf/arrow.git
commit 6e0ed38be102e26306834918d8801931c6d56db0 Author: Joris Van den Bossche <[email protected]> AuthorDate: Tue Oct 26 11:14:19 2021 +0200 ARROW-14459: [Doc] Update the pinned sphinx version to 4.2 Closes #11533 from jorisvandenbossche/ARROW-14459-sphinx-update Authored-by: Joris Van den Bossche <[email protected]> Signed-off-by: Joris Van den Bossche <[email protected]> --- ci/conda_env_sphinx.txt | 3 +-- docs/source/python/dataset.rst | 4 +++- 2 files changed, 4 insertions(+), 3 deletions(-) diff --git a/ci/conda_env_sphinx.txt b/ci/conda_env_sphinx.txt index 49388e2..64e1c16 100644 --- a/ci/conda_env_sphinx.txt +++ b/ci/conda_env_sphinx.txt @@ -19,6 +19,5 @@ breathe doxygen ipython -# Pinned per ARROW-9693 -sphinx=3.1.2 +sphinx=4.2 pydata-sphinx-theme diff --git a/docs/source/python/dataset.rst b/docs/source/python/dataset.rst index 5ca6e7a..e2d8c90 100644 --- a/docs/source/python/dataset.rst +++ b/docs/source/python/dataset.rst @@ -598,8 +598,10 @@ to supply a visitor that will be called as each file is created: print(f"path={written_file.path}") print(f"metadata={written_file.metadata}") +.. ipython:: python + ds.write_dataset(table, base / "dataset_visited", format="parquet", partitioning=part, - file_visitor=file_visitor) + file_visitor=file_visitor) This will allow you to collect the filenames that belong to the dataset and store them elsewhere which can be useful when you want to avoid scanning directories the next time you need to read
