AlenkaF commented on code in PR #39112:
URL: https://github.com/apache/arrow/pull/39112#discussion_r1418882389
##########
python/pyarrow/parquet/core.py:
##########
@@ -3234,13 +2170,12 @@ def _mkdir_if_not_exists(fs, path):
def write_to_dataset(table, root_path, partition_cols=None,
partition_filename_cb=None, filesystem=None,
- use_legacy_dataset=None, schema=None,
Review Comment:
I will add it back here as it gets caught by `write_options =
parquet_format.make_write_options(**kwargs)` and raises an error:
```
>>> pq.write_to_dataset(table, root_path='dataset_v2',
... partition_cols=['year'],
... use_legacy_dataset=None)
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/Users/alenkafrim/repos/arrow/python/pyarrow/parquet/core.py", line
2113, in write_to_dataset
write_options = parquet_format.make_write_options(**kwargs)
File "pyarrow/_dataset_parquet.pyx", line 201, in
pyarrow._dataset_parquet.ParquetFileFormat.make_write_options
File "pyarrow/_dataset_parquet.pyx", line 578, in
pyarrow._dataset_parquet.ParquetFileWriteOptions.update
TypeError: unexpected parquet write option: use_legacy_dataset
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
