johnseekins opened a new issue, #34546:
URL: https://github.com/apache/arrow/issues/34546
### Describe the bug, including details regarding any error messages,
version, and platform.
I've been trying to create (and then write) a dataset using pyarrow:
```
file_options = ds.ParquetFileFormat().make_write_options(compression="zstd")
partitions = ds.partitioning(
schema=pyarrow.schema([
("partition1", pyarrow.large_string()),
("partition2", pyarrow.large_string()),
("3", pyarrow.large_string()),
])
dataset = ds.dataset(
f"gs://{bucket}/path1/",
partitioning=partitions,
)
table = dataset.scanner().to_table()
ds.write_dataset(
table,
f"gs://{bucket}/path1/",
format="parquet",
file_options=file_options,
partitioning=partitions,
schema=table.schema,
existing_data_behavior="overwrite_or_ignore",
)
```
This code never seems to turn the partitions into the actual expected
strings:
```
pyarrow.lib.ArrowInvalid: google::cloud::Status(INVALID_ARGUMENT: Permanent
error CreateResumableUpload: Disallowed unicode characters present in object
name 'curation/bills/[
"partition1"
]/[
"partition2"
]/[
"3"
]/part-0.par...' error_info={reason=invalid, domain=global,
metadata={http_status_code=400}}). Detail: [errno 22] Invalid argument
```
Am I doing something wrong here? I _thought_ I was following the
documentation...
### Component(s)
Parquet, Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]