Joris Van den Bossche created ARROW-11378:
---------------------------------------------
Summary: [C++][Dataset] Writing partitions with timestamp type
give mis-formatted (integers) directory names
Key: ARROW-11378
URL: https://issues.apache.org/jira/browse/ARROW-11378
Project: Apache Arrow
Issue Type: Bug
Components: C++
Reporter: Joris Van den Bossche
Fix For: 4.0.0
{code}
In [1]: df = pd.DataFrame({"dates": list(pd.date_range("2012-01-01", periods=2,
freq="D")) * 5, "col": range(10)})
In [2]: table = pa.table(df)
In [8]: part = ds.partitioning(table.select(["dates"]).schema, flavor="hive")
In [9]: ds.write_dataset(table, "test_partition_timestamp", format="parquet",
partitioning=part)
In [10]: !ls test_partition_timestamp/
'dates=1325376000000000000' 'dates=1325462400000000000'
{code}
Same happens for non-ns timestamp types.
(didn't directly find an existing issue about it)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
