Tom Scheffers created ARROW-14596:
-------------------------------------
Summary: [Python] parquet.read_table nested fields in columns does
not work for use_legacy_dataset=False
Key: ARROW-14596
URL: https://issues.apache.org/jira/browse/ARROW-14596
Project: Apache Arrow
Issue Type: Bug
Reporter: Tom Scheffers
Fix For: 5.0.0
Reading nested field does not work with use_legacy_dataset=False.
This works:
{code:java}
import pyarrow.parquet as pq
t = pq.read_table(
source=*filename*,
columns=['store_key', 'properties.country'],
use_legacy_dataset=True,
).to_pandas()
{code}
This does not work (for the same parquet file):
{code:java}
import pyarrow.parquet as pq
t = pq.read_table(
source=*filename*,
columns=['store_key', 'properties.country'],
use_legacy_dataset=False,
).to_pandas(){code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
