cfis commented on issue #1018:
URL:
https://github.com/apache/datafusion-python/issues/1018#issuecomment-2684263588
Thanks @kosiew - I'll close this ticket then.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
cfis closed issue #1018: DuplicateQualifiedField With Paritioned Data
URL: https://github.com/apache/datafusion-python/issues/1018
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment
kosiew commented on issue #1018:
URL:
https://github.com/apache/datafusion-python/issues/1018#issuecomment-2677496800
hi @cfis
> Not sure if this error is from Arrow or from the way DataFusion
It's from Datafusion
https://github.com/apache/datafusion/blob/c92982c393c69cbc4f5
cfis commented on issue #1018:
URL:
https://github.com/apache/datafusion-python/issues/1018#issuecomment-2676440635
Thanks for looking into this @kosiew.
Yes, I understand that the duplicate fields come from the combination of
hive partition fields and the parquet fields. However, I
kosiew commented on issue #1018:
URL:
https://github.com/apache/datafusion-python/issues/1018#issuecomment-2673258796
Managed to reproduce this without S3
```
import os
import tempfile
import pyarrow as pa
import pyarrow.parquet as pq
import datafusion
def create
cfis opened a new issue, #1018:
URL: https://github.com/apache/datafusion-python/issues/1018
This might be more of an arrow issue, but I am running into this error:
`Exception: DataFusion error: SchemaError(DuplicateQualifiedField {
qualifier: Bare { table: "data" }, name: "year" }, S
