devinjdangelo commented on issue #8853:
URL:
https://github.com/apache/arrow-datafusion/issues/8853#issuecomment-1890474486
Similar to #8851, the parallelized parquet writer code is to blame here.
There is something wrong with how that code is handling nested types.
```
DataFusion CLI v34.0.0
❯ set datafusion.execution.parquet.allow_single_file_parallelism = false;
0 rows in set. Query took 0.010 seconds.
❯ create table t as values (struct ('foo', 1)), (struct('bar', 2));
0 rows in set. Query took 0.002 seconds.
❯ copy (select * from t) to '/tmp/foo.parquet';
+-------+
| count |
+-------+
| 2 |
+-------+
1 row in set. Query took 0.021 seconds.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
