devinjdangelo commented on PR #8670: URL: https://github.com/apache/arrow-datafusion/pull/8670#issuecomment-1871373043
@andygrove I started working on this but hit a roadblock, as the parquet crate does not expose default_column_properties. We could open an upstream ticket to expose this, but I am also wondering if it might be better overall to just refactor the Copy logical plan to never contain FileTypeWriterOptions. The reason that was added was to provide a nicer interface for DataFrame methods than tuples of strings. We may be able to rework that interface to avoid needing to serialize these complex arrow-rs writer structs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
