devinjdangelo commented on issue #8994: URL: https://github.com/apache/arrow-datafusion/issues/8994#issuecomment-1911274693
Yes, this is a great idea! It will also allow for more uniformity in our session level and statement level option naming conventions. E.g. currently we have ```sql set datafusion.execution.parquet.max_row_group_size=1234 ``` vs ```sql COPY table to 'file.parquet (MAX_ROW_GROUP_SIZE 1234)' ``` could become instead: ``` COPY table to 'file.parquet (datafusion.execution.parquet.max_row_group_size 1234)' ``` A nice side effect would be that `FileTypeWriterOptions` could safely ignore options outside of relevant name spaces rather than throwing an error. E.g. anything that doesn't match `format.*` could be ignored. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
