devinjdangelo commented on issue #9369: URL: https://github.com/apache/arrow-datafusion/issues/9369#issuecomment-1968062132
The current copy statement syntax is based on duckdb https://duckdb.org/docs/sql/statements/copy.html. Postgres also has a similar copy to syntax, though their options list is not as flexible and based on fixed keywords. I think there is a middle ground between these two approaches where dfparser could parse some special keywords in the option list and pass through anything else as a HashMap or Vec. #9247 is related. I'm also not opposed to pulling keywords out of the option list entirely to make copy support similar syntax to create external table. The flexible options list would have to stay of course to support format specific options like parquet row group size, but partition_by could be pulled out. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
