lmwnshn commented on issue #14373: URL: https://github.com/apache/datafusion/issues/14373#issuecomment-2625132755
On `enable_ident_normalization`: I think there may be some extra complications in my situation arising from the use of Substrait (or perhaps Substrait table names are treated as quoted? or perhaps I misunderstand the purpose of the flag - entirely possible!). Please see https://github.com/lmwnshn/15799-s25-project1-remnants/blob/main/run_datafusion_ident.py#L37 Even with enable_ident_normalization=false, lowercase tablenames and lowercase column names in the parquet files as shown here results in `Exception: DataFusion error: Plan("No table named 'LINEITEM'")`: https://github.com/lmwnshn/15799-s25-project1-remnants/blob/main/run_datafusion_ident.py#L12-L19 So I hacked the parquet files up a bit https://github.com/lmwnshn/15799-s25-project1-remnants/blob/main/fix_parquet.py#L11-L23 and switched to uppercased column names + register tables as uppercase https://github.com/lmwnshn/15799-s25-project1-remnants/blob/main/run_datafusion.py#L12-L19 to get the Substrait plan to execute successfully. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
