zml1206 opened a new pull request, #7124: URL: https://github.com/apache/incubator-gluten/pull/7124
## What changes were proposed in this pull request? The Spark implementations of input_file_name/input_file_block_start/input_file_block_length uses a thread local to stash the file name and retrieve it from the function. If there is a transformer node between project input_file_function and scan, the result of input_file_name is an empty string. So we should push down input_file_function to transformer scan or add fallback project of input_file_function before fallback scan. The processing logic is as follows: 1.Before offload, add new project before leaf node and push down input file expression to the new project 2.Normal offload project and scan 3.After offload, if scan be offloaded, push down input file expression into scan and remove project ## How was this patch tested? UT -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
