parthchandra opened a new issue, #7433: URL: https://github.com/apache/datafusion-comet/issues/7433
### What is the problem the feature request solves? Native Parquet and Iceberg scans fall back to Spark when the query uses `input_file_name()`, `input_file_block_start()` or `input_file_block_length()`. These are common for lineage and debugging columns in ETL. ### Describe the potential solution Have the native scans emit the current file path (and block start and length) per batch, so these expressions can be evaluated natively. For Iceberg, the native scan already produces the `_file` metadata column, so `input_file_name()` could be planned onto it. ### Additional context #6573, #6707 and #6708 fixed empty values by falling back. This issue is about removing the fallback. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
