linhr commented on PR #18921: URL: https://github.com/apache/datafusion/pull/18921#issuecomment-3927881842
Sorry for missing the update on this thread and thanks for the detailed analysis @gstvg! The reasoning makes a lot of sense to me. And it's great to see your investigation on the Spark codebase. I didn't think deeply enough about how the lambda function would need to interact with various parts in DataFusion, such as tree traversal, SQL unparser, and the general ability to preserve argument positions. So the `LambdaUDF` trait I mentioned indeed has many limitations. Therefore, feel free to continue the ideas you are pursuing! And let's see if DataFusion maintainers who are familiar with this part of the codebase have anything to add for the approach. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
