notfilippo commented on issue #12622: URL: https://github.com/apache/datafusion/issues/12622#issuecomment-2377126283
> We should make it a goal that physical planning also abstracts over physical representation of individual batches. > We should also make it a goal that function are expressible directly on logical types. While I support both ideas (one of them was also mentioned in the original proposal) I think that there is still some discussion to be had before making them goals of this effort (https://github.com/apache/datafusion/issues/11513#issuecomment-2371338847, https://github.com/apache/datafusion/issues/11513#issuecomment-2372367122, and https://github.com/apache/datafusion/issues/11513#issuecomment-2373367220). I suggest we first define a plan for decoupling logical types from physical types (including the issue with functions that you are mentioning) and in parallel we can continue to validate this two ideas. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
