alamb commented on issue #7923: URL: https://github.com/apache/arrow-datafusion/issues/7923#issuecomment-1783459112
> Introducing a LogicalType in DF would have a relatively small impact. The LogicalType only comes into play during the planning phase and is not significantly different from the existing logic (based on arrow datatype). I am not sure about how large the change is, but my intuition is that it would be substantial. However, the only way to find out I think would be to try. > Finally, in my opinion, both of the following plans are feasible: > Add ExtensionType in arrow DataType > Add LogicalType in DF I agree they are both feasible, though they come with different tradeoffs. I think the next step is probably to prototype one of the approaches with a technical spike (aka make a PR with that it would look like, to get a sense of the API as well as what would need to be changed) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
