Github user rxin commented on the issue:
https://github.com/apache/spark/pull/17630
Wait - are we storing UTF8Strings directly in the catalog for statistics?
That doesn't make sense ... if we are not, then we are not using internal
types. In that case we should document clearly what's happening.
My concern is that the internal types are specific to the physical
execution path and stats/CBO are independent of that. We can in the future
change the internal data types without changing CBO, and completely screw
ourselves.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
