Hongze Zhang created SPARK-59850:
------------------------------------
Summary: Support user statistics visitor
Key: SPARK-59850
URL: https://issues.apache.org/jira/browse/SPARK-59850
Project: Spark
Issue Type: New Feature
Components: SQL
Affects Versions: 4.1.3
Reporter: Hongze Zhang
Currently Spark only supports built-in statistics visitors in query planning.
This makes Spark difficult to generate optimal query plan when 3rd SQL plugins
are used, since SQL plugins might introduce custom expressions or execution
backend with specialized statistics calculation.
To address this, we can provide a registry and a configuration option to allow
user to enable a custom statistics visitor.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]