Hongze Zhang created SPARK-59850:
------------------------------------

             Summary: Support user statistics visitor
                 Key: SPARK-59850
                 URL: https://issues.apache.org/jira/browse/SPARK-59850
             Project: Spark
          Issue Type: New Feature
          Components: SQL
    Affects Versions: 4.1.3
            Reporter: Hongze Zhang


Currently Spark only supports built-in statistics visitors in query planning.

This makes Spark difficult to generate optimal query plan when 3rd SQL plugins 
are used, since SQL plugins might introduce custom expressions or execution 
backend with specialized statistics calculation. 

To address this, we can provide a registry and a configuration option to allow 
user to enable a custom statistics visitor.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to