[
https://issues.apache.org/jira/browse/KYLIN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
pengfei.zhan updated KYLIN-5774:
--------------------------------
Description:
When converting the calcite plan to spark LogicalPlan ，using the DataFrame
interface means parsing while building the LogicalPlan.
In this process，select, aggregation and other operators will execute the method
below, we need care the invoking of "qe.assertAnalyzed()".
{code:java}
def ofRows(sparkSession: SparkSession, logicalPlan: LogicalPlan): DataFrame =
sparkSession.withActive {
val qe = sparkSession.sessionState.executePlan(logicalPlan)
qe.assertAnalyzed()
new Dataset[Row](qe, RowEncoder(qe.analyzed.schema))
} {code}
> Optimize Calcite plan to convert spark logical plan
> ---------------------------------------------------
>
> Key: KYLIN-5774
> URL: https://issues.apache.org/jira/browse/KYLIN-5774
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
> Affects Versions: 5.0-beta
> Reporter: pengfei.zhan
> Assignee: pengfei.zhan
> Priority: Major
> Fix For: 5.0-beta
>
>
> When converting the calcite plan to spark LogicalPlan ，using the DataFrame
> interface means parsing while building the LogicalPlan.
> In this process，select, aggregation and other operators will execute the
> method below, we need care the invoking of "qe.assertAnalyzed()".
> {code:java}
> def ofRows(sparkSession: SparkSession, logicalPlan: LogicalPlan): DataFrame =
> sparkSession.withActive {
> val qe = sparkSession.sessionState.executePlan(logicalPlan)
> qe.assertAnalyzed()
> new Dataset[Row](qe, RowEncoder(qe.analyzed.schema))
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
