[
https://issues.apache.org/jira/browse/KYLIN-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guangyuan Feng updated KYLIN-5574:
----------------------------------
Description:
*How the error occurred?*
During build a model, KE will construct a new SELECT sql from KE's table
metadata, to read data from source tables. But if the user had deleted some
unused columns from any source table, KE's metadata will be different with
Hive's metastore, as a consequence, `SparkSession::sql` will throws validation
exceptions because of the mismatched columns found in the SELECT sql.
*How to solve it?*
Using the intersection between KE's columns and Hive metastore's.
was:
How the error occurred?
During build a model, KE will construct a new SELECT sql from KE's table
metadata, to read data from source tables. But if the user had deleted some
unused columns from any source table, KE's metadata will be different with
Hive's metastore, as a consequence, `SparkSession::sql` will throws validation
exceptions because of the mismatched columns found in the SELECT sql.
How to solve it?
Using the intersection between KE's columns and Hive metastore's.
> Build model failed if any of the source table schema had been changed, saying
> deleted unrelated columns.
> ---------------------------------------------------------------------------------------------------------
>
> Key: KYLIN-5574
> URL: https://issues.apache.org/jira/browse/KYLIN-5574
> Project: Kylin
> Issue Type: Bug
> Components: Modeling
> Affects Versions: 5.0-alpha
> Reporter: Guangyuan Feng
> Priority: Major
> Fix For: 5.0-alpha
>
>
> *How the error occurred?*
> During build a model, KE will construct a new SELECT sql from KE's table
> metadata, to read data from source tables. But if the user had deleted some
> unused columns from any source table, KE's metadata will be different with
> Hive's metastore, as a consequence, `SparkSession::sql` will throws
> validation exceptions because of the mismatched columns found in the SELECT
> sql.
> *How to solve it?*
> Using the intersection between KE's columns and Hive metastore's.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
