[
https://issues.apache.org/jira/browse/KYLIN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yaguang Jia updated KYLIN-5699:
-------------------------------
Fix Version/s: 5.0.0
> Support special character for bitmap measure column & computed column
> ---------------------------------------------------------------------
>
> Key: KYLIN-5699
> URL: https://issues.apache.org/jira/browse/KYLIN-5699
> Project: Kylin
> Issue Type: Improvement
> Components: Modeling
> Affects Versions: 5.0-alpha
> Reporter: Yaguang Jia
> Assignee: Yaguang Jia
> Priority: Critical
> Fix For: 5.0.0
>
>
> *Root Cause*
> The Spark org.apache.spark.sql.functions.expr function cannot recognize
> special characters such as Chinese characters and needs to be enclosed in
> backticks.
> *Dev Design*
> Identify the places where expr is called and add compatibility handling for
> special characters:
> Build the computable column
> {code:java}
> FlatTableAndDictBase#concatCCs{code}
> Build dictionary
> {code:java}
> DFBuilderHelper#selectColumnsInTable, DFBuilderHelper#chooseSuitableCols{code}
> Build dictionary
> {code:java}
> DFDictionaryBuilder#wrapCol{code}
>
> ----
>
> *Root Cause*
> Spark {{org.apache.spark.sql.functions.expr}} 函数不能识别中文等特殊字符，需要用反引号包裹。
> *Dev Design*
> 找出 expr 调用处，增加对特殊字符的兼容处理：
> # 构建可计算列 {{FlatTableAndDictBase#concatCCs}}
> # 构建字典
> {{{}DFBuilderHelper#selectColumnsInTable{}}}、{{{}DFBuilderHelper#chooseSuitableCols{}}}
> # 构建字典 {{DFDictionaryBuilder#wrapCol}}
> {{}}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
