[jira] [Updated] (KYLIN-5699) Support special character for bitmap measure column & computed column
[ https://issues.apache.org/jira/browse/KYLIN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaguang Jia updated KYLIN-5699: --- Affects Version/s: 5.0-beta (was: 5.0-alpha) > Support special character for bitmap measure column & computed column > - > > Key: KYLIN-5699 > URL: https://issues.apache.org/jira/browse/KYLIN-5699 > Project: Kylin > Issue Type: Improvement > Components: Modeling >Affects Versions: 5.0-beta >Reporter: Yaguang Jia >Assignee: Yaguang Jia >Priority: Critical > Fix For: 5.0.0 > > > *Root Cause* > The Spark org.apache.spark.sql.functions.expr function cannot recognize > special characters such as Chinese characters and needs to be enclosed in > backticks. > *Dev Design* > Identify the places where expr is called and add compatibility handling for > special characters: > Build the computable column > {code:java} > FlatTableAndDictBase#concatCCs{code} > Build dictionary > {code:java} > DFBuilderHelper#selectColumnsInTable, DFBuilderHelper#chooseSuitableCols{code} > Build dictionary > {code:java} > DFDictionaryBuilder#wrapCol{code} > > > > *Root Cause* > Spark {{org.apache.spark.sql.functions.expr}} 函数不能识别中文等特殊字符,需要用反引号包裹。 > *Dev Design* > 找出 expr 调用处,增加对特殊字符的兼容处理: > # 构建可计算列 {{FlatTableAndDictBase#concatCCs}} > # 构建字典 > {{{}DFBuilderHelper#selectColumnsInTable{}}}、{{{}DFBuilderHelper#chooseSuitableCols{}}} > # 构建字典 {{DFDictionaryBuilder#wrapCol}} > {{}} > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (KYLIN-5699) Support special character for bitmap measure column & computed column
[ https://issues.apache.org/jira/browse/KYLIN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaguang Jia updated KYLIN-5699: --- Fix Version/s: 5.0.0 > Support special character for bitmap measure column & computed column > - > > Key: KYLIN-5699 > URL: https://issues.apache.org/jira/browse/KYLIN-5699 > Project: Kylin > Issue Type: Improvement > Components: Modeling >Affects Versions: 5.0-alpha >Reporter: Yaguang Jia >Assignee: Yaguang Jia >Priority: Critical > Fix For: 5.0.0 > > > *Root Cause* > The Spark org.apache.spark.sql.functions.expr function cannot recognize > special characters such as Chinese characters and needs to be enclosed in > backticks. > *Dev Design* > Identify the places where expr is called and add compatibility handling for > special characters: > Build the computable column > {code:java} > FlatTableAndDictBase#concatCCs{code} > Build dictionary > {code:java} > DFBuilderHelper#selectColumnsInTable, DFBuilderHelper#chooseSuitableCols{code} > Build dictionary > {code:java} > DFDictionaryBuilder#wrapCol{code} > > > > *Root Cause* > Spark {{org.apache.spark.sql.functions.expr}} 函数不能识别中文等特殊字符,需要用反引号包裹。 > *Dev Design* > 找出 expr 调用处,增加对特殊字符的兼容处理: > # 构建可计算列 {{FlatTableAndDictBase#concatCCs}} > # 构建字典 > {{{}DFBuilderHelper#selectColumnsInTable{}}}、{{{}DFBuilderHelper#chooseSuitableCols{}}} > # 构建字典 {{DFDictionaryBuilder#wrapCol}} > {{}} > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (KYLIN-5699) Support special character for bitmap measure column & computed column
[ https://issues.apache.org/jira/browse/KYLIN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoxiang Yu updated KYLIN-5699: Fix Version/s: (was: 5.0-beta) > Support special character for bitmap measure column & computed column > - > > Key: KYLIN-5699 > URL: https://issues.apache.org/jira/browse/KYLIN-5699 > Project: Kylin > Issue Type: Improvement > Components: Modeling >Affects Versions: 5.0-alpha >Reporter: Yaguang Jia >Assignee: Yaguang Jia >Priority: Critical > > *Root Cause* > The Spark org.apache.spark.sql.functions.expr function cannot recognize > special characters such as Chinese characters and needs to be enclosed in > backticks. > *Dev Design* > Identify the places where expr is called and add compatibility handling for > special characters: > Build the computable column > {code:java} > FlatTableAndDictBase#concatCCs{code} > Build dictionary > {code:java} > DFBuilderHelper#selectColumnsInTable, DFBuilderHelper#chooseSuitableCols{code} > Build dictionary > {code:java} > DFDictionaryBuilder#wrapCol{code} > > > > *Root Cause* > Spark {{org.apache.spark.sql.functions.expr}} 函数不能识别中文等特殊字符,需要用反引号包裹。 > *Dev Design* > 找出 expr 调用处,增加对特殊字符的兼容处理: > # 构建可计算列 {{FlatTableAndDictBase#concatCCs}} > # 构建字典 > {{{}DFBuilderHelper#selectColumnsInTable{}}}、{{{}DFBuilderHelper#chooseSuitableCols{}}} > # 构建字典 {{DFDictionaryBuilder#wrapCol}} > {{}} > -- This message was sent by Atlassian Jira (v8.20.10#820010)