Hi Peng, Spark 2.3 won't work, please check: https://issues.apache.org/jira/browse/KYLIN-3272
2018-07-19 12:55 GMT+08:00 彭鱼宴 <[email protected]>: > Hi Shaofeng, > > Thanks for your reply. I know Kylin now embeds Spark. I mean, if I want > to build the cube on spark engine, using the spark cluster 2.3.1 I already > deploy， can it success? Or will it just use the spark engine embeded in > Kylin? > > Looking forward to your reply and help. This bothers me the whole last > week. > > Best, > Zhefu Peng > ------------------ 原始邮件 ------------------ > *发件人:* "ShaoFeng Shi"<[email protected]>; > *发送时间:* 2018年7月18日(星期三) 中午11:14 > *收件人:* "user"<[email protected]>; > *主题:* Re: Want to know the Version of Spark can use in Kylin. > > Kylin 2.1 to 2.4 embeds Spark 2.1.1+ for Cube building. The dependency can > be found in https://kylin.apache.org/docs/install/index.html > > Only Kylin 2.0 uses Spark 1.6. > > 2018-07-17 15:08 GMT+08:00 彭鱼宴 <[email protected]>: > >> Hi, >> >> Can someone tell me what the version of Spark can Kylin use to build the >> cube? As we all know, the latest version of Kylin is embeded with Spark 1.6 >> . However, if I already deployed my own spark cluster but not 1.6, can it >> run successfully to build the cube? And, I want to know the impact of hive >> cluster, since Apache is always strict with the match between hive version >> and spark version. >> >> In sum, just wanna know whether the kylin can support spark 2.3.0 or >> other versions? >> >> Looking forward to your reply and help. >> >> Best wishes, >> Zhefu Peng >> >> > > > -- > Best regards, > > Shaofeng Shi 史少锋 > > -- Best regards, Shaofeng Shi 史少锋
