Re: Need Information on source Type of Apache Kylin
Yep, but some queries might not be recognized by SQL Server. For example, SQL Server does not support LIMIT. Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." From: Devhuti Kumari Reply-To: "user@kylin.apache.org" Date: Tuesday, April 17, 2018 at 5:16 PM To: "user@kylin.apache.org" Subject: Re: Need Information on source Type of Apache Kylin If there is no Pre built cube for any random query generated by BI tool then it uses SQL server query engine to fetch data from RDBMS? Thanks, Devhuti Kumari On Tue, Apr 17, 2018 at 8:00 AM, Kaige Liu mailto:kaige@kyligence.io>> wrote: Spark could be used as building engine for RDBMS data source as well. Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." From: Devhuti Kumari mailto:devhuti.kum...@gmail.com>> Reply-To: "user@kylin.apache.org<mailto:user@kylin.apache.org>" mailto:user@kylin.apache.org>> Date: Tuesday, April 17, 2018 at 2:15 AM To: "user@kylin.apache.org<mailto:user@kylin.apache.org>" mailto:user@kylin.apache.org>> Subject: Re: Need Information on source Type of Apache Kylin Hi Kaige, If we are going to build cube on RDBMS data source then spark wont be used as computing engine for building fast cube right? Regards, Devhuti Kumari On 16-Apr-2018, at 9:00 PM, Kaige Liu mailto:kaige@kyligence.io>> wrote: Sure, I’d be glad to. Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." From: ShaoFeng Shi mailto:shaofeng...@apache.org>> Reply-To: "user@kylin.apache.org<mailto:user@kylin.apache.org>" mailto:user@kylin.apache.org>> Date: Monday, April 16, 2018 at 11:19 PM To: user mailto:user@kylin.apache.org>> Subject: Re: Need Information on source Type of Apache Kylin Hi Kaige, As more and more people try this function, can you compose a step by step tutorial, so we can put it to Kylin's online documentation? Thanks! 2018-04-16 22:54 GMT+08:00 Kaige Liu mailto:kaige@kyligence.io>>: “GUI is not ready to use” means RDBMS data source is not shown in the source list (check attachment) and reuse the “load hive table” button. When you configured your RDBMS data source correctly and click “Load hive table” button, it actually loads RDBMS tables. Then you could use these tables to design models and create cubes. This is an example for how to configure RDBMS data source. https://issues.apache.org/jira/browse/KYLIN-3044?focusedCommentId=16262000&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16262000 Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." On 4/16/18, 10:20 PM, "Devhuti Kumari" mailto:devhuti.kum...@gmail.com>> wrote: By GUI is not ready to use you mean though we can connect to these DB we cant create Cube yet on top of these, correct me if i misunderstood? On Mon, Apr 16, 2018 at 7:46 PM, Kaige Liu mailto:kaige@kyligence.io>> wrote: > Sql server, MySql and Vertica has already been supported as data source, and it’s easy to extend other RDBMS data source. But the GUI is not ready to use. > You are so welcome to contribute a patch for integrating Splice Machine ☺. > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > > On 4/16/18, 7:51 PM, "Devhuti Kumari" mailto:devhuti.kum...@gmail.com>> wrote: > > Hi, > > Can we have any RDBMS as a data source for Apache Kylin instead of > Hadoop Hive tables? > > If Yes then can we integrate it to Splice Machine using Splice Machine > as data source. > > > > Thanks, > > Devhuti Kumari > > > -- Best regards, Shaofeng Shi 史少锋
Re: Need Information on source Type of Apache Kylin
If there is no Pre built cube for any random query generated by BI tool then it uses SQL server query engine to fetch data from RDBMS? Thanks, Devhuti Kumari On Tue, Apr 17, 2018 at 8:00 AM, Kaige Liu wrote: > Spark could be used as building engine for RDBMS data source as well. > > > > Best regards, > > > > Kaige Liu(刘凯歌) > > Mail: kaige@kyligence.io > > Shanghai Kyligence Information Technology Co., Ltd > > 上海市浦东新区亮秀路112号Y1座405室 > > > > *"Do small things with great love." * > > > > > > *From: *Devhuti Kumari > *Reply-To: *"user@kylin.apache.org" > *Date: *Tuesday, April 17, 2018 at 2:15 AM > *To: *"user@kylin.apache.org" > > *Subject: *Re: Need Information on source Type of Apache Kylin > > > > Hi Kaige, > > > > If we are going to build cube on RDBMS data source then spark wont be used > as computing engine for building fast cube right? > > > > > > Regards, > > Devhuti Kumari > > > On 16-Apr-2018, at 9:00 PM, Kaige Liu wrote: > > Sure, I’d be glad to. > > > > Best regards, > > > > Kaige Liu(刘凯歌) > > Mail: kaige@kyligence.io > > Shanghai Kyligence Information Technology Co., Ltd > > 上海市浦东新区亮秀路112号Y1座405室 > > > > *"Do small things with great love." * > > > > > > *From: *ShaoFeng Shi > *Reply-To: *"user@kylin.apache.org" > *Date: *Monday, April 16, 2018 at 11:19 PM > *To: *user > *Subject: *Re: Need Information on source Type of Apache Kylin > > > > Hi Kaige, > > > > As more and more people try this function, can you compose a step by step > tutorial, so we can put it to Kylin's online documentation? Thanks! > > > > 2018-04-16 22:54 GMT+08:00 Kaige Liu : > > “GUI is not ready to use” means RDBMS data source is not shown in the > source list (check attachment) and reuse the “load hive table” button. When > you configured your RDBMS data source correctly and click “Load hive table” > button, it actually loads RDBMS tables. Then you could use these tables to > design models and create cubes. > > This is an example for how to configure RDBMS data source. > https://issues.apache.org/jira/browse/KYLIN-3044? > focusedCommentId=16262000&page=com.atlassian.jira. > plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16262000 > > > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > > On 4/16/18, 10:20 PM, "Devhuti Kumari" wrote: > > By GUI is not ready to use you mean though we can connect to these DB > we cant create Cube yet on top of these, correct me if i > misunderstood? > > On Mon, Apr 16, 2018 at 7:46 PM, Kaige Liu > wrote: > > Sql server, MySql and Vertica has already been supported as data > source, and it’s easy to extend other RDBMS data source. But the GUI is not > ready to use. > > You are so welcome to contribute a patch for integrating Splice > Machine ☺. > > > > Best regards, > > > > Kaige Liu(刘凯歌) > > Mail: kaige@kyligence.io > > Shanghai Kyligence Information Technology Co., Ltd > > 上海市浦东新区亮秀路112号Y1座405室 > > > > "Do small things with great love." > > > > > > > > On 4/16/18, 7:51 PM, "Devhuti Kumari" > wrote: > > > > Hi, > > > > Can we have any RDBMS as a data source for Apache Kylin instead > of > > Hadoop Hive tables? > > > > If Yes then can we integrate it to Splice Machine using Splice > Machine > > as data source. > > > > > > > > Thanks, > > > > Devhuti Kumari > > > > > > > > > > > > > > -- > > Best regards, > > > > Shaofeng Shi 史少锋 > > > >
Re: Need Information on source Type of Apache Kylin
Spark could be used as building engine for RDBMS data source as well. Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." From: Devhuti Kumari Reply-To: "user@kylin.apache.org" Date: Tuesday, April 17, 2018 at 2:15 AM To: "user@kylin.apache.org" Subject: Re: Need Information on source Type of Apache Kylin Hi Kaige, If we are going to build cube on RDBMS data source then spark wont be used as computing engine for building fast cube right? Regards, Devhuti Kumari On 16-Apr-2018, at 9:00 PM, Kaige Liu mailto:kaige@kyligence.io>> wrote: Sure, I’d be glad to. Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." From: ShaoFeng Shi mailto:shaofeng...@apache.org>> Reply-To: "user@kylin.apache.org<mailto:user@kylin.apache.org>" mailto:user@kylin.apache.org>> Date: Monday, April 16, 2018 at 11:19 PM To: user mailto:user@kylin.apache.org>> Subject: Re: Need Information on source Type of Apache Kylin Hi Kaige, As more and more people try this function, can you compose a step by step tutorial, so we can put it to Kylin's online documentation? Thanks! 2018-04-16 22:54 GMT+08:00 Kaige Liu mailto:kaige@kyligence.io>>: “GUI is not ready to use” means RDBMS data source is not shown in the source list (check attachment) and reuse the “load hive table” button. When you configured your RDBMS data source correctly and click “Load hive table” button, it actually loads RDBMS tables. Then you could use these tables to design models and create cubes. This is an example for how to configure RDBMS data source. https://issues.apache.org/jira/browse/KYLIN-3044?focusedCommentId=16262000&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16262000 Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." On 4/16/18, 10:20 PM, "Devhuti Kumari" mailto:devhuti.kum...@gmail.com>> wrote: By GUI is not ready to use you mean though we can connect to these DB we cant create Cube yet on top of these, correct me if i misunderstood? On Mon, Apr 16, 2018 at 7:46 PM, Kaige Liu mailto:kaige@kyligence.io>> wrote: > Sql server, MySql and Vertica has already been supported as data source, and it’s easy to extend other RDBMS data source. But the GUI is not ready to use. > You are so welcome to contribute a patch for integrating Splice Machine ☺. > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > > On 4/16/18, 7:51 PM, "Devhuti Kumari" mailto:devhuti.kum...@gmail.com>> wrote: > > Hi, > > Can we have any RDBMS as a data source for Apache Kylin instead of > Hadoop Hive tables? > > If Yes then can we integrate it to Splice Machine using Splice Machine > as data source. > > > > Thanks, > > Devhuti Kumari > > > -- Best regards, Shaofeng Shi 史少锋
Re: Need Information on source Type of Apache Kylin
Hi Kaige, If we are going to build cube on RDBMS data source then spark wont be used as computing engine for building fast cube right? Regards, Devhuti Kumari > On 16-Apr-2018, at 9:00 PM, Kaige Liu wrote: > > Sure, I’d be glad to. > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > From: ShaoFeng Shi > Reply-To: "user@kylin.apache.org" > Date: Monday, April 16, 2018 at 11:19 PM > To: user > Subject: Re: Need Information on source Type of Apache Kylin > > Hi Kaige, > > As more and more people try this function, can you compose a step by step > tutorial, so we can put it to Kylin's online documentation? Thanks! > > 2018-04-16 22:54 GMT+08:00 Kaige Liu : > “GUI is not ready to use” means RDBMS data source is not shown in the source > list (check attachment) and reuse the “load hive table” button. When you > configured your RDBMS data source correctly and click “Load hive table” > button, it actually loads RDBMS tables. Then you could use these tables to > design models and create cubes. > > This is an example for how to configure RDBMS data source. > https://issues.apache.org/jira/browse/KYLIN-3044?focusedCommentId=16262000&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16262000 > > > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > > On 4/16/18, 10:20 PM, "Devhuti Kumari" wrote: > > By GUI is not ready to use you mean though we can connect to these DB > we cant create Cube yet on top of these, correct me if i > misunderstood? > > On Mon, Apr 16, 2018 at 7:46 PM, Kaige Liu wrote: > > Sql server, MySql and Vertica has already been supported as data > source, and it’s easy to extend other RDBMS data source. But the GUI is not > ready to use. > > You are so welcome to contribute a patch for integrating Splice Machine > ☺. > > > > Best regards, > > > > Kaige Liu(刘凯歌) > > Mail: kaige@kyligence.io > > Shanghai Kyligence Information Technology Co., Ltd > > 上海市浦东新区亮秀路112号Y1座405室 > > > > "Do small things with great love." > > > > > > > > On 4/16/18, 7:51 PM, "Devhuti Kumari" wrote: > > > > Hi, > > > > Can we have any RDBMS as a data source for Apache Kylin instead of > > Hadoop Hive tables? > > > > If Yes then can we integrate it to Splice Machine using Splice > Machine > > as data source. > > > > > > > > Thanks, > > > > Devhuti Kumari > > > > > > > > > > > > > -- > Best regards, > > Shaofeng Shi 史少锋 >
Re: Need Information on source Type of Apache Kylin
Sure, I’d be glad to. Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." From: ShaoFeng Shi Reply-To: "user@kylin.apache.org" Date: Monday, April 16, 2018 at 11:19 PM To: user Subject: Re: Need Information on source Type of Apache Kylin Hi Kaige, As more and more people try this function, can you compose a step by step tutorial, so we can put it to Kylin's online documentation? Thanks! 2018-04-16 22:54 GMT+08:00 Kaige Liu mailto:kaige@kyligence.io>>: “GUI is not ready to use” means RDBMS data source is not shown in the source list (check attachment) and reuse the “load hive table” button. When you configured your RDBMS data source correctly and click “Load hive table” button, it actually loads RDBMS tables. Then you could use these tables to design models and create cubes. This is an example for how to configure RDBMS data source. https://issues.apache.org/jira/browse/KYLIN-3044?focusedCommentId=16262000&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16262000 Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." On 4/16/18, 10:20 PM, "Devhuti Kumari" mailto:devhuti.kum...@gmail.com>> wrote: By GUI is not ready to use you mean though we can connect to these DB we cant create Cube yet on top of these, correct me if i misunderstood? On Mon, Apr 16, 2018 at 7:46 PM, Kaige Liu mailto:kaige@kyligence.io>> wrote: > Sql server, MySql and Vertica has already been supported as data source, and it’s easy to extend other RDBMS data source. But the GUI is not ready to use. > You are so welcome to contribute a patch for integrating Splice Machine ☺. > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > > On 4/16/18, 7:51 PM, "Devhuti Kumari" mailto:devhuti.kum...@gmail.com>> wrote: > > Hi, > > Can we have any RDBMS as a data source for Apache Kylin instead of > Hadoop Hive tables? > > If Yes then can we integrate it to Splice Machine using Splice Machine > as data source. > > > > Thanks, > > Devhuti Kumari > > > -- Best regards, Shaofeng Shi 史少锋
Re: Need Information on source Type of Apache Kylin
Hi Kaige, As more and more people try this function, can you compose a step by step tutorial, so we can put it to Kylin's online documentation? Thanks! 2018-04-16 22:54 GMT+08:00 Kaige Liu : > “GUI is not ready to use” means RDBMS data source is not shown in the > source list (check attachment) and reuse the “load hive table” button. When > you configured your RDBMS data source correctly and click “Load hive table” > button, it actually loads RDBMS tables. Then you could use these tables to > design models and create cubes. > > This is an example for how to configure RDBMS data source. > https://issues.apache.org/jira/browse/KYLIN-3044? > focusedCommentId=16262000&page=com.atlassian.jira. > plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16262000 > > > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > > On 4/16/18, 10:20 PM, "Devhuti Kumari" wrote: > > By GUI is not ready to use you mean though we can connect to these DB > we cant create Cube yet on top of these, correct me if i > misunderstood? > > On Mon, Apr 16, 2018 at 7:46 PM, Kaige Liu > wrote: > > Sql server, MySql and Vertica has already been supported as data > source, and it’s easy to extend other RDBMS data source. But the GUI is not > ready to use. > > You are so welcome to contribute a patch for integrating Splice > Machine ☺. > > > > Best regards, > > > > Kaige Liu(刘凯歌) > > Mail: kaige@kyligence.io > > Shanghai Kyligence Information Technology Co., Ltd > > 上海市浦东新区亮秀路112号Y1座405室 > > > > "Do small things with great love." > > > > > > > > On 4/16/18, 7:51 PM, "Devhuti Kumari" > wrote: > > > > Hi, > > > > Can we have any RDBMS as a data source for Apache Kylin instead > of > > Hadoop Hive tables? > > > > If Yes then can we integrate it to Splice Machine using Splice > Machine > > as data source. > > > > > > > > Thanks, > > > > Devhuti Kumari > > > > > > > > > > -- Best regards, Shaofeng Shi 史少锋
Re: Need Information on source Type of Apache Kylin
“GUI is not ready to use” means RDBMS data source is not shown in the source list (check attachment) and reuse the “load hive table” button. When you configured your RDBMS data source correctly and click “Load hive table” button, it actually loads RDBMS tables. Then you could use these tables to design models and create cubes. This is an example for how to configure RDBMS data source. https://issues.apache.org/jira/browse/KYLIN-3044?focusedCommentId=16262000&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16262000 Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." On 4/16/18, 10:20 PM, "Devhuti Kumari" wrote: By GUI is not ready to use you mean though we can connect to these DB we cant create Cube yet on top of these, correct me if i misunderstood? On Mon, Apr 16, 2018 at 7:46 PM, Kaige Liu wrote: > Sql server, MySql and Vertica has already been supported as data source, and it’s easy to extend other RDBMS data source. But the GUI is not ready to use. > You are so welcome to contribute a patch for integrating Splice Machine ☺. > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > > On 4/16/18, 7:51 PM, "Devhuti Kumari" wrote: > > Hi, > > Can we have any RDBMS as a data source for Apache Kylin instead of > Hadoop Hive tables? > > If Yes then can we integrate it to Splice Machine using Splice Machine > as data source. > > > > Thanks, > > Devhuti Kumari > > >
Re: Need Information on source Type of Apache Kylin
By GUI is not ready to use you mean though we can connect to these DB we cant create Cube yet on top of these, correct me if i misunderstood? On Mon, Apr 16, 2018 at 7:46 PM, Kaige Liu wrote: > Sql server, MySql and Vertica has already been supported as data source, and > it’s easy to extend other RDBMS data source. But the GUI is not ready to use. > You are so welcome to contribute a patch for integrating Splice Machine ☺. > > Best regards, > > Kaige Liu(刘凯歌) > Mail: kaige@kyligence.io > Shanghai Kyligence Information Technology Co., Ltd > 上海市浦东新区亮秀路112号Y1座405室 > > "Do small things with great love." > > > > On 4/16/18, 7:51 PM, "Devhuti Kumari" wrote: > > Hi, > > Can we have any RDBMS as a data source for Apache Kylin instead of > Hadoop Hive tables? > > If Yes then can we integrate it to Splice Machine using Splice Machine > as data source. > > > > Thanks, > > Devhuti Kumari > > >
Re: Need Information on source Type of Apache Kylin
Sql server, MySql and Vertica has already been supported as data source, and it’s easy to extend other RDBMS data source. But the GUI is not ready to use. You are so welcome to contribute a patch for integrating Splice Machine ☺. Best regards, Kaige Liu(刘凯歌) Mail: kaige@kyligence.io Shanghai Kyligence Information Technology Co., Ltd 上海市浦东新区亮秀路112号Y1座405室 "Do small things with great love." On 4/16/18, 7:51 PM, "Devhuti Kumari" wrote: Hi, Can we have any RDBMS as a data source for Apache Kylin instead of Hadoop Hive tables? If Yes then can we integrate it to Splice Machine using Splice Machine as data source. Thanks, Devhuti Kumari
RE: Need Information on source Type of Apache Kylin
I guess Currently Kylin is being supported only for Hive or Kafka (real time streaming). However, There was some jira for sql-server. Not sure about this. Regards, Manoj -Original Message- From: Devhuti Kumari [mailto:devhuti.kum...@gmail.com] Sent: Monday, April 16, 2018 5:21 PM To: user@kylin.apache.org Subject: Need Information on source Type of Apache Kylin Hi, Can we have any RDBMS as a data source for Apache Kylin instead of Hadoop Hive tables? If Yes then can we integrate it to Splice Machine using Splice Machine as data source. Thanks, Devhuti Kumari This message is confidential and subject to terms at: http://www.jpmorgan.com/emaildisclaimer including on confidentiality, legal privilege, viruses and monitoring of electronic messages. If you are not the intended recipient, please delete this message and notify the sender immediately. Any unauthorized use is strictly prohibited.
Need Information on source Type of Apache Kylin
Hi, Can we have any RDBMS as a data source for Apache Kylin instead of Hadoop Hive tables? If Yes then can we integrate it to Splice Machine using Splice Machine as data source. Thanks, Devhuti Kumari
